Math Expert (Remote)
Posted Today by Keystone Recruitment
Negotiable
Undetermined
Remote
United Kingdom
Summary: The Math Expert role involves evaluating and improving AI systems' mathematical reasoning capabilities for a leading AI research organization. The position requires a PhD in Mathematics and expertise in various mathematical fields, focusing on ensuring the accuracy and clarity of AI-generated mathematical outputs. The role is fully remote, allowing for flexible scheduling and direct influence on AI performance in mathematical contexts.
Key Responsibilities:
- Write and refine prompts to guide AI model behavior in mathematical contexts
- Evaluate large language model (LLM) responses to mathematics-related queries for correctness, rigor, and logical coherence
- Verify mathematical claims, derivations, and proofs using deep domain expertise
- Conduct fact-checking using authoritative public sources and mathematical knowledge
- Annotate model responses by identifying strengths, weaknesses, and factual or conceptual errors
- Assess clarity, structure, and suitability of explanations for different audience levels
- Ensure outputs align with expected conversational standards and evaluation guidelines
- Apply consistent evaluation frameworks, benchmarks, and taxonomies across tasks
Key Skills:
- PhD in Mathematics or a closely related field
- Demonstrated expertise in Probability & Statistics
- Experience in Algebra & Number Theory, Calculus & Analysis, Geometry & Topology, Discrete Mathematics, Logic & Computation
- Comfortable working with large language models and understanding real-world usage patterns
- Excellent written communication skills with the ability to explain complex concepts clearly
- Strong attention to detail and ability to identify subtle logical or conceptual issues
- Experience reviewing, editing, or evaluating technical or academic writing
- Prior experience with RLHF, model evaluation, or data annotation (nice-to-have)
- Teaching, mentoring, or explaining mathematics to non-expert audiences (nice-to-have)
- Familiarity with structured evaluation rubrics, benchmarks, or review frameworks (nice-to-have)
Salary (Rate): undetermined
City: undetermined
Country: United Kingdom
Working Arrangements: remote
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
Role: Math Expert (Remote)
Location: 100% Remote (Global)
Compensation: USD 73.29 per hour
Why This Role Exists
One of our clients, a leading AI research organization, is working to improve the quality, usefulness, and reliability of general-purpose conversational AI systems. These systems are used across a wide range of professional and everyday contexts, and their effectiveness depends on clear reasoning, accuracy, and helpful explanations. In mathematics-related use cases, AI systems must demonstrate rigorous formal reasoning, conceptual clarity, and mathematical correctness. This project focuses on evaluating and improving how models reason about mathematical problems, explanations, and proofs across both foundational and advanced areas of mathematics.
What You’ll Do
- Write and refine prompts to guide AI model behavior in mathematical contexts
- Evaluate large language model (LLM) responses to mathematics-related queries for correctness, rigor, and logical coherence
- Verify mathematical claims, derivations, and proofs using deep domain expertise
- Conduct fact-checking using authoritative public sources and mathematical knowledge
- Annotate model responses by identifying strengths, weaknesses, and factual or conceptual errors
- Assess clarity, structure, and suitability of explanations for different audience levels
- Ensure outputs align with expected conversational standards and evaluation guidelines
- Apply consistent evaluation frameworks, benchmarks, and taxonomies across tasks
Who You Are
PhD in Mathematics or a closely related field
Demonstrated expertise in Probability & Statistics , with experience in one or more of the following areas: Algebra & Number Theory Calculus & Analysis Geometry & Topology Discrete Mathematics, Logic & Computation
Comfortable working with large language models and understanding real-world usage patterns
Excellent written communication skills with the ability to explain complex concepts clearly
Strong attention to detail and ability to identify subtle logical or conceptual issues
Experience reviewing, editing, or evaluating technical or academic writing
Nice-to-Have Specialties
Prior experience with RLHF, model evaluation, or data annotation
Teaching, mentoring, or explaining mathematics to non-expert audiences
Familiarity with structured evaluation rubrics, benchmarks, or review frameworks
What Success Looks Like
You consistently identify inaccuracies or weak reasoning in mathematical AI outputs
Your feedback improves rigor, correctness, and clarity of model responses
You deliver reliable, reproducible evaluation artifacts that strengthen AI performance
The client’s AI systems are trusted in mathematical contexts due to your rigorous evaluations
Why Join This Project
This opportunity allows mathematicians to apply deep theoretical expertise to the evaluation and improvement of cutting-edge AI systems. The role is fully remote and flexible, enabling you to directly influence how mathematical reasoning is represented and communicated at scale.
Contract and Payment Terms
- Engagement as an independent contractor
- Fully remote with flexible scheduling
- Projects may be extended, shortened, or concluded based on performance and project needs
- Work will not involve access to confidential or proprietary information from any employer, client, or institution
- Payments are issued weekly via Stripe or Wise based on services rendered
- H1-B and STEM OPT candidates cannot be supported at this time
APPLY NOW!