Quality Assurance Specialist | $125/hr Remote | Mercor
Posted 3 days ago by Crossing Hurdles
Negotiable
Undetermined
Remote
United Kingdom
Summary: The role at Mercor involves reviewing long-form transcripts between users and AI coding assistants, focusing on the AI's logic and execution. Candidates will score transcripts using a structured rubric and provide written justifications for their evaluations. The position is remote and offers flexible hours ranging from 10 to 40 hours per week. Strong experience in code review and proficiency in Python are essential for this role.
Key Responsibilities:
- Review long-form transcripts between users and AI coding assistants.
- Analyze the AI’s logic, execution, and reasoning process in depth.
- Score each transcript using a structured 10-point rubric across multiple dimensions.
- Identify discrepancies between AI-stated intentions and actual actions.
- Provide concise written justifications with supporting examples from transcripts.
Key Skills:
- Strong experience in code review, testing, or software documentation.
- Background as a Senior or Staff Engineer, QA Engineer, or Technical Writer preferred.
- Proficiency in Python; familiarity with additional languages (JavaScript, TypeScript, Java, C++, Go, Ruby, Rust, Bash) is a plus.
- Understanding of Git workflows, testing frameworks, and debugging tools.
- Exceptional analytical and written communication skills.
Salary (Rate): £125.00/hr
City: undetermined
Country: United Kingdom
Working Arrangements: remote
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
At Crossing Hurdles, we work as a referral partner. We refer candidates to Mercor that collaborates with the world’s leading AI research labs to build and train cutting-edge AI models.
Organization: Mercor
Position: Senior/Staff Code Review Experts
Referral Partner: Crossing Hurdles
Type: Hourly contract
Compensation: $40–$125 per hour
Location: Remote
Commitment: 10–40 hours/week
Role Responsibilities (Training support will be provided)
- Review long-form transcripts between users and AI coding assistants.
- Analyze the AI’s logic, execution, and reasoning process in depth.
- Score each transcript using a structured 10-point rubric across multiple dimensions.
- Identify discrepancies between AI-stated intentions and actual actions.
- Provide concise written justifications with supporting examples from transcripts.
Requirements
- Strong experience in code review, testing, or software documentation.
- Background as a Senior or Staff Engineer, QA Engineer, or Technical Writer preferred.
- Proficiency in Python; familiarity with additional languages (JavaScript, TypeScript, Java, C++, Go, Ruby, Rust, Bash) is a plus.
- Understanding of Git workflows, testing frameworks, and debugging tools.
- Exceptional analytical and written communication skills.
Application Process (Takes 20 min)
- Upload resume
- AI interview based on your resume (15 min)
- Submit form