£125 Per hour
Undetermined
Remote
United Kingdom
Summary: The Staff Software Engineer role involves reviewing developer–AI interactions to evaluate and enhance the performance of coding assistants. Candidates will assess the quality and accuracy of these interactions, providing feedback based on structured criteria. This position is remote and offers flexible, short-term engagements with ongoing opportunities. The role requires senior-level experience in code review or related fields.
Key Responsibilities:
- Review long-form transcripts of user–AI coding conversations
- Assess logic, execution quality, and consistency across a structured rubric
- Flag inconsistencies between stated actions and actual behavior
- (Optional) Provide concise written justifications for your assessments
Key Skills:
- Senior/Staff-level experience in code review, QA, or technical documentation
- Strong ability to verify consistency between instructions and implementation
- Comfort with backend, full-stack, DevOps, or SRE workflows
- Familiarity with Python; knowledge of JS/TS, Java, C++, Go, Ruby, Rust, or Bash is a plus
- Experience with Git, testing frameworks, and debugging tools
Salary (Rate): £125/hour
City: undetermined
Country: United Kingdom
Working Arrangements: remote
IR35 Status: undetermined
Seniority Level: Senior
Industry: IT
Role: Staff Software Engineer
Location: Remote
We are hiring experienced code review professionals to help evaluate and improve how next-generation coding assistants reason and execute during real development workflows. You’ll review full transcripts of developer–AI interactions and assess the quality, consistency, and accuracy of the assistant’s behavior. This is a flexible, remote, short-term engagement with ongoing batch opportunities.
What You’ll Do
- Review long-form transcripts of user–AI coding conversations
- Assess logic, execution quality, and consistency across a structured rubric
- Flag inconsistencies between stated actions and actual behavior
- (Optional) Provide concise written justifications for your assessments
What You Bring
- Senior/Staff-level experience in code review, QA, or technical documentation
- Strong ability to verify consistency between instructions and implementation
- Comfort with backend, full-stack, DevOps, or SRE workflows
- Familiarity with Python; knowledge of JS/TS, Java, C++, Go, Ruby, Rust, or Bash is a plus
- Experience with Git, testing frameworks, and debugging tools
Role Details
- Remote and asynchronous
- Each assigned batch must be completed within 5 hours
- Unlimited task availability with potential for recurring work
Compensation
$40–$125/hour depending on experience and location
Independent contractor role
Weekly payments via Stripe Connect
Apply Now!