Negotiable
Undetermined
Remote
United Kingdom
Summary: The Software Engineering Evaluator role is a contract position focused on curating and evaluating code examples across various programming languages. The evaluator will assess AI-generated code and design automated verification mechanisms while collaborating with researchers to enhance AI-driven coding systems. A commitment of 10 to 40 hours per week is required, with partial overlap in Pacific Standard Time. Strong professional software engineering experience and expertise in full-stack development are essential for this role.
Key Responsibilities:
- Curate, build, and correct real-world code examples across multiple programming languages.
- Evaluate AI-generated code for efficiency, scalability, reliability, and correctness.
- Design automated verification mechanisms to validate software engineering solutions.
- Assess AI capabilities across the full software development lifecycle.
- Collaborate with researchers and cross-functional teams to improve AI-driven coding systems.
Key Skills:
- Strong professional software engineering experience.
- Continuous full-time experience at a top-tier product company.
- Strong expertise in full-stack development and production-grade system design.
- Deep understanding of software architecture, debugging, and code quality assessment.
- Excellent written and verbal communication skills.
- Access to a desktop or laptop computer.
Salary (Rate): £150.00/hr
City: undetermined
Country: United Kingdom
Working Arrangements: remote
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
Position: Software Engineering Evaluator
Type: Contract
Compensation: $150/hr
Location: Remote
Commitment: Minimum 10 hours/week, up to 40 hours/week (partial PST overlap required)
Role Responsibilities
- Curate, build, and correct real-world code examples across multiple programming languages.
- Evaluate AI-generated code for efficiency, scalability, reliability, and correctness.
- Design automated verification mechanisms to validate software engineering solutions.
- Assess AI capabilities across the full software development lifecycle.
- Collaborate with researchers and cross-functional teams to improve AI-driven coding systems.
Requirements
- Strong professional software engineering experience.
- Continuous full-time experience at a top-tier product company.
- Strong expertise in full-stack development and production-grade system design.
- Deep understanding of software architecture, debugging, and code quality assessment.
- Excellent written and verbal communication skills.
- Access to a desktop or laptop computer
Application Process (45 min)
- Upload resume
- Automated coding exercise
- Interview