About the Opportunity
We are seeking experienced Senior Software Engineers and Open Source Maintainers to support an AI training and evaluation project.
You’ll review LLM-generated code patches for repositories you maintain and provide expert technical assessments.
No prior AI experience is required — your open-source and software engineering expertise is what matters.
Key Responsibilities
- Evaluate LLM-generated code patches and provide detailed technical feedback.
- Provide written justifications and assessments for reviewed patches.
- Conduct peer reviews of work submitted by other technical experts.
- Assess code quality, correctness, maintainability, and alignment with repository standards.
Required Qualifications
- Clear and demonstrable open-source contributions through GitHub, GitLab, or similar platforms.
- Experience maintaining or contributing to open-source repositories.
- Strong software engineering experience with one or more of C++, Java, TypeScript, Rust, Golang, Python, or C.
- Experience reviewing code submitted by other contributors.
- Strong written communication and technical judgment.
Preferred Qualifications
- Direct experience as an open-source repository maintainer.
- Experience managing contributor submissions and conducting code reviews.
- Active GitHub or GitLab profile showcasing substantial open-source work.
Compensation
$150–$300/hour equivalent.
Independent contractor engagement.
15 hours/week with a flexible schedule.
Compensation is output-based and paid per completed task meeting project requirements.
Minimum weekly submission requirements apply.
Application Process
Complete the application and screening questions.
Complete an approximately 10-minute AI interview.
Proceed through hiring manager review.
Begin your first tasks within 24–48 hours of onboarding if selected.