Code Expert Evaluator for AI Training (Python)
Posted 1 day ago by G2i Inc.
Negotiable
Undetermined
Remote
United Kingdom
Summary: The role of Code Expert Evaluator for AI Training involves reviewing AI-generated code responses for technical accuracy and best practices, providing expert feedback to enhance AI systems. Candidates will engage with various programming languages and coding challenges, ensuring outputs meet industry standards. The position requires a strong background in Computer Science and expertise in Python, along with excellent analytical and communication skills. Contributions are compensated weekly upon approval, reflecting a commitment to reliable payment for work performed.
Key Responsibilities:
- Review AI-generated responses for technical accuracy and best practices.
- Provide expert feedback to improve AI systems' code writing capabilities.
- Work with various programming languages and coding challenges.
- Ensure AI outputs are functional, efficient, and adhere to industry standards.
Key Skills:
- BS, MS, or PhD with a significant focus on Computer Science.
- Expert in Python with a strong grasp of algorithms, data structures, and debugging practices.
- Expert-level English proficiency with excellent writing skills.
- Expert at fact-checking information using public sources across multiple domains.
- Significant experience using large language models (LLMs).
- Strong analytical and structured thinking skills.
- Ability to explain complex programming concepts clearly and accurately.
- Prior experience with RLHF annotation (preferred).
- Prior Software Engineering work experience (strongly preferred).
- Expertise in additional programming languages (nice to have): C#, Java, SQL, C++, TypeScript, PHP, C, Go, Bash, PowerShell, Rust, R.
Salary (Rate): undetermined
City: undetermined
Country: United Kingdom
Working Arrangements: remote
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
About the Company G2i connects subject-matter experts, students, and professionals with flexible, remote AI training work such as annotation, evaluation, fact-checking, and content review. We partner with leading AI teams, and all contributions are paid weekly upon approval, ensuring consistent, reliable compensation.
Project info This project involves reviewing AI-generated responses, evaluating technical accuracy and best practices, and providing expert feedback that trains AI systems to write better code. You'll work with various programming languages and coding challenges, ensuring AI outputs are functional, efficient, and follow industry standards.
Compensation Compensation is competitive and varies based on education level, institution , and prior experience .
Hiring Profile BS, MS, or PhD with a significant focus on Computer Science (Required). Expert in Python , with a firm grasp of algorithms, data structures, and debugging practices. Expert-level English proficiency with excellent writing skills. Expert at fact-checking information using public sources across multiple domains. Significant experience using large language models (LLMs). Strong analytical and structured thinking skills. Ability to explain complex programming concepts clearly and accurately. Prior experience with RLHF annotation (preferred). Prior Software Engineering work experience (strongly preferred). E xpertise in additional programming languages (nice to have) : C#, Java, SQL, C++, TypeScript, PHP, C, Go, Bash, PowerShell, Rust, R.