Summary: The role of QA Specialist involves auditing the work of Data Annotators who evaluate AI-generated code across various programming languages. Candidates will assess compliance with guidelines, test functionality, and provide feedback based on their expertise in specific languages. This position is fully remote and offers flexible working hours, focusing on enhancing the quality of AI-generated content. The ideal candidate will have extensive experience in programming and a strong understanding of QA processes.

Key Responsibilities:

• Review and audit evaluations of AI-generated code specific to your area of expertise.
• Verify annotator compliance with instruction-following and factual correctness guidelines.
• Test code snippets for functionality, performance, safety, and formatting.
• Evaluate annotator-submitted proof-of-work and validate reasoning.
• Identify logical flaws, missed edge cases, or incorrect scoring.
• Provide structured, constructive feedback to annotators.
• Collaborate with QA leads and contribute to guideline refinement.

Key Skills:

• 7+ years of professional experience in at least one of the listed languages.
• Deep understanding of language-specific syntax, best practices, and testing methodologies.
• Ability to debug, validate, and explain code clearly.
• Experience with code review or QA processes.
• Strong documentation and feedback skills.
• English proficiency at B2, C1, C2, or Native level.

Salary (Rate): undetermined

City: undetermined

Country: undetermined

Working Arrangements: remote

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT