Summary: The QA Specialist role focuses on auditing evaluations of AI-generated C# code responses by Data Annotators. The position requires ensuring accurate ratings of instruction-following and correctness, validating code snippets, and providing actionable feedback. This role is crucial for maintaining quality standards in AI training workflows. The position is fully remote with flexible hours and a milestone-based structure.

Key Responsibilities:

• Audit annotator evaluations of AI-generated C# code responses.
• Verify accurate application of rating rubrics for instruction-following and correctness.
• Review and test annotator-submitted proof-of-work code to validate code behavior and accuracy.
• Identify discrepancies in annotator feedback, flawed logic in conclusions, or missed code errors.
• Provide concise, actionable feedback to annotators and maintain quality standards.
• Collaborate with the QA lead to align with evaluation goals and guideline updates.

Key Skills:

• 5–7+ years of experience in C# software QA, debugging, or code evaluation roles.
• Proficiency in C# syntax, .NET framework basics, and object-oriented programming principles.
• Experience with code testing, debugging, and performance validation tools.
• Strong analytical skills and attention to detail in evaluating code correctness and usability.
• Excellent written communication and feedback delivery skills.
• English proficiency at B2, C1, C2, or Native level.

Salary (Rate): undetermined

City: undetermined

Country: undetermined

Working Arrangements: remote

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT