Summary: The QA Specialist role focuses on auditing the evaluations of Data Annotators assessing AI-generated C code. The specialist will ensure that annotators accurately rate instruction-following, validate proof-of-work, and confirm the correctness and safety of C programs. This position requires strong experience in C programming and offers a fully remote working arrangement with flexible hours. The role is essential for maintaining quality standards in AI technology solutions.

Key Responsibilities:

• Audit annotator evaluations of AI-generated C code.
• Validate the application of instruction-following and correctness rubrics.
• Review annotator-submitted proof-of-work to confirm code executability, correctness, and safety.
• Identify flawed logic, incomplete testing, or inaccuracies in annotator feedback.
• Provide concise and constructive feedback to annotators to improve future evaluations.
• Collaborate with QA leads to uphold consistency and quality standards across the team.

Key Skills:

• 5–7+ years of professional experience in C programming, embedded systems, or QA/code review.
• Proficient in C syntax, memory management, pointers, and low-level debugging.
• Experience testing and validating C programs in command-line or IDE-based environments.
• Strong analytical thinking and clear written communication skills.
• English proficiency at B2, C1, C2, or Native level.
• Experience in annotation QA or evaluating AI-generated coding responses (preferred).
• Familiarity with LLM behavior, reinforcement learning with human feedback (RLHF), or model evaluation (preferred).
• Understanding of secure and efficient C programming practices (preferred).

Salary (Rate): undetermined

City: undetermined

Country: undetermined

Working Arrangements: remote

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT