Summary: The QA Specialist role focuses on auditing and validating AI-generated R code and data analysis tasks, ensuring accuracy and adherence to quality standards. The position requires strong expertise in R programming and statistical analysis, along with the ability to provide constructive feedback to improve evaluation quality. This fully remote role offers flexible hours and is part of a team dedicated to advancing AI technology. Candidates should have significant experience in QA within the data science domain.

Key Responsibilities:

• Audit annotator evaluations of AI-generated R code and data analysis tasks.
• Verify correct application of rating rubrics for instruction-following and factual accuracy.
• Test annotator-submitted R code to confirm functionality, reproducibility, and statistical correctness.
• Identify any flaws in annotator reasoning, missed code issues, or incorrect ratings.
• Deliver clear, actionable feedback to improve annotator evaluation quality.
• Collaborate with QA leads to maintain alignment with guidelines and quality standards.

Key Skills:

• 5–7+ years of experience in R programming, statistical analysis, or data science QA.
• Proficient in core R syntax, data manipulation (dplyr, tidyverse), visualization (ggplot2), and modeling.
• Experience validating code logic, reproducibility, and statistical integrity.
• Ability to assess instructional adherence and provide constructive written feedback.
• English proficiency at B2, C1, C2, or Native level.

Salary (Rate): undetermined

City: undetermined

Country: undetermined

Working Arrangements: remote

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT