
QA Specialist – AI Chatbot Response Evaluations (MATLAB)
Posted 3 days ago by SuperAnnotate on Linkedin
Negotiable
Undetermined
Remote
EMEA
Summary: The role of QA Specialist focuses on auditing and validating Data Annotator evaluations of AI-generated MATLAB code, ensuring accuracy in instruction-following and code correctness. The position requires strong MATLAB expertise and experience in numerical computing or signal processing. The candidate will provide feedback to maintain high-quality standards and work with QA leads to ensure evaluation integrity. This is a fully remote, flexible contract position aimed at enhancing AI technology reliability.
Key Responsibilities:
- Audit annotator evaluations of AI-generated MATLAB code and related simulation tasks.
- Validate proper application of evaluation rubrics for instruction-following and correctness.
- Review and test annotator-submitted proof-of-work to ensure code functionality and alignment with instructions.
- Identify misjudged ratings, flawed logic, or incomplete testing by annotators.
- Provide detailed, actionable feedback to maintain high-quality standards.
- Work with QA leads to uphold rubric consistency and evaluation integrity.
Key Skills:
- 5–7+ years of hands-on experience in MATLAB programming, modeling, or code QA.
- Strong understanding of MATLAB syntax, data structures, plotting, and mathematical functions.
- Experience with simulation, algorithm development, or data analysis in MATLAB.
- Familiarity with testing code behavior and reproducibility.
- Strong communication skills and attention to technical detail.
- English proficiency at B2, C1, C2, or Native level.
Salary (Rate): undetermined
City: undetermined
Country: undetermined
Working Arrangements: remote
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT