QA Specialist – AI Chatbot Response Evaluations (MATLAB)

QA Specialist – AI Chatbot Response Evaluations (MATLAB)

Posted 3 days ago by SuperAnnotate on Linkedin

Negotiable
Undetermined
Remote
EMEA

Summary: The role of QA Specialist focuses on auditing and validating Data Annotator evaluations of AI-generated MATLAB code, ensuring accuracy in instruction-following and code correctness. The position requires strong MATLAB expertise and experience in numerical computing or signal processing. The candidate will provide feedback to maintain high-quality standards and work with QA leads to ensure evaluation integrity. This is a fully remote, flexible contract position aimed at enhancing AI technology reliability.

Key Responsibilities:

  • Audit annotator evaluations of AI-generated MATLAB code and related simulation tasks.
  • Validate proper application of evaluation rubrics for instruction-following and correctness.
  • Review and test annotator-submitted proof-of-work to ensure code functionality and alignment with instructions.
  • Identify misjudged ratings, flawed logic, or incomplete testing by annotators.
  • Provide detailed, actionable feedback to maintain high-quality standards.
  • Work with QA leads to uphold rubric consistency and evaluation integrity.

Key Skills:

  • 5–7+ years of hands-on experience in MATLAB programming, modeling, or code QA.
  • Strong understanding of MATLAB syntax, data structures, plotting, and mathematical functions.
  • Experience with simulation, algorithm development, or data analysis in MATLAB.
  • Familiarity with testing code behavior and reproducibility.
  • Strong communication skills and attention to technical detail.
  • English proficiency at B2, C1, C2, or Native level.

Salary (Rate): undetermined

City: undetermined

Country: undetermined

Working Arrangements: remote

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT