QA Specialist – AI Chatbot Response Evaluations (Excel)

QA Specialist – AI Chatbot Response Evaluations (Excel)

Posted 3 days ago by SuperAnnotate on Linkedin

Negotiable
Undetermined
Remote
EMEA

Summary: The QA Specialist role focuses on auditing evaluations conducted by Data Annotators on AI-generated spreadsheet tasks, specifically using Microsoft Excel. The position requires verifying the accuracy of data assessments, formula correctness, and adherence to evaluation rubrics. The role is fully remote and offers flexible hours, emphasizing the importance of quality assurance in AI technology. Candidates should possess extensive experience with Excel and strong analytical skills.

Key Responsibilities:

  • Audit annotator evaluations of AI-generated Excel responses, including formulas, functions, charts, and data transformations.
  • Validate code functionality and test cases provided by annotators for correctness and completeness.
  • Review instruction-following accuracy and proper rubric application in evaluations.
  • Identify incorrect or incomplete assessments, errors in logic, or flawed proof-of-work.
  • Provide constructive, concise feedback to annotators to uphold evaluation standards.
  • Collaborate with QA leads to align on rubric interpretation and process improvements.

Key Skills:

  • 5–7+ years of experience working with Microsoft Excel for data analysis, reporting, automation, or QA.
  • Proficient in advanced formulas (e.g., VLOOKUP, INDEX-MATCH, IF, nested logic), charts, data validation, pivot tables, and error handling.
  • Experience auditing Excel-based outputs, validating logic, and ensuring consistency.
  • Familiarity with spreadsheet auditing tools and Excel testing methods.
  • Strong written communication and analytical skills.
  • English proficiency at B2, C1, C2, or Native level.

Salary (Rate): undetermined

City: undetermined

Country: undetermined

Working Arrangements: remote

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT