
QA Specialist – AI Chatbot Response Evaluations (Excel)
Posted 3 days ago by SuperAnnotate on Linkedin
Negotiable
Undetermined
Remote
EMEA
Summary: The QA Specialist role focuses on auditing evaluations conducted by Data Annotators on AI-generated spreadsheet tasks, specifically using Microsoft Excel. The position requires verifying the accuracy of data assessments, formula correctness, and adherence to evaluation rubrics. The role is fully remote and offers flexible hours, emphasizing the importance of quality assurance in AI technology. Candidates should possess extensive experience with Excel and strong analytical skills.
Key Responsibilities:
- Audit annotator evaluations of AI-generated Excel responses, including formulas, functions, charts, and data transformations.
- Validate code functionality and test cases provided by annotators for correctness and completeness.
- Review instruction-following accuracy and proper rubric application in evaluations.
- Identify incorrect or incomplete assessments, errors in logic, or flawed proof-of-work.
- Provide constructive, concise feedback to annotators to uphold evaluation standards.
- Collaborate with QA leads to align on rubric interpretation and process improvements.
Key Skills:
- 5–7+ years of experience working with Microsoft Excel for data analysis, reporting, automation, or QA.
- Proficient in advanced formulas (e.g., VLOOKUP, INDEX-MATCH, IF, nested logic), charts, data validation, pivot tables, and error handling.
- Experience auditing Excel-based outputs, validating logic, and ensuring consistency.
- Familiarity with spreadsheet auditing tools and Excel testing methods.
- Strong written communication and analytical skills.
- English proficiency at B2, C1, C2, or Native level.
Salary (Rate): undetermined
City: undetermined
Country: undetermined
Working Arrangements: remote
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT