AI Quality Analyst – Critical Reasoning & Model Evaluation | Remote

Summary: The role of AI Quality Analyst involves evaluating AI-generated responses for accuracy and clarity, providing structured feedback, and identifying logical gaps in reasoning. The position is flexible, allowing for part-time or full-time commitment based on project needs, and requires strong analytical and communication skills. The role is remote and emphasizes the importance of unbiased and precise assessments. Candidates should have a bachelor's degree and native-level English proficiency.

Key Responsibilities:

• Evaluate AI-generated responses for accuracy, reasoning, and clarity
• Provide structured, detailed written feedback on model outputs
• Identify gaps in logic, implicit assumptions, and reasoning flaws
• Apply evaluation guidelines consistently across tasks
• Write clear, evidence-based rationales beyond surface-level observations
• Ensure high-quality, unbiased, and precise assessments

Key Skills:

• Bachelor's degree preferred from a top-ranked university
• Strong analytical thinking and critical reading skills
• Strong written communication with clear and precise reasoning
• Ability to identify nuanced issues in complex responses
• Strong attention to detail and consistency in evaluations
• Ability to work independently and follow structured guidelines
• Native-level English proficiency
• Ability to complete tasks without using AI writing tools

Salary (Rate): £200.00/hr

City: undetermined

Country: United Kingdom

Working Arrangements: remote

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT