AI Quality Assurance Analyst – Content Evaluation | $70/hr Remote

AI Quality Assurance Analyst – Content Evaluation | $70/hr Remote

Posted 1 day ago by Crossing Hurdles

Negotiable
Undetermined
Remote
United Kingdom

Summary: The role of AI Quality Assurance Analyst involves evaluating AI-generated responses and providing structured feedback based on detailed evaluation guidelines. The position requires strong analytical skills and the ability to work independently while contributing to AI research through consistent evaluations. The commitment ranges from 10 to 40 hours per week, and the role is entirely remote.

Key Responsibilities:

  • Evaluate AI-generated responses
  • Provide structured written feedback
  • Apply detailed evaluation guidelines to assess response quality
  • Contribute to AI research through accurate and consistent evaluations

Key Skills:

  • Strong analytical and written communication skills
  • Ability to work independently and follow detailed task guidelines
  • Strong critical reading skills with the ability to identify nuance, implicit meaning, and gaps in reasoning
  • Ability to write clear, precise, and well-evidenced written rationales beyond surface-level observations
  • Consistent and honest judgment with the ability to provide critical assessments when warranted
  • Strict attention to detail and accurate application of structured evaluation guidelines
  • Ability to work entirely without AI writing tools

Salary (Rate): £70.00 hourly

City: undetermined

Country: United Kingdom

Working Arrangements: remote

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

Position: Generalist Expert

Type: Hourly contract

Compensation: $70 per hour

Location: Remote

Commitment: 10 - 40 hours/week

Role Responsibilities

  • Evaluate AI-generated responses
  • Provide structured written feedback
  • Apply detailed evaluation guidelines to assess response quality
  • Contribute to AI research through accurate and consistent evaluations

Requirements

  • Strong analytical and written communication skills
  • Ability to work independently and follow detailed task guidelines
  • Strong critical reading skills with the ability to identify nuance, implicit meaning, and gaps in reasoning
  • Ability to write clear, precise, and well-evidenced written rationales beyond surface-level observations
  • Consistent and honest judgment with the ability to provide critical assessments when warranted
  • Strict attention to detail and accurate application of structured evaluation guidelines
  • Ability to work entirely without AI writing tools

Application Process (Takes 20 Mins)

  • Upload resume
  • Interview (15 min)
  • Submit form