AI Quality Assurance Analyst – Content Evaluation | $70/hr Remote
Posted 1 day ago by Crossing Hurdles
Negotiable
Undetermined
Remote
United Kingdom
Summary: The role of AI Quality Assurance Analyst involves evaluating AI-generated responses and providing structured feedback based on detailed evaluation guidelines. The position requires strong analytical skills and the ability to work independently while contributing to AI research through consistent evaluations. The commitment ranges from 10 to 40 hours per week, and the role is entirely remote.
Key Responsibilities:
- Evaluate AI-generated responses
- Provide structured written feedback
- Apply detailed evaluation guidelines to assess response quality
- Contribute to AI research through accurate and consistent evaluations
Key Skills:
- Strong analytical and written communication skills
- Ability to work independently and follow detailed task guidelines
- Strong critical reading skills with the ability to identify nuance, implicit meaning, and gaps in reasoning
- Ability to write clear, precise, and well-evidenced written rationales beyond surface-level observations
- Consistent and honest judgment with the ability to provide critical assessments when warranted
- Strict attention to detail and accurate application of structured evaluation guidelines
- Ability to work entirely without AI writing tools
Salary (Rate): £70.00 hourly
City: undetermined
Country: United Kingdom
Working Arrangements: remote
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
Position: Generalist Expert
Type: Hourly contract
Compensation: $70 per hour
Location: Remote
Commitment: 10 - 40 hours/week
Role Responsibilities
- Evaluate AI-generated responses
- Provide structured written feedback
- Apply detailed evaluation guidelines to assess response quality
- Contribute to AI research through accurate and consistent evaluations
Requirements
- Strong analytical and written communication skills
- Ability to work independently and follow detailed task guidelines
- Strong critical reading skills with the ability to identify nuance, implicit meaning, and gaps in reasoning
- Ability to write clear, precise, and well-evidenced written rationales beyond surface-level observations
- Consistent and honest judgment with the ability to provide critical assessments when warranted
- Strict attention to detail and accurate application of structured evaluation guidelines
- Ability to work entirely without AI writing tools
Application Process (Takes 20 Mins)
- Upload resume
- Interview (15 min)
- Submit form