AI Evaluation and Data Analyst
Posted 2 days ago by 1770271710
£52,000 Per year
Undetermined
Hybrid
London
Summary: The AI Evaluation and Data Analyst role involves supporting a global tech company in evaluating generative image and video AI models. The position focuses on assessing AI outputs, identifying quality gaps, and enhancing model performance through data analysis and collaboration with engineers. The role is hybrid, requiring three days on-site in London, and offers a competitive salary. Candidates should have a background in data analysis and familiarity with AI technologies.
Key Responsibilities:
- Evaluate AI-generated images and videos across quality, realism, and prompt accuracy
- Support human and semi-automated evaluation frameworks for generative models
- Identify model weaknesses and clearly communicate findings to ML engineers
- Use Python and SQL to explore data and support evaluations
- Help identify data gaps and contribute to training data improvements
Key Skills:
- Experience in data analysis, quality analysis, AI evaluation, or product-focused analytical roles
- Strong attention to detail, especially with visual or unstructured data
- Working knowledge of Python and/or SQL
- Exposure to AI, machine learning, computer vision, or generative models
- STEM background or equivalent practical experience
Salary (Rate): £52000 yearly
City: London
Country: United Kingdom
Working Arrangements: hybrid
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
AI Evaluation and Data Analyst
Contract | London (Hybrid - 3 days onsite)
£47,000-£52,000
We're hiring an AI Evaluation and Data Analyst for a large global tech company to support a high-impact team building and assessing generative image and video AI models used at global scale.
This role focuses on evaluating AI outputs, identifying quality gaps, and improving model performance through data and human judgement, working closely with engineers in a fast-moving product environment.
What you'll do
Evaluate AI-generated images and videos across quality, realism, and prompt accuracy
Support human and semi-automated evaluation frameworks for generative models
Identify model weaknesses and clearly communicate findings to ML engineers
Use Python and SQL to explore data and support evaluations
Help identify data gaps and contribute to training data improvements
What we're looking for
Experience in data analysis, quality analysis, AI evaluation, or product-focused analytical roles
Strong attention to detail, especially with visual or unstructured data
Working knowledge of Python and/or SQL
Exposure to AI, machine learning, computer vision, or generative models
STEM background or equivalent practical experience
Apply today, as this role will move quickly!