Data Analyst – Generative AI (Image & Video Evaluation)
Posted 2 days ago by Russell Tobin
£30 Per hour
Inside
Hybrid
London Area, United Kingdom
Summary: The Data Analyst role focuses on evaluating AI-generated images and videos for a global technology company specializing in generative AI. The position involves assessing model outputs, identifying quality gaps, and collaborating with engineering teams to enhance AI quality evaluation processes. Candidates will engage in both hands-on evaluation and operational analysis, contributing to the improvement of generative AI models. This hybrid role requires a strong attention to detail and a foundational knowledge of data analysis tools.
Key Responsibilities:
- Evaluate AI-generated images and videos across multiple quality dimensions such as visual realism, prompt adherence, identity consistency, natural motion, and text rendering.
- Prototype and refine human rating and semi-automated evaluation frameworks.
- Conduct small-to-medium scale in-house evaluations for complex or high-impact use cases.
- Analyze evaluation results to identify model weaknesses and quality gaps.
- Collaborate closely with engineering teams to summarize findings and propose improvements.
- Identify and prepare training data needed to address model gaps.
- Support the scaling of validated evaluation protocols through internal operations and annotation teams.
- Maintain high standards of accuracy, consistency, and attention to detail in repetitive evaluation tasks.
- Engage in hands-on evaluation, annotation, and quality analysis of AI-generated content.
- Perform operational and analytical work, including reviewing datasets, running basic scripts, and preparing insights and proposals.
Key Skills:
- Experience in data analysis, quality analysis, QA, or model evaluation.
- Basic working knowledge of Python or SQL.
- Strong attention to visual detail and comfort reviewing image/video data.
- Ability to work independently and manage time effectively.
- Clear written and verbal communication skills.
- Exposure to AI/machine learning/generative models (nice-to-have).
- Experience with computer vision, image, or video data (nice-to-have).
- Familiarity with Unix/command line tools (nice-to-have).
- Background in annotation, labeling, or human-in-the-loop evaluation (nice-to-have).
- Prior experience in product-focused tech companies or AI startups (nice-to-have).
- Associate’s degree or higher in relevant STEM fields.
Salary (Rate): £30.00/hr
City: London
Country: United Kingdom
Working Arrangements: hybrid
IR35 Status: inside IR35
Seniority Level: undetermined
Industry: IT
Data Analyst – Generative AI (Image & Video Evaluation) Location: Kings Cross, London (3days in office, hybrid) Contract:12 Months
About the Role
We are hiring Data Analysts to support a global technology company developing advanced generative AI models for images and videos. These models power high-quality, complex visual content, and the team places strong emphasis on human-centered quality evaluation to ensure outputs meet real-world expectations. This role sits at the intersection of data analysis, AI quality evaluation, and product improvement. You will work closely with engineers and researchers to assess model outputs, identify gaps, and help shape how generative AI quality is measured and improved at scale.
Responsibilities:
- Evaluate AI-generated images and videos across multiple quality dimensions such as: Visual realism and clarity Prompt adherence Identity consistency Natural motion and transitions (for video) Text rendering within visuals
- Prototype and refine human rating and semi-automated evaluation frameworks
- Conduct small-to-medium scale in-house evaluations for complex or high-impact use cases
- Analyze evaluation results to identify model weaknesses and quality gaps
- Collaborate closely with engineering teams to summarize findings and propose improvements
- Identify and prepare training data needed to address model gaps
- Support the scaling of validated evaluation protocols through internal operations and annotation teams
- Maintain high standards of accuracy, consistency, and attention to detail in repetitive evaluation tasks
Day-to-Day Work
~50% hands-on evaluation, annotation, and quality analysis of AI-generated content ~50% operational and analytical work, including: Reviewing datasets Running basic scripts Preparing insights and proposals Supporting evolving team priorities The work is dynamic, and priorities may shift based on model development needs.
Required Skills & Experience
Must-Have
- Experience in data analysis, quality analysis, QA, or model evaluation
- Basic working knowledge of Python or SQL (running scripts, queries, or simple analysis)
- Strong attention to visual detail and comfort reviewing image/video data
- Ability to work independently, manage time, and stay focused on repetitive tasks
- Clear written and verbal communication skills
Nice-to-Have
- Exposure to AI / machine learning / generative models
- Experience with computer vision, image, or video data
- Familiarity with Unix / command line tools
- Background in annotation, labeling, or human-in-the-loop evaluation
- Prior experience in product-focused tech companies or AI startups
Education
Associate’s degree or higher (or equivalent experience) in: Computer Science Engineering Physics Bioinformatics Applied Mathematics Other STEM fields
Additional Requirements
Onsite presence required (Menlo Park or London) Contract role Close collaboration with internal engineering and product teams No external client interaction
Who This Role Is Best For
Data Analysts who enjoy hands-on, product-focused work Candidates interested in AI quality and evaluation, not just dashboards People with a strong eye for detail who like understanding why AI outputs succeed or fail Professionals looking to gain exposure to large-scale generative AI systems