Summary: The Data Science Expert role involves evaluating AI systems' performance in real-world data science tasks and establishing criteria for excellence. Candidates will design grading criteria, score work samples, and provide detailed justifications for their assessments. The position requires a strong background in data science and experience in business operations or product data science. Excellent written communication and attention to detail are essential for success in this role.
Key Responsibilities:
- Design precise, task-specific grading criteria for real-world data science deliverables (analyses, models, dashboards, experiment readouts, and written recommendations).
- Score AI-generated and human work samples against those criteria, with detailed written justifications for every score.
- Apply consistent, evidence-based judgment so that scores are reproducible and defensible.
- Incorporate structured feedback from senior reviewers and iterate quickly on your work.
Key Skills:
- 5+ years of professional data science experience in industry.
- Background in business operations, product, or growth data science at top-tier technology companies.
- Deep fluency in experiment design and A/B testing, metric definition, SQL/Python analysis, and communicating findings to executive stakeholders.
- Exceptionally strong written communication.
- Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers.
- Prior experience with AI training, evaluation, or human-data projects is a strong plus.
Salary (Rate): £170.00/hr
City: undetermined
Country: United Kingdom
Working Arrangements: undetermined
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
description: Data Science Expert [$120-$170/hr] Experienced data scientists to evaluate how well AI systems perform real-world data science work and define what excellent work looks like: designing task-specific grading criteria and scoring completed work samples with rigorous, well-reasoned written justifications Role Responsibilities Design precise, task-specific grading criteria for real-world data science deliverables (analyses, models, dashboards, experiment readouts, and written recommendations) Score AI-generated and human work samples against those criteria, with detailed written justifications for every score Apply consistent, evidence-based judgment so that scores are reproducible and defensible Incorporate structured feedback from senior reviewers and iterate quickly on your work Good Candidature 5+ years of professional data science experience in industry Background in business operations, product, or growth data science at top-tier technology companies Deep fluency in experiment design and A/B testing, metric definition, SQL/Python analysis, and communicating findings to executive stakeholders Exceptionally strong written communication Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers Prior experience with AI training, evaluation, or human-data projects is a strong plus