Data Analyst
Posted 3 days ago by LanceSoft UK
Negotiable
Undetermined
Undetermined
London Area, United Kingdom
Summary: The Data Analyst role involves collaborating with teams to develop and evaluate human rating protocols for model assessments. The position requires conducting in-house evaluations, identifying model gaps, and preparing training data for model improvements. Additionally, the analyst will work with PDO teams to scale validated evaluation protocols. Strong communication and problem-solving skills, along with a basic understanding of programming and data analysis, are essential for success in this role.
Key Responsibilities:
- Working with the team to prototype human rating and semi-automatic model evaluation protocols.
- Conduct small-to-medium scale in-house human rating on generated content for high stake and/or high complexity protocols.
- Identify and summarize model gaps based on evaluations in collaboration with engineers.
- Identify data needed to close model gaps and prepare training data for the next iteration of model training.
- Work with PDO teams to scale up validated evaluation protocols, including coordination and auditing.
Key Skills:
- Verbal and written communication skills, problem solving skills, and interpersonal skills.
- Attention to details and an aptitude for experimental investigations.
- Basic ability to work independently and manage one’s time.
- Basic knowledge of Python, Unix, and SQL.
- Basic knowledge of computer vision and generative models.
Salary (Rate): undetermined
City: London Area
Country: United Kingdom
Working Arrangements: undetermined
IR35 Status: undetermined
Seniority Level: undetermined
Industry: Other
Job Responsibilities:
- Working with the team to prototype human rating and semi-automatic model evaluation protocols.
- For high stake and / or high complexity protocols, conduct small-to-medium scale in-house human rating on generated content.
- Working with engineers to identify and summarize model gaps based on the above evaluation
- Working with engineers to identify data needed to close those gaps and mine such data to prepare training data for the next iteration of model training
- Working with PDO teams to scale up validated evaluation protocols, including coordination and auditing.
Skills:
- Verbal and written communication skills, problem solving skills, and interpersonal skills.
- Attention to details and an aptitude to experimental investigations
- Basic ability to work independently and manage one’s time.
- Basic knowledge of Python, Unix, and SQL.
- Basic knowledge of computer vision and generative models