Audio Evaluator | Remote

Summary: The Audio Evaluator role involves supporting AI audio research by transcribing, evaluating, and benchmarking Dutch language content to enhance the performance of language models. This position is fully remote and offers a flexible schedule, requiring fluency in both Dutch and English. The evaluator will create structured outputs, develop evaluation rubrics, and participate in quality assurance processes. Strong writing and analytical skills are essential for success in this role.

Key Responsibilities:

• Transcribe and optimize Dutch audio and video content
• Create structured written outputs in Dutch with supporting English content
• Develop evaluation rubrics and response quality guidelines
• Test language model outputs against predefined evaluation standards
• Conduct grading and benchmarking reviews for AI-generated responses
• Participate in QA processes to ensure consistency and reliability

Key Skills:

• Fluency in Dutch and English
• Ability to transcribe and analyze audio and video content accurately
• Strong writing and critical analysis capabilities
• Experience applying structured evaluation criteria and guidelines
• Ability to work independently and meet project deadlines
• Availability to work within GMT or PST working hours

Salary (Rate): £50.00 hourly

City: undetermined

Country: United Kingdom

Working Arrangements: remote

IR35 Status: outside IR35

Seniority Level: undetermined

Industry: Other