Ukrainian LLM Evaluator

Summary: The role of Ukrainian LLM Evaluator involves reviewing and assessing model-generated replies in Ukrainian, focusing on either Tone or Fluency. Evaluators will provide feedback on the quality and naturalness of responses, contributing to the validation of evaluation frameworks for AI development. This position is project-based and allows for remote work as an Independent Contractor with CrowdGen. Strong English comprehension alongside native-level fluency in Ukrainian is essential for this role.

Key Responsibilities:

• Evaluate model replies in your native language based on either Tone or Fluency.
• Assess the overall quality, correctness, and naturalness of responses.
• Read the user prompt and two model replies, then rate each using a five-point scale.
• Provide brief rationales for any extreme ratings.

Key Skills:

• Native-level fluency in Ukrainian.
• Strong comprehension of English.
• Ability to assess quality dimensions such as Tone and Fluency.
• Experience with evaluating language model outputs.

Salary (Rate): undetermined

City: undetermined

Country: undetermined

Working Arrangements: remote

IR35 Status: outside IR35

Seniority Level: undetermined

Industry: IT