Negotiable
Undetermined
Remote
EMEA
Summary: The Senior Korean Audio Expert role involves contributing to an AI research project by performing transcription, annotation, and evaluation tasks. Candidates should be fluent in Korean and English, with strong analytical skills, and will work independently in a structured, remote environment. This position is ideal for individuals with a background in linguistics or related fields who are interested in AI and language models.
Key Responsibilities:
- Define and Document Evaluation Standards
- Establish clear expectations for correct and high-quality responses in general consumer audio contexts
- Develop detailed evaluation rubrics and grading guidelines in Korean and English
- Document standards to ensure consistency across reviewers and model evaluations
- Conduct Model Testing and Grading
- Run prompts through language models and assess generated outputs
- Evaluate responses against predefined criteria for accuracy, completeness, and instructional clarity
- Support Benchmarking and Quality Assurance
- Participate in QA and review cycles to ensure tasks, rubrics, and outputs meet established quality standards
- Maintain consistency and reliability before datasets are integrated into official benchmarks
- Collaborate with project leads to resolve ambiguities and improve task design
Key Skills:
- Strong writing, editing, and critical thinking skills
- Ability to work independently, manage time effectively, and meet deadlines
- Fluency in Korean and English (spoken and written)
- Availability to commit 10–20 hours per week
- Background in linguistics, humanities, social sciences, or technical fields
- Prior experience with transcription, annotation, evaluation, or research workflows
- Interest in AI, language models, or applied research environments
Salary (Rate): undetermined
City: undetermined
Country: undetermined
Working Arrangements: remote
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
Role: Senior Korean Audio Expert (Remote)
Location: 100% Remote (Global)
Compensation: USD 50 per hour
Role Overview
One of our clients, a leading AI research organization, is seeking a Korean Audio Generalist Evaluator Expert to contribute to a high-impact audio AI research project. In this role, you will work on transcription, annotation, and evaluation tasks that help train and benchmark advanced language models. This is a short-term, structured engagement ideal for candidates with strong academic or analytical backgrounds who are fluent in Korean and English and enjoy translating complex audio and visual information into precise, well-structured text.
Key Responsibilities
- Define and Document Evaluation Standards
- Establish clear expectations for correct and high-quality responses in general consumer audio contexts
- Develop detailed evaluation rubrics and grading guidelines in Korean and English
- Document standards to ensure consistency across reviewers and model evaluations
- Conduct Model Testing and Grading
- Run prompts through language models and assess generated outputs
- Evaluate responses against predefined criteria for accuracy, completeness, and instructional clarity
- Support Benchmarking and Quality Assurance
- Participate in QA and review cycles to ensure tasks, rubrics, and outputs meet established quality standards
- Maintain consistency and reliability before datasets are integrated into official benchmarks
- Collaborate with project leads to resolve ambiguities and improve task design
Minimum Qualifications
- Strong writing, editing, and critical thinking skills
- Ability to work independently, manage time effectively, and meet deadlines
- Fluency in Korean and English (spoken and written)
- Availability to commit 10–20 hours per week
Preferred Qualifications
- College students or recent graduates
- Background in linguistics, humanities, social sciences, or technical fields
- Prior experience with transcription, annotation, evaluation, or research workflows
- Interest in AI, language models, or applied research environments
Additional Role Details
- Structured, goal-oriented project environment with clear tooling, guidelines, and support
- Hands-on exposure to real-world AI research and evaluation workflows
- Contract and Payment Terms
- Engagement as an independent contractor
- Fully remote with flexible scheduling
- Projects may be extended, shortened, or concluded based on performance and project needs
- Work will not involve access to confidential or proprietary information from any employer, client, or institution
- Payments are issued weekly via Stripe or Wise based on services rendered
- H1-B or STEM OPT candidates cannot be supported at this time
APPLY NOW!