Summary: The QA Specialist role focuses on auditing evaluations of AI-generated Kotlin code, ensuring adherence to best practices and correctness. The position requires a keen eye for detail and extensive experience in Kotlin, particularly in mobile and backend development. The specialist will provide feedback to annotators and collaborate with QA leads to enhance evaluation guidelines. This is a fully remote, flexible contract position aimed at improving the quality of AI solutions.

Key Responsibilities:

• Review and audit evaluations of AI-generated Kotlin code provided by annotators.
• Validate that annotators correctly apply rubrics for instruction-following and code accuracy.
• Test Kotlin code snippets and verify functionality, readability, and correctness of proof-of-work.
• Identify logical flaws, missed requirements, or misjudged evaluations.
• Provide clear, actionable feedback to annotators to improve quality and consistency.
• Collaborate with QA leads and contribute to refining evaluation guidelines.

Key Skills:

• 5–7+ years of professional experience with Kotlin in software development, QA, or code review roles.
• Deep understanding of Kotlin syntax, type system, OOP principles, and Android or backend application design.
• Experience validating code functionality, testing logic, and refactoring.
• Familiarity with Kotlin testing tools, IDEs (e.g., IntelliJ), and modern development workflows.
• Excellent analytical and written communication skills.
• English proficiency at B2, C1, C2, or Native level.

Salary (Rate): undetermined

City: undetermined

Country: undetermined

Working Arrangements: remote

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT