Summary: The role of QA Specialist involves auditing evaluations of AI-generated terminal scripts, specifically focusing on Bash or shell scripting. The specialist will ensure the accuracy and completeness of annotator evaluations, provide feedback, and uphold code quality standards within the AI training workflow. This position is fully remote and offers flexible hours, emphasizing the importance of detail-oriented QA expertise in AI technology. Candidates should have significant experience in scripting and QA processes.

Key Responsibilities:

• Audit annotator evaluations of AI-generated Bash or shell scripts.
• Verify proper application of instruction-following and factual correctness rubrics.
• Test annotator-submitted code using local or secure shell environments.
• Evaluate annotator explanations and test coverage for accuracy and completeness.
• Identify gaps, errors, or inconsistencies in code execution, functionality, or safety.
• Provide clear, actionable feedback to annotators to improve future evaluations.
• Work with QA leads to uphold consistent review standards.

Key Skills:

• 5–7+ years of experience in Bash or shell scripting, automation, or Linux-based QA.
• Deep understanding of scripting logic, command-line utilities, file operations, and permissions.
• Familiarity with script safety, error handling, and real-world usability.
• Experience testing scripts in Unix/Linux terminal environments.
• Excellent analytical and documentation skills.
• English proficiency at B2, C1, C2, or Native level.

Salary (Rate): undetermined

City: undetermined

Country: undetermined

Working Arrangements: remote

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT