
QA Specialist – AI Chatbot Response Evaluations (PHP)
Posted 4 days ago by SuperAnnotate on Linkedin
Negotiable
Undetermined
Remote
EMEA
Summary: The QA Specialist role focuses on auditing evaluations of AI-generated PHP code, ensuring high-quality standards in AI training datasets. The position requires a detail-oriented individual with strong PHP experience to review annotator assessments for accuracy and functionality. The role is fully remote, offering flexible hours and a milestone-based structure. Candidates will collaborate with QA leads to enhance evaluation quality and consistency.
Key Responsibilities:
- Audit annotator evaluations of AI-generated PHP code responses.
- Ensure annotators follow guidelines accurately in assessing instruction-following and code correctness.
- Test proof-of-work code snippets submitted by annotators to verify output, functionality, and security.
- Identify logical flaws, incomplete evaluations, or misapplied rubric criteria.
- Deliver structured and helpful feedback to improve evaluation quality.
- Collaborate with QA leads to ensure consistency in review processes.
Key Skills:
- 5–7+ years of professional experience with PHP development or technical QA.
- Strong understanding of PHP syntax, logic, and server-side scripting practices.
- Experience with web debugging, backend testing, and functional validation.
- Familiarity with frameworks like Laravel, Symfony, or plain PHP scripting.
- Strong documentation and written communication skills.
- English proficiency at B2, C1, C2, or Native level.
Salary (Rate): undetermined
City: undetermined
Country: undetermined
Working Arrangements: remote
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT