QA Specialist – AI Chatbot Response Evaluations (PHP)

QA Specialist – AI Chatbot Response Evaluations (PHP)

Posted 4 days ago by SuperAnnotate on Linkedin

Negotiable
Undetermined
Remote
EMEA

Summary: The QA Specialist role focuses on auditing evaluations of AI-generated PHP code, ensuring high-quality standards in AI training datasets. The position requires a detail-oriented individual with strong PHP experience to review annotator assessments for accuracy and functionality. The role is fully remote, offering flexible hours and a milestone-based structure. Candidates will collaborate with QA leads to enhance evaluation quality and consistency.

Key Responsibilities:

  • Audit annotator evaluations of AI-generated PHP code responses.
  • Ensure annotators follow guidelines accurately in assessing instruction-following and code correctness.
  • Test proof-of-work code snippets submitted by annotators to verify output, functionality, and security.
  • Identify logical flaws, incomplete evaluations, or misapplied rubric criteria.
  • Deliver structured and helpful feedback to improve evaluation quality.
  • Collaborate with QA leads to ensure consistency in review processes.

Key Skills:

  • 5–7+ years of professional experience with PHP development or technical QA.
  • Strong understanding of PHP syntax, logic, and server-side scripting practices.
  • Experience with web debugging, backend testing, and functional validation.
  • Familiarity with frameworks like Laravel, Symfony, or plain PHP scripting.
  • Strong documentation and written communication skills.
  • English proficiency at B2, C1, C2, or Native level.

Salary (Rate): undetermined

City: undetermined

Country: undetermined

Working Arrangements: remote

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT