QA & Automation Engineers
Posted 6 days ago by 1757579533
Negotiable
Outside
Remote
USA
Summary: The QA & Automation Engineer role focuses on developing AI-aligned test suites for multi-agent workflows and automating regression tests for LLM-driven features. The position requires collaboration with Test Agent to enhance test coverage and ensure reliability in AI systems. Candidates should have experience in test automation specifically for AI/LLM systems and proficiency in API and end-to-end testing tools. This role is remote and classified as outside IR35.
Key Responsibilities:
- Develop AI-aligned test suites for multi-agent workflows, cross-cloud integrations, and APIs.
- Work with Test Agent to auto-generate and optimize test coverage.
- Automate regression and reliability tests for LLM-driven features.
Key Skills:
- Experience with test automation in AI/LLM systems (flakiness, non-determinism, hallucinations).
- Proficiency in API/E2E testing (Playwright, Cypress, Pytest).
- Familiarity with agent reliability evaluation frameworks.
- Experience with automated defect classification and ML model testing.
Salary (Rate): undetermined
City: undetermined
Country: USA
Working Arrangements: remote
IR35 Status: outside IR35
Seniority Level: undetermined
Industry: IT
Detailed Description From Employer:
Responsibilities
- Develop AI-aligned test suites for multi-agent workflows, cross-cloud integrations, and APIs.
- Work with Test Agent to auto-generate and optimize test coverage.
- Automate regression and reliability tests for LLM-driven features.
Requirements
- Experience with test automation in AI/LLM systems (flakiness, non-determinism, hallucinations).
- Proficiency in API/E2E testing (Playwright, Cypress, Pytest).
- Familiarity with agent reliability evaluation frameworks.
Preferred
- Experience with automated defect classification and ML model testing.