The Role
As a Senior Test Engineer, you will operate at a strategic level, shaping testing approaches for AI and data services while remaining hands-on across automation, validation, and delivery pipelines.
- Lead the design and execution of end-to-end test strategies across AI and digital programmes
- Ensure quality across AI models, data pipelines, APIs, and cloud-based services
- Embed test-driven (TDD) and behaviour-driven (BDD) practices within engineering teams
- Drive improvements in automation frameworks and testing tools
- Provide expert oversight on AI model validation, including Generative AI and RAG solutions
- Identify risks early and implement mitigation strategies
- Mentor and coach engineers to build strong testing capability across teams
Key Responsibilities
- Define and deliver testing strategies aligned to organisational standards
- Lead AI testing, validation, and evaluation frameworks
- Integrate testing within CI/CD and DevOps pipelines
- Champion modern testing approaches, including AI-led and predictive testing techniques
- Collaborate with cross-functional teams including engineering, data science, product, and leadership
- Oversee defect management, quality metrics, and release assurance
- Ensure compliance with accessibility, security, and performance standards
Key Skills & Experience: Essential
- Strong experience delivering quality assurance for AI/ML solutions across the full life cycle
- Hands-on expertise with Microsoft-based environments (eg Azure testing tools, AI platforms)
- Proficiency in one or more: Python, Java, JavaScript, SQL, or R
- Proven experience in:
- AI/Generative AI testing
- RAG (Retrieval-Augmented Generation) solution validation (eg RAGAS framework)
- CI/CD, DevOps, and cloud-based test integration
- Ability to define and implement AI testing strategies and model validation frameworks
- Strong understanding of:
- Functional and non-functional testing
- Accessibility, security, and performance testing
- Experience working in regulated or enterprise environments
- Active SC Clearance (mandatory)
Rate:
£650/day
Location:
London
IR35 Status:
Inside
Remote Status:
Hybrid
Industry:
AI & Machine Learning
Seniority Level:
Senior