Software QA - AI & Data Quality

The Role

Working closely with developers, data engineers, technical architects and business stakeholders, you'll be responsible for testing AI-driven solutions, validating document categorisation outputs and ensuring data quality throughout migration and integration processes.

The engagement will involve a combination of traditional software testing, AI/ML validation, data quality assurance and technical delivery assurance, ensuring solutions meet agreed quality standards and business requirements.

Key Responsibilities

• Test and validate AI-enabled classification and categorisation of unstructured documents.
• Assess AI model outputs against agreed accuracy and precision measures.
• Validate end-to-end document migration processes, including classification, transfer, event monitoring and audit controls.
• Perform data quality testing across data pipelines, migrations and analytics platforms.
• Ensure AI-driven solutions deliver reliable, fair and explainable outcomes.
• Review technical designs, user stories, acceptance criteria and defects to identify quality gaps.
• Work closely with developers, data engineers, architects and delivery teams to resolve technical issues.
• Provide independent technical assurance throughout the project lifecycle.
• Identify and report technical risks, dependencies, defects and quality concerns.
• Support Agile ceremonies, including sprint planning, backlog refinement and reviews.
• Assess solution readiness against agreed delivery and governance milestones.
• Produce testing reports, quality assessments and evidence-based recommendations.

Essential Experience

• Proven experience as a Software Tester, QA Engineer or Data QA Tester.
• Hands-on experience testing AI, Machine Learning or data-driven solutions.
• Experience validating document classification or categorisation outputs, including accuracy and precision measures.
• Strong experience in data quality assurance, data validation and migration testing.
• Experience testing data pipelines, analytics platforms or intelligent automation solutions.
• Strong understanding of software testing methodologies, Agile delivery and the software development lifecycle.
• Ability to review and challenge technical designs, architectural decisions and delivery approaches.
• Experience identifying defects, assessing risks and producing technical assurance reports.
• Strong analytical, problem-solving and stakeholder management skills.
• Experience working collaboratively with developers, data engineers, architects and delivery teams.
• Active SC Clearance is mandatory.

Desirable Experience

• Experience testing document management systems or document migration solutions.
• Familiarity with responsible AI principles, including fairness, bias and explainability testing.
• Experience working within public sector or regulated environments.
• Knowledge of event monitoring, audit controls and data governance.