All Jobs Vacancy

Test Engineer - Knowledge AI

Posted 5 days ago by Thomas Ren Associates

As a Knowledge Test Engineer, you will be responsible for ensuring the accuracy, reliability, and performance of AI and Graph platform. You will design, build, and execute comprehensive testing frameworks covering everything from graph ontology and ETL data pipelines to AI chatbot accuracy and hallucination prevention

Key Responsibilities

  • Test Strategy & Execution
  • Graph & Data Quality: Design and execute test plans covering ontology conformance, data loading, and graph query accuracy.
  • Automation: Build and maintain automated regression test suites for graph schemas, ETL pipelines, and chatbot responses.
  • End-to-End Testing: Perform functional, integration, and end-to-end testing across the knowledge graph, operational dashboards, and AI chatbot interfaces.
  • Non-Functional Testing: Execute performance, load, and security testing tailored specifically to graph databases and chatbot systems.

AI & Chatbot Validation

  • Output Accuracy: Validate chatbot outputs against ground-truth expected answers, rigorous evaluation for factual accuracy, relevance, and hallucination risk mitigation.

Quality Assurance & Collaboration

  • Test Design: Define clear test cases and acceptance criteria in close collaboration with the System Architect and Quality Engineer.
  • Defect Management: Log, triage, and track defects through to resolution, partnering closely with engineering teams.
  • Environment & Data Management: Maintain realistic test datasets and environments representative of production scenarios.
  • UAT & Release Management: Coordinate User Acceptance Testing (UAT) and support sign-off criteria for scheduled releases.
  • Reporting: Report regularly on test coverage, quality trends, and release readiness to program leadership.

Preferred Qualifications & Skills

  • Hands-on experience testing graph databases, ontology structures, or semantic data models.
  • Proven track record testing LLM applications, conversational interfaces, and evaluating hallucination risk.
  • Proficiency in automated test frameworks and ETL pipeline validation.
  • Strong knowledge of defect-tracking systems and test management tools

Please add salary rerquirements to application

Rate:
Not specified
Location:
London
IR35 Status:
Not specified
Remote Status:
Not specified
Industry:
IT
Seniority Level:
Not Specified

Take-Home Pay

Not Available

Visit calculators for additional details

Create a free account to view the take-home pay for this contract

Share job