Principal AI Data Engineer (GenAI/Agentic AI) - Contract Opportunity
- Principal AI Data Engineer
- Hybrid Working
- Initial 6-Month Contract (Inside IR35)
- Long-Term Programme with expected extensions over a multi-year transformation initiative
The Role
We are seeking an experienced Principal AI Data Engineer to join a large-scale AI and data transformation programme. This is an exciting opportunity to help shape and deliver cutting-edge GenAI, Agentic AI and Data Engineering solutions, taking concepts from prototype through to enterprise-scale production deployment.
You'll play a key role in designing, building and scaling AI-powered solutions that deliver real business value, while collaborating with both technical and non-technical stakeholders across a complex global environment.
- Develop and evaluate GenAI, Agentic AI and AI-powered prototypes using modern AI platforms and frameworks.
- Design, build and optimise Retrieval-Augmented Generation (RAG) solutions, including embedding strategies, prompt engineering and evaluation frameworks.
- Build and deploy AI agents using technologies such as LangChain, LangGraph, AutoGen and similar frameworks.
- Deliver production-grade AI applications using Azure OpenAI, Azure AI Foundry, Databricks Mosaic AI, MLflow, Agent Bricks and Docker.
- Create scalable and reusable solutions using Python and modern software engineering practices.
- Build and manage AI workflows on Databricks, leveraging Delta Lake, DLT, Unity Catalog and MLflow.
- Develop robust evaluation, benchmarking and testing frameworks for GenAI systems.
- Work with large-scale structured and unstructured datasets, ensuring reproducibility and high engineering standards.
- Contribute to architecture, technical strategy and long-term platform design.
- Partner closely with stakeholders, translating complex AI concepts into clear business outcomes.
- Lead technical direction, influence delivery roadmaps and help shape future AI capabilities.
Key Skills & Experience
- 8-12+ years' experience delivering Data Science, AI or Advanced Analytics projects
Strong experience with:
- Databricks (DLT, Delta Lake, Unity Catalog)
- Azure Cloud
- Python, SQL and/or Scala
- Spark Structured Streaming and Auto Loader
- Data modelling, ETL/ELT and data architecture
- ADF and Qlik Replicate
- CI/CD, GitHub workflows and DevOps best practices
Deep understanding of:
- Large Language Models including GPT, Llama, Claude and Mistral
- GenAI architecture and implementation
- RAG design patterns and evaluation techniques
- Agentic AI frameworks and orchestration
Hands-on experience with:
- Microsoft Copilot
- Azure AI Foundry
- Databricks Mosaic AI
- MLflow
- Agent Bricks
- Genie
Proven ability to:
- Take AI solutions from proof-of-concept to production
- Operate in Agile environments
- Influence senior stakeholders
- Lead technical workstreams and help define future delivery backlogs
What's on Offer?
- Industry-leading AI and GenAI programme
- Opportunity to work on production-scale Agentic AI initiatives
- Long-term contract potential within a multi-year programme
- Hybrid working model
- High-profile role with significant technical influence
If you're passionate about building enterprise AI solutions and want to be at the forefront of GenAI and Agentic AI delivery, we'd love to hear from you.