Python Senior Engineer
Posted 1 week ago by Project Recruit
Negotiable
Undetermined
Hybrid
London, UK
Summary: The role of Python Senior Engineer involves developing AI-powered services and implementing evaluation frameworks for LLM-based systems. The position is based in London, UK, and offers a hybrid working arrangement, allowing remote work alongside office attendance. This is a temporary contract lasting 12 months, with an immediate start date.
Key Responsibilities:
- Building and evolving AI-powered services using Python
- Designing and implementing evaluation frameworks for LLM-based systems
- Improving output quality through structured evals rather than purely code changes
- Applying techniques such as LLM-as-a-Judge to assess response and recommendation quality
- Working with non-deterministic systems and iterating based on real-world behaviour
- Integrating AI services into a broader platform and API ecosystem
- Contributing to production readiness including reliability, observability, and performance
- Partnering with data scientists on prompts, model usage, and evaluation strategies
Key Skills:
- Strong Python engineering experience in production environments
- Experience building AI-enabled applications, particularly in recommendation or conversational systems
- Hands-on experience with evaluation frameworks for LLM or AI systems
- Clear understanding of how AI systems differ from traditional deterministic systems
- Ability to design meaningful evals and improve system quality over time
- Experience working in cross-functional teams with engineering, data, and product
- Experience with Azure AI services or similar platforms
- Familiarity with OpenAI or similar SDKs
- Exposure to infrastructure and distributed systems
- Experience with tools such as Terraform or Kafka
Salary (Rate): undetermined
City: London
Country: UK
Working Arrangements: hybrid
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
Python Senior Engineer
Our client, a leading global supplier for IT services, requires Python Senior Engineer to be based at their client's office in London, UK.
This is a hybrid role - you can work remotely in the UK and attend the London office 2 days per week.
This is a 12 month temporary contract to start ASAP
Day rate: Competitive Market rate
Key Responsibilities
- Building and evolving AI-powered services using Python
- Designing and implementing evaluation frameworks for LLM-based systems
- Improving output quality through structured evals rather than purely code changes
- Applying techniques such as LLM-as-a-Judge to assess response and recommendation quality
- Working with non-deterministic systems and iterating based on real-world behaviour
- Integrating AI services into a broader platform and API ecosystem
- Contributing to production readiness including reliability, observability, and performance
- Partnering with data scientists on prompts, model usage, and evaluation strategies
Key Requirements
Essential Skills:
- Strong Python engineering experience in production environments
- Experience building AI-enabled applications, particularly in recommendation or conversational systems
- Hands-on experience with evaluation frameworks for LLM or AI systems
- Clear understanding of how AI systems differ from traditional deterministic systems
- Ability to design meaningful evals and improve system quality over time
- Experience working in cross-functional teams with engineering, data, and product
Desirable Skills:
- Experience with Azure AI services or similar platforms
- Familiarity with OpenAI or similar SDKs
- Exposure to infrastructure and distributed systems
- Experience with tools such as Terraform or Kafka
Due to the volume of applications received, unfortunately we cannot respond to everyone.
If you do not hear back from us within 7 days of sending your application, please assume that you have not been successful on this occasion.
