The role
You’ll work across a major modernisation of the organisation’s data estate, including the transformation and migration of large-scale data pipelines, development of new data products and adoption of modern, AI-assisted engineering practices.
Responsibilities
- Providing Staff-level technical leadership across complex data engineering initiatives
- Remaining deeply hands-on with Python, PySpark and Spark
- Modernising and migrating large-scale data pipelines across AWS
- Designing and challenging approaches across AWS Glue, Airflow and associated technologies
- Shaping scalable data architectures, frameworks and engineering patterns
- Supporting the development of new data products and reusable capabilities
- Championing AI-assisted development to improve engineering quality and delivery speed
- Raising engineering standards and capability across multiple teams
What we're looking for
- Deep hands-on Python/PySpark and Apache Spark expertise
- Strong AWS data engineering, particularly AWS Glue
- Strong Apache Airflow experience
- Experience delivering complex data transformation or modernisation programmes
- Strong software engineering fundamentals
- Experience operating at Staff, Principal or Senior Lead Engineer level
- Ability to independently challenge thinking and shape technical solutions
- Genuine desire to remain hands-on with code
- Experience incorporating AI-assisted development tools into engineering workflows
- Snowflake experience would be beneficial
- The sweet spot is someone who can operate across both technical strategy and hands-on delivery — setting the engineering direction while still being capable of building and proving the solution.
Rate:
£1,300/day
Location:
London
IR35 Status:
Inside
Remote Status:
Hybrid
Industry:
Data & Analytics
Seniority Level:
Senior