Data Platform & Engineering Lead

Databricks. Azure. Cloud Migration. PySpark. Lakehouse. Teradata Modernisation

We're building a bench of top-tier Databricks and Cloud Data Engineering contractors for a series of high-impact transformation programmes across multiple UK clients. If you specialise in cloud migration, Databricks engineering, and modern data platform builds, there are several projects kicking off now and over the coming weeks.

These are hands-on, delivery-focused roles where you'll be shaping modern data platforms, migrating Legacy estates, and building scalable engineering foundations that actually get used; not just documented.

Depending on the project, you'll be involved in:

• Migrating enterprise data workloads from Teradata and other Legacy systems into Databricks on Azure

• Designing and building high-performance PySpark pipelines, Delta Lake tables, and medallion architectures

• Developing scalable ETL/ELT workflows and optimising existing pipelines

• Implementing Unity Catalog, governance frameworks, and platform standards

• Leading or contributing to cloud-native data platform builds

• Performance tuning, cost optimisation, and FinOps-aligned engineering

• Working closely with analytics, data science, and product teams to deliver real business value

These projects move fast - you'll be expected to deliver clean, scalable, production-ready engineering from day one.

You'll thrive in these roles if you bring:

• Strong hands-on experience with Databricks, Spark, Delta Lake, and Databricks SQL

• Proven delivery of cloud migration projects (Teradata experience is a big plus)

• Solid Azure knowledge: Data Lake, Data Factory, Unity Catalog

• Advanced SQL and PySpark engineering skills

• Experience building and optimising medallion/lakehouse architectures

• Ability to work autonomously in fast-paced, product-led environments

• A contractor mindset: pragmatic, delivery-driven, and commercially aware

Leadership experience is welcome, but not essential - we have both individual contributor and lead-level opportunities.

• Outside IR35

• Competitive day rates

• Remote or hybrid options depending on the client

• Initial 3-6 month contracts with extensions highly likely

• Start dates available immediately and rolling over the next few weeks

You'll be working on programmes where:

• The tech stack is modern and evolving

• The work is genuinely transformative, not BAU

• You have autonomy to shape engineering standards

• Your impact is visible - faster insights, better governance, lower costs

• You're surrounded by senior engineers who know their craft

If you're tired of firefighting Legacy systems and want to build platforms that matter, this is the kind of work you'll enjoy.