Databricks Lead Engineer - Technology - Contract

About the Role

We are searching on behalf of our client for this role.

This position is not with OVI.

We are hiring a hands-on Databricks Lead Engineer with experience in delivering modern data platforms on Databricks.

This role requires a minimum of 2 years of recent Databricks experience.

Key Responsibilities

• Lead the engineering delivery of Databricks lakehouse solutions from ingestion to curated serving layers.
• Define and implement Medallion Architecture (Bronze/Silver/Gold) and reusable engineering patterns.
• Build scalable ingestion pipelines using AutoLoader, Lakeflow Connect, batch/streaming, and incremental patterns.
• Develop Declarative Pipelines with Expectations (DLT) to enforce and monitor data quality.
• Implement and operate Unity Catalog for governance, access control, lineage, and secure data sharing patterns.
• Drive code quality and operational excellence (CI/CD approach, testing strategy, monitoring, incident triage).
• Partner with architects, platform teams, and stakeholders to align delivery with enterprise standards.
• Mentor engineers and act as the technical escalation point during delivery.

Your Profile

• 2+ years of hands-on Databricks experience in recent years, demonstrating usage of modern capabilities and patterns.
• Active Databricks Certification: Data Engineer Associate/Professional, Machine Learning Associate/Professional, or Generative AI Engineer (Associate).
• Unity Catalog hands-on experience with metastore/catalog design, grants, lineage, and secure access patterns.
• Experience with Declarative Pipelines with Expectations (DLT) for building pipelines and handling failures.
• Proficiency in Databricks-native ingestion engineering using AutoLoader and/or Lakeflow Connect.
• Implementation experience with Medallion Architecture and best practices.

What's Offered

• Competitive daily rate of £500
• £550.
• Opportunity to work in a dynamic and innovative environment.
• Chance to lead and mentor a team of engineers.
• Collaborative work culture with architects and platform teams.

Ideal Candidate

The ideal candidate is a proactive and skilled Databricks engineer with a strong foundation in modern data platform capabilities.

You should be comfortable leading projects, mentoring team members, and collaborating with stakeholders to deliver high-quality solutions.

Your expertise in Databricks and commitment to operational excellence will be key to your success in this role.