All Jobs Vacancy

SC Cleared Databricks Platform Engineer - Outside IR35 - ASAP

Posted Today by Tenth Revolution Group

About the Company

We are working with one of the UK's leading Databricks consultancies, renowned for delivering cutting-edge data and AI solutions across highly regulated environments.

As a recognised Databricks specialist partner, they help organisations design, implement, govern, and optimise enterprise-scale Databricks platforms across some of the most complex AWS environments in the market.

The Role

We are looking for an experienced Databricks Platform Engineer to provide technical leadership across platform design, governance, security, automation, and operational excellence within a large-scale AWS Databricks environment.

This is not a traditional Data Engineer role. Instead, the focus is on Databricks platform ownership, administration, governance, security, networking, automation, and enablement.

You'll act as the go-to subject matter expert for Databricks platform capabilities, supporting architecture decisions, reviewing platform designs, implementing governance controls, and helping client teams build sustainable ownership of the platform.

Key Responsibilities

  • Act as the technical authority for Databricks platform architecture and operational best practices.
  • Design and administer Databricks environments across workspace and account levels.
  • Implement and manage Unity Catalog permissions, access controls, governance, and data lineage.
  • Design and support secure AWS networking for Databricks, including private connectivity, network isolation, and platform security controls.
  • Define and maintain identity and access management standards across Databricks environments.
  • Develop and maintain Infrastructure as Code using Terraform.
  • Build and maintain GitHub CI/CD pipelines for platform deployments and configuration management.
  • Design, review, and document disaster recovery and resilience strategies for Databricks platforms.
  • Support platform release management processes and change governance.
  • Assess platform impacts, technical risks, and architectural decisions.
  • Produce high-quality platform documentation using the Atlassian suite (Jira and Confluence).
  • Deliver knowledge transfer sessions and technical enablement workshops for client platform teams.
  • Communicate complex technical concepts clearly to both technical and non-technical stakeholders.

About You

You will be an experienced Databricks Platform Architect, Databricks Administrator, Platform Engineer, or Cloud Data Platform Consultant with strong experience managing enterprise Databricks environments within AWS.

You'll have a deep understanding of platform governance, security, automation, networking, and operational management, alongside the ability to advise stakeholders and lead platform best practices.

Key Requirements

  • Active SC Clearance.
  • Extensive hands-on Databricks platform experience.
  • Strong knowledge of Unity Catalog, including governance, permissions, access management, and lineage.
  • Experience administering Databricks across both workspace and account levels.
  • Strong understanding of Databricks security models and identity management.
  • Experience designing and supporting Databricks networking on AWS.
  • Strong Infrastructure as Code experience using Terraform.
  • Experience building CI/CD pipelines using GitHub Actions.
  • Experience implementing platform governance, operational controls, and release management processes.
  • Strong documentation and knowledge transfer experience.
  • Excellent stakeholder engagement and communication skills.
  • Ability to operate as a trusted advisor across architecture, engineering, and platform teams.

Highly Desirable

  • AWS platform architecture experience.
  • Databricks Asset Bundles experience.
  • Experience with disaster recovery planning and implementation for Databricks environments.
  • Exposure to large enterprise or regulated environments.
  • Databricks certifications.
  • Consulting or client-facing experience.

What's On Offer

  • Fully remote role
  • Initial 3-month contract with extension potential
  • Opportunity to work with one of the UK's leading Databricks specialists.
  • Exposure to enterprise-scale Databricks platform transformation projects.
  • Work alongside highly experienced Databricks consultants, platform engineers, and architects.
  • Immediate start available.

Why Apply?

This is a rare opportunity to join one of the most respected Databricks consultancies in the UK and take ownership of a large-scale Databricks platform in a highly secure environment.

You'll be working at the intersection of cloud architecture, platform engineering, governance, security, automation, and enablement, helping organisations maximise the value of their Databricks investment while building best-in-class platform capabilities.

Rate:
£550/day
Location:
London
IR35 Status:
Outside
Remote Status:
Remote
Industry:
IT
Seniority Level:
Not Specified

Take-Home Pay

£8,800 per month

Visit calculators for additional details

Share job