Azure / Databricks Platform Engineer

Azure / Databricks Platform Engineer

Posted 1 day ago by ShareForce

£75 Per hour
Outside
Hybrid
London Area, United Kingdom

Summary: The role of Azure / Databricks Platform Engineer involves supporting the rollout and ongoing operation of a large-scale Data and AI platform, focusing on building secure and scalable Azure infrastructure. The position requires expertise in Terraform, CI/CD pipelines, and governance frameworks to ensure compliant data access across multiple business domains. The engineer will collaborate with various teams to maintain a resilient and cost-optimized cloud ecosystem. This is an outside IR35 engagement with an initial 6-month contract.

Key Responsibilities:

  • Design, build, and maintain Azure infrastructure using Terraform (IaC).
  • Develop, manage, and optimise CI/CD pipelines with GitHub Actions.
  • Implement secure network connectivity using Azure Private Link and Private Link Service.
  • Configure and govern Databricks and Unity Catalog to ensure compliant data access and lineage.
  • Enforce consistency and control through Azure Policy and compliance frameworks.
  • Manage identity and access management (IAM) using OAuth, federated credentials, and RBAC principles.
  • Apply Azure security best practices, including Defense in Depth, BCDR, and high availability.
  • Monitor and optimise cloud cost efficiency using Azure Cost Management and FinOps practices.
  • Collaborate with data, platform, and security teams to ensure a resilient, governed, and performant cloud ecosystem.

Key Skills:

  • Proven experience delivering Terraform-based Azure infrastructure.
  • Strong understanding of GitHub Actions and CI/CD automation.
  • Hands-on expertise with Azure Private Link and Private Link Service.
  • Deep knowledge of Databricks and Unity Catalog for governance and security.
  • Solid experience with Azure Policy, compliance enforcement, and resource governance.
  • Background in identity and access management, OAuth, and federated authentication.
  • Proven ability to design with security, resilience, and cost-optimisation in mind.
  • Excellent collaboration and documentation skills within cross-functional teams.

Salary (Rate): £75.00/hr

City: London

Country: United Kingdom

Working Arrangements: hybrid

IR35 Status: outside IR35

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

Location: London (2 days per week on client site)

Rate: £600 per day

Start Date: 01/11/25

Engagement: Outside IR35 | Initial 6-month contract

We are seeking an experienced Platform Engineer to support the rollout and ongoing operation of a large-scale, federated Data and AI platform . The role will focus on building secure, scalable, and cost-optimised Azure infrastructure , implementing governance, and enabling advanced data services across multiple business domains.

Key Responsibilities

  • Design, build, and maintain Azure infrastructure using Terraform (IaC) .
  • Develop, manage, and optimise CI/CD pipelines with GitHub Actions .
  • Implement secure network connectivity using Azure Private Link and Private Link Service .
  • Configure and govern Databricks and Unity Catalog to ensure compliant data access and lineage.
  • Enforce consistency and control through Azure Policy and compliance frameworks.
  • Manage identity and access management (IAM) using OAuth , federated credentials , and RBAC principles.
  • Apply Azure security best practices , including Defense in Depth , BCDR , and high availability .
  • Monitor and optimise cloud cost efficiency using Azure Cost Management and FinOps practices.
  • Collaborate with data, platform, and security teams to ensure a resilient, governed, and performant cloud ecosystem.

Required Skills & Experience

  • Proven experience delivering Terraform-based Azure infrastructure.
  • Strong understanding of GitHub Actions and CI/CD automation .
  • Hands-on expertise with Azure Private Link and Private Link Service .
  • Deep knowledge of Databricks and Unity Catalog for governance and security.
  • Solid experience with Azure Policy , compliance enforcement , and resource governance .
  • Background in identity and access management , OAuth , and federated authentication .
  • Proven ability to design with security, resilience, and cost-optimisation in mind.
  • Excellent collaboration and documentation skills within cross-functional teams