Platform Engineer (AWS/Databricks)

Platform Engineer (AWS/Databricks)

Posted Today by Jobserve

Apply
£600 Per day
Inside
Hybrid
London
Apply
Access Controls Amazon S3 Amazon Web Services (AWS) Apache Hive Apache Parquet AWS Identity And Access Management (IAM) AWS Key Management Service (KMS) Azure Databricks Cloud Computing Cloud Technology Continuous Integration and Continuous Delivery Data Access Databricks Data Integration Github Gitlab Infrastructure as Code (IaC) JSON Metadata Pyspark Python (Programming Language) SQL (Programming Language) Terraform

Summary: The Platform Engineer role focuses on leveraging AWS and Databricks expertise to support secure data integration for a leading global IT transformation business. The position is a 6-month contract based in London with hybrid working arrangements. The ideal candidate will have hands-on experience with AWS IAM, Databricks, and Unity Catalog, and will start as soon as possible in May/June 2026.

Key Responsibilities:

  • Supporting secure integration between AWS hosted data sources, Databricks workspaces and downstream enterprise data platforms.
  • Design and support secure integration across AWS S3, Databricks and downstream data platforms.
  • Strong hands-on experience with AWS IAM, S3, KMS and secure cloud access patterns.
  • Hands-on Databricks on AWS experience, including Hive Metastore, Delta tables, SQL Warehouse and workspace access controls.
  • Practical Unity Catalog experience, including grants, external locations, storage credentials and governed data access.
  • Scope includes data held in S3, registered through Databricks Hive Metastore, governed or exposed through Unity Catalog, and consumed through approved connector-based patterns.
  • Configure least-privilege access to S3 using IAM roles, bucket policies, KMS permissions and approved access controls.
  • Support Databricks access patterns where S3-backed data is registered through Hive Metastore and exposed or migrated into Unity Catalog.
  • Configure and validate Unity Catalog objects, including catalogs, schemas, tables, views, grants, storage credentials and external locations.
  • Support downstream connectivity to Databricks using SQL Warehouse, tables, views or connector-based integration patterns.
  • Develop Terraform/IaC for AWS IAM, S3, KMS and Databricks-related configuration.
  • Troubleshoot access, metadata, schema, query and connectivity issues across AWS, Databricks and downstream integrations.
  • Technical Environment: AWS, Databricks, Unity Catalog, Palantir Foundry, Terraform, IaC, Delta, Parquet, CSV, JSON, Python, PySpark, SQL, CI/CD, GitLab, GitHub Actions.

Key Skills:

  • Strong experience with AWS services, particularly IAM, S3, and KMS.
  • Hands-on experience with Databricks, including Hive Metastore and Delta tables.
  • Practical knowledge of Unity Catalog and its components.
  • Experience in developing Infrastructure as Code (IaC) using Terraform.
  • Proficiency in Python, PySpark, and SQL.
  • Familiarity with CI/CD practices and tools like GitLab and GitHub Actions.
  • Ability to troubleshoot complex integration issues across cloud platforms.

Salary: £600/day

City: London

Country: United Kingdom

Working Arrangements: hybrid

IR35 Status: inside IR35

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

Platform Engineer (AWS/Databricks)

London (Hybrid)

6 Month Contract

£600/day (Inside IR35)

Platform Engineer needed with strong AWS, Databricks and Unity Catalog experience. Start ASAP in May/June 2026.

6 Month Rolling Contract based in London (Hybrid), with occasional travel to the Leeds office.

Hybrid Working - 3-4 days/week remote (WFH) + 1-2 days/week working from the office in London.

A chance to work with a leading global IT transformation business specialising in large-scale Government projects:

  • Supporting secure integration between AWS hosted data sources, Databricks workspaces and downstream enterprise data platforms.
  • Design and support secure integration across AWS S3, Databricks and downstream data platforms.
  • Strong hands-on experience with AWS IAM, S3, KMS and secure cloud access patterns.
  • Hands-on Databricks on AWS experience, including Hive Metastore, Delta tables, SQL Warehouse and workspace access controls.
  • Practical Unity Catalog experience, including grants, external locations, storage credentials and governed data access.
  • Scope includes data held in S3, registered through Databricks Hive Metastore, governed or exposed through Unity Catalog, and consumed through approved connector-based patterns.
  • Configure least-privilege access to S3 using IAM roles, bucket policies, KMS permissions and approved access controls.
  • Support Databricks access patterns where S3-backed data is registered through Hive Metastore and exposed or migrated into Unity Catalog.
  • Configure and validate Unity Catalog objects, including catalogs, schemas, tables, views, grants, storage credentials and external locations.
  • Support downstream connectivity to Databricks using SQL Warehouse, tables, views or connector-based integration patterns.
  • Develop Terraform/IaC for AWS IAM, S3, KMS and Databricks-related configuration.
  • Troubleshoot access, metadata, schema, query and connectivity issues across AWS, Databricks and downstream integrations.
  • Technical Environment: AWS, Databricks, Unity Catalog, Palantir Foundry, Terraform, IaC, Delta, Parquet, CSV, JSON, Python, PySpark, SQL, CI/CD, GitLab, GitHub Actions.
Apply
Similar Jobs
Loading data...