Platform Engineer (Palantir Foundry)

Platform Engineer (Palantir Foundry)

Posted Today by Jobserve

Apply
Negotiable
Inside
Hybrid
London
Apply
Access Controls Amazon S3 Amazon Web Services (AWS) Apache Hive Apache Parquet Authentications AWS Identity And Access Management (IAM) AWS Key Management Service (KMS) Azure Databricks Continuous Integration and Continuous Delivery Databricks Data Integration Data Management Github Gitlab Infrastructure as Code (IaC) JSON Management Ontologies Pyspark Python (Programming Language) SQL (Programming Language) Terraform

Summary: The Platform Engineer role focuses on leveraging Palantir Foundry and Databricks on AWS to support secure data integration for a leading global IT transformation business. The position is a 6-month hybrid contract based in London, requiring hands-on experience with various data management tools and AWS services. The role involves troubleshooting, configuring, and validating data connections and permissions within the platform. The ideal candidate will start ASAP in May/June 2026.

Key Responsibilities:

  • Configure + support secure integration between Palantir Foundry and Databricks on AWS.
  • Scope includes data held in S3, registered through Databricks Hive Metastore, governed or exposed through Unity Catalog, and consumed by Foundry using the Databricks connector or approved ingestion patterns.
  • Hands-on Palantir Foundry experience, including connectors, Data Connection, datasets, syncs, projects and permissions.
  • Experience configuring or supporting the Palantir Foundry Databricks connectors.
  • Strong Databricks on AWS experience, including SQL Warehouse, clusters, tables, views and access controls.
  • Good understanding of Hive Metastore and Unity Catalog, including catalogs, schemas, grants, storage credentials and external locations.
  • Strong AWS IAM, S3, KMS, bucket policy and cross-account access experience.
  • Set up and validate the Foundry Databricks connector for approved SQL Warehouses, tables, views and Unity Catalog-governed objects.
  • Support end-to-end access from AWS S3 sources through Hive Metastore and Unity Catalog into Foundry datasets or products.
  • Configure Foundry Data Connection, datasets, syncs, projects, permissions and lineage as required.
  • Work with AWS teams to define IAM roles, S3 bucket policies, KMS permissions and approved cross account access patterns.
  • Troubleshoot Foundry connector failures, Databricks authentication issues, Unity Catalog grants, schema mismatches and query failures.
  • Technical Environment: Palantir Foundry, Foundry Virtual Tables, Ontology, Workshop, Pipeline Builder, Code Repositories, AWS, Databricks, Terraform, IaC, Delta Lake, Parquet, Iceberg, CSV, JSON, Python, PySpark, SQL, CI/CD, GitLab, GitHub Actions.

Key Skills:

  • Strong Palantir Foundry experience.
  • Experience with Databricks on AWS.
  • Knowledge of AWS services including IAM, S3, and KMS.
  • Understanding of Hive Metastore and Unity Catalog.
  • Proficiency in SQL, Python, and PySpark.
  • Experience with CI/CD tools like GitLab and GitHub Actions.
  • Ability to troubleshoot data integration issues.
  • Hands-on experience with data management tools and environments.

Salary (Rate): £600/day

City: London

Country: United Kingdom

Working Arrangements: hybrid

IR35 Status: inside IR35

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

Platform Engineer (Palantir Foundry)

London (Hybrid)

6 Month Contract

£600/day (Inside IR35)

Platform Engineer needed with strong Palantir Foundry and Databricks on AWS. Start ASAP in May/June 2026.

6 Month Rolling Contract based in London (Hybrid), with occasional travel to the Leeds office.

Hybrid Working - 3-4 days/week remote (WFH) + 1-2 days/week working from the office in London.

A chance to work with a leading global IT transformation business specialising in large-scale Government projects:

  • Configure + support secure integration between Palantir Foundry and Databricks on AWS.
  • Scope includes data held in S3, registered through Databricks Hive Metastore, governed or exposed through Unity Catalog, and consumed by Foundry using the Databricks connector or approved ingestion patterns.
  • Hands-on Palantir Foundry experience, including connectors, Data Connection, datasets, syncs, projects and permissions.
  • Experience configuring or supporting the Palantir Foundry Databricks connectors.
  • Strong Databricks on AWS experience, including SQL Warehouse, clusters, tables, views and access controls.
  • Good understanding of Hive Metastore and Unity Catalog, including catalogs, schemas, grants, storage credentials and external locations.
  • Strong AWS IAM, S3, KMS, bucket policy and cross-account access experience.
  • Set up and validate the Foundry Databricks connector for approved SQL Warehouses, tables, views and Unity Catalog-governed objects.
  • Support end-to-end access from AWS S3 sources through Hive Metastore and Unity Catalog into Foundry datasets or products.
  • Configure Foundry Data Connection, datasets, syncs, projects, permissions and lineage as required.
  • Work with AWS teams to define IAM roles, S3 bucket policies, KMS permissions and approved cross account access patterns.
  • Troubleshoot Foundry connector failures, Databricks authentication issues, Unity Catalog grants, schema mismatches and query failures.
  • Technical Environment: Palantir Foundry, Foundry Virtual Tables, Ontology, Workshop, Pipeline Builder, Code Repositories, AWS, Databricks, Terraform, IaC, Delta Lake, Parquet, Iceberg, CSV, JSON, Python, PySpark, SQL, CI/CD, GitLab, GitHub Actions.
Apply
Similar Jobs
Loading data...