Senior Data Engineer

Senior Data Engineer

Posted Today by Jobserve

Apply
£575 Per day
Outside
Remote
United Kingdom
Apply
Airflow Apache Airflow Apache Hadoop Apache Spark Azure Databricks Continuous Integration and Continuous Delivery Databricks Data Engineering Data Pipeline Github Microsoft Azure Python (Programming Language) SQL (Programming Language) Version Control Workflows

Summary: We are looking for three Senior Data Engineers to support a Databricks Platform Buildout project, which involves reviewing and preparing the group-level Databricks platform for replication across country-level platforms. The role requires hands-on experience with Databricks and participation in the rollout and replication phases. Candidates should have a strong background in data engineering and consulting, with specific expertise in relevant technologies. This position is fully remote and classified as outside IR35.

Key Responsibilities:

  • Review group-level Databricks platform foundations for readiness.
  • Participate in the rollout and replication phase across country-level platforms.
  • Deliver projects with hands-on experience in Databricks.
  • Collaborate with teams to ensure successful implementation of data solutions.

Key Skills:

  • 4+ Years Data Engineering Experience.
  • 5+ years of consulting experience.
  • Minimum 2-3 projects delivered with hands-on experience in Databricks.
  • Experience in Spark and/or Hadoop.
  • Familiarity with Databricks multi-hop pipeline architecture.
  • Strong Databricks knowledge (PySpark, SQL, Delta Lake, Unity Catalog).
  • Proficiency in Python and SQL.
  • Experience with ETL/ELT development and data pipeline orchestration.
  • Knowledge of Github for version control.
  • Experience with CI/CD tools (Azure DevOps/Terraform/Bicep).

Salary (Rate): £575 daily

City: undetermined

Country: United Kingdom

Working Arrangements: remote

IR35 Status: outside IR35

Seniority Level: Senior

Industry: IT

Detailed Description From Employer:

Databricks Platform Buildout

Senior Data Engineer

Outside IR35

Fully Remote

£500 - £575 per day

Overview & Objective

We are seeking 3x Senior Data Engineers for a Databricks Platform Buildout

project which is part of a bigger engagement.

The main project focus is to review the group-level Databricks platform foundations to confirm readiness for replication and then rollout across country-level platforms. These Engineers will participate in the rollout and replication phase.

Requirements

  • 4+ Years Data Engineering Experience,
  • 5+ years of consulting experience
  • Minimum 2-3 projects delivered with hands-on experience in Databricks
  • Experience in Spark and/or Hadoop,
  • Familiarity with Databricks multi-hop pipeline architecture

Technical Stack and Required Capabilities

  • Python, SQL
  • Strong Databricks knowledge (PySpark, SQL, Delta Lake, Unity Catalog)
  • Azure
  • ETL/ELT development and data pipeline orchestration (eg, Databricks Workflows, DLT, Airflow, ADF, Glue, and Step Functions.)
  • Github (creating branches, pull requests, reviewing PRs, solving merge conflicts)
  • Apache Spark
  • CI/CD (Azure DevOps/Terraform/Bicep
Apply
Similar Jobs
Loading data...