Azure Databricks Engineer

Summary: We're looking for a Contract Data Engineer with expertise in Databricks and cloud data platforms to support a significant data transformation initiative. This hybrid role requires two days a week on-site in Manchester, with the rest of the work being remote. The successful candidate will be part of a dynamic data team focused on building and optimizing scalable data pipelines. Key responsibilities include designing ETL/ELT pipelines and collaborating with various stakeholders to ensure data quality and accessibility.

Key Responsibilities:

• Design and implement robust, scalable ETL/ELT pipelines using Databricks and Apache Spark
• Ingest, transform, and manage large volumes of data from diverse sources
• Collaborate with analysts, data scientists, and business stakeholders to deliver clean, accessible datasets
• Ensure high performance and reliability of data pipelines and warehouse structures
• Apply data governance, security, and quality best practices
• Work with cloud-native tools and services (preferably Azure)

Key Skills:

• Proven experience as a Data Engineer on cloud-based projects
• Strong hands-on skills with Databricks, Apache Spark, and Python or Scala
• Proficient in SQL and working with large-scale data environments
• Experience with Delta Lake, Azure Data Lake, or similar technologies
• Familiarity with version control, CI/CD, and infrastructure-as-code tools
• Ability to deliver independently in a contractor capacity and meet tight deadlines

Salary (Rate): £500 daily

City: Manchester

Country: United Kingdom

Working Arrangements: hybrid

IR35 Status: outside IR35

Seniority Level: Mid-Level

Industry: IT

Detailed Description From Employer:

Data Engineer- Outside Ir35 - £500 daily rate- Manchester - 6 Month

Role Overview:
We're seeking an experienced Contract Data Engineer with a strong background in Databricks and cloud data platforms to support a high-impact data transformation programme. This hybrid role requires 2 days per week onsite in our Manchester office (non-negotiable), with the remainder remote.

You'll join a fast-paced, delivery-focused data team responsible for building and optimising scalable, production-grade data pipelines and infrastructure.

Key Responsibilities:

• Design and implement robust, scalable ETL/ELT pipelines using Databricks and Apache Spark
• Ingest, transform, and manage large volumes of data from diverse sources
• Collaborate with analysts, data scientists, and business stakeholders to deliver clean, accessible datasets
• Ensure high performance and reliability of data pipelines and warehouse structures
• Apply data governance, security, and quality best practices
• Work with cloud-native tools and services (preferably Azure)

Required Skills & Experience:

• Proven experience as a Data Engineer on cloud-based projects
• Strong hands-on skills with Databricks, Apache Spark, and Python or Scala
• Proficient in SQL and working with large-scale data environments
• Experience with Delta Lake, Azure Data Lake, or similar technologies
• Familiarity with version control, CI/CD, and infrastructure-as-code tools
• Ability to deliver independently in a contractor capacity and meet tight deadlines
  

Data Engineer- Outside Ir35 - rate £500 day rate- Manchester - 6 Month