Data Engineer

Data Engineer

Posted Today by Identify Solutions

Apply
£59 Per hour
Outside
Remote
United Kingdom
Apply
Agile Methodology Apache Spark Application Programming Interface (API) Azure Databricks Cloud Computing Cloud Technology Continuous Integration and Continuous Delivery Databricks Data Engineering Data Governance Data Processing Microsoft Azure Pyspark Python (Programming Language) SQL (Programming Language) Stakeholder Engagement Stakeholder Management Version Control Workflows

Summary: My market leading client is seeking a contract-based Data Engineer to support critical project work over the next three months. The ideal candidate will have a consultancy background and extensive experience in secure and regulated environments, particularly within the public sector. The role involves designing and maintaining scalable data pipelines and contributing to Lakehouse architecture using Azure Databricks. Strong stakeholder engagement and collaboration are essential for success in this position.

Key Responsibilities:

  • Strong stakeholder engagement and collaboration.
  • Design, build and maintain scalable data pipelines.
  • Develop using Azure Databricks (PySpark, Spark SQL, Python).
  • Contribute to Lakehouse architecture (Delta Lake patterns, Databricks capabilities).
  • Build and manage workflows (Databricks Workflows, Delta Live Tables).
  • Implement data governance (Unity Catalog – access, discovery, control).
  • Support analytics/reporting using Databricks SQL.
  • Ingest and transform API, structured, semi-structured and geospatial data.
  • Write clean, testable, maintainable code.
  • Contribute to agile delivery (ceremonies, peer reviews, planning).

Key Skills:

  • Strong Data Engineering experience with Azure Databricks.
  • Proven delivery of production-grade data pipelines.
  • Strong Python, SQL, PySpark and Spark SQL capability.
  • Experience with Lakehouse / modern data platform design.
  • Hands-on with Databricks tools (Unity Catalog, Workflows, Delta Live Tables, Databricks SQL).
  • Data ingestion from APIs and external sources.
  • Geospatial data processing experience (real-world use cases).
  • Experience with geospatial formats (Shapefile, GeoParquet, GeoPackage, GeoTIFF).
  • Knowledge of Apache Sedona or similar frameworks.
  • Understanding of data modelling, quality, monitoring and optimisation.
  • Experience with version control, CI/CD and cloud environments.
  • Strong analytical and problem-solving skills.

Salary (Rate): £58.75/hr

City: undetermined

Country: United Kingdom

Working Arrangements: remote

IR35 Status: outside IR35

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

Data Engineer

Duration : 3 Months

Location : Remote

Rate : £450 - £470 per day DOE

Status : OUTSIDE IR35

Clearance : Eligible for SC

Start Date: ASAP

Summary: My market leading client are looking to secure the services of a contract based Data Engineer to assist with critical project work over the coming months. Ideally coming from a consultancy background with extensive experience working in secure and regulated environments. Experience and knowledge of working in a public sector environment is essential.

Key Responsibilities

  • Strong stakeholder engagement and collaboration.
  • Design, build and maintain scalable data pipelines.
  • Develop using Azure Databricks (PySpark, Spark SQL, Python).
  • Contribute to Lakehouse architecture (Delta Lake patterns, Databricks capabilities).
  • Build and manage workflows (Databricks Workflows, Delta Live Tables).
  • Implement data governance (Unity Catalog – access, discovery, control).
  • Support analytics/reporting using Databricks SQL.
  • Ingest and transform API, structured, semi-structured and geospatial data.
  • Write clean, testable, maintainable code.
  • Contribute to agile delivery (ceremonies, peer reviews, planning).

Key Skills & Experience

  • Strong Data Engineering experience with Azure Databricks.
  • Proven delivery of production-grade data pipelines.
  • Strong Python, SQL, PySpark and Spark SQL capability.
  • Experience with Lakehouse / modern data platform design.
  • Hands-on with Databricks tools (Unity Catalog, Workflows, Delta Live Tables, Databricks SQL).
  • Data ingestion from APIs and external sources.
  • Geospatial data processing experience (real-world use cases).
  • Experience with geospatial formats (Shapefile, GeoParquet, GeoPackage, GeoTIFF).
  • Knowledge of Apache Sedona or similar frameworks.
  • Understanding of data modelling, quality, monitoring and optimisation.
  • Experience with version control, CI/CD and cloud environments.
  • Strong analytical and problem-solving skills.

If you’d like more information on the assignment, please drop me an email Adam.Rees@IdentifySolutions.co.uk – or give me a call on 07400 28 3333.

Apply
Similar Jobs
Loading data...