Azure Databricks Data Engineer (Contract OUTSIDE IR35)
Posted 5 days ago by 83zero Ltd on CVLibrary
£550 Per day
Outside
Hybrid
City of London, London
Summary: The role is for a Databricks Data Engineer on a contract basis, requiring immediate availability. Candidates must possess experience in Capital Markets or Banking, with a strong focus on data engineering using Databricks and related technologies. The position allows for hybrid working, with two days a week in London.
Key Responsibilities:
- Data Engineering in Databricks, including Spark programming with Scala, Python, and SQL.
- Experience with Delta Lake and Databricks workflows and jobs.
- Data ingestion and ETL/ELT frameworks using Azure Data Lake.
- Data Governance experience, including Metadata, Data Quality, Lineage, and Data Access Models.
- Understanding of Data Modelling concepts, Data Products, and Data Domains.
- Experience with Unity Catalog or similar Data Governance Management components.
- Familiarity with MS Purview and other data quality tools like Collibra and Informatica.
- Data Architecture experience is a bonus.
- Ownership and ability to drive implementation and solution design.
Key Skills:
- Data Engineering expertise in Databricks, Spark, Scala, Python, and SQL.
- Experience with Delta Lake and Azure Data Lake.
- Knowledge of Data Governance and Data Quality tools.
- Understanding of Data Modelling and Data Architecture.
- Ability to drive implementation and solution design.
- Familiarity with Unity Catalog and MS Purview.
Salary (Rate): £550
City: London
Country: United Kingdom
Working Arrangements: hybrid
IR35 Status: outside IR35
Seniority Level: Mid-Level
Industry: IT