Azure Databricks Data Engineer - OUTSIDE IR35
Posted 1 day ago by 83Zero Ltd on JobServe
£550 Per day
Outside
Hybrid
City of London, UK
Summary: The role of a Databricks Data Engineer involves working on data engineering tasks within Databricks, specifically requiring expertise in Spark programming and familiarity with Azure Data Lake. The position demands immediate availability and emphasizes the necessity of experience in Capital Markets or Banking. The role is hybrid, requiring two days a week in London.
Key Responsibilities:
- Data Engineering in Databricks, including Spark programming with Scala, Python, and SQL.
- Experience with Delta Lake and Databricks workflows.
- Data ingestion and ETL/ELT frameworks using Azure Data Lake.
- Data Governance, including Metadata, Data Quality, Lineage, and Data Access Models.
- Understanding of Data Modelling concepts, Data Products, and Data Domains.
- Experience with Unity Catalog or similar Data Governance Management components.
- Experience with MS Purview or similar tools for Metadata and Data Quality.
- Data Architecture experience is a bonus.
- Ownership and ability to drive implementation and solution design.
Key Skills:
- Data Engineering in Databricks.
- Spark programming with Scala, Python, SQL.
- Experience with Delta Lake.
- Familiarity with Azure Data Lake.
- Data Governance experience.
- Understanding of Data Modelling concepts.
- Experience with Unity Catalog or similar components.
- Experience with MS Purview or similar tools.
- Data Architecture experience.
- Strong Python, Scala, Databricks Spark, and Pyspark skills.
- Ability to drive implementation and solution design.
Salary (Rate): £550
City: City of London
Country: UK
Working Arrangements: hybrid
IR35 Status: outside IR35
Seniority Level: undetermined
Industry: IT