Summary: The Azure Databricks Data Engineer role is a contract position focused on data engineering within Azure Databricks, requiring expertise in Spark programming and familiarity with data governance. The position is hybrid, allowing for remote work while being based in London, and is aimed at candidates with experience in capital markets or banking. The contract duration is between 6 to 12 months, with an immediate start date.

Key Responsibilities:

• Data Engineering in Azure Databricks, including Spark programming with Scala, Python, and SQL.
• Experience with Delta Lake and Databricks workflows.
• Data ingestion and ETL/ELT frameworks using Azure Data Lake.
• Data Governance, including Metadata, Data Quality, Lineage, and Data Access Models.
• Utilization of Unity Catalog or similar Data Governance Management components.
• Understanding of Data Modelling concepts, Data Products, and Data Domains.
• Experience with MS Purview or similar tools for Metadata and Data Quality.
• Experience in Capital Markets or Banking is desirable.
• Data Architecture experience is a bonus.

Key Skills:

• Proficiency in Azure Databricks and Spark programming (Scala, Python, SQL).
• Experience with Delta Lake and Databricks workflows.
• Familiarity with Azure Data Lake and ETL/ELT frameworks.
• Knowledge of Data Governance practices and tools.
• Experience with Unity Catalog or similar Data Governance Management components.
• Understanding of Data Modelling concepts and Data Domains.
• Experience with MS Purview or similar Metadata and Data Quality tools.
• Background in Capital Markets or Banking.
• Data Architecture experience is a plus.

Salary (Rate): 725

City: City of London

Country: UK

Working Arrangements: hybrid

IR35 Status: outside IR35

Seniority Level: undetermined

Industry: IT