Azure Databricks Data Engineer - OUTSIDE IR35
Posted 1 day ago by 83zero Ltd on CVLibrary
£550 Per day
Outside
Hybrid
City of London, London
Summary: The role of Azure Databricks Data Engineer involves working on data engineering tasks within Databricks, requiring expertise in Spark programming and familiarity with data governance and architecture. The position is contract-based with an immediate start and necessitates experience in capital markets or banking. The role allows for hybrid working, with two days a week in London.
Key Responsibilities:
- Data engineering in Databricks using Spark programming with Scala, Python, and SQL.
- Experience with Delta Lake and Databricks workflows and jobs.
- Data ingestion and ETL/ELT frameworks familiarity, particularly with Azure Data Lake.
- Data governance experience, including metadata, data quality, lineage, and data access models.
- Understanding of data modeling concepts, data products, and data domains.
- Experience with Unity Catalog or similar data governance management components.
- Bonus experience with MS Purview or similar tools like Collibra and Informatica Data Quality.
- Ability to drive implementation and solution design.
Key Skills:
- Data engineering expertise in Databricks.
- Proficiency in Spark programming with Scala, Python, and SQL.
- Experience with Delta Lake and data governance practices.
- Familiarity with Azure Data Lake and ETL/ELT frameworks.
- Understanding of data modeling concepts and data domains.
- Experience with Unity Catalog or similar data governance tools.
- Knowledge of MS Purview or similar metadata and data quality tools.
- Strong ownership and solution design capabilities.
Salary (Rate): £550
City: London
Country: United Kingdom
Working Arrangements: hybrid
IR35 Status: outside IR35
Seniority Level: Mid-Level
Industry: IT