Summary: The role of a Databricks Data Engineer focuses on delivering impactful projects within the Capital Markets or Banking sectors. Candidates will leverage their expertise in data engineering, particularly with Databricks and related technologies, to enhance data modeling and governance. The position is contract-based, offering a dynamic work environment and the opportunity to work with advanced data solutions.

Key Responsibilities:

• Develop and implement data engineering solutions using Databricks, Spark, Scala, Python, and SQL.
• Manage Delta Lake Databricks workflows and jobs.
• Handle data ingestion and ETL/ELT processes within Azure Data Lake.
• Ensure data governance through metadata management, data quality, and lineage tracking.
• Apply data modeling concepts to create effective data products and domains.
• Utilize Unity Catalog or similar data governance management tools.
• Contribute to data architecture discussions and implementations.

Key Skills:

• Proficiency in Databricks, Spark programming, Scala, Python, and SQL.
• Experience with Delta Lake and Databricks workflows.
• Familiarity with Azure Data Lake and ETL/ELT frameworks.
• Knowledge of data governance practices, including metadata, data quality, and lineage.
• Understanding of data modeling concepts and data products.
• Experience with Unity Catalog or similar data governance tools (e.g., MS Purview, Collibra, Informatica).
• Background in Capital Markets or Banking is preferred.
• Data architecture experience is a plus.

Salary (Rate): 750

City: London

Country: United Kingdom

Working Arrangements: hybrid

IR35 Status: outside IR35

Seniority Level: undetermined

Industry: IT