Summary: The Databricks Data Engineer role is a contract opportunity at a leading banking and financial services firm in London, focusing on designing and implementing data solutions using Databricks technology. The position requires expertise in handling complex financial datasets within a dynamic trading environment. The role offers a competitive day rate and the potential for contract extension, along with a hybrid working arrangement. Candidates will collaborate with industry experts in financial data management.

Key Responsibilities:

• Design, develop, and implement data solutions using Databricks technology.
• Work with complex financial datasets in a dynamic trading environment.
• Utilize Spark programming with Scala, Python, and SQL.
• Manage data ingestion and ETL/ELT frameworks using Azure Data Lake.
• Ensure data governance, including metadata management and data quality control.
• Implement data modeling concepts and manage data products and domains.
• Utilize Unity Catalog for data management.

Key Skills:

• Strong Data Engineering experience on the Databricks platform.
• Proficient in Spark programming using Scala, Python, and SQL.
• Experience with Delta Lake technology and Databricks workflows/jobs.
• Solid understanding of Azure Data Lake.
• Strong background in Data Governance.
• Understanding of Data Modelling concepts and Data Products.
• Experience with Unity Catalog.
• Knowledge of MS Purview or similar tools.
• Capital Markets or Banking industry knowledge.
• Data Architecture experience.

Salary (Rate): 600

City: London

Country: United Kingdom

Working Arrangements: hybrid

IR35 Status: outside IR35

Seniority Level: undetermined

Industry: Other