Summary: The role of Senior Data Engineer involves working on data engineering projects for a duration of three months, starting in January. Candidates are expected to have extensive experience with Databricks, Python, Pyspark, Deltalake, SQL, and ADF, and to have contributed to the creation and configuration of data engineering frameworks. The position requires security clearance and is based in the UK, specifically in locations such as London, Manchester, or the Midlands.

Key Responsibilities:

• Develop and maintain data pipelines following best practices and standards.
• Utilize Azure Data Factory and Databricks for data pipeline automation and configuration.
• Ensure quality checks and reporting are integrated into data pipelines.
• Create operational handover documents and engage with end users for feedback.
• Deploy data assets after thorough testing and obtain sign-off from stakeholders.

Key Skills:

• 5+ years of data engineering experience.
• Proficient in building data products using Microsoft Azure, Azure Data Factory, and Databricks.
• Strong knowledge of data management and data quality management.
• Experience with Azure SQL.
• Security clearance required.

Salary (Rate): 525

City: Manchester

Country: United Kingdom

Working Arrangements: undetermined

IR35 Status: inside IR35

Seniority Level: Senior

Industry: IT