Responsibilities
- Design, build, and optimise end-to-end data pipelines using Azure Databricks, including Delta Live Tables.
- Collaborate with stakeholders to define technical requirements and propose Databricks-based solutions.
- Drive best practices for data engineering.
- Help clients realise the potential of data science, machine learning, and scaled data processing within Azure / Databricks ecosystem.
- Mentor junior engineers and support their personal development.
- Take ownership for the delivery of core solution components.
- Support with planning, requirements refinements, and work estimation.
Skills & Experiences
- Proven experience designing and implementing data solutions in Azure using Databricks as a core platform.
- Hands-on expertise in Delta Lake, Delta Live Tables and Databricks Workflows.
- Strong coding skills in Python and SQL, with experience in developing modular, reusable code in Databricks.
- Deep understanding of lakehouse architecture, with a solid grasp of data warehousing, data lakes, and real-time data processing.
- Familiar with Azure Data Factory, Azure Synapse Analytics, and Microsoft Fabric.
- Good experience with CI/CD practices and tools for data platforms using Azure DevOps.
- Good knowledge on how to leverage AI to increase deployment productivity and quality.
- Excellent communication skills.
- Desirable: certification in Databricks Data Engineer and/or Azure Data Engineer are a plus.
Additional Information:
- Rate offered: £500-550 per day
- IR35 Status: Outside
- Location: Hybrid working, North England
- Start date: October
- Duration: 6 months initial sign up, significant opportunity for extension
- Required: Active SC Clearance
Rate:
£550/day
Location:
United Kingdom
IR35 Status:
Outside
Remote Status:
Hybrid
Industry:
Data & Analytics
Seniority Level:
Not Specified