Senior Data Engineer
Posted 1 day ago by IO Associates
£650 Per day
Outside
Onsite
England, UK
Summary: We are seeking a Senior Databricks Engineer to join a growing team, focusing on modern data platforms and analytics capabilities. This role involves leading data engineering projects and requires onsite presence once a month. The position is classified as outside IR35. Candidates must hold ACTIVE clearance to be eligible for this role.
Key Responsibilities:
- Lead end-to-end data engineering projects, turning business requirements into robust technical solutions.
- Design and build scalable data pipelines using modern cloud and big data technologies.
- Work closely with clients and internal teams to refine data strategies and deliver best-practice solutions.
- Establish and promote data governance, quality, and resilience standards.
- Build modern data architectures using Azure, Spark, Python, SQL, and orchestration tools.
- Drive successful delivery through Agile practices and strong SDLC discipline.
- Mentor junior engineers and contribute to internal knowledge-sharing.
Key Skills:
- Deep experience with cloud data platforms, especially Microsoft Azure.
- Strong skills in Python, SQL, and Spark/Databricks.
- Ability to design complex queries and optimise performance.
- Knowledge of governance and orchestration tools such as Azure Data Factory, Unity Catalog, Terraform.
- Solid understanding of Agile delivery, CI/CD, and data quality frameworks.
- Background in client-facing consulting.
Salary (Rate): £650 daily
City: undetermined
Country: UK
Working Arrangements: on-site
IR35 Status: outside IR35
Seniority Level: Senior
Industry: IT
We are looking for a Senior Databricks Engineer(s) to join Our Client's growing team. You'll play a key part in shaping modern data platforms, driving analytics capabilities, and leading high-value projects. This role is outside IR35 and requires onsite presence once a month to my clients site.
Key Responsibilities- Lead end-to-end data engineering projects, turning business requirements into robust technical solutions.
- Design and build scalable data pipelines using modern cloud and big data technologies.
- Work closely with clients and internal teams to refine data strategies and deliver best-practice solutions.
- Establish and promote data governance, quality, and resilience standards.
- Build modern data architectures using Azure, Spark, Python, SQL, and orchestration tools.
- Drive successful delivery through Agile practices and strong SDLC discipline.
- Mentor junior engineers and contribute to internal knowledge-sharing.
Essential Skills & Experience
- Deep experience with cloud data platforms, especially Microsoft Azure.
- Strong skills in Python, SQL, and Spark/Databricks.
- Ability to design complex queries and optimise performance.
- Knowledge of governance and orchestration tools such as Azure Data Factory, Unity Catalog, Terraform.
- Solid understanding of Agile delivery, CI/CD, and data quality frameworks.
- Background in client-facing consulting.
Desirable Skills & Experience
- Experience with Power BI, Tableau, or other visualisation tools.
- Exposure to streaming technologies such as Azure Stream Analytics, Event Hubs, IoT Hubs.
- Ability to build distributed or serverless systems using Azure Functions (Python or C#).
- Engagement in industry events, conferences, or community initiatives.
If you're a data engineer who has a proven track record it a collaborative, forward-thinking environment and wants to work on meaningful, technically challenging projects, we'd love to hear from you. You must hold ACTIVE clearance to be elgible for this role.
