
SC Cleared Azure Data Engineer - Contract Opportunity (Databricks Focus) - SC Government -
Posted 3 days ago by Empiric Solutions
£550 Per day
Outside
Hybrid
Remote/London, UK
Summary: The role is for an Azure Data Engineer with a strong focus on Databricks, aimed at supporting a new project in data analytics and AI. The position requires active SC clearance and involves designing and building data pipelines, collaborating with stakeholders, and mentoring junior engineers. The contract is initially for three months with a strong likelihood of extension. The working arrangement is hybrid, requiring one day a week onsite in London.
Key Responsibilities:
- Designing and building robust, end-to-end data pipelines using Azure Databricks, including Delta Live Tables
- Collaborating with stakeholders to define requirements and shape Databricks-based architecture
- Championing best practices in data engineering and scalable solution design
- Supporting clients in leveraging data science, machine learning, and Real Time processing on Azure
- Mentoring junior engineers and taking ownership of key solution components
- Contributing to sprint planning, estimating work, and refining technical requirements
Key Skills:
- Solid experience in Azure Data Engineering with Databricks as a core component
- Deep hands-on knowledge of Delta Lake, Delta Live Tables, and Databricks Workflows
- Strong Python and SQL skills - comfortable writing clean, modular, reusable code
- Strong understanding of lakehouse architecture, and Real Time/streaming data solutions
- Familiar with complementary tools like Azure Data Factory, Synapse Analytics, and Microsoft Fabric
- Comfortable working with CI/CD pipelines (ideally using Azure DevOps)
- Bonus points if you're exploring how AI can boost deployment and platform efficiency
- Excellent communication skills and team collaboration
- Nice to have: Databricks and/or Azure Data Engineer certifications
Salary (Rate): £550/day
City: London
Country: UK
Working Arrangements: hybrid
IR35 Status: outside IR35
Seniority Level: undetermined
Industry: IT
Key Details:
Location: Hybrid (1 day/week onsite in London)
Rate: £500-£550/day (Outside IR35)
Start Date: Mid to End of July
Duration: 3 months initially - with strong likelihood of extension (up to 9 months)
Clearance Required: Active SC Clearance
I'm currently supporting an exciting opportunity for an Azure Data Engineer with strong Databricks experience to join a new project at the cutting edge of data analytics and AI. This is a fantastic chance to work alongside a highly skilled team delivering scalable, enterprise-grade solutions in the Azure ecosystem.
What you'll be doing:
-
Designing and building robust, end-to-end data pipelines using Azure Databricks, including Delta Live Tables
-
Collaborating with stakeholders to define requirements and shape Databricks-based architecture
-
Championing best practices in data engineering and scalable solution design
-
Supporting clients in leveraging data science, machine learning, and Real Time processing on Azure
-
Mentoring junior engineers and taking ownership of key solution components
-
Contributing to sprint planning, estimating work, and refining technical requirements
What we're looking for:
-
Solid experience in Azure Data Engineering with Databricks as a core component
-
Deep hands-on knowledge of Delta Lake, Delta Live Tables, and Databricks Workflows
-
Strong Python and SQL skills - comfortable writing clean, modular, reusable code
-
Strong understanding of lakehouse architecture, and Real Time/streaming data solutions
-
Familiar with complementary tools like Azure Data Factory, Synapse Analytics, and Microsoft Fabric
-
Comfortable working with CI/CD pipelines (ideally using Azure DevOps)
-
Bonus points if you're exploring how AI can boost deployment and platform efficiency
-
Excellent communication skills and team collaboration
-
Nice to have: Databricks and/or Azure Data Engineer certifications
Please Reach out via the platform below: