Negotiable
Outside
Hybrid
Greater London, UK
Summary: The role of Data Engineer involves designing and building a modern Azure-based Data Lakehouse environment for a global London market insurer. The position requires extensive experience in Azure technologies and a strong understanding of the Lloyd's insurance market. The successful candidate will play a crucial role in a high-profile transformation program aimed at modernizing the client's data ecosystem. This is an Outside IR35 contract requiring a quick start and a hybrid working arrangement.
Key Responsibilities:
- Design and build a modern Azure-based Data Lakehouse environment.
- Deliver tiered Lakehouse architectures in medallion architecture.
- Build pipelines in Azure Data Factory and Databricks, and write robust, scalable Python code.
- Utilize Delta Lake, Delta Live Tables, and Databricks Notebooks.
- Build frameworks to track and manage data changes across systems.
- Implement DevOps practices, including automation and YAML-based deployment pipelines.
- Peer-review code and package Python Wheels for scalable delivery.
- Leverage Lloyd's market or London Market insurance experience.
Key Skills:
- Experience in Azure, Databricks, and SQL Server.
- Hands-on experience with tiered Lakehouse architectures.
- Proficiency in building pipelines in Azure Data Factory and Databricks.
- Strong Python programming skills.
- Familiarity with Delta Lake and Databricks Notebooks.
- Understanding of DevOps practices and automation.
- Experience in peer code review and packaging Python Wheels.
- Knowledge of Lloyd's market or London Market insurance.
Salary (Rate): undetermined
City: Greater London
Country: UK
Working Arrangements: hybrid
IR35 Status: outside IR35
Seniority Level: undetermined
Industry: IT
Data Engineer - Azure Lakehouse Build - Outside IR35 Contract
Our sister company Stellarmann is looking for a contract Data Engineer to help design and build a modern Azure-based Data Lakehouse environment. Stellarmann builds expert teams to deliver high-impact technology and change initiatives, in this case for a global London market insurer.
We're looking for an experienced Data Engineer with Lloyd's insurance market knowledge, hands-on Azure skills, and a strong track record delivering tiered data platforms. This is a key role on a high-profile transformation programme modernising the client's data ecosystem.
You'll be great for this role if:
- You're a seasoned Data Engineer with experience in Azure, Databricks, and SQL Server
- You've delivered tiered Lakehouse architectures in medallion architecture
- You can build pipelines in Azure Data Factory and Databricks, and write robust, scalable Python code
- You have experience with Delta Lake, Delta Live Tables, and Databricks Notebooks
- You're confident building frameworks to track and manage data changes across systems
- You understand DevOps practices, including automation and YAML-based deployment pipelines
- You can peer-review code and package Python Wheels as part of a scalable delivery approach
- You bring Lloyd's market or London Market insurance experience (essential)
This is an Outside IR35 contract, and it is essential the successful candidate can start within a 2-week notice period. The role requires 3 days per week onsite in London.
Data Engineer - Azure Lakehouse Build - Outside IR35 Contract
