Data Engineer

Data Engineer

Posted 5 days ago by William Alexander Recruitment Ltd

Negotiable
Outside
Hybrid
Greater London, UK

Summary: The role of Data Engineer involves designing and building a modern Azure-based Data Lakehouse environment for a global London market insurer. The position requires extensive experience in Azure technologies and a strong understanding of the Lloyd's insurance market. The successful candidate will play a crucial role in a high-profile transformation program aimed at modernizing the client's data ecosystem. This is an Outside IR35 contract requiring a quick start and a hybrid working arrangement.

Key Responsibilities:

  • Design and build a modern Azure-based Data Lakehouse environment.
  • Deliver tiered Lakehouse architectures in medallion architecture.
  • Build pipelines in Azure Data Factory and Databricks, and write robust, scalable Python code.
  • Utilize Delta Lake, Delta Live Tables, and Databricks Notebooks.
  • Build frameworks to track and manage data changes across systems.
  • Implement DevOps practices, including automation and YAML-based deployment pipelines.
  • Peer-review code and package Python Wheels for scalable delivery.
  • Leverage Lloyd's market or London Market insurance experience.

Key Skills:

  • Experience in Azure, Databricks, and SQL Server.
  • Hands-on experience with tiered Lakehouse architectures.
  • Proficiency in building pipelines in Azure Data Factory and Databricks.
  • Strong Python programming skills.
  • Familiarity with Delta Lake and Databricks Notebooks.
  • Understanding of DevOps practices and automation.
  • Experience in peer code review and packaging Python Wheels.
  • Knowledge of Lloyd's market or London Market insurance.

Salary (Rate): undetermined

City: Greater London

Country: UK

Working Arrangements: hybrid

IR35 Status: outside IR35

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

Data Engineer - Azure Lakehouse Build - Outside IR35 Contract

Our sister company Stellarmann is looking for a contract Data Engineer to help design and build a modern Azure-based Data Lakehouse environment. Stellarmann builds expert teams to deliver high-impact technology and change initiatives, in this case for a global London market insurer.

We're looking for an experienced Data Engineer with Lloyd's insurance market knowledge, hands-on Azure skills, and a strong track record delivering tiered data platforms. This is a key role on a high-profile transformation programme modernising the client's data ecosystem.

You'll be great for this role if:

  • You're a seasoned Data Engineer with experience in Azure, Databricks, and SQL Server
  • You've delivered tiered Lakehouse architectures in medallion architecture
  • You can build pipelines in Azure Data Factory and Databricks, and write robust, scalable Python code
  • You have experience with Delta Lake, Delta Live Tables, and Databricks Notebooks
  • You're confident building frameworks to track and manage data changes across systems
  • You understand DevOps practices, including automation and YAML-based deployment pipelines
  • You can peer-review code and package Python Wheels as part of a scalable delivery approach
  • You bring Lloyd's market or London Market insurance experience (essential)

This is an Outside IR35 contract, and it is essential the successful candidate can start within a 2-week notice period. The role requires 3 days per week onsite in London.

Data Engineer - Azure Lakehouse Build - Outside IR35 Contract