Senior Data Engineer
Posted 2 weeks ago by eTeam Workforce Limited
Negotiable
Inside
Hybrid
London
Summary: The role of Senior Data Engineer involves building and maintaining data pipelines using Informatica and Azure Databricks, while also designing and optimizing data lake models. The position requires collaboration with various teams to deliver robust data solutions and implement data quality frameworks. This is a hybrid role based in London, with a contract duration of 9-12 months and classified as inside IR35.
Key Responsibilities:
- Build and maintain data pipelines using Informatica and Azure Databricks (Spark/Delta Lake).
- Design and optimize data lake/lakehouse models, ensuring performance, reliability, and governance.
- Enable BI consumption by preparing clean, curated datasets for Power BI and SAP BO.
- Implement data quality rules, monitoring, and exception handling frameworks.
- Collaborate with business, analytics, and technology teams to understand requirements and deliver robust data solutions.
- Apply DevOps practices including Git, CI/CD, and automated testing for data pipelines.
- Support creation of lightweight workflow/ops tools using Power Apps (nice to have).
Key Skills:
- 7+ years of experience in data engineering within enterprise environments.
- Strong hands-on experience with Informatica ETL, Azure Databricks, Spark, Delta Lake, and Azure data services.
- Proficiency in SQL and Python (or Scala).
- Experience preparing data models and datasets for Power BI and/or SAP BO.
- Practical understanding of data quality frameworks, metadata, and lineage.
- Strong problem-solving, documentation, and stakeholder communication skills.
Salary (Rate): undetermined
City: London
Country: UK
Working Arrangements: hybrid
IR35 Status: inside IR35
Seniority Level: undetermined
Industry: IT
Job Description:
We are a Global Recruitment specialist that provides support to the clients across EMEA, APAC, US and Canada. We have an excellent job opportunity for you.
Role: Senior Data Engineer
Location: London
Working Mode: Hybrid (3 days a week from the office, 4 days in the future)
Contract Type: Inside IR35
Duration: 9-12 months
Pay Rate: Market Rate
Key Responsibilities:
-Build and maintain data pipelines using Informatica and Azure Databricks (Spark/Delta Lake).
-Design and optimize data lake/lakehouse models, ensuring performance, reliability, and governance.
-Enable BI consumption by preparing clean, curated datasets for Power BI and SAP BO.
-Implement data quality rules, monitoring, and exception handling frameworks.
-Collaborate with business, analytics, and technology teams to understand requirements and deliver robust data solutions.
-Apply DevOps practices including Git, CI/CD, and automated testing for data pipelines.
-Support creation of lightweight workflow/ops tools using Power Apps (nice to have).
Required Skills:
-7+ years of experience in data engineering within enterprise environments.
-Strong hands-on experience with Informatica ETL, Azure Databricks, Spark, Delta Lake, and Azure data services.
-Proficiency in SQL and Python (or Scala).
-Experience preparing data models and datasets for Power BI and/or SAP BO.
-Practical understanding of data quality frameworks, metadata, and lineage.
-Strong problem-solving, documentation, and stakeholder communication skills.
If you are interested in this position and would like to learn more, please send through your CV and we will get in touch with you as soon as possible. Please note, candidates are often Shortlisted within 48 hours.