Senior Data Engineer

Senior Data Engineer

Posted 3 days ago by X4 Technology

£60 Per hour
Outside
Hybrid
London Area, United Kingdom

Summary: The Senior Data Engineer role involves designing, building, and maintaining scalable data pipelines and models within Microsoft Fabric, with a focus on migrating from Azure Synapse. The position requires strong technical expertise in data integration, ETL workflows, and Power BI, along with mentoring business users. The role is based on-site in either London or Birmingham for three days a week and is outside IR35. The contract is for a duration of six months.

Key Responsibilities:

  • Design, build, and maintain scalable data pipelines and data models within Microsoft Fabric.
  • Lead the migration from Azure Synapse to Microsoft Fabric using a Medallion architecture approach.
  • Integrate internal systems and third-party data sources into the Fabric platform using APIs.
  • Develop, optimise, and automate ETL workflows ensuring high standards for data quality.
  • Deliver and govern Power BI dashboards and reports while mentoring business users.

Key Skills:

  • Strong hands-on experience with Microsoft Fabric, Azure Data Lake, Azure Synapse, and Power BI.
  • Advanced SQL expertise and experience with PySpark, Python, and Spark SQL.
  • Proven track record in designing and optimising ETL pipelines and integrating data sources.
  • Experience with workflow automation tools such as Power Automate and Power Apps.
  • Domain knowledge in Wealth Management and familiarity with financial planning processes.

Salary (Rate): £60.00/hr

City: London

Country: United Kingdom

Working Arrangements: hybrid

IR35 Status: outside IR35

Seniority Level: Senior

Industry: IT

Detailed Description From Employer:

Job Title: Senior Data Engineer

Day Rate: £400-450/day (Outside IR35)

Location: 3 days per week on-site in either London or Birmingham

Contract Length: 6 months

Senior Data Engineer - Role & Responsibilities

  • Design, build, and maintain scalable data pipelines and data models within Microsoft Fabric, supporting enterprise analytics and reporting needs.
  • Lead the migration from Azure Synapse to Microsoft Fabric using a Medallion architecture approach, while ensuring stability of existing Azure and SQL Server environments.
  • Integrate internal systems and third-party data sources into the Fabric platform using APIs and robust data integration patterns.
  • Develop, optimise, and automate ETL workflows, ensuring high standards for data quality, validation, and performance.
  • Deliver and govern Power BI dashboards and reports, while mentoring and upskilling business users to build a self-service analytics capability.

Senior Data Engineer - Required Experience

  • Strong hands-on experience with Microsoft Fabric, Azure Data Lake, Azure Synapse, and Power BI in a production environment.
  • Advanced SQL expertise and solid experience with PySpark, Python, and Spark SQL for large-scale data processing and transformation.
  • Proven track record in designing and optimising ETL pipelines and integrating multiple data sources, including API-based ingestion.
  • Experience with workflow automation tools such as Power Automate and Power Apps, plus exposure to AI/ML tools for predictive analytics.
  • Ideally, domain knowledge in Wealth Management, including familiarity with financial planning processes and regulatory frameworks (e.g., Consumer Duty, SMCR, MiFID).

Interviews: April 2026

Start Date: April 2026

How to Apply: Apply to Gary Hargreaves at X4 Technology to learn more about the role or connect with me on LinkedIn to hear about regular job updates available with X4 Technology