All Jobs Vacancy

Senior Azure Data Engineer - ADF/Databricks/Python

Posted 2 days ago by Strike IT Services

We are looking for a hands-on Azure Data Engineer to join a data engineering project within the Energy Trading/Commodities sector. This role would suit someone with approximately 6-8 years of relevant professional experience who enjoys building pipelines and developing data solutions.

Hybrid - 3 days at the office in London

The Role

  • Build and maintain data pipelines using Azure Data Factory (ADF), Databricks and Azure Data Lake Storage (ADLS).
  • Develop data ingestion, transformation and processing solutions using Python and SQL.
  • Design and build streaming data pipelines, supporting reliable and timely data processing.
  • Investigate and resolve pipeline failures, data quality issues and performance bottlenecks.
  • Work with business analysts, engineers and architects to translate requirements into practical data solutions.
  • Apply sound engineering practices, including testing, documentation and reusable development patterns.

Key Skills & Experience

  • Approximately 6-8 years of relevant professional experience, with a strong focus on hands-on data engineering.
  • Practical experience across the Azure data engineering stack, particularly ADF, Databricks and ADLS.
  • Strong hands-on development skills in Python and SQL.
  • Proven experience building streaming data pipelines.
  • Experience developing and supporting data ingestion and transformation processes.
  • Strong problem-solving skills and the ability to work collaboratively within a delivery team.

Desirable

  • Experience with Microsoft Power Platform, including Power BI and/or Power Apps.
  • Previous experience within energy, commodities or trading environments.
  • Exposure to Openlink Endur and its trading data.
  • Knowledge of LNG trading processes.
Rate:
Not specified
Location:
London
IR35 Status:
Not specified
Remote Status:
Hybrid
Industry:
Data & Analytics
Seniority Level:
Senior

Take-Home Pay

Not Available

Visit calculators for additional details

Share job