We are looking for a hands-on Azure Data Engineer to join a data engineering project within the Energy Trading/Commodities sector. This role would suit someone with approximately 6-8 years of relevant professional experience who enjoys building pipelines and developing data solutions.
Hybrid - 3 days at the office in London
The Role
- Build and maintain data pipelines using Azure Data Factory (ADF), Databricks and Azure Data Lake Storage (ADLS).
- Develop data ingestion, transformation and processing solutions using Python and SQL.
- Design and build streaming data pipelines, supporting reliable and timely data processing.
- Investigate and resolve pipeline failures, data quality issues and performance bottlenecks.
- Work with business analysts, engineers and architects to translate requirements into practical data solutions.
- Apply sound engineering practices, including testing, documentation and reusable development patterns.
Key Skills & Experience
- Approximately 6-8 years of relevant professional experience, with a strong focus on hands-on data engineering.
- Practical experience across the Azure data engineering stack, particularly ADF, Databricks and ADLS.
- Strong hands-on development skills in Python and SQL.
- Proven experience building streaming data pipelines.
- Experience developing and supporting data ingestion and transformation processes.
- Strong problem-solving skills and the ability to work collaboratively within a delivery team.
Desirable
- Experience with Microsoft Power Platform, including Power BI and/or Power Apps.
- Previous experience within energy, commodities or trading environments.
- Exposure to Openlink Endur and its trading data.
- Knowledge of LNG trading processes.