Summary: We are looking for a Senior Data Engineer with over 10 years of experience, specializing in Azure Data Factory, Data Lake, Snowflake, Python, and Databricks. The role involves designing and maintaining data pipelines, ensuring data quality, and providing mentorship to junior engineers. The candidate will work on projects related to Energy Trading and Risk Management, integrating data solutions with trading systems. Strong hands-on experience in Python and related technologies is essential.

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines and systems.
• Implement data ingestion processes from various source systems using ADF pipelines and ODATA adapters.
• Work with Azure Data Factory, Data Lake, Snowflake, Python, and Databricks to build and optimize data solutions.
• Collaborate with cross-functional teams to understand data requirements and deliver solutions.
• Ensure data quality and integrity across all data pipelines and systems.
• Provide technical leadership and mentorship to junior data engineers.
• Work on projects within the Energy Trading and Risk Management (ETRM) domain.
• Integrate data solutions with trading systems such as Allegro, RightAngle, and Endur.

Key Skills:

• Azure Data Factory (ADF)
• Data Lake
• Snowflake
• Python
• Databricks
• Experience with data ingestion using ODATA adapters and ADF pipelines
• Experience in the ETRM domain
• Hands-on experience in Python and PyTest
• Experience with Azure Services and Azure Datalake
• Experience with Fast APIs

Salary (Rate): undetermined

City: London

Country: UK

Working Arrangements: undetermined

IR35 Status: undetermined

Seniority Level: Senior

Industry: IT