Summary: The role of Azure Data Engineer involves designing, building, and maintaining scalable data pipelines on the Azure platform for a high-impact data transformation programme in Central London. The position is a 6-month contract with a strong likelihood of extension, requiring collaboration with various stakeholders to ensure best practices in data engineering. The consultant will work primarily on-site for two days a week.
Key Responsibilities:
- Design, build and maintain scalable and secure data pipelines on the Azure platform.
- Develop and deploy data ingestion processes using Azure Data Factory, Databricks (PySpark), and Azure Synapse Analytics.
- Optimise ETL/ELT processes to improve performance, reliability and efficiency.
- Integrate multiple data sources including Azure Data Lake (Gen2), SQL-based systems and APIs.
- Collaborate with Data Architects, Analysts, and stakeholders to define data models and ensure best practices in data engineering.
- Ensure compliance with data governance and security policies (incl. GDPR and ISO standards).
Key Skills:
- Proven commercial experience as a Data Engineer delivering enterprise-scale solutions in Azure.
- Azure Data Factory.
- Azure Databricks (PySpark).
- SQL & Python.
- Understanding of CI/CD in a data environment, ideally with tools like Azure DevOps.
- Experience working within consultancy or client-facing projects is highly desirable.
Salary (Rate): £350 per day
City: London
Country: United Kingdom
Working Arrangements: hybrid
IR35 Status: outside IR35
Seniority Level: Mid-Level
Industry: IT
Detailed Description From Employer:
Azure Data Engineer Rate - up to 350/day Outside IR35 Location - 2 days a week onsite in Central London Duration - 6 Months Likely Extension We are working with a well-established consultancy supporting a high-impact data transformation programme for an end client based in Central London. They are seeking an experienced Azure Data Engineer to join the project on an initial 6-month contract, with strong potential for extension. Key Responsibilities - Azure Data Engineer: Design, build and maintain scalable and secure data pipelines on the Azure platform. Develop and deploy data ingestion processes using Azure Data Factory, Databricks (PySpark), and Azure Synapse Analytics. Optimise ETL/ELT processes to improve performance, reliability and efficiency. Integrate multiple data sources including Azure Data Lake (Gen2), SQL-based systems and APIs. Collaborate with Data Architects, Analysts, and stakeholders to define data models and ensure best practices in data engineering. Ensure compliance with data governance and security policies (incl. GDPR and ISO standards). Required Skills & Experience - Azure Data Engineer: Proven commercial experience as a Data Engineer delivering enterprise-scale solutions in Azure Azure Data Factory Azure Databricks (PySpark) SQL & Python Understanding of CI/CD in a data environment, ideally with tools like Azure DevOps. Experience working within consultancy or client-facing projects is highly desirable. Interested? Apply now with your CV or reach out to discuss the opportunity further. This is a highly sought-after role for a consultant who wants to contribute to a major Azure-led data transformation programme. Data Engineer, Azure Data Engineer, Senior Data Engineer