The Role
As an Azure Data Engineer, you will be responsible for designing, developing and optimising data pipelines and data platform capabilities within Azure.
Working closely with architects, analysts and business stakeholders, you'll help deliver a modern, scalable and high-performing data ecosystem.
Key Responsibilities
- Design and develop scalable data pipelines within Azure
- Support the migration of Legacy data platforms and workloads to the cloud
- Build and optimise ETL/ELT processes for data ingestion and transformation
- Develop and maintain Databricks notebooks and workflows
- Integrate data from multiple systems and applications
- Ensure data quality, governance and security standards are maintained
- Optimise data processing performance and platform efficiency
- Collaborate with business and technical stakeholders to deliver data solutions
- Support the evolution of a modern cloud-based data platform
Essential Skills & Experience
- Proven experience as an Azure Data Engineer
- Strong hands-on experience with Azure Databricks
- Experience delivering data migration and cloud transformation projects
- Strong SQL development skills
- Experience with PySpark and/or Spark
- Azure Data Factory
- Azure Data Lake
- ETL/ELT pipeline development
- Data modelling and warehousing concepts
- Experience working with large-scale datasets
Desirable Skills
- Azure Synapse Analytics
- Microsoft Fabric
- CI/CD and Azure DevOps
- Experience within enterprise-scale environments
- Knowledge of data governance and security best practice
- Real Time data processing and event-driven architectures
Contract Details
- 6-Month Initial Contract
- £500 per day
- Outside IR35
- Hybrid Working
- End-User Environment
- Strong Extension Potential