Responsibilities
- Design and implement scalable data pipelines and ETL processes using Azure technologies including Delta Live Tables, Medallion Architecture, Azure Synapse, Python, SQL, Fabric, Data Modelling and Notebook development.
- Lead technical discussions with clients and stakeholders to gather requirements and propose solutions.
- Take ownership for the delivery of core solution components.
- Support with planning, requirements refinement and work estimation.
Skills and Experiences
- Design and develop end-to-end data solutions leveraging Azure services for batch, real time and streaming workloads (including data ingestion, cleansing, modelling and integration)
- Strong background of enterprise data platform development, concepts and methods such as data warehouses and data lakehouse, with the ability to adapt and tailor based on requirements
- Experience with Azure, Microsoft Fabric, Data Factory.
- Expert Python skills
- Good experience of CI/CD practices and tools for data platforms using Azure DevOps
- Good understanding of data governance and data architecture principles
- Excellent communication skills
- Desirable: experience with Terraform, certifications in Azure Data Engineering
Additional Information
- Day Rate: Up to £550
- IR35 Status: Outside IR35
- Start date: ASAP
- Duration: 6 month initial sign up
- Location: Fully remote