Senior Data Engineer (Azure/Medallion Architecture) - 12 months - Warwick(Hybrid)
Posted 2 weeks ago by Hamilton Barnes
£430 Per day
Inside
Hybrid
Warwick, Warwickshire, UK
Summary: The Senior Data Engineer role focuses on providing architectural direction and technical leadership for the Interconnectors Data Platform, which is transitioning to a Medallion Architecture on Azure. This hybrid position requires hands-on experience in designing scalable data architectures and migrating legacy ETL tools to modern Azure-based solutions. The role emphasizes the development of robust data pipelines and collaboration with business stakeholders to ensure data outputs meet operational needs. The engagement is for a 6-month contract based in Warwick, requiring 3 days in the office each week.
Key Responsibilities:
- Lead the design and implementation of scalable data architectures including Bronze/Silver/Gold Medallion layered models, driving the platform's architectural roadmap in line with modern engineering best practices
- Lead the migration from Legacy ETL tooling (eg Matillion) into modern Azure-based pipelines including Azure Functions and Azure Data Factory, building performant SQL-based transformations and reusable data models
- Develop robust, secure, and observable data ingestion and transformation pipelines, ensuring CI/CD, automated testing, version control, and full observability are Embedded throughout
- Implement data validation, reconciliation, profiling, and auditability across platform layers, working with business stakeholders to ensure outputs meet analytical and operational needs
Key Skills:
- Strong, hands-on Python experience building production-grade data pipelines, transformations, and orchestration - essential
- Expert-level analytical SQL including query optimisation and data modelling
- Solid Azure cloud experience - Azure Functions, Azure Data Factory, Azure Storage, Key Vault, and cloud security fundamentals
- Deep understanding of data warehousing principles, dimensional modelling, and scalable enterprise data design
- Strong grounding in Git, CI/CD, automated testing, and modern engineering practices
- Experience with API and SFTP ingestion patterns and resilient pipeline design
- Exposure to Medallion/Lakehouse patterns or Databricks-style ecosystems - preferred
Salary (Rate): £430 per day
City: Warwick
Country: UK
Working Arrangements: hybrid
IR35 Status: inside IR35
Seniority Level: Mid-Level
Industry: IT
Senior Data Engineer (Azure/Medallion Architecture) - 12 months - Warwick(Hybrid)
Contracting role based in Warwick (Hybrid, 3 days in office) for a 6-month engagement within the Cloud practice. You will provide architectural direction and hands-on technical leadership on the Interconnectors Data Platform (ICDP) - a cloud-based data warehouse enabling critical commercial, financial modelling, and operational decision-making - as the platform modernises toward a Medallion Architecture and Azure-native ingestion patterns.
Key Responsibilities:
- Lead the design and implementation of scalable data architectures including Bronze/Silver/Gold Medallion layered models, driving the platform's architectural roadmap in line with modern engineering best practices
- Lead the migration from Legacy ETL tooling (eg Matillion) into modern Azure-based pipelines including Azure Functions and Azure Data Factory, building performant SQL-based transformations and reusable data models
- Develop robust, secure, and observable data ingestion and transformation pipelines, ensuring CI/CD, automated testing, version control, and full observability are Embedded throughout
- Implement data validation, reconciliation, profiling, and auditability across platform layers, working with business stakeholders to ensure outputs meet analytical and operational needs
What You Will Ideally Bring:
- Strong, hands-on Python experience building production-grade data pipelines, transformations, and orchestration - essential
- Expert-level analytical SQL including query optimisation and data modelling
- Solid Azure cloud experience - Azure Functions, Azure Data Factory, Azure Storage, Key Vault, and cloud security fundamentals
- Deep understanding of data warehousing principles, dimensional modelling, and scalable enterprise data design
- Strong grounding in Git, CI/CD, automated testing, and modern engineering practices
- Experience with API and SFTP ingestion patterns and resilient pipeline design
- Exposure to Medallion/Lakehouse patterns or Databricks-style ecosystems - preferred
Contract Details:
- Duration: 6 months
- Rate: £430 per day
- Location: Warwick (Hybrid - 3 days on-site)
- Start Date: ASAP