The Role
As a Senior Data Engineer, you will be responsible for designing, developing and supporting modern data platform solutions, working across data lakes, cloud technologies, data ingestion and CI/CD.
You will work with a range of modern technologies and will be expected to bring strong hands-on engineering experience across data platforms and cloud environments.
Key Responsibilities
- Design, develop and maintain scalable data lake and data platform solutions.
- Work with modern data technologies including Microsoft Fabric and/or Databricks.
- Develop robust data processing and transformation solutions using Python, PySpark and advanced SQL.
- Implement and maintain CI/CD pipelines using Terraform, GitHub and/or Azure DevOps.
- Develop and support data ingestion solutions using technologies such as AWS Lambda, Azure Functions, AWS DMS and other ingestion services.
- Build reliable, scalable and production-ready data engineering solutions.
- Work closely with technical stakeholders and wider delivery teams to understand requirements and deliver effective data solutions.
- Apply data engineering best practices across development, testing, deployment and support.
- Contribute to the continuous improvement of the organisation's data platform capabilities.
Essential Skills & Experience: The successful candidate will have strong hands-on experience with:
- Modern Data Lakes/Data Platforms
- Microsoft Fabric and/or Databricks
- Python
- PySpark
- Advanced SQL
- CI/CD
- Terraform
- GitHub and/or Azure DevOps
- Cloud-based data ingestion technologies
- AWS Lambda, Azure Functions and/or AWS DMS
- Developing and managing production-grade data engineering solutions
Desirable Skills
Experience with AI/ML, including building or managing machine learning models and working with data science notebooks, would be advantageous but is not essential.
Contract Details
- Contract: 6 months
- Rate: £580 per day
- IR35: Inside IR35
- Location: Bidborough House, London
- Working pattern: Hybrid
- Start date: October 2026, TBC
- Notice period: 14 days
- Interview: 1-hour interview, with interview dates expected between 21st and 25th September, TBC
This is a great opportunity for a Senior Data Engineer to work within a high-profile higher education environment, contributing to modern data platform initiatives across cloud, data engineering and DevOps technologies.