Contract Data Engineer - Databricks
Hybrid | Contract
An established specialist professional services organisation is looking for an experienced Contract Data Engineer to help maintain and evolve its existing Databricks data platform and strengthen the data foundations supporting reporting, analytics and decision-making across the organisation.
This is an opportunity to join a growing data function and make a tangible impact on how data is collected, transformed, governed and trusted.
You will work hands-on with Databricks, Python and SQL, developing and enhancing a modern Bronze/Silver/Gold medallion architecture. A key focus will be improving data quality through robust automated controls, validation and exception reporting.
Working closely with analysts, developers and business stakeholders, you will turn data requirements into reliable, scalable and maintainable data products.
What You'll Be Doing
- Maintain, optimise and enhance an existing Databricks environment.
- Build and improve scalable data pipelines using Spark and Databricks best practices.
- Develop reusable data engineering patterns across multiple data domains.
- Monitor and troubleshoot pipeline failures, performance issues and data incidents.
- Identify opportunities to improve reliability, performance and cost-effectiveness.
Medallion Architecture
- Build and evolve Bronze, Silver and Gold data layers.
- Develop transformation, enrichment and aggregation logic between layers.
- Design Gold-layer data models in collaboration with
This role will involve 1/2 days work on site per week.