GCP data engineer

In-scope technologies/products

• Google Cloud Platform (GCP) and comparable cloud-based data engineering services
• dbt
• Python
• SQL
• ETL/ELT tooling and methodologies
• Data modelling and data product development
• AI-enabled data development
• Testing and validation frameworks
• Master Data Management (MDM), including commercial off-the-shelf and bespoke solutions
• MDM integration and implementation
• Real-time data product patterns
• DevOps tooling and deployment practices

Skillsets required

• Expert-level GCP or cloud-based data engineering capability
• Advanced practical experience of dbt, Python data engineering and SQL
• Strong data modelling and ETL/ELT design skills
• Proven end-to-end data product build experience
• Experience applying AI-enabled approaches to data development
• Strong testing, data validation and quality assurance capability
• Data architecture expertise
• MDM and enterprise data architecture experience, including strategy, solution selection, integration and implementation
• DevOps, deployment, governance, and production go-live experience
• Senior technical leadership capable of leading a multidisciplinary feature team

Scope of services

• The requirement is for two UK-based feature teams, each comprising six resources and led by a Senior Lead Data Engineer.
• All team members must be based in Bristol or Manchester; London-based delivery is specifically excluded.
• The teams are required to start immediately, and suppliers must propose resources who are available and capable of being onboarded without delay.
• Improve the quality, richness, and consumption-readiness of FDP data.
• Deliver FDPs end to end, from ODP selection through design, engagement and shaping, development, DevOps, testing, validation, governance, deployment and go-live.
• Define and support MDM architecture and strategy.
• Assess and implement commercial off-the-shelf MDM products where appropriate.
• Design and develop bespoke MDM solutions.
• Deliver MDM integration and implementation activities.
• Design and implement real-time data product patterns.
• Work within the applicable delivery, architecture, engineering, security and governance standards.
• Provide experienced, delivery-ready practitioners; proposals based on academic exercises, speculative hiring or resources requiring extended mobilisation will not be accepted.