Data Engineering Lead

Responsibilities

• Lead and manage a team of six Senior Data Engineers within the Data Product Feature Team.
• Own the technical direction and engineering delivery across the team.
• Provide hands-on technical leadership across Python, SQL and cloud-based data engineering.
• Set and maintain coding standards, engineering best practices and development approaches.
• Review code and technical designs, providing guidance and constructive challenge to Senior Data Engineers.
• Design and oversee scalable data pipelines, transformations and data processing solutions.
• Lead engineering delivery across GCP services including BigQuery, Dataflow, Dataproc and Cloud Storage.
• Support complex data transformation, matching and merge processes and identity resolution.
• Ensure appropriate data quality, lineage, governance and engineering controls are Embedded within solutions.
• Identify and remove technical blockers impacting the engineering team.
• Mentor and support Senior Data Engineers while maintaining accountability for delivery and technical quality.
• Work closely with architecture, product and delivery teams to turn requirements into effective engineering solutions.
• Contribute to cloud migration and wider data platform modernisation activities.
• Ensure engineering solutions are scalable, maintainable and aligned with the wider data architecture.

Requirements

• Strong hands-on background in data engineering with experience as a Data Engineering Lead, Lead Data Engineer or similar.
• Proven experience leading and managing a team of experienced Data Engineers.
• Strong hands-on coding experience using Python and SQL.
• Strong experience designing and building scalable data pipelines and data transformation solutions.
• Hands-on experience with Google Cloud Platform.
• Experience with GCP data technologies such as BigQuery, Dataflow, Dataproc and Cloud Storage.
• Experience with dbt or similar data transformation tooling.
• Strong understanding of data engineering principles, coding standards, testing and CI/CD.
• Experience with data quality, lineage and governance.
• Ability to conduct code reviews and provide technical guidance to experienced engineers.
• Strong problem-solving skills with the ability to take ownership of complex engineering challenges.
• Strong stakeholder management skills and the ability to work across engineering, architecture, product and delivery teams.
• Comfortable joining a contract engagement and taking ownership of a team and delivery from the outset.

Nice to Have

• Previous experience within banking or financial services.
• Experience working within a data product or feature team environment.
• Experience with identity resolution, matching and merge processes or complex customer datasets.
• Experience supporting large-scale cloud migration or data platform modernisation programmes.