Data Engineer Lead Role - Hybrid - Banking
Posted 3 days ago by GCS
£700 Per day
Inside
Hybrid
City of London, UK
Summary: The Data Engineer Lead role at a Tier 1 Bank in London involves designing and supporting a modern data platform, focusing on Databricks and cloud-based data engineering. The position requires leadership in migrating legacy Oracle systems to scalable cloud-native environments while ensuring high-quality data pipelines for analytics and regulatory reporting. The role also emphasizes collaboration with various teams and adherence to engineering best practices. This is a hybrid position requiring three days a week in the office at Liverpool Street.
Key Responsibilities:
- Design and develop Data Marts using Databricks (SQL/Python).
- Lead the migration of data assets from Oracle database systems to the modern cloud data platform.
- Provide technical leadership, mentoring, and coaching to data engineers.
- Ensure governance and performance optimisation of data processes.
- Engage with cross-functional teams to translate technical decisions into business impacts.
- Comply with change management processes for production deployments.
Key Skills:
- Experience with SQL, Oracle, Python, and ETL processes.
- Strong knowledge of Databricks and cloud data engineering.
- Leadership and mentoring capabilities in a data engineering context.
- Ability to collaborate with cross-functional teams and communicate technical concepts to stakeholders.
- Understanding of data governance and compliance standards.
Salary (Rate): £700 per day
City: London
Country: UK
Working Arrangements: hybrid
IR35 Status: inside IR35
Seniority Level: Senior
Industry: IT
Detailed Description From Employer:
Data Engineer Lead - Tier 1 Bank - London - 6 months
Role - Data Engineer Lead
Rate - £700 per day (Inside IR35)
Duration - 6 months with very likely extension
Location - Hybrid/Liverpool Street - 3 days per week in an office in Liverpool Street (London)
Role
- The Data Engineer Lead is responsible for designing, building, and supporting modern data platform, with a particular focus on Databricks, cloud-based data engineering, and leading the migration of Legacy Oracle systems into scalable, cloud-native environments.
- The role supports the organisation's data strategy especially on Finance and Regulatory domain by ensuring high-quality, reliable pipelines and data models that enable analytics, regulatory reporting, and data-driven decision-making.
- The post holder plays a key leadership role within the Data Engineering function, shaping architectural direction, ensuring engineering excellence, and partnering with Technology, Architecture, and Business teams across the organisation.
Tech Stack
- SQL
- Oracle
- Python
- ETL
Background:
- The bank is migrating from an on-premise Oracle estate to a modern data platform built on cloud and Databricks. This role leads the design, implementation, and optimisation the Data Mart and migration processes, ensuring alignment with enterprise data architecture and compliance standards.
Core Responsibilities
Databricks/Modern Data Platform Engineering
- Lead the design and development of Data Marts using Databricks (SQL/Python).
- Follow engineering best practices including version control, CI/CD, orchestration, and environment management.
- Ensure governance, performance optimisation.
Legacy Oracle Migration Leadership
- Lead and coordinate the migration of data assets from Oracle database systems to the modern cloud data platform.
- Oversee source-to-target mapping, data model redesign, and automated migration frameworks.
- Define strategy for retiring Legacy ETLs and implementing equivalent or improved cloud-native solutions.
- Collaborate tightly with Oracle DBAs, business SMEs, and architects to ensure data integrity and continuity.
Team Leadership & Stakeholder Collaboration
- Provide technical leadership, mentoring, and coaching to data engineers.
- Engage with cross-functional teams (Architecture, DevOps, Analytics, Risk, Finance).
- Translate complex technical decisions into clear business impacts for senior stakeholders.
- Support and review development outputs, ensuring high quality and alignment with standards.
Change Management Control
- Comply with change management processes for production deployments and environment updates.
- Ensure documentation and configuration records meet audit requirements.
GCS is acting as an Employment Business in relation to this vacancy.