This is a senior technical leadership role responsible for governing and leading an enterprise-scale data platform. The successful candidate will provide the technical vision, architectural direction, and delivery leadership for a large data ecosystem.
The hiring manager emphasized that this is not just a hands-on data engineer role-it is a technical lead role with ownership responsibilities.
The hiring manager mentioned that tools such as PowerDesigner and BizDesign are used, but expertise in the exact tools is less important than having strong architecture and design experience.
We are seeking a highly experienced Technical Lead with deep expertise in the Azure Data Platform and Databricks ecosystem. The ideal candidate should have strong hands-on experience with Structured Streaming, Delta Live Tables (DLT), PySpark architecture, Python, and SQL, and a proven track record of delivering large-scale enterprise data platforms.
Key responsibilities and qualifications include:
Leading the design, development, and implementation of scalable, high-performance data solutions on Azure and Databricks.
Defining and driving data strategy, data governance, data quality, and platform best practices.
Optimising platform runtime performance and managing overall cloud costs, with a strong focus on Databricks streaming workloads.
Providing end-to-end technical leadership, from solution architecture through delivery and production support.
Collaborating with business stakeholders to understand requirements and translate them into robust technical solutions.
Demonstrating strong ownership, accountability, and stakeholder management skills.
Having experience within the financial trading domain, including knowledge of trading data models and related business processes.
Driving technical decision-making, mentoring engineering teams, and ensuring successful delivery of business outcomes.
The successful candidate will possess excellent communication skills, strong leadership capabilities, and the ability to influence technical direction while delivering complex data solutions from concept to implementation.
Products Data Exchange (PDE) is a centralized data repository of harmonized NA and WONA data. It en
Business case: Achieving cloud modernization is imperative to alleviate speed and agility challenges faced with the current on-premise data landscapes and to increase technical capabilities necessary to deliver outcomes of the PDS 2030 Vision. Benefits include:
Global Reporting: One of the driving benefits is the ability to enable a consistent and cleansed view of global P&L and Exposure.