Contract (6 months) - 650-700pd - Outside IR35 - Remote (Remote first, London once per week).

Initial 6 month interim contract with a likely extension.

La Fosse are partnered with a global banking client who urgently require a Senior Data Engineer with a proven track record of building and maintaining Data Lakehouses, preferably in the financial services.

The ideal candidate will have a strong background in both Scala (and ideally Python) programming skills, with specific experience working on Databricks with Spark.

The Data Lakehouse will be serving business users in the Capital Markets space. As such, experience in derivatives, risk, PnL, trade life cycle, market data and market scenarios are highly desired.

Responsibilities:

• Design, develop and maintain robust, scalable and efficient data pipelines (Spark, Scala,Databricks)
• Integrate external and internal data sources ensuring data consistency and accuracy
• Consistently uphold industry-leading standards and best practices in the design & development of data pipelines
• Data modelling on medallion architecture, ensuring schema is intuitive and serves business users analytical and reporting objectives
• Collaborate with business stakeholders to understand their data requirements and provide appropriate solutions;
• Ensure data quality and consistency throughout all data pipelines
• Troubleshoot issues and optimize performance of the platform

Requirements:

• Strong knowledge and experience on Databricks (preferably on Azure)
• Domain knowledge of trading, derivatives, risk and trade-life cycle;
• Strong programming skills in Scala (preferabely with Python too)
• Solid understanding of Spark and its underlying architecture
• Solid understanding of database design principles and data modelling
• Familiarity with data integration tools and technologies
• Experience with Agile methodologies and SDLC practices
• Strong problem-solving and analytical skills