Senior Data Engineer
Posted 1 day ago by Caspian One on Linkedin
Negotiable
Undetermined
Undetermined
London Area, United Kingdom
Summary: The Senior Data Engineer role at a leading investment bank involves leading cloud-based data engineering projects, transforming complex data into actionable insights, and implementing automation techniques. This position offers the opportunity to shape data architecture within a global financial organization while fostering a culture of continuous improvement. The role requires collaboration across teams and a strong focus on delivering high-quality, scalable solutions. The contract is for an initial six months with potential for permanent conversion at the Director level.
Key Responsibilities:
- Lead end-to-end data engineering projects from conception to deployment.
- Transform complex data into actionable business insights using internal data platforms.
- Develop and implement data engineering techniques to automate processes.
- Maintain quality, security, reliability, and compliance of all solutions.
- Build robust observability into solutions and monitor production health.
- Advocate for client needs and deliver solutions that exceed expectations.
- Establish and share best practices and methodologies across engineering teams.
- Shape the data architecture and technology stack within the cloud-based datalake-house.
- Foster a culture of continuous learning, improvement, and automation.
Key Skills:
- Solid understanding of data modelling, data warehousing principles, and Lakehouse architecture.
- Expert knowledge of ETL using Azure Databricks (Spark, Spark SQL, Python, SQL).
- Strong Databricks, SQL, and Python skills with understanding of software development life cycles.
- Proficiency with columnar and/or time series data design patterns and performance tuning techniques.
- Experience with Infrastructure as Code and Scripting languages.
- Knowledge of Information Security principles for compliant data handling.
- Excellent communication skills to explain complex solutions clearly.
- Strong problem-solving and analytical abilities.
- Working experience with Agile methodologies (SCRUM, Kanban).
- Team-oriented mindset with leadership skills and ability to collaborate across business units.
Salary (Rate): 800
City: London
Country: United Kingdom
Working Arrangements: undetermined
IR35 Status: undetermined
Seniority Level: Senior
Industry: IT