All Jobs Vacancy

Senior Data Engineer - Python/PySpark/SQL

Posted 1 day ago by Harvey Nash IT Recruitment UK

Fantastic opportunity to join a thriving Financial Services business. This is a hybrid role, and can be based out of either the London or Manchester office.

As a digital-first company, our Enterprise Security & Fraud (ES&F) team aims to innovate using cutting edge technology to prevent fraud and financial crime on our investment platform. Join an established cybersecurity-focused development team and be on the cutting edge of implementing a suite of tools to protect hundreds of thousands of clients across the UK & Europe.

In this role you will:

  • Be creative with solutions for business needs, it's important that we consider our options outside of what is already being done. We want to build resilient, future-proof novel solutions.
  • Aid with the design and implement of pipelines for Real Time analysis and critical decision making for operational systems.
  • Build ELT pipelines, from source to presentation of data to our internal customers.
  • Write high quality, testable and readable code, assist with code reviews, provide solution design input, build automated tests, create documentation, and other tasks throughout the development life cycle.
  • Collaborate closely with junior and senior developers, scrum master, and product owner to ensure the data is enabling our client experience.
  • Identify and help implement continuous improvement of technical standards, methodologies, technologies, and processes.
  • Own the deployment and operations of the system across environments from development, test, and through to production.
  • Participate in agile meetings aligned to the scrum framework: sprint planning, daily scrums, sprint review, sprint retrospective.

Qualifications we're looking for:

A bachelor's degree in computer science, STEM or related discipline is a plus, but not strictly required.

Experience as a data engineer.

Strong experience with Python and SQL is required as well as a solid understanding of working in a cloud-based environment (AWS is preferred).

Proficient using transformation tools such as PySpark/Pandas.

Knowledge and practice of graph databases is preferred but not required.

Key responsibilities/Skills and experience

Familiarity using data quality frameworks, ie. Great Expectations.

Experience building cloud infrastructure using IaC (CloudFormation/Terraform).

Demonstrable understanding of industry standards and best practices as it relates to development methodology such as testing, code quality and consistency.

Great communication skills: the ability to bridge the gap between the technical and non-technical across various communication channels.

An understanding of agile software development methodology, with scrum framework experience preferred.

A desire to continuously learn and develop yourself in both technical and non-technical skillsets.

Rate:
£500/day
Location:
London
IR35 Status:
Not specified
Remote Status:
Hybrid
Industry:
Data & Analytics
Seniority Level:
Senior

Take-Home Pay

£7,000 per month

Visit calculators for additional details

Create a free account to view the take-home pay for this contract

Share job