Data Engineer – PySpark / Python
Posted 1 week ago by Totaljobs
£600 Per day
Inside
Hybrid
City of London (EC1)
Summary: The Data Engineer role focuses on developing and maintaining scalable data pipelines and ETL processes using Python and PySpark within a major global banking organization. The position is part of a large-scale data transformation program and requires collaboration with various stakeholders to ensure high-quality data solutions. The role is hybrid, with a preference for candidates who can travel to the Sheffield office. This is an initial 6-month contract with a strong likelihood of extension.
Key Responsibilities:
- Design, develop and maintain scalable data pipelines and ETL processes
- Develop robust solutions using Python, PySpark and SQL
- Work with large-scale datasets in distributed data environments
- Contribute to data modelling and data warehousing initiatives
- Support CI/CD and automation practices across the data engineering lifecycle
- Collaborate with business stakeholders, architects and engineering teams to deliver high-quality data solutions
- Ensure data quality, performance and reliability across data platforms
Key Skills:
- Strong commercial experience in Data Engineering
- Excellent Python and PySpark development skills
- Advanced SQL knowledge
- Experience building and maintaining data pipelines and ETL solutions
- Good understanding of data warehousing and data modelling concepts
- Experience working within large-scale enterprise environments
- CI/CD experience
- Jenkins
- Ansible
- SAS
- Experience working with distributed systems and cloud-based data platforms
- Financial services or banking sector experience
Salary (Rate): £600 per day
City: Sheffield
Country: United Kingdom
Working Arrangements: hybrid
IR35 Status: inside IR35
Seniority Level: Mid-Level
Industry: IT
Data Engineer – PySpark / Python
Location: Sheffield (Hybrid – 3 days per week preferred)
c.£600 per day Inside IR35
Initial 6-month contract with strong likelihood of extension
We are supporting a major global banking organisation on the growth of its Data Technology function and are looking for an experienced Data Engineer to join a large-scale data transformation programme.
This is an excellent opportunity to work on enterprise-grade data platforms, building and enhancing data pipelines that support critical business and regulatory functions across a complex global environment.
Please note this role is aligned to the bank's Sheffield office, therefore there is a preference for individuals who would be able to travel to this location, if they are not already based in the local area.
Key Responsibilities
- Design, develop and maintain scalable data pipelines and ETL processes
- Develop robust solutions using Python, PySpark and SQL
- Work with large-scale datasets in distributed data environments
- Contribute to data modelling and data warehousing initiatives
- Support CI/CD and automation practices across the data engineering lifecycle
- Collaborate with business stakeholders, architects and engineering teams to deliver high-quality data solutions
- Ensure data quality, performance and reliability across data platforms
Key Requirements
- Strong commercial experience in Data Engineering
- Excellent Python and PySpark development skills
- Advanced SQL knowledge
- Experience building and maintaining data pipelines and ETL solutions
- Good understanding of data warehousing and data modelling concepts
- Experience working within large-scale enterprise environments
Desirable Skills
- CI/CD experience
- Jenkins
- Ansible
- SAS
- Experience working with distributed systems and cloud-based data platforms
- Financial services or banking sector experience
The successful candidate will be a hands-on Data Engineer who enjoys solving complex data challenges and can quickly contribute within a fast-paced, delivery-focused environment.