Data Engineer – PySpark / Python
Posted 3 days ago by Totaljobs
£600 Per day
Inside
Hybrid
Sheffield (S1)
Summary: The Data Engineer role focuses on supporting a major global banking organization by developing and maintaining scalable data pipelines and ETL processes using Python and PySpark. The position is part of a large-scale data transformation program, emphasizing collaboration with stakeholders and ensuring data quality across platforms. This is a hands-on role requiring strong technical skills and the ability to work in a fast-paced environment. The contract is initially for six months with a strong likelihood of extension.
Key Responsibilities:
- Design, develop and maintain scalable data pipelines and ETL processes
- Develop robust solutions using Python, PySpark and SQL
- Work with large-scale datasets in distributed data environments
- Contribute to data modelling and data warehousing initiatives
- Support CI/CD and automation practices across the data engineering lifecycle
- Collaborate with business stakeholders, architects and engineering teams to deliver high-quality data solutions
- Ensure data quality, performance and reliability across data platforms
Key Skills:
- Strong commercial experience in Data Engineering
- Excellent Python and PySpark development skills
- Advanced SQL knowledge
- Experience building and maintaining data pipelines and ETL solutions
- Good understanding of data warehousing and data modelling concepts
- Experience working within large-scale enterprise environments
- CI/CD experience
- Jenkins
- Ansible
- SAS
- Experience working with distributed systems and cloud-based data platforms
- Financial services or banking sector experience
Salary (Rate): £600 per day
City: Sheffield
Country: United Kingdom
Working Arrangements: hybrid
IR35 Status: inside IR35
Seniority Level: Mid-Level
Industry: IT
Data Engineer – PySpark / Python
Location: Sheffield (Hybrid – 3 days per week preferred)
c.£600 per day Inside IR35
Initial 6-month contract with strong likelihood of extension
We are supporting a major global banking organisation on the growth of its Data Technology function and are looking for an experienced Data Engineer to join a large-scale data transformation programme.
This is an excellent opportunity to work on enterprise-grade data platforms, building and enhancing data pipelines that support critical business and regulatory functions across a complex global environment.
- Key Responsibilities
- Design, develop and maintain scalable data pipelines and ETL processes
- Develop robust solutions using Python, PySpark and SQL
- Work with large-scale datasets in distributed data environments
- Contribute to data modelling and data warehousing initiatives
- Support CI/CD and automation practices across the data engineering lifecycle
- Collaborate with business stakeholders, architects and engineering teams to deliver high-quality data solutions
- Ensure data quality, performance and reliability across data platforms
- Key Requirements
- Strong commercial experience in Data Engineering
- Excellent Python and PySpark development skills
- Advanced SQL knowledge
- Experience building and maintaining data pipelines and ETL solutions
- Good understanding of data warehousing and data modelling concepts
- Experience working within large-scale enterprise environments
- Desirable Skills
- CI/CD experience
- Jenkins
- Ansible
- SAS
- Experience working with distributed systems and cloud-based data platforms
- Financial services or banking sector experience
The successful candidate will be a hands-on Data Engineer who enjoys solving complex data challenges and can quickly contribute within a fast-paced, delivery-focused environment.