Senior Data Engineer
Posted 4 days ago by Talent International
£743 Per day
Inside
Hybrid
Taunton, Somerset, UK
Summary: The role of Senior Data Engineer involves working on a 6-month contract basis in a hybrid environment based in Somerset. The position requires active SC Clearance and focuses on designing and building solutions for complex big data challenges, primarily using Python and AWS. The engineer will collaborate with stakeholders and support technology teams while contributing to an inclusive team culture.
Key Responsibilities:
- Design and build solutions for complex big data challenges.
- Program confidently in Python to high code quality standards.
- Implement data ingest and processing capabilities.
- Utilize AWS cloud capabilities in production environments.
- Develop solutions delivered by automated CI/CD pipelines with testing and analysis.
- Implement effective monitoring and logging of data processing systems.
- Process geospatial, marine, or oceanographic data.
- Provide line management support.
- Continuously integrate, test, and deploy services to cloud environments.
- Write high-quality Python code for data capabilities.
- Work with stakeholders to understand data consumption needs.
- Support wider technology teams with data and code challenges.
- Coach and pair program with team members.
- Contribute to an open and supportive team environment.
Key Skills:
- Strong programming skills in Python.
- Experience with data ingest and processing capabilities.
- Production experience with AWS cloud services.
- Knowledge of CI/CD pipelines, automated testing, and static analysis.
- Experience in monitoring and logging data processing systems.
- Ability to process geospatial, marine, or oceanographic data.
- Line management experience.
- Active SC Clearance.
Salary (Rate): £730 per day
City: Taunton
Country: UK
Working Arrangements: hybrid
IR35 Status: inside IR35
Seniority Level: Senior
Industry: IT
Job Description:
6 month contract
Hybrid working - Somerset base
£730 per day Inside IR35
Active SC Clearance required
Senior Data Engineer
Our public sector client is looking for a Senior Data Engineer to join the team to work in a collaborative environment, designing and building solutions to complex big data challenges.
Skills and Experience
Be capable of confidently programming in Python to high code quality standards.
(We have a large codebase that consists of numerous serverless Python components. These are application components, not scripts, so require strong Python engineering experience).
Experience of designing and implementing data ingest and processing capabilities.
Production experience utilising AWS cloud capabilities.
Experience of developing solutions delivered by automated CI/CD pipelines with automated testing, static analysis, and linting.
Has implemented effective monitoring and logging of data processing systems.
Can show experience of processing geospatial, marine or oceanographic data.
Has had some line management experience.
Day to Day
Be working with cutting edge technology on marine geospatial data on a wide range of fascinating and impactful projects.
Continuously integrate, test, and deploy services to our cloud environments (predominantly AWS but Azure and GCP may be used occasionally).
Write high quality Python code to implement data ingest and processing capabilities.
Work with stakeholders to understand how they wish to consume our data holdings.
Support the wider technology teams with their data and code challenges.
Coach and/or pair program with team members to share knowledge.
Contribute to an open, inclusive, and supportive team environment.
Next Steps
If you have active SC Clearance, and the relevant experience, and are interested in finding out more about this opportunity
£ 721.25/day
Talent International UK and it's subsidiaries, Digital Gurus, Infinite Talent and Rethink act as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this opportunity, you accept the TandC's, Privacy Policy and Disclaimers which can be found on our website