Senior Data Engineer
Posted 4 days ago by Talent
£730 Per day
Inside
Hybrid
Somerset, England, United Kingdom
Summary: The role of Senior Data Engineer involves working on a 6-month contract in a hybrid environment, primarily based in Somerset. The position requires designing and building solutions for complex big data challenges, utilizing advanced programming skills in Python and AWS cloud capabilities. Active SC Clearance is mandatory for this role, which focuses on marine geospatial data projects.
Key Responsibilities:
- Design and build solutions for complex big data challenges.
- Program confidently in Python to high code quality standards.
- Implement data ingest and processing capabilities.
- Utilize AWS cloud capabilities for production experience.
- Develop solutions delivered by automated CI/CD pipelines with testing and analysis.
- Implement effective monitoring and logging of data processing systems.
- Process geospatial, marine, or oceanographic data.
- Provide line management support.
- Work with stakeholders to understand data consumption needs.
- Support technology teams with data and code challenges.
- Coach and pair program with team members.
- Contribute to an inclusive and supportive team environment.
Key Skills:
- Strong programming skills in Python.
- Experience with AWS cloud capabilities.
- Knowledge of CI/CD pipelines and automated testing.
- Experience in monitoring and logging data processing systems.
- Ability to process geospatial, marine, or oceanographic data.
- Line management experience.
- Strong collaboration and communication skills.
Salary (Rate): £730 daily
City: Somerset
Country: United Kingdom
Working Arrangements: hybrid
IR35 Status: inside IR35
Seniority Level: Senior
Industry: IT
6 month contract Hybrid working – Somerset base £730 per day Inside IR35 Active SC Clearance required Senior Data Engineer Our public sector client is looking for a Senior Data Engineer to join the team to work in a collaborative environment, designing and building solutions to complex big data challenges.
Skills and Experience Be capable of confidently programming in Python to high code quality standards. (We have a large codebase that consists of numerous serverless Python components. These are application components, not scripts, so require strong Python engineering experience). Experience of designing and implementing data ingest and processing capabilities. Production experience utilising AWS cloud capabilities. Experience of developing solutions delivered by automated CI/CD pipelines with automated testing, static analysis, and linting. Has implemented effective monitoring and logging of data processing systems. Can show experience of processing geospatial, marine or oceanographic data. Has had some line management experience.
Day to Day Be working with cutting edge technology on marine geospatial data on a wide range of fascinating and impactful projects. Continuously integrate, test, and deploy services to our cloud environments (predominantly AWS but Azure and GCP may be used occasionally). Write high quality Python code to implement data ingest and processing capabilities. Work with stakeholders to understand how they wish to consume our data holdings. Support the wider technology teams with their data and code challenges. Coach and/or pair program with team members to share knowledge. Contribute to an open, inclusive, and supportive team environment.
Next Steps If you have active SC Clearance, and the relevant experience, and are interested in finding out more about this opportunity