Data Engineer

Data Engineer

Posted 6 days ago by Talent on Linkedin

Negotiable
Inside
Onsite
England, United Kingdom
6 month contract opportunity within the public sectorHybrid working, bases across the UK 26 - 27 per hour Inside IR35Must be eligible for UK Security Clearance Data Engineer Our public sector client is looking for a number of Data Engineers to join the team and build robust scalable data solutions and Python-based software that the production team can integrate into their operations. You ll be responsible for managing the Python codebase, creating intuitive user interfaces, and connecting to cloud databases, helping to ensure the system remains efficient and safe. Skills and Experience Proficiency in Python, including experience with data manipulation libraries (Pandas).Experience in designing, developing, and maintaining ETL pipelines and data flows in a cloud-based environment.Understanding of relational databases, including experience with database design, query optimisation, and data warehousing.Ability to create intuitive, user-friendly interfaces.Excellent troubleshooting, problem-solving, and debugging skills.Strong understanding of software testing, including unit testing, integration testing, and performance testing.Ability to work collaboratively in a team environment, communicate effectively, and manage multiple tasks in a fast-paced setting.Familiarity with DevOps tools and methodologies for automating deployments and managing infrastructure as code.Exposure to other programming languages, such as R.Key ResponsibilitiesDesign, develop, and maintain ETL pipelines and data processing workflows to manage and manipulate datasets, ensuring data quality, consistency, and accuracy.Create intuitive and user-friendly interfaces for internal production teams, making sure that all software products are highly usable and meet the users requirements.Manage and enhance the Python codebase used for both data processing and user interface functionality, ensuring clean, maintainable, and well-documented code.Build and maintain scalable, secure, and efficient cloud-based solutions, including designing database schemas and managing data flows.Implement software development best practices, including version control (Git), continuous integration, testing, and deployment (CI/CD).Troubleshoot and optimise existing data pipelines and software, ensuring performance improvements and resilience in production environments.Collaborate with data scientists, analysts, and other teams to ensure efficient data integration, storage, and processing, and the transfer of appropriate data engineering knowledge.**Must be eligible for UK Security Clearance** Next Steps If you have the relevant skills and experience, and would be interested in applying for this role, please apply with your up to date CV and I will endeavor to get back to you.











Show more















Show less