Summary: The Data Engineer role at DWP involves developing and maintaining data products and services to enhance workforce participation and support vulnerable citizens. The position requires collaboration with stakeholders and the application of agile methodologies using cloud technologies. The role also includes responsibilities in ETL development, ensuring code quality, and potentially managing other Data Engineers. SC Clearance eligibility is essential for this position.

Key Responsibilities:

• Translate business requirements into reusable production-ready code and effective data models.
• Define version control mechanisms and strategies for source code.
• Support Quality Assurance and Data Managers in testing and live running of data products.
• Shape solutions following agreed principles and contribute to the Data Engineer Development lifecycle.
• Perform data profiling and quality measurements.
• Design and develop reusable metadata libraries.
• Ensure stability and robustness of new products.
• Identify and resolve issues affecting product delivery and development.
• Support team growth by sharing knowledge and keeping abreast of industry trends.
• Develop automated data ingest routines and workflows using Azure services.
• Produce test scripts to ensure code quality and accountability for ETL solutions.
• Collaborate with team members to meet data delivery objectives.
• Potential line management responsibilities for other Data Engineers.

Key Skills:

• Experience with Microsoft Azure services for data collection, storage, processing, analysis, and security.
• Proficiency in ETL development and data pipeline creation.
• Strong coding skills in Python and SQL.
• Ability to produce comprehensive test scripts.
• Experience in version control and code quality assurance.
• Knowledge of agile methodologies and cloud technologies.
• Strong problem-solving and issue resolution skills.
• Ability to collaborate effectively with stakeholders and team members.

Salary (Rate): undetermined

City: Manchester

Country: UK

Working Arrangements: hybrid

IR35 Status: inside IR35

Seniority Level: undetermined

Industry: IT