Summary: The Data Engineer role at DWP involves developing and maintaining data products and services to enhance workforce participation and support vulnerable claimants. The position requires collaboration with stakeholders and the application of cloud technologies to deliver innovative data solutions. The role is hybrid, requiring two days in the office, and is based in various locations including Manchester, Birmingham, Sheffield, Leeds, Newcastle, or Blackpool. SC Clearance eligibility is essential for this position.

Key Responsibilities:

• Translate business requirements into reusable production-ready code and effective data models.
• Define version control mechanisms and strategies for source code.
• Support Quality Assurance and Data Managers in testing and live operations of data products.
• Shape solutions following agreed principles and contribute to the Data Engineer Development lifecycle.
• Perform data profiling and quality measurements.
• Design and develop reusable metadata libraries.
• Ensure stability and robustness of new products.
• Identify and resolve issues affecting product delivery and development.
• Support team growth by sharing knowledge and staying updated on industry trends.
• Develop data pipelines on the Health Data and Analytics Platform as an ETL developer.

Key Skills:

• Experience with Microsoft Azure services for data collection, storage, processing, analysis, and security.
• Proficiency in developing automated data ingest routines and workflows using Azure technologies (e.g., Databricks, Data Factory, Synapse, Python, SQL).
• Ability to produce comprehensive test scripts for code quality assurance.
• Experience in translating user requirements into robust ETL solutions.
• Knowledge of version control mechanisms for source code.
• Experience in data profiling and quality measurement techniques.

Salary (Rate): undetermined

City: Manchester

Country: United Kingdom

Working Arrangements: hybrid

IR35 Status: inside IR35

Seniority Level: undetermined

Industry: IT