Lead Data Engineer
Posted Today by Public Sector Resourcing
Negotiable
Inside
Hybrid
London
Summary: The Ministry of Justice is seeking a Lead Data Engineer for a 6-month contract, requiring active SC Clearance and offering hybrid working arrangements in London. The role involves overseeing the integration of legal aid data into the Analytical Platform and collaborating with Analytics Engineering to develop a flexible data model. The position is critical for modernizing the legal aid data landscape and enhancing data-driven decision-making within the Ministry. Candidates must possess strong technical skills and experience in leading data engineering teams.
Key Responsibilities:
- Oversee and enable work with upstream teams to integrate legal aid data onto the Analytical Platform.
- Lead the development of a new data layer and collaborate with Analytics Engineering colleagues.
- Build and maintain data pipelines for extracting and loading data to the Analytical Platform.
- Guide and support a team of data engineers in applying best practices.
- Engage with business stakeholders and cross-functional teams to maintain relationships.
- Ensure data engineering practices are up to date with the latest developments.
- Review, design, and develop data pipelines.
- Build CI/CD workflows, ideally using GitHub Actions.
- Utilize infrastructure as code, ideally Terraform.
Key Skills:
- Active SC Clearance.
- Excellent skills in Python, SQL, and Jinja.
- Experience with cloud platforms, ideally AWS.
- Familiarity with orchestration tools, ideally Airflow.
- Experience in leading and supporting data engineering teams.
- Experience in building CI/CD workflows.
- Knowledge of current best practices in data engineering.
- Experience in reviewing and developing data pipelines.
- Strong stakeholder engagement skills.
- Experience with infrastructure as code, ideally Terraform.
Salary (Rate): undetermined
City: London
Country: United Kingdom
Working Arrangements: hybrid
IR35 Status: inside IR35
Seniority Level: Senior
Industry: IT