Data Engineer
Summary: The Data Engineer role is focused on supporting a significant Defence data transformation programme in Corsham, requiring SC security clearance. The position involves assessing and migrating metadata from legacy systems to a modern data catalogue, ensuring the integrity and accessibility of critical defence data. The successful candidate will collaborate with various technical teams to influence migration strategy and data governance. This is a hybrid role, requiring on-site presence 1-2 days per week.
Key Responsibilities:
- Assessing existing data catalogue content, metadata and governance artefacts
- Evaluating migration feasibility from legacy catalogue platforms
- Designing metadata mappings, transformation rules and migration approaches
- Building and optimising ETL/ELT pipelines
- Integrating data from multiple source systems and APIs
- Working closely with Business Analysts, Data Architects and technical teams to deliver migration outcomes
- Producing technical documentation, migration assessments and risk analysis
- Supporting backlog prioritisation and catalogue onboarding activities
Key Skills:
- Proven experience as a Data Engineer within large-scale data transformation or migration programmes
- Strong experience with data catalogue platforms, particularly Informatica
- Excellent ETL/ELT development experience
- Strong SQL and Python skills
- Experience with metadata management, data governance and data modelling
- Experience integrating APIs and multiple data sources
- Ability to assess data quality and define migration strategies
Salary (Rate): £550 per day
City: Corsham
Country: United Kingdom
Working Arrangements: hybrid
IR35 Status: inside IR35
Seniority Level: Mid-Level
Industry: IT
Detailed Description From Employer:
Data Engineer
Corsham/hybrid (1 - 2 days per week on site)
£550 per day inside ir35
SC security clearance is required for this role
Help shape one of the UK's most important Defence data transformation programmes.
We're looking for an experienced Data Engineer to play a key role on a high-profile MOD programme focused on modernising enterprise data catalogue capabilities.
You'll be responsible for assessing, transforming and enabling the migration of metadata from legacy platforms into a modern data catalogue, ensuring critical defence data is discoverable, trusted and fit for future exploitation.
This is an opportunity to work on a complex national programme where your work will directly influence migration strategy, data governance and long-term platform capability.
Responsibilities
- Assessing existing data catalogue content, metadata and governance artefacts
- Evaluating migration feasibility from legacy catalogue platforms
- Designing metadata mappings, transformation rules and migration approaches
- Building and optimising ETL/ELT pipelines
- Integrating data from multiple source systems and APIs
- Working closely with Business Analysts, Data Architects and technical teams to deliver migration outcomes
- Producing technical documentation, migration assessments and risk analysis
- Supporting backlog prioritisation and catalogue onboarding activities
Experience
- Proven experience as a Data Engineer within large-scale data transformation or migration programmes
- Strong experience with data catalogue platforms, particularly Informatica
- Excellent ETL/ELT development experience
- Strong SQL and Python skills
- Experience with metadata management, data governance and data modelling
- Experience integrating APIs and multiple data sources
- Ability to assess data quality and define migration strategies
Desirable experience
- Defence or Central Government programmes
- Microsoft Fabric, Palantir or Snowflake
- CI/CD and DevOps practices
- MODNet PUID
If you are interested in this role, please submit your CV
Similar Jobs
Apologies, there are currently no similar jobs available.