Job Description
Technically Lead the architectural modernisation of a large-scale, established data platform (DWX) within DWP. This role requires experience of brownfield environments, strong hands-on technical capability, and the ability to reshape existing architectures to align with DWP and Data & Analytic (D&A) standards while maintaining uninterrupted service.
You will be responsible for impact assessment due to re-architecting the source system, design data flows, design and implement infrastructure changes to align DWP standards, managing large-scale schema evolution, enabling cross-cloud connectivity, and providing senior guidance to technical teams and stakeholders.
Key Responsibilities
- Lead Architecture for Brownfield Modernisation
- Analyse and reshape the existing AWS EMR based DWX architecture to support new microservices architecture at source system and evolving schema definitions (300+ schemas).
- Design approaches for merging 3-5 years of historical data in DWX with newly structured data while maintaining consistent user journeys.
- Identify and define implementation approaches that minimise disruption to live services.
- Data Platform & Integration Architecture
- Define new and/or modify ingestion, transformation, and storage patterns to implement the changes due to microservice-based rearchitected source system.
- Ensure downstream services maintain data quality, lineage, and continuity during schema transitions.
- Design data migration strategies and transient approaches supporting phased, low-risk rollouts.
- Infrastructure, Security & Network Architecture
- Architect the transition from Universal Credit (UC) specific MacBooks (bespoke laptop)/VPC access to DWP-standard devices using Zscaler.
- Define the infrastructure and security requirements for safe and compliant connectivity between AWS-hosted services and Azure-hosted DWP environments (eg, SaSViya).
- Ensure the confidentiality, integrity, and controlled movement of sensitive data across cloud boundaries.
- Technology Modernisation & Standards Alignment
- Assess existing technology choices (eg, Kotlin) and define Python migration paths aligned to DWP-approved standards.
- Produce clear technical options, roadmap recommendations, and architectural decision records.
- Advocate for simplification, reduction of technical debt, and alignment to DWP Digital Blueprint and Enterprise Architecture.
- Leadership, Governance & Stakeholder Engagement
- Act as the senior architectural authority across DWX and related services.
- Communicate complex technical concepts in a clear, structured, audience-appropriate manner.
- Collaborate closely with DWP domain architects, engineers, and suppliers.
- Provide architectural assurance and technical governance across delivery teams.
Skills & Experience Required
Essential
Proven experience as a senior technical architect in complex brownfield environments.
Strong data platform architecture experience using AWS EMR: ingestion patterns, schema evolution, ETL/ELT, microservices data integration.
Multi-cloud integration expertise (Azure + AWS) including secure data transfer patterns.
Deep understanding of government, public sector, or regulated environments.
Strong experience of technical authority, security governance and SRE handover
Experience maintaining critical services while modernising underlying platforms.
Strong infrastructure, security, and network architecture capability (Zscaler, VPC patterns, VPN, identity).
Ability to navigate and implement organisational standards (DWP, D&A or similar).
Hands-on experience re-architecting or migrating technology stacks to standardised platforms.
Exceptional communication & leadership: able to drive clarity and decision-making in ambiguous contexts.
Strong experience of technical documentation on Confluence/SharePoint
Desirable
Experience with event-driven architectures and microservice-based data contracts.
Knowledge of Kotlin and migration pathways to DWP-standard languages (Java, Python, etc.).
Relevant AWS certifications.
Success Measures
DWX architectural redesign provides a clear, low-risk path to support UC's microservice-based schema model.
Cross-cloud connectivity and infrastructure changes are defined, approved, and adopted.
Migration away from non-standard technologies is recommended with clear options and impact analysis.
Continuous service delivery is maintained while modernisation progresses.
Stakeholders gain confidence that architecture decisions are correct, consistent, and strategic.