Key Responsibilities
- Build and maintain robust data pipelines using Python
- Work across Azure environments on the low side
- Support data engineering workloads within Kubernetes environments on the high side
- Develop and maintain workflows using Apache Airflow
- Work with Apache Spark for large-scale data processing
- Support the ongoing development and improvement of established data pipelines
- Help ensure data remains within MoD-owned infrastructure in line with data governance requirements
- Work within an existing long-running programme requiring additional delivery capacity
Essential Skills
- Active DV Clearance
- Strong Python data engineering experience
- Experience with Azure
- Strong knowledge of Kubernetes
- Experience with Apache Airflow
- Experience with Apache Spark
- Strong background building and maintaining production data pipelines
Desirable
- Previous experience working within a Palantir environment
- Experience delivering data solutions within secure defence or government environments
Rate:
£800/day
Location:
Hereford
IR35 Status:
Inside
Remote Status:
Onsite
Industry:
Data & Analytics
Seniority Level:
Not Specified