Senior Data Engineer - DV Cleared
Posted 1 day ago by Jobserve
£75 Per hour
Outside
Onsite
Worcester, Worcestershire
Summary: The Senior Data Engineer role focuses on designing, building, and maintaining secure data pipelines and platforms using the Elastic Stack and Apache NiFi within a regulated environment. This position offers the flexibility of compressed working hours while contributing to high-profile data engineering projects. The role requires collaboration with architects and security teams to ensure compliance with stringent governance standards. It is fully onsite in Worcester, providing an opportunity for long-term contract stability.
Key Responsibilities:
- Design, develop, and maintain secure, scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi
- Build and manage data ingestion, transformation, and integration processes
- Ensure data quality, integrity, security, and compliance with governance standards
- Collaborate with data architects and security teams within highly secure environments
- Monitor and manage large-scale, Real Time data flows, optimising performance and reliability
- Develop robust data models to support analytics and reporting capabilities
- Create dashboards and visualisations using Kibana to drive operational insights
- Troubleshoot, debug, and tune data pipelines and platform performance
- Implement high availability, backup, and disaster recovery strategies
- Produce clear technical documentation, including architecture, workflows, and security protocols
Key Skills:
- Strong experience with the Elastic Stack (Elasticsearch, Logstash, Kibana)
- Proven expertise with Apache NiFi
- Extensive experience designing and building enterprise-scale data pipelines
- Strong understanding of secure data architectures and data governance
- Experience operating within regulated or security-conscious environments
- Ability to design and deliver end-to-end data engineering solutions
- Excellent troubleshooting and performance optimisation skills
Salary (Rate): £75 per hour
City: Worcester
Country: United Kingdom
Working Arrangements: on-site
IR35 Status: outside IR35
Seniority Level: Senior
Industry: IT
Senior Data Engineer - Elastic Stack/Apache NiFi
?? Worcester (Onsite)
?? £70-£75 per hour | Outside IR35
?? 12-Month Rolling Contract
? Compressed Working Available - Work 3 Long Days, Paid for 5
We are seeking an experienced Senior Data Engineer to join a high-profile programme delivering secure, scalable data platforms within a highly regulated environment. This is an exciting opportunity to work on complex data engineering challenges using cutting-edge technologies, with the flexibility of compressed working patterns.
The OpportunityAs a Senior Data Engineer, you will play a key role in designing, building, and maintaining robust data pipelines and platforms. You will work closely with architects, engineers, and security teams to deliver high-performance data solutions that meet stringent security and governance requirements.
This role is fully onsite in Worcester, with the option to work a compressed schedule (eg three extended working days while being compensated for a full five-day week).
Key Responsibilities- Design, develop, and maintain secure, scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi
- Build and manage data ingestion, transformation, and integration processes
- Ensure data quality, integrity, security, and compliance with governance standards
- Collaborate with data architects and security teams within highly secure environments
- Monitor and manage large-scale, Real Time data flows, optimising performance and reliability
- Develop robust data models to support analytics and reporting capabilities
- Create dashboards and visualisations using Kibana to drive operational insights
- Troubleshoot, debug, and tune data pipelines and platform performance
- Implement high availability, backup, and disaster recovery strategies
- Produce clear technical documentation, including architecture, workflows, and security protocols
Essential Skills & Experience
- Strong experience with the Elastic Stack (Elasticsearch, Logstash, Kibana)
- Proven expertise with Apache NiFi
- Extensive experience designing and building enterprise-scale data pipelines
- Strong understanding of secure data architectures and data governance
- Experience operating within regulated or security-conscious environments
- Ability to design and deliver end-to-end data engineering solutions
- Excellent troubleshooting and performance optimisation skills
Desirable Experience
- Experience working within government, defence, or other highly regulated sectors
- Knowledge of Apache Kafka, Spark, or Hadoop
- Experience with Docker and Kubernetes
- Familiarity with monitoring and observability tools such as Prometheus, Grafana, or ELK
- Understanding of machine learning algorithms and their implementation
- Experience with Infrastructure as Code tools such as Terraform and Ansible
What's on Offer?
? £70-£75 per hour
? Outside IR35
? 12-month rolling contract
? Compressed working available (3 long days, paid for 5)
? Opportunity to work on complex, mission-critical data platforms
? Long-term contract stability within a high-profile programme
If you're an experienced Data Engineer with strong Elastic Stack and Apache NiFi expertise and are looking for a long-term, high-impact contract opportunity, we'd like to hear from you.