Data Engineer

Summary: The role of Data Engineer involves designing, developing, and managing complex data pipelines in a high-security defence environment in Bristol. Candidates must possess UK DV Clearance or be willing to undergo the vetting process. The position requires collaboration with cross-functional teams and a strong focus on data security and compliance. This contract opportunity is inside IR35 and offers a duration of 6-12 months.

Key Responsibilities:

• Design, develop, and manage complex, large-scale data pipelines in secure or regulated environments
• Ingest, process, index, and visualise data using the Elastic Stack (Elasticsearch, Logstash, Kibana)
• Build and maintain robust data flows with Apache NiFi
• Implement best practices for handling sensitive data, including encryption, anonymisation, and access control
• Monitor and troubleshoot real-time data pipelines to ensure high performance and reliability
• Write efficient, secure scripts and code using Python, Bash, or similar languages
• Collaborate with cross-functional teams to meet technical and operational requirements

Key Skills:

• 3+ years’ experience as a Data Engineer in secure, regulated, or mission-critical environments
• Proven expertise with the Elastic Stack (Elasticsearch, Logstash, Kibana)
• Solid experience with Apache NiFi
• Strong understanding of data security, governance, and compliance requirements
• Experience building real-time, large-scale data pipelines
• Working knowledge of cloud platforms (AWS, Azure, or GCP), particularly in secure deployments
• Experience using Infrastructure as Code tools
• Excellent communication and stakeholder management skills
• Detail-oriented with a strong focus on data accuracy, quality, and reliability

Salary (Rate): undetermined

City: Bristol

Country: United Kingdom

Working Arrangements: hybrid

IR35 Status: inside IR35

Seniority Level: Mid-Level

Industry: IT