Data Federation Engineer (Apache Kafka / Java / Python)

Data Federation Engineer (Apache Kafka / Java / Python)

Posted 2 weeks ago by ISR RECRUITMENT LIMITED

£80 Per hour
Outside
Remote
Nationwide

Summary: The Data Federation Engineer role focuses on designing and implementing a federated data-sharing platform to facilitate secure data exchange across organizational boundaries. This position requires strong technical skills in Apache Kafka, Java, and Python, and is integral to supporting public sector collaboration and digital transformation. The role is remote and initially set for a duration of six months. Candidates must be eligible for BPSS security clearance.

Key Responsibilities:

  • Design, implement, and operationalize a federated data-sharing platform.
  • Utilize Apache Kafka for producer/consumer patterns, topic management, and streaming architecture.
  • Develop secure, scalable microservices using Java, preferably with Spring Boot or equivalent frameworks.
  • Employ Python for scripting, automation, and data processing tasks.
  • Deploy federated or decentralized data solutions that ensure secure access and compliance.
  • Collaborate with public sector organizations or regulated environments.

Key Skills:

  • Strong hands-on experience with Apache Kafka.
  • Proficiency in Java and experience with microservices.
  • Solid experience in Python for automation and data processing.
  • Experience in deploying secure federated data solutions.
  • Familiarity with public sector or regulated environments.

Salary (Rate): £80/hour

City: undetermined

Country: UK

Working Arrangements: remote

IR35 Status: outside IR35

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

Data Federation Engineer
Remote Working
6 months (initially)
c£650 per day (Outside IR35)

The Opportunity:
We are seeking a technically proficient and strategically minded Data Federation Engineer to join a high-impact programme focused on enabling secure, decentralised data exchange across organisational boundaries. This role is integral to the design, implementation, and operationalisation of a federated data-sharing platform, supporting public sector collaboration, digital transformation, and cross-entity interoperability.

Skills and Experience:

  • Strong, hands-on experience with Apache Kafka – including producer/consumer patterns, topic management, and streaming architecture.
  • Proficiency in Java – with a background in building secure, scalable microservices (preferably with Spring Boot or equivalent frameworks).
  • Solid experience in Python – particularly for scripting, automation, and data processing tasks.
  • Demonstrated experience in deploying federated or decentralised data solutions that prioritise secure access, data sovereignty, and compliance.
  • Familiarity with working in or alongside public sector organisations or regulated environments (desirable).

Role and Responsibilities:

  • Strong, hands-on experience with Apache Kafka – including producer/consumer patterns, topic management, and streaming architecture.
  • Proficiency in Java – with a background in building secure, scalable microservices (preferably with Spring Boot or equivalent frameworks).
  • Solid experience in Python – particularly for scripting, automation, and data processing tasks.
  • Demonstrated experience in deploying federated or decentralised data solutions that prioritise secure access, data sovereignty, and compliance.
  • Familiarity with working in or alongside public sector organisations or regulated environments (desirable).

NB: Candidates must be eligible for BPSS security clearance which will processed following successful interviews (7-10 days).

Applications:
To learn and understand more about our client’s new six month contract role operating as a Data Federation Engineer on a remote-working basis here in the UK; please call and speak with Edward Laing here at ISR on (phone number removed) or please email me a copy of your latest CV for an immediate call back in the very strictest of confidence.
Please call Edward here at ISR on (phone number removed) to learn more about our client and how they are leading the way in developing the next-generation of technical solutions through innovation and transformational technology?