Summary: The Senior Data Engineer (Kafka) role involves designing and implementing scalable, high-performance real-time data processing systems using Apache Kafka. The position requires expertise in architecting resilient Kafka clusters and optimizing data pipelines to support critical business operations. The role is hybrid, requiring two days on-site in London, and is classified as inside IR35. The contract is for six months with a possibility of extension.

Key Responsibilities:

• Architect and implement scalable, real-time data processing systems using Kafka.
• Deploy, configure, and maintain Kafka clusters.
• Integrate Kafka with data processing frameworks such as Kafka Streams, Kafka Connect, Spark Streaming, Schema Registry, Flink, and Beam.
• Ensure security and performance by implementing best practices, monitoring system health, and resolving issues proactively.
• Work closely with cross-functional teams, providing technical guidance while staying updated on the latest Kafka advancements and industry trends.

Key Skills:

• Skilled in optimizing Kafka clusters for high availability, security, and performance, with hands-on experience in troubleshooting and monitoring.
• Strong communicator and collaborator, able to work with cross-functional teams to design scalable solutions that meet business and technical requirements.

Salary (Rate): undetermined

City: London

Country: UK

Working Arrangements: hybrid

IR35 Status: inside IR35

Seniority Level: Senior

Industry: Consulting