Summary: The Kafka Real-Time Architect is tasked with designing and implementing scalable real-time data processing systems using Kafka. This role requires expertise in architecting Kafka clusters, ensuring high availability, and integrating with various data processing tools. The architect will collaborate with cross-functional teams to meet data requirements and implement security measures while monitoring performance and providing technical support. Staying updated with Kafka's latest features and industry practices is also essential for success in this position.

Key Responsibilities:

• Designing and architecting scalable, real-time systems in Kafka.
• Configuring, deploying, and maintaining Kafka clusters for high availability and scalability.
• Integrating Kafka with other data processing tools and platforms such as Kafka Streams, Kafka Connect, Spark Streaming, Schema Registry, Flink, and Beam.
• Collaborating with cross-functional teams to understand data requirements and design solutions.
• Implementing security measures to protect Kafka clusters and data streams.
• Monitoring Kafka performance and troubleshooting issues for optimal performance.
• Providing technical guidance and support to development operations teams.
• Staying updated with the latest Kafka features, updates, and industry practices.

Key Skills:

• Extensive experience with Apache Kafka and real-time architecture including event-driven frameworks.
• Strong knowledge of Kafka Streams, Kafka Connect, Spark Streaming, Schema Registry, Flink, and Beam.
• Experience with cloud platforms such as GCP Pub/Sub.
• Excellent problem-solving skills.
• Knowledge of Kafka data pipelines and messaging solutions for real-time data processing.
• Experience in monitoring Kafka performance and enhancing operational efficiency.
• Ability to collaborate with development teams for Kafka application integration.
• Experience in maintaining an architectural library for Kafka deployment models and patterns.
• Assisting developers with Kafka connectors and topics schemas for streamlined data ingestion.

Salary (Rate): undetermined

City: Leeds

Country: United Kingdom

Working Arrangements: undetermined

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT