Kafka Architect
Posted 2 weeks ago by Infoplus Technologies UK Limited on Linkedin
Negotiable
Undetermined
Undetermined
Leeds, England, United Kingdom
Summary: The Kafka Architect is responsible for designing and implementing scalable, real-time data processing systems using Kafka. This role requires expertise in architecting Kafka clusters, ensuring high availability, and integrating with various data processing tools. The architect will collaborate with cross-functional teams to meet business data requirements and implement security measures for data protection. Additionally, the role involves monitoring performance and providing technical support to development operations teams.
Key Responsibilities:
- Designing and architecting scalable, real-time systems in Kafka.
- Configuring, deploying, and maintaining Kafka clusters to ensure high availability and scalability.
- Integrating Kafka with other data processing tools and platforms such as Kafka Streams, Kafka Connect, Spark Streaming, Schema Registry, Flink, and Beam.
- Collaborating with cross-functional teams to understand data requirements and design solutions that meet business needs.
- Implementing security measures to protect Kafka clusters and data streams.
- Monitoring Kafka performance and troubleshooting issues to ensure optimal performance.
- Providing technical guidance and support to development operations teams.
- Staying updated with the latest Kafka features, updates, and industry practices.
Key Skills:
- Extensive experience with Apache Kafka and real-time architecture including event-driven frameworks.
- Strong knowledge of Kafka Streams, Kafka Connect, Spark Streaming, Schema Registry, Flink, and Beam.
- Experience with cloud platforms such as GCP Pub/Sub.
- Excellent problem-solving skills.
- Knowledge of Kafka data pipelines and messaging solutions.
- Experience in monitoring Kafka performance and enhancing operational efficiency.
- Ability to collaborate with development teams to integrate Kafka applications and services.
- Experience in maintaining Kafka connectors and topics schemas.
Salary (Rate): undetermined
City: Leeds
Country: United Kingdom
Working Arrangements: undetermined
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT