Kafka devloper

Kafka devloper

Posted 2 weeks ago by Adroit People Limited (UK)

Apply
Negotiable
Undetermined
Hybrid
Sheffield, England, United Kingdom
Apply
Amazon Managed Streaming for Apache Kafka (Amazon MSK) Apache Kafka Apache Zookeeper Azure Kubernetes Service Confluent Data Integrity Google Cloud Platform (GCP) Kubernetes Microsoft Azure Python (Programming Language) Scripting

Summary: The role of a Senior Kafka Engineer involves designing, implementing, and maintaining high-throughput Kafka clusters, with a focus on upgrading existing clusters to the latest version. The candidate will lead Confluent migration efforts and ensure system availability through monitoring and troubleshooting. Collaboration with other engineers and mentoring junior staff are also key aspects of the position. This role requires extensive experience with Kafka architecture and cloud-based deployments.

Key Responsibilities:

  • Design, implement, and maintain high-throughput, low-latency Kafka clusters.
  • Lead the upgrade of existing Kafka clusters from version 3.3.1 to the latest supported version, ensuring minimal downtime and data integrity.
  • Experience in Confluent migration.
  • Develop and implement monitoring and alerting systems for Kafka.
  • Troubleshoot and resolve Kafka-related issues.
  • Participate in on-call rotation to ensure 24/7 system availability.
  • Collaborate with other engineers to integrate Kafka into existing systems.
  • Design and implement Kafka security best practices.
  • Contribute to the improvement of Kafka infrastructure.
  • Mentor junior engineers and share expertise.
  • Stay current with the latest Kafka technologies and best practices.

Key Skills:

  • 8+ years of experience working with Apache Kafka.
  • Proven experience upgrading Kafka clusters, specifically from version 3.3.1 to a current supported version.
  • Strong understanding of Kafka architecture, including topics, partitions, consumers, and producers.
  • Experience with Kafka Connect.
  • Experience with Kafka Zookeeper, Kraft.
  • Experience working in Confluent Kafka.
  • Experience in deploying the Kafka image in Kubernetes.
  • Experience in setting up Stretched Kafka Cluster.
  • Experience with Kafka Streams or ksqlDB a plus.
  • Proficiency in at least one scripting language (e.g., Python, Shell).
  • Experience with cloud-based Kafka deployments (AWS, Azure, GCP) is highly preferred.
  • Experience with Kafka monitoring and alerting tools.
  • Excellent problem-solving and troubleshooting skills.
  • Strong communication and collaboration skills.

Salary (Rate): undetermined

City: Sheffield

Country: United Kingdom

Working Arrangements: hybrid

IR35 Status: undetermined

Seniority Level: Senior

Industry: IT

Apply
Similar Jobs
Loading data...