Kafka Architect | Admin Exp | 8+ Years | Remote | Independent/H1B | Low Rate

Kafka Architect | Admin Exp | 8+ Years | Remote | Independent/H1B | Low Rate

Posted 1 week ago by 1753170981

Negotiable
Outside
Remote
USA

Summary: The Kafka Architect with Admin Experience is responsible for the installation, configuration, management, and monitoring of Apache Kafka clusters, ensuring high availability and optimal performance. This role requires a minimum of 8 years of experience and involves collaboration with various teams to integrate Kafka with different systems. The position is fully remote and is open to independent contractors and H1B visa holders. The focus is on managing Kafka environments, including security configurations and performance optimization.

Key Responsibilities:

  • Install, configure, manage, and monitor Apache Kafka clusters.
  • Ensure high availability, security, and optimal performance of Kafka environments.
  • Manage brokers, topics, and partitions within Kafka.
  • Collaborate with other teams for system integration.
  • Implement and manage security configurations, including access control and encryption.
  • Monitor performance and optimize Kafka for throughput and latency.
  • Troubleshoot issues within the Kafka ecosystem.
  • Create and maintain documentation for Kafka configurations and processes.
  • Automate routine tasks and develop scripts for cluster management.
  • Assess resource needs for effective scaling of the Kafka environment.

Key Skills:

  • Strong experience setting up Kafka clusters from scratch.
  • Hands-on experience in Kafka Cluster Management.
  • Kafka security configurations (Authentication, Authorization, Encryption, and audit logging).
  • Proficiency with Kafka Connect.
  • Knowledge of Cluster Linking and MirrorMaker.
  • Experience with Terraform/Ansible scripting.
  • Ability to install and configure the Confluent Platform.
  • Understanding of rebalancing, Schema Registry, and REST Proxies.
  • Familiarity with RBAC (Role-Based Access Control) and ACLs (Access Control Lists).

Salary (Rate): undetermined

City: undetermined

Country: USA

Working Arrangements: remote

IR35 Status: outside IR35

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

Position: Kafka Architect with Admin Experience
Location: 100% Remote
Experience: Min 8 Years Exp is needed (Low Rate)
Visa Status: Independent(No OPT/CPT) & H1B's workable on low rate

Job Description:
A Kafka Architect with Admin Experience is responsible for the installation, configuration, management, and monitoring of Apache Kafka clusters, ensuring high availability, security, and optimal performance. They manage the Kafka environment, including brokers, topics, and partitions, and work with other teams to integrate Kafka with various systems.

Required Skills & Experience:
Strong Experience setting up Kafka clusters from scratch.
Hands-on experience in Kafka Cluster Management.
Kafka security configurations(Authentication, Authorization, Encryption and audit logging)
Proficiency with Kafka Connect.
Knowledge of Cluster Linking and MirrorMaker.
Experience on Terraform/Ansible script.
Ability to install and configure the Confluent Platform.
Understanding of rebalancing, Schema Registry, and REST Proxies.
Familiarity with RBAC (Role-Based Access Control) and ACLs (Access Control Lists).

Administration Experience
Kafka Cluster Management: Installing, configuring, and maintaining Kafka clusters, including high availability and disaster recovery strategies.
Performance Optimization :Monitoring performance, identifying bottlenecks, and fine-tuning Kafka for optimal throughput and latency.
Security Management: Implementing and managing security configurations, including access control, authentication, and encryption.
Monitoring and Alerting: Setting up and maintaining monitoring and alerting systems to proactively identify and address issues.
Troubleshooting: Diagnosing and resolving issues within the Kafka ecosystem, including performance problems, connectivity issues, and data-related problems.
Integration: Collaborating with development and other teams to integrate
Kafka with other systems and applications, including data ingestion and real-time data streaming.
Documentation: Creating and maintaining documentation for Kafka configurations, processes, and procedures.
Automation: Automating routine tasks and developing scripts to streamline cluster management.
Capacity Planning: Assessing current and future resource needs to ensure the Kafka environment can scale effectively.