Kafka Developer
Posted Today by 1760607072
Negotiable
Outside
Remote
USA
Summary: The Kafka Developer role involves designing, developing, and implementing Kafka Connectors, particularly for integrating data with external systems and APIs. The position requires hands-on experience with Confluent Kafka and managing Kafka Connect clusters. The developer will also be responsible for monitoring performance, troubleshooting issues, and ensuring security measures are in place. This is a remote position based in the USA for a duration of 16 months.
Key Responsibilities:
- Design, develop, and implement Kafka Connectors, specifically leveraging HTTP/HTTPS Source and Sink Connectors, to integrate data with external systems and APIs.
- Configure, deploy, and manage Kafka Connect clusters and connectors within a Confluent Platform environment.
- Hands-on experience with managing Confluent Kafka On premise and Google Cloud platform.
- Work with various data formats and ensure proper schema evolution and compatibility.
- Monitor connector performance, troubleshoot issues, and optimize configurations for efficiency and reliability.
- Implement security measures for Kafka Connect and HTTP/HTTPS connectors, including SSL/TLS, authentication (e.g., Basic Auth, OAuth2), and authorization.
- Collaborate with development teams to understand data requirements and design appropriate data ingestion and delivery solutions.
- Document connector configurations, operational procedures, and best practices.
- Stay updated with the latest features and best practices in Confluent Platform, Kafka Connect, and related technologies.
- Strong understanding of Kafka Connect architecture, including connectors, tasks, and workers.
- Hands-on experience with configuring and deploying HTTP Source and Sink Connectors.
- Proficiency in working with RESTful APIs and understanding HTTP/HTTPS protocols.
- Ability to troubleshoot and resolve issues related to Kafka Connect and connector operations.
Key Skills:
- Kafka
- Middleware
- Confluent Kafka
Salary (Rate): undetermined
City: undetermined
Country: USA
Working Arrangements: remote
IR35 Status: outside IR35
Seniority Level: undetermined
Industry: IT
Role: Kafka Developer
Work Location: Richardson, TX 75082 (Remote)
Duration: 16 months
Must Have Skills:
- Kafka
- Middleware
- Confluent Kafka
Detailed Job Description:
High Level Responsibilities:
- Design, develop, and implement Kafka Connectors, specifically leveraging
- HTTP/HTTPS Source and Sink Connectors, to integrate data with external systems
- and APIs.
- Configure, deploy, and manage Kafka Connect clusters and connectors within anConfluent Platform environment.
- Hands on experience with managing Confluent Kafka On premise and Google Cloud
- platform
- Work with various data formats and ensure proper schema evolution andncompatibility.
- Monitor connector performance, troubleshoot issues, and optimize configurations for efficiency and reliability.
- Implement security measures for Kafka Connect and HTTP/HTTPS connectors, including SSL/TLS, authentication (e.g., Basic Auth, OAuth2), and authorization.
- Collaborate with development teams to understand data requirements and design
- appropriate data ingestion and delivery solutions.
- Document connector configurations, operational procedures, and best practices.
- Stay updated with the latest features and best practices in Confluent Platform, Kafka Connect, and related technologies.
- Strong understanding of Kafka Connect architecture, including connectors, tasks, and workers.
- Hands-on experience with configuring and deploying HTTP Source and Sink Connectors.
- Proficiency in working with RESTful APIs and understanding HTTP/HTTPS protocols.
- Ability to troubleshoot and resolve issues related to Kafka Connect and connector operations.