Kafka Migration Engineer (.NET + Kafka)
Summary: This role seeks a Kafka Migration Engineer with strong .NET skills and Kafka expertise to migrate Kafka producers and consumers to Confluent Cloud. The position involves reading, modifying, and validating .NET Kafka client code, ensuring proper configurations, and validating message flows. Collaboration with .NET engineers to resolve integration issues is also a key aspect of the role. The candidate will be responsible for Kafka throughput validation and performance testing post-migration.
Key Responsibilities:
- Migrate all Kafka producers and consumers from Kafka to Confluent Cloud
- Update Confluent.Kafka .NET client configuration (SASL auth, Schema Registry, bootstrap servers)
- Validate message flows end-to-end for apps acting as both producer and consumer
- Ensure consumer group configurations, offset management, and error handling are correct post-migration
- Kafka throughput validation and performance testing
- Work with .NET engineers to resolve application-level Kafka integration issues
Key Skills:
- C# / .NET — strong coding ability (reading and modifying producer/consumer code)
- Confluent.Kafka .NET client library (ProducerBuilder, ConsumerBuilder, configuration)
- Confluent Cloud — SASL/PLAIN authentication, Schema Registry, ACLs
- Kafka internals: topics, partitions, consumer groups, offset management, rebalancing
- Message serialization (Avro, JSON Schema) with .NET-specific serializers/deserializers
- Troubleshooting Kafka connectivity and message flow issues in .NET applications
- Kafka monitoring (consumer lag, throughput, error rates)
Salary (Rate): undetermined
City: London Area
Country: United Kingdom
Working Arrangements: undetermined
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
This role requires strong .NET skills in addition to Kafka expertise. All producers and consumers are .NET applications — APIs produce messages, and some services both consume and produce. This is not an infrastructure-only Kafka role; it requires reading, modifying, and validating .NET Kafka client code.
Responsibilities
- Migrate all Kafka producers and consumers from Kafka to Confluent Cloud
- Update Confluent.Kafka .NET client configuration (SASL auth, Schema Registry, bootstrap servers)
- Validate message flows end-to-end for apps acting as both producer and consumer
- Ensure consumer group configurations, offset management, and error handling are correct post-migration
- Kafka throughput validation and performance testing
- Work with .NET engineers to resolve application-level Kafka integration issues
Required Skills
- C# / .NET — strong coding ability (reading and modifying producer/consumer code)
- Confluent.Kafka .NET client library (ProducerBuilder, ConsumerBuilder, configuration)
- Confluent Cloud — SASL/PLAIN authentication, Schema Registry, ACLs
- Kafka internals: topics, partitions, consumer groups, offset management, rebalancing
- Message serialization (Avro, JSON Schema) with .NET-specific serializers/deserializers
- Troubleshooting Kafka connectivity and message flow issues in .NET applications
- Kafka monitoring (consumer lag, throughput, error rates)
Nice to Have
- Experience with apps that are both consumers and producers (event-driven architectures)
- Schema evolution and compatibility strategies in Schema Registry
- Performance tuning (batch size, linger.ms, compression) for .NET producers
- Kafka Connect and MirrorMaker for migration scenarios
Similar Jobs
Apologies, there are currently no similar jobs available.