.NET Developer with Kafka & Confluent Cloud Experience
Summary: The role of Kafka Migration Engineer requires expertise in .NET and Kafka to migrate Kafka producers and consumers to Confluent Cloud for a client in London. The position involves strong coding skills in C#/.NET and familiarity with Kafka internals, including message serialization and troubleshooting connectivity issues. The contract duration is four months, with remote work and occasional office visits. The engineer will collaborate with .NET engineers to ensure successful integration and performance validation post-migration.
Key Responsibilities:
- Migrate all Kafka producers and consumers from DHLParcel.UK.Kafka to Confluent Cloud
- Update Confluent.Kafka .NET client configuration (SASL auth, Schema Registry, bootstrap servers)
- Validate message flows end-to-end for apps acting as both producer and consumer
- Ensure consumer group configurations, offset management, and error handling are correct post-migration
- Kafka throughput validation and performance testing
- Work with .NET engineers to resolve application-level Kafka integration issues
Key Skills:
- C# / .NET — strong coding ability (reading and modifying producer/consumer code)
- Confluent.Kafka .NET client library (ProducerBuilder, ConsumerBuilder, configuration)
- Confluent Cloud — SASL/PLAIN authentication, Schema Registry, ACLs
- Kafka internals: topics, partitions, consumer groups, offset management, rebalancing
- Message serialization (Avro, JSON Schema) with .NET-specific serializers/deserializers
- Troubleshooting Kafka connectivity and message flow issues in .NET applications
- Kafka monitoring (consumer lag, throughput, error rates)
Salary (Rate): undetermined
City: London
Country: United Kingdom
Working Arrangements: hybrid
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
Hiring Kafka Migration Engineer (.NET + Kafka) for our client in London. Location: London-Remote (With Once or twice a month office visit) Duration: 4 months Mode-Contract Note: This role requires strong .NET skills in addition to Kafka expertise. All producers and consumers are .NET applications
Required Skills
- C# / .NET — strong coding ability (reading and modifying producer/consumer code)
- Confluent.Kafka .NET client library (ProducerBuilder, ConsumerBuilder, configuration)
- Confluent Cloud — SASL/PLAIN authentication, Schema Registry, ACLs
- Kafka internals: topics, partitions, consumer groups, offset management, rebalancing
- Message serialization (Avro, JSON Schema) with .NET-specific serializers/deserializers
- Troubleshooting Kafka connectivity and message flow issues in .NET applications
- Kafka monitoring (consumer lag, throughput, error rates)
Responsibilities
- Migrate all Kafka producers and consumers from DHLParcel.UK.Kafka to Confluent Cloud
- Update Confluent.Kafka .NET client configuration (SASL auth, Schema Registry, bootstrap servers)
- Validate message flows end-to-end for apps acting as both producer and consumer
- Ensure consumer group configurations, offset management, and error handling are correct post-migration
- Kafka throughput validation and performance testing
- Work with .NET engineers to resolve application-level Kafka integration issues
Nice to Have
- Experience with apps that are both consumers and producers (event-driven architectures)
- Schema evolution and compatibility strategies in Schema Registry
- Performance tuning (batch size, linger.ms, compression) for .NET producers
- Kafka Connect and MirrorMaker for migration scenarios
Similar Jobs
Apologies, there are currently no similar jobs available.