Administrator
Summary: The role of Administrator focuses on managing and optimizing Kafka-based streaming services within the Streaming CoE lab. The position requires expertise in Kafka architecture, DevOps practices, Kubernetes, and cloud engineering to ensure reliable and scalable data streaming solutions. The role is based in Manchester and involves supporting real-time data ingestion and event-driven data flows. Two positions are available for this role.
Key Responsibilities:
- Manage Kafka architecture, including brokers, topics, partitions, and replication.
- Oversee Kafka components such as Kafka Connect, Schema Registry, and Streams.
- Handle topic and partition management, consumer groups, and performance tuning.
- Set up, upgrade, scale, and troubleshoot Kafka clusters.
- Implement CI/CD pipelines and configuration management for deployment automation.
- Utilize Kubernetes technologies and manage Helm charts and ArgoCD workflows.
- Ensure cloud engineering practices across AWS, Azure, or GCP.
- Monitor and maintain observability using tools like Prometheus and Grafana.
- Support ongoing optimization and reliability improvements for Streaming-as-a-Service tooling.
Key Skills:
- Core Kafka expertise, including architecture and performance tuning.
- DevOps and automation skills with CI/CD tools like Jenkins and GitHub Actions.
- Proficiency in Kubernetes and container management.
- Understanding of cloud platforms such as AWS, Azure, or GCP.
- Experience with monitoring tools like Prometheus and Grafana.
Salary (Rate): undetermined
City: Manchester
Country: United Kingdom
Working Arrangements: undetermined
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
In-Scope Technologies:
- Streaming Platform: Kafka, Kafka Connect, Schema Registry, Streams, ZooKeeper/KRaft
- DevOps / CI-CD: Jenkins, GitHub Actions, Azure DevOps
- Container Platform: Kubernetes, Helm, ArgoCD
- Cloud: AWS, Azure, GCP
- Monitoring: Prometheus, Grafana, Dynatrace, Confluent Control Centre
- Supporting: Terraform, Ansible
Core Kafka Expertise (Must-Have)
- Kafka architecture: brokers, topics, partitions, replication
- Kafka components: Kafka Connect, Schema Registry, Streams, ZooKeeper/Kraft
- Topic & partition management, consumer groups
- Performance tuning, retention, throughput optimisation
- Cluster setup, upgrades, scaling and failover
- Troubleshooting (e.g. lag, ISR, leader issues)
- Security: SSL/TLS, ACLs, authentication, encryption
2. DevOps & Automation Skills (Must-Have)
- CI/CD pipelines (Jenkins, GitHub Actions, Azure DevOps, etc.)
- Configuration management and deployment automation
3. Kubernetes & Container Platform Expertise (Must-Have)
- Understanding of Kubernetes technologies
- Helm charts, ArgoCD / GitOps workflows
- ConfigMaps, Secrets, cert management
- Rolling updates, pod lifecycle, scaling
4. Cloud Engineering (Must-Have)
- Understanding of any one of the Cloud platforms: AWS / Azure / GCP
5. Monitoring, Observability & Reliability (Must-Have)
- Monitoring tools: Prometheus, Grafana, Dynatrace, Confluent Control Centre
- Alerting & SRE practices
Scope of Services: Track400 within the Streaming CoE lab is focused on delivering and hardening enterprise Kafka-based streaming services, enabling real-time data ingestion, event-driven data flows, and multi-region, highly available streaming capabilities for IBS and CAT-A workloads. It also covers ongoing optimisation, reliability improvements, and operational support of Streaming-as-a-Service tooling to ensure scalable, secure, and performant data streaming across the platform. This requirement is for 2 roles based in Manchester.
Similar Jobs
Apologies, there are currently no similar jobs available.