Key Responsibilities
- Design systems using microservice-style architecture, with Apache Kafka as a core building block for event-driven data flow
- Own schema management using tools such as Confluent Schema Registry, ensuring consistency and governance across streaming data contracts
- Apply strong understanding of Kafka concepts - brokers, producers, consumers, partitioning, and topic design - to build resilient, scalable data pipelines
- Design stream processing frameworks using Kafka Streams, Apache Spark, or equivalent technologies
- Develop Canonical Data Models aligned with Kafka topic design, ensuring data consistency across producers and consumers
- Triage new requirements, assess their impact, and provide estimates for modifying data models accordingly
- Develop and enhance business physical data models to meet evolving needs, driving alignment as necessary
- Act as custodian of data models, defining and owning modelling standards and principles within delivery teams
- Create solutions that fulfil business needs and align with end-state architecture, documenting and centrally managing data models
- Collaborate with the broader architecture community, sharing expertise to promote alignment and innovation
What You Will Ideally Bring
- Strong, hands-on understanding of Apache Kafka concepts (broker, producer, consumer, topic design) and real-world experience designing Kafka-based data flows
- Experience designing stream processing frameworks - Kafka Streams, Apache Spark, or similar
- Schema Management experience, ideally with Confluent Schema Registry or an equivalent tool
- Canonical Data Modelling experience aligned with Kafka topic design
- Experience designing microservice-style architectures
- Understanding of Cloud Infrastructure, AWS preferred
- Strong expertise in data warehousing, analytic end-to-end architecture, and modelling methodologies - 3NF, Dimensional, and Data Vault
- Proven experience as a Data Architect or Data Modeller, comfortable working with vast and complex data sets
- Knowledge of machine learning and modern algorithmic techniques at scale
- Excellent communication skills for interacting with stakeholders and presenting technical concepts
Contract Details:
- Duration: 6 months
- Rate: £525 day - InsideIR35
- Location: London, 2 days per week (Hybrid)
- Start Date: ASAP
Industry:
Data & Analytics
Seniority Level:
Not Specified