Data Architect (Kafka (Confluent) and AWS), London, UK

Data Architect (Kafka (Confluent) and AWS), London, UK

Posted Today by eTeam Workforce Limited

Apply
Negotiable
Inside
Hybrid
London, United Kingdom
Apply
Amazon Athena Amazon Web Services (AWS) Apache Avro Apache Kafka AWS Kinesis Confluent Data Architecture Management

Summary: The Data Architect role focuses on designing and implementing data solutions using Kafka (Confluent) and AWS technologies. The position is hybrid, requiring 2 to 3 days of work from the office, and is contracted for a duration of 6 months. The role demands expertise in streaming data architecture and schema management within the AWS ecosystem.

Key Responsibilities:

  • Design and implement streaming data architectures using Kafka and AWS services.
  • Manage schema compatibility and evolution using Avro and Protobuf.
  • Utilize AWS data stack components such as S3, Glue, Athena, and Redshift.
  • Develop and maintain streaming pipelines and data lakehouse patterns.

Key Skills:

  • Expertise in Kafka (Confluent) and AWS services (Kinesis, Glue, etc.).
  • Proficient in schema management with Avro and Protobuf.
  • Experience with AWS data stack including S3, Glue, Athena, and Redshift.
  • Knowledge of streaming data pipelines and DLQ patterns.

Salary (Rate): £495 daily

City: London

Country: United Kingdom

Working Arrangements: hybrid

IR35 Status: inside IR35

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

We are a Global Recruitment specialist that provides support to the clients across EMEA, APAC, US and Canada. We have an excellent job opportunity for you.

Role Title: Data Architect
Work mode: Hybrid, 2 to 3 days WFO
Contract duration: 6 months
Max Rate: 450 - 495 pounds/day on Inside

Must-Have Skills:

Streaming EDA:

  • Kafka (Confluent) and AWS: Kinesis, Kinesis Firehose -Outbox, ordering, replay, exactly-at-least-once semantics -EventBridge for event routing and filtering

Schema Management:

  • Avro, Protobuf

  • Schema Registry: compatibility, subject strategy, evolution

AWS Data Stack:

  • S3, Glue, Athena, Redshift

  • Step Functions, Lambda

  • Iceberg-ready lakehouse patterns

Streaming Pipelines:

  • Kinesis S3 Glue

  • Glue Streaming

  • DLQ patterns

If you are interested in this position and would like to learn more, please send through your CV and we will get in touch with you as soon as possible. Please note, candidates are often Shortlisted within 48 hours.

Apply
Similar Jobs
Loading data...