Senior Data Engineer – Kafka & Microservices

Senior Data Engineer – Kafka & Microservices

Posted 1 week ago by GIOS Technology

Apply
Negotiable
Undetermined
Hybrid
Glasgow, Scotland, United Kingdom
Apply
Amazon Managed Streaming for Apache Kafka (Amazon MSK) Apache Kafka Application Programming Interface (API) Azure Kubernetes Service Data Ingestion Data Processing Data Quality DevOps Docker (Software) Financial Services Java (Programming Language) Kubernetes Microservices MongoDB NoSQL Python (Programming Language) Spring Boot

Summary: The Senior Data Engineer role focuses on developing scalable, event-driven data platforms in a financial services setting. The position requires expertise in designing microservices and building real-time data pipelines using technologies such as Java, Python, and Apache Kafka. Collaboration with cross-functional teams is essential to ensure data quality and reliability. The role is hybrid, requiring 2 to 3 days on-site in Glasgow, UK.

Key Responsibilities:

  • Design and develop data-driven microservices using Java (Spring Boot) and/or Python.
  • Build and maintain real-time and near real-time data pipelines using Apache Kafka.
  • Develop scalable REST APIs and backend services for data processing and integration.
  • Implement data ingestion, transformation, and persistence layers ensuring data quality and reliability.
  • Work with MongoDB and NoSQL databases, applying efficient data modelling techniques.
  • Collaborate with cross-functional teams and contribute to architecture, DevOps practices, and production support.

Key Skills:

  • Java
  • Spring Boot
  • Python
  • Apache Kafka
  • Microservices
  • REST APIs
  • MongoDB
  • Docker
  • Kubernetes
  • CI/CD

Salary (Rate): undetermined

City: Glasgow

Country: United Kingdom

Working Arrangements: hybrid

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

I am hiring for Senior Data Engineer – Kafka & Microservices

Location: Glasgow, UK (Hybrid – 2 to 3 days onsite)

Job Description:

We are hiring a Senior Data Engineer to work on scalable, event-driven data platforms within a leading financial services environment.

Design and develop data-driven microservices using Java (Spring Boot) and/or Python

Build and maintain real-time and near real-time data pipelines using Apache Kafka

Develop scalable REST APIs and backend services for data processing and integration

Implement data ingestion, transformation, and persistence layers ensuring data quality and reliability

Work with MongoDB and NoSQL databases, applying efficient data modelling techniques

Collaborate with cross-functional teams and contribute to architecture, DevOps practices, and production support

Key Skills:

Java, Spring Boot, Python, Apache Kafka, Microservices, REST APIs, MongoDB, Docker, Kubernetes, CI/CD

Apply
Similar Jobs
Loading data...