All Jobs Vacancy

Senior Data Integration Engineer ( holders only)

Posted 2 weeks ago by Vertex solutions consulting

Role overview

We are looking for a Senior Data Integration Engineer to design, implement and operate reliable integrations between a cloud data platform and an established data-processing application. The role will focus on building production-grade integration solutions, ensuring data consistency, compatibility, traceability and seamless processing across multiple services.

Key responsibilities:

  • Design and implement source-to-application integrations, adapters and data transformation workflows.
  • Develop and maintain batch and change-data processing pipelines using Python and SQL.
  • Work with APIs, XML/JSON and integration services to enable reliable data exchange.
  • Ensure record identity, data consistency and compatibility with existing applications.
  • Implement robust logging, monitoring, retries, error handling and replay mechanisms.
  • Develop automated tests and validate integrations across multiple services.
  • Troubleshoot end-to-end data flows and trace individual records across systems.
  • Evaluate and recommend whether to modify existing applications, introduce adapters, or use shared data models.
  • Collaborate with engineering teams to ensure reliable, maintainable and production-ready integration solutions.

Required skills and qualifications:

  • 9+ years of experience building and operating production-grade data integrations.
  • Strong hands-on experience with Python and SQL.
  • Experience working with REST APIs and data formats such as XML and JSON.
  • Strong understanding of batch processing and change-data processing.
  • Experience developing integration adapters and transformation workflows.
  • Hands-on experience with automated testing, logging, retries and replay mechanisms.
  • Ability to troubleshoot and trace data across multiple services and processing layers.

Must have skills:

  • Python and SQL
  • API and data processing
  • XML/JSON
  • Batch and change-data processing
  • Integration adapters and data transformations
  • Automated testing
  • Error handling, logging, retry and replay
  • Strong understanding of end-to-end data flow and record traceability

Good to have skills:

  • Experience with AWS Cloud services.
  • Hands-on experience with RabbitMQ.
  • Experience with MongoDB and Solr.
  • Knowledge of cloud-based data platforms and distributed systems.
  • Familiarity with CI/CD and DevOps practices.

Desired attributes:

  • Strong problem-solving and troubleshooting skills.
  • Ability to make sound architectural decisions around adapters, application changes and shared models.
  • Strong focus on data accuracy, reliability and system compatibility.
  • Excellent communication and collaboration skills.
  • Ability to work independently and take end-to-end ownership of integration solutions.
  • Strong engineering mindset with a focus on maintainability, testability and production readiness.
Rate:
Not specified
Location:
Remote
IR35 Status:
Not specified
Remote Status:
Remote
Industry:
Data & Analytics
Seniority Level:
Senior

Take-Home Pay

Not Available

Visit calculators for additional details

Share job