Role overview
We are looking for a Senior Data Integration Engineer to design, implement and operate reliable integrations between a cloud data platform and an established data-processing application. The role will focus on building production-grade integration solutions, ensuring data consistency, compatibility, traceability and seamless processing across multiple services.
Key responsibilities:
- Design and implement source-to-application integrations, adapters and data transformation workflows.
- Develop and maintain batch and change-data processing pipelines using Python and SQL.
- Work with APIs, XML/JSON and integration services to enable reliable data exchange.
- Ensure record identity, data consistency and compatibility with existing applications.
- Implement robust logging, monitoring, retries, error handling and replay mechanisms.
- Develop automated tests and validate integrations across multiple services.
- Troubleshoot end-to-end data flows and trace individual records across systems.
- Evaluate and recommend whether to modify existing applications, introduce adapters, or use shared data models.
- Collaborate with engineering teams to ensure reliable, maintainable and production-ready integration solutions.
Required skills and qualifications:
- 9+ years of experience building and operating production-grade data integrations.
- Strong hands-on experience with Python and SQL.
- Experience working with REST APIs and data formats such as XML and JSON.
- Strong understanding of batch processing and change-data processing.
- Experience developing integration adapters and transformation workflows.
- Hands-on experience with automated testing, logging, retries and replay mechanisms.
- Ability to troubleshoot and trace data across multiple services and processing layers.
Must have skills:
- Python and SQL
- API and data processing
- XML/JSON
- Batch and change-data processing
- Integration adapters and data transformations
- Automated testing
- Error handling, logging, retry and replay
- Strong understanding of end-to-end data flow and record traceability
Good to have skills:
- Experience with AWS Cloud services.
- Hands-on experience with RabbitMQ.
- Experience with MongoDB and Solr.
- Knowledge of cloud-based data platforms and distributed systems.
- Familiarity with CI/CD and DevOps practices.
Desired attributes:
- Strong problem-solving and troubleshooting skills.
- Ability to make sound architectural decisions around adapters, application changes and shared models.
- Strong focus on data accuracy, reliability and system compatibility.
- Excellent communication and collaboration skills.
- Ability to work independently and take end-to-end ownership of integration solutions.
- Strong engineering mindset with a focus on maintainability, testability and production readiness.