We are looking for an experienced Data Engineer with strong hands-on Go (Golang) development experience to design, build, and maintain scalable data pipelines and data processing systems.
The ideal candidate will have a strong background in data engineering, Go development, distributed systems, APIs, cloud platforms, and large-scale data processing. The candidate will work closely with software engineers, data scientists, and cross-functional teams to build reliable and high-performance data solutions.
Key Responsibilities
- Design, develop, and maintain scalable and reliable data pipelines using Go/Golang.
- Develop high-performance data processing and ingestion services using Go.
- Build and maintain REST APIs and backend services supporting data platforms and applications.
- Design and implement ETL/ELT pipelines for batch and real-time data processing.
- Work with structured and unstructured data from multiple sources and ensure data quality and consistency.
- Optimize data processing workflows for performance, scalability, and reliability.
- Develop distributed systems and services capable of processing large volumes of data.
- Integrate data pipelines with databases, data warehouses, APIs, and cloud services.
- Implement monitoring, logging, alerting, and troubleshooting mechanisms for data pipelines and services.
- Collaborate with software engineers, data scientists, analysts, and product teams to understand data requirements.
- Participate in architecture discussions and contribute to technical design decisions.
- Develop automated unit, integration, and performance tests.
- Troubleshoot production issues and identify root causes of data and application failures.
- Follow software engineering best practices including Git, CI/CD, code reviews, documentation, and Agile methodologies.
Required Skills
- Go / Golang