Introduction
International Solutions Group (ISG) is looking for a Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for architecting and optimizing our mission-critical financial data platforms. You will work on building high-throughput pipelines for quantitative analysis, regulatory reporting, and risk management.
Responsibilities
- Build and maintain high-performance ETL/ELT pipelines using Python and Java
- Optimize and maintain data frameworks using Hadoop and Apache Spark
- Deploy and scale containerized financial data applications in Amazon EKS
- Securely manage data continuity between On-Premises systems and AWS environments
- Implement data governance and end-to-end data lineage tracking
- Troubleshoot and optimize distributed processing jobs
Required Technical Skills
- Advanced proficiency in Python (Pandas, PySpark) and Java (Spring Boot)
- Mastery of Apache Spark and the Hadoop ecosystem
- Deep knowledge of Docker, Kubernetes, and Amazon EKS
- Experience with SQL, time-series databases, and relational platforms
- Experience with enterprise security frameworks
Preferred Skills
- 5+ years of data engineering experience in investment banking or fintech
- Knowledge of financial instruments and market data structures
- Bachelor's or Master's degree in Computer Science or related field