The ideal candidate is a hands-on developer with deep technical expertise in modern data engineering technologies and experience working in large-scale enterprise cloud migration and modernization programs.
Required Qualifications
- Bachelor's degree in Computer Science, Information Systems, Engineering, or related field.
- 10+ years of IT experience with 6+ years in Data Engineering and Big Data development.
- Strong hands-on experience with PySpark and Spark-based data processing.
- Experience developing data pipelines on Cloudera Data Platform (CDP).
- Strong knowledge of Apache Iceberg table architecture and data lake concepts.
- Experience designing and managing workflows using Apache Airflow.
- Experience with SQL and data modeling techniques.
- Strong understanding of ETL/ELT development and data transformation frameworks.
- Experience working with large-scale structured and unstructured datasets.
- Knowledge of Git, CI/CD pipelines, and DevOps practices.
- Strong analytical, troubleshooting, and problem-solving skills.
- Excellent communication and collaboration skills.