Job Description
We are looking for an experienced Snowflake Data Engineer with strong expertise in Python, SQL, PySpark, and Snowflake. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and data solutions.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Python, PySpark, SQL, and Snowflake.
- Develop and optimize ETL/ELT processes for large-scale data integration and transformation.
- Write complex and optimized SQL queries for data processing and analysis.
- Develop data transformation and processing solutions using PySpark / Apache Spark.
- Work with Snowflake for data loading, transformation, performance tuning, and data management.
- Integrate data from multiple sources and ensure data quality and consistency.
- Troubleshoot and resolve data pipeline and production issues.
- Optimize data pipelines and queries for better performance and scalability.
- Collaborate with Data Engineers, Developers, Analysts, and business teams to understand data requirements.
- Follow best practices for coding, testing, documentation, and deployment.
- Participate in an Agile/Scrum development environment.
Required Skills
- Strong hands-on experience with Snowflake.
- Strong programming experience in Python.
- Strong knowledge of SQL.
- Hands-on experience with PySpark / Apache Spark.
- Experience with ETL/ELT and data pipeline development.
- Experience working with large datasets and data transformation.
- Strong troubleshooting and problem-solving skills.
- Good understanding of data engineering concepts and best practices.
- Excellent communication and collaboration skills.