ETL SDET with Pyspark

Summary: The ETL SDET with Pyspark role focuses on ensuring the quality and reliability of ETL processes and data integration workflows through automated testing. The position requires collaboration with data engineers and developers to address data quality issues while leveraging expertise in ETL testing and data validation. The ideal candidate will have extensive experience in automation frameworks and strong SQL skills, particularly in cloud environments. This is a remote contract position with a focus on enhancing data pipeline performance and integrity.

Key Responsibilities:

• Review requirements specifications and technical design documents to understand and provide feedback.
• Develop and implement test strategies for complex initiatives.
• Estimate, prioritize, plan, and coordinate testing activities.
• Create automation test framework.
• Design, develop, and execute automation scripts.
• Identify, record, document thoroughly, and track bugs.
• Perform thorough regression testing when bugs are resolved.
• Develop and apply testing processes for new and existing features to meet client needs.
• Liaise with cross-functional teams to identify system requirements.
• Track quality assurance metrics like defect densities and open defect counts.
• Stay up to date with new testing tools and test strategies requirements.
• Support and guide junior team members.

Key Skills:

• At least 10 years of IT experience with a minimum of 5 years in ETL testing and automation framework development.
• Proficiency in ETL Testing and developing automation framework test cases in at least one scripting language.
• Mandatory experience in Pyspark.
• Strong SQL skills with experience in handling big data using ETL tools (e.g., Informatica).
• Testing experience in cloud environments (AWS S3).
• Experience with Test Automation and DevOps practices in ETL and Cloud.
• Experience providing testing oversight in Agile teams.
• Excellent business communication skills to interact with business and cross-functional teams.

Salary (Rate): undetermined

City: undetermined

Country: USA

Working Arrangements: remote

IR35 Status: outside IR35

Seniority Level: undetermined

Industry: IT