Negotiable
Outside
Remote
USA
Summary: The ETL SDET role focuses on ensuring the quality and reliability of ETL processes and data integration workflows. The position requires designing and implementing automated tests while collaborating with data engineers and developers to address data quality issues. Candidates should have extensive experience in ETL testing and data validation to improve data pipeline performance. This is a contract position based in NYC, NY, with remote work options available.
Key Responsibilities:
- Ensure the quality and reliability of ETL processes and data integration workflows.
- Design and implement automated tests to validate data transformation and migration.
- Collaborate with data engineers and developers to identify and resolve data quality issues.
- Leverage expertise in ETL testing and data validation to enhance data pipeline performance and integrity.
Key Skills:
- ETL Testing, SDET, Python/PySpark
- AWS S3, Redshift
- Complex SQL
- Kafka, Shell scripting, Healthcare domain (good to have)
- Proficiency in developing automation frameworks and test cases in at least one scripting language.
- Strong SQL skills with experience in handling big data using ETL tools (e.g., Informatica).
- Testing experience in cloud environments (AWS S3).
- Experience with Test Automation and DevOps practices in ETL and Cloud.
- Work experience in a Big Data ecosystem processing data in data lakehouse.
- Familiarity with DBT (Data Build Tool) or similar data transformation tools is a plus.
- Experience providing testing oversight in Agile teams.
Salary (Rate): undetermined
City: New York
Country: USA
Working Arrangements: remote
IR35 Status: outside IR35
Seniority Level: undetermined
Industry: IT
Must-Have Skills:
- ETL Testing, SDET, Python/PySpark
- AWS S3, Redshift
- Complex SQL
Good to Have:
- Kafka, Shell scripting, Healthcare domain
- The SDET (Software Development Engineer in Test) is responsible for ensuring the quality and reliability of ETL processes and data integration workflows.
- This role involves designing and implementing automated tests to validate data transformation and migration, as well as collaborating with data engineers and developers to identify and resolve data quality issues.
- The ideal candidate will leverage their expertise in ETL testing and data validation to enhance the overall data pipeline performance and integrity.
At least 8 years of IT experience with minimum 5 years of experience in below skills:
- Proficiency in ETL Testing and developing automation framework & testcases in atleast one scripting language.
- Strong SQL skills, with experience in handling big data using ETL tools (e.g., Informatica).
- Testing experience in cloud environment (AWS s3)
- Experience with Test Automation and DevOps practices in ETL and Cloud
- Work experience in a Big Data ecosystem processing data in data lakehouse.
- Familiarity with DBT (Data Build Tool) or similar data transformation tools is a plus.
- Experience providing testing oversight in Agile team.