SDET (ETL Testing ICEDQ / Query Surge)
Posted 2 days ago by 1761659562
Negotiable
Outside
Remote
USA
Summary: We are looking for a highly skilled Software Development Engineer in Test (SDET) specializing in ETL testing and data validation automation using ICEDQ or QuerySurge. The candidate should have extensive experience with AWS, Python/PySpark, SQL, and CI/CD tools, focusing on data accuracy and quality across data pipelines. This role is a long-term contract position that requires a strong background in automated testing frameworks and collaboration with data engineering and QA teams. The position is remote and outside IR35 regulations.
Key Responsibilities:
- Design, develop, and maintain automated ETL test frameworks using ICEDQ or QuerySurge.
- Validate large data sets between source, staging, and target systems for ETL workflows.
- Develop test scripts and automation frameworks using Python/PySpark for data verification.
- Perform API testing, SQL-based data validation, and end-to-end data quality testing.
- Collaborate with Data Engineering and QA teams to ensure robust data migration and transformation.
- Integrate test execution into CI/CD pipelines using Jenkins and GitHub.
- Work with AWS Services (S3, Lambda, Glue, Redshift, etc.) for testing cloud-based ETL pipelines.
- Utilize Unix/Linux for running automated jobs and validating ETL workflows.
- Document test results, log defects, and ensure continuous test improvement.
Key Skills:
- Strong experience in ETL testing and Data Validation Automation.
- Hands-on experience with ICEDQ or QuerySurge (mandatory).
- Proficiency in SQL, Python/PySpark, and Unix/Linux scripting.
- Familiar with AWS cloud services for data pipelines.
- Experience with GitHub, Jenkins, and CI/CD automation.
- Strong understanding of software testing techniques, test design, and data validation strategies.
- Excellent problem-solving, analytical, and communication skills.
Salary (Rate): undetermined
City: undetermined
Country: USA
Working Arrangements: remote
IR35 Status: outside IR35
Seniority Level: undetermined
Industry: IT
Role: SDET (ETL Testing ICEDQ / Query Surge)
Location: Remote USA
Experience: 10+ Years
Duration: Long-term Contract
Position Summary:
We are seeking a highly skilled Software Development Engineer in Test (SDET) with strong expertise in ETL testing and data validation automation using ICEDQ or QuerySurge. The ideal candidate will have hands-on experience with AWS, Python/PySpark, SQL, and CI/CD tools, focusing on ensuring data accuracy, integrity, and quality across data pipelines.
Key Responsibilities:
- Design, develop, and maintain automated ETL test frameworks using ICEDQ or QuerySurge.
- Validate large data sets between source, staging, and target systems for ETL workflows.
- Develop test scripts and automation frameworks using Python/PySpark for data verification.
- Perform API testing, SQL-based data validation, and end-to-end data quality testing.
- Collaborate with Data Engineering and QA teams to ensure robust data migration and transformation.
- Integrate test execution into CI/CD pipelines using Jenkins and GitHub.
- Work with AWS Services (S3, Lambda, Glue, Redshift, etc.) for testing cloud-based ETL pipelines.
- Utilize Unix/Linux for running automated jobs and validating ETL workflows.
- Document test results, log defects, and ensure continuous test improvement.
Required Skills & Experience:
- Strong experience in ETL testing and Data Validation Automation.
- Hands-on experience with ICEDQ or QuerySurge (mandatory).
- Proficiency in SQL, Python/PySpark, and Unix/Linux scripting.
- Familiar with AWS cloud services for data pipelines.
- Experience with GitHub, Jenkins, and CI/CD automation.
- Strong understanding of software testing techniques, test design, and data validation strategies.
- Excellent problem-solving, analytical, and communication skills.
Nice to Have:
- Exposure to Informatica or other ETL tools.
- Experience testing API integrations and data lakes.
- Knowledge of test automation frameworks for data engineering workflows.