Job Summary
The SDET (Software Development Engineer in Test) is responsible for ensuring the quality and reliability of ETL processes and data integration workflows. This role involves designing and implementing automated tests to validate data transformation and migration, as well as collaborating with data engineers and developers to identify and resolve data quality issues.
The ideal candidate will leverage their expertise in ETL testing and data validation to enhance overall data pipeline performance and integrity.
Minimum Qualifications
- At least 8 years of experience in IT.
- Minimum 5 years of experience in the technical skills listed below.
Technical Skills
- ETL Testing and Automation
- Proficiency in ETL testing.
- Developing automation frameworks and test cases using at least one scripting language.
- SQL and ETL Tools
- Strong SQL skills.
- Experience handling big data using ETL tools such as Informatica.
- PySpark
- Mandatory work experience with PySpark.
- AWS Cloud Testing
- Testing experience in the AWS cloud environment.
- Experience with the following AWS services and tools:
- S3
- SSS (as shown in the image; verify the intended service)
- AWS Glue
- Amazon EMR
- AWS Data Catalog
- AWS Crawler
- Amazon SQS
- ETL Jobs
- Amazon EventBridge
- Amazon Athena
- Amazon Redshift Spectrum Databases
- AWS Commands and File Processing
- Experience using AWS commands to run jobs and perform file processing and movements.
- Test Automation and DevOps
- Experience with test automation and DevOps practices in ETL and cloud systems.
Rate:
Not specified
Location:
United States
IR35 Status:
Outside
Remote Status:
Remote
Industry:
Data & Analytics
Seniority Level:
Senior