Data QA Engineer

Data QA Engineer

Posted Today by 1765010440

Negotiable
Outside
Remote
USA

Summary: The SDET Software Development Engineer in Test is tasked with ensuring the quality and reliability of ETL processes and data integration workflows. This role focuses on designing and implementing automated tests for data validation while collaborating with data engineers and developers to address data quality issues. The ideal candidate will have extensive experience in ETL testing and data validation, particularly with Pyspark. Strong communication skills are essential for effective interaction with business and cross-functional teams.

Key Responsibilities:

  • Review requirements specifications and technical design documents to understand and provide feedback.
  • Develop and implement test strategies for complex initiatives.
  • Estimate, prioritize, plan, and coordinate testing activities.
  • Create automation test framework.
  • Design, develop, and execute automation scripts.
  • Identify, record, document thoroughly, and track bugs.
  • Perform thorough regression testing when bugs are resolved.
  • Develop and apply testing processes for new and existing features to meet client needs.
  • Liaise with cross-functional teams to identify system requirements.
  • Track quality assurance metrics like defect densities and open defect counts.
  • Stay up to date with new testing tools and test strategies requirements.
  • Support and guide junior team members.

Key Skills:

  • Proficiency in ETL Testing and developing automation framework test cases in at least one scripting language.
  • Experience in Pyspark is Mandatory.
  • Strong SQL skills with experience in handling big data using ETL tools (e.g., Informatica).
  • Testing experience in cloud environment (AWS S3).
  • Experience with Test Automation and DevOps practices in ETL and Cloud.
  • Experience providing testing oversight in Agile teams.
  • Excellent business communication skills to interact with business teams and cross-functional teams.

Salary (Rate): undetermined

City: undetermined

Country: USA

Working Arrangements: remote

IR35 Status: outside IR35

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

Hi,

Hope you are doing well.

Position: SDET with Pyspark Coding Experience

Location: Remote

Job Description:

Position Summary

The SDET Software Development Engineer in Test is responsible for ensuring the quality and reliability of ETL processes and data integration workflows This role involves designing and implementing automated tests to validate data transformation and migration as well as collaborating with data engineers and developers to identify and resolve data quality issues The ideal candidate will leverage their expertise in ETL testing and data validation to enhance the overall data pipeline performance and integrity

Minimum Qualification

At least 10 years of IT experience with minimum 5 years of experience in below skills

Tech Skills

Proficiency in ETL Testing and developing automation framework test cases in at least one scripting language

Experience in Pyspark is Mandatory

Strong SQL skill with experience in handling big data using ETL tools eg Informatica

Testing experience in cloud environment AWS s3

Experience with Test Automation and DevOps practices in ETL and Cloud

Experience providing testing oversight in Agile team

Should have excellent business communication to interact with Business teams and cross functional teams

Responsibilities

Review requirements specifications and technical design documents to understand and feedback

Experience in developing and implementing test strategies for complex initiatives

Estimate prioritize plan and coordinate testing activities

Create automation test framework

Design develop and execute automation scripts

Identify record document thoroughly and track bugs

Strong problem solving skills troubleshooting and root cause analysis skills

Perform thorough regression testing when bugs are resolved

Develop and apply testing processes for new and existing features to meet client needs

Liaise with cross functional teams to identify system requirements

Track quality assurance metrics like defect densities and open defect counts

Stay up to date with new testing tools and test strategies requirements

Support and guide junior team members