Urgent: Data Quality Engineer or ETL Tester

Urgent: Data Quality Engineer or ETL Tester

Posted 2 days ago by MHK TECH INC

Apply
Negotiable
Undetermined
Remote
Remote
Apply
Ab Initio (Software) Agile Methodology Airflow Apache Airflow Apache Kafka Application Lifecycle Management Automation Azure Kubernetes Service Bash (Scripting Language) Big Data Business Intelligence Business Operations Continuous Integration and Continuous Delivery Datamodel Data Modeling Data Quality Data Warehousing Docker (Software) Er Diagrams Extract Transform Load (ETL) File Servers Generic Programming Informatica JIRA Kubernetes Management Microsoft SQL Servers Nice (Unix Utility) Power BI Python (Programming Language) Rally Software Snowflake (Data Warehouse) Software Development SQL (Programming Language) SQLDB Tableau (Business Intelligence Software) Talend Test Automation Test Management Test Management Tools Test Planning Test Strategy Test Suite Unit Testing User Acceptance Testing (UAT) User Interface Verification And Validation Web SQL Databases

Summary: The role of Data Quality Engineer or ETL Tester involves expertise in writing and executing test cases, managing large data sets, and creating automation scripts. The position requires collaboration with data professionals and engineers to address reporting needs, alongside a strong focus on ETL processes and automation testing. Candidates should have experience with SQL queries, orchestration tools, and Agile methodologies. A proactive attitude and leadership abilities are essential for success in this role.

Key Responsibilities:

  • Write and execute test cases, manage and analyze large data sets, and create automation scripts.
  • Collaborate with data professionals, engineers, and business operation experts to address reporting needs.
  • Create and maintain complex SQL queries and execute ETL jobs using orchestration tools.
  • Conduct and facilitate User Acceptance Testing (UAT).
  • Implement CI/CD through Jenkins/GitLab/Maven and review technical requirements for testing strategies.
  • Create test plans and execute strategies for applications using ETL components.
  • Utilize frontend (UI) to generate test scenarios and validate backend data.
  • Write Python tests using unit test frameworks and work with Kafka messaging.

Key Skills:

  • Solid understanding of test automation architecture and framework using Python and Bash Scripts.
  • Strong knowledge of SQL queries for database validation and data warehouse testing.
  • Hands-on experience with data models and ER diagrams.
  • Experience with traditional SQL databases and cloud-native data warehouses.
  • Familiarity with ETL tools and reporting tools like Tableau and PowerBI.
  • Experience with agile test management tools such as HP ALM, Jira, and Rally.
  • Knowledge of Docker and Kubernetes is a plus.

Salary (Rate): undetermined

City: undetermined

Country: undetermined

Working Arrangements: remote

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

Be an expert in writing and executing test cases, managing and analyzing large sets of data, creating automation scripts, and communicating relevant insights to the team

Love to collaborate with other data professionals, engineers, and business operation experts to understand and address reporting needs

Experience with both traditional and big data streaming

Create and maintain complex SQL queries such as; type 2 triggers, various joins, aggregations, groupings, and more

Execute ETL jobs using orchestration tools (airflow/scheduler/SQL agent)

Have a working knowledge and testing experience of ETL

Be proactive with leadership abilities with a strong can do attitude

Possesses heavy experience with automation testing for ETL

Highly detailed oriented

Strong willingness & comfort in taking on and challenging development approaches

Conduct and facilitate UAT

Previously worked in Agile and Scrum

What You Will Need:

Solid understanding of test Automation architecture, framework, and Automation script creation using programming language Python, Bash Scripts, etc. and Orchestration tools like Apache Airflow, Luigi

Strong knowledge of creating SQL queries for source to target database validation and Data warehouse testing

Hands-on experience interpreting and understanding data models and ER diagrams

Experienced in traditional SQL DB (MySQL, Postgres, SQL server) and cloud-native data warehouses Snowflake or Redshift

Experienced in ETL tools Informatica, ab initio, Talend, and reporting tools - Tableau and PowerBI

Create and execute strategies and test cases for applications that use ETL components

CI/CD implementation through Jenkins/GitLab/Maven

Experienced with HP ALM, Jira, rally any agile test management tools

Implement the orchestration of business flows on given problem statements for the automation of complex scenarios

Review technical requirements with data warehouse and business intelligence terminology to produce test strategies, test scenarios, and test cases for the data warehouse team

Create the test plan for the software release, defining resources, and test suites required for each test cycle, dependencies, risks, and the overall strategy for testing complex systems and applications

Experienced in using frontend (UI) to generate test scenarios and validate data in the backend

Write Python test using unit test framework

Experience with Kafka messaging is desired

Rest APIs

Docker and Kubernetes experience is a nice to have

Apply
Similar Jobs
Loading data...