Data Engineer (ex employee of Walmart or Apex systems will be huge plus) - W2 (NO C2C,1099) - Posted by Tauqeer
Posted Today by 1764392009
Negotiable
Outside
Remote
USA
Summary: Walmart is looking for a Data Engineer to enhance its data and analytics team by designing and optimizing data pipelines and workflows. The role involves utilizing advanced technologies to ensure data accessibility and reliability for informed business decisions. Candidates will collaborate with various stakeholders to deliver high-quality data solutions while maintaining data governance and compliance. Strong technical skills in Python, Apache Spark, and data warehousing are essential for success in this position.
Key Responsibilities:
- Develop and maintain scalable ETL/ELT pipelines using Apache Airflow, dbt, and PySpark.
- Design and implement data models and transformations for analytics and reporting.
- Work with BigQuery and other cloud-based data warehouses to manage large-scale datasets.
- Optimize data workflows for performance and cost efficiency.
- Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality data solutions.
- Ensure data quality, governance, and compliance with security standards.
Key Skills:
- Strong proficiency in Python 3 for data engineering and automation tasks.
- Hands-on experience with Apache Spark 3 and PySpark for distributed data processing.
- Expertise in Apache Airflow for workflow orchestration.
- Solid understanding of pandas for data manipulation and analysis.
- Experience with dbt for data transformation and modeling.
- Familiarity with BigQuery or similar cloud data warehouses.
- Knowledge of SQL and performance tuning.
- Strong problem-solving skills and ability to work in a fast-paced environment.
Salary (Rate): undetermined
City: undetermined
Country: USA
Working Arrangements: remote
IR35 Status: outside IR35
Seniority Level: undetermined
Industry: IT
About the Role
Walmart is seeking a highly skilled Data Engineer to join our growing data and analytics team. In this role,
you will design, build, and optimize data pipelines and workflows that power insights across our
organization. You will work with cutting-edge technologies to ensure data is accessible, reliable, and
actionable for business decision-making.
Key Responsibilities
Develop and maintain scalable ETL/ELT pipelines using Apache Airflow, dbt, and PySpark.
Design and implement data models and transformations for analytics and reporting.
Work with BigQuery and other cloud-based data warehouses to manage large-scale datasets.
Optimize data workflows for performance and cost efficiency.
Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality data
solutions.
Ensure data quality, governance, and compliance with security standards.
Required Skills & Qualifications
Strong proficiency in Python 3 for data engineering and automation tasks.
Hands-on experience with Apache Spark 3 and PySpark for distributed data processing.
Expertise in Apache Airflow for workflow orchestration.
Solid understanding of pandas for data manipulation and analysis.
Experience with dbt for data transformation and modeling.
Familiarity with BigQuery or similar cloud data warehouses.
Knowledge of SQL and performance tuning.
Strong problem-solving skills and ability to work in a fast-paced environment.
Preferred Qualifications
Experience with CI/CD for data pipelines.
Knowledge of data governance and security best practices.
Familiarity with cloud platforms (Google Cloud Platform, AWS, or Azure).
Excellent communication and collaboration skills.
Screening
- Coderbyte SQL & Python