Data Engineer - Malvern, PA

Data Engineer - Malvern, PA

Posted 2 weeks ago by TechniPros, LLC

Apply
Negotiable
Undetermined
Undetermined
Remote or Malvern, Pennsylvania
Apply
Agile Methodology Amazon Athena Amazon Redshift Amazon S3 Amazon Web Services (AWS) Automation AWS Glue AWS Lambda Big Data Continuous Integration and Continuous Delivery Data Processing Data Quality Data Warehousing Extract Transform Load (ETL) Git (Version Control System) Management Pyspark Python (Programming Language) Workflows

Summary: The Data Engineer role involves designing, developing, and optimizing scalable data solutions on AWS. The position requires expertise in AWS data services, ETL/ELT development, and big data processing using Python and PySpark. The ideal candidate will work with cross-functional teams in an Agile environment to ensure data quality and consistency. This is a long-term contract position with a focus on AWS technologies.

Key Responsibilities:

  • Design, develop, and maintain scalable ETL/ELT pipelines using AWS services.
  • Build and optimize data processing workflows using AWS Glue, PySpark, and Python.
  • Develop and manage data warehouses using Amazon Redshift and related AWS technologies.
  • Integrate data from multiple sources and ensure data quality and consistency.
  • Work with large datasets stored in Amazon S3 and query data using Athena.
  • Implement automation and monitoring solutions using AWS Lambda and other AWS services.
  • Collaborate with cross-functional teams in an Agile environment.
  • Utilize Git and CI/CD pipelines for code management and deployment.

Key Skills:

  • AWS Glue (Crawlers, Data Catalog, ETL Jobs)
  • Python and PySpark
  • SQL and Data Warehousing
  • Amazon S3, Athena, Redshift, and Lambda
  • ETL/ELT Pipeline Development
  • Data Modeling and Data Integration
  • Git and CI/CD Tools
  • Agile/Scrum Methodologies

Salary (Rate): undetermined

City: undetermined

Country: undetermined

Working Arrangements: undetermined

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

Job Title: Data Engineer
Long term Contract
Location: Malvern, PA/Wilmington, DE/Cherry Hill, NJ/ New York City, NY/Norwalk, CT.
Can do Only W2, No C2C

Job Description:
We are seeking an experienced AWS Data Engineer to design, develop, and optimize scalable data solutions on AWS. The ideal candidate will have strong expertise in AWS data services, ETL/ELT development, data warehousing, and big data processing using Python and PySpark.

Required Skills:

  • AWS Glue (Crawlers, Data Catalog, ETL Jobs)
  • Python and PySpark
  • SQL and Data Warehousing
  • Amazon S3, Athena, Redshift, and Lambda
  • ETL/ELT Pipeline Development
  • Data Modeling and Data Integration
  • Git and CI/CD Tools
  • Agile/Scrum Methodologies

Key Responsibilities:

  • Design, develop, and maintain scalable ETL/ELT pipelines using AWS services.
  • Build and optimize data processing workflows using AWS Glue, PySpark, and Python.
  • Develop and manage data warehouses using Amazon Redshift and related AWS technologies.
  • Integrate data from multiple sources and ensure data quality and consistency.
  • Work with large datasets stored in Amazon S3 and query data using Athena.
  • Implement automation and monitoring solutions using AWS Lambda and other AWS services.
  • Collaborate with cross-functional teams in an Agile environment.
  • Utilize Git and CI/CD pipelines for code management and deployment.

Best Regards:

Tina
Phone:
Email:

Apply
Similar Jobs
Loading data...