Data Engineer

Data Engineer

Posted 2 days ago by 1762594715

Apply
Negotiable
Outside
Remote
USA
Apply
Agile Methodology Airflow Amazon Web Services (AWS) Apache Airflow Automation AWS Elastic MapReduce (EMR) AWS Lambda Big Data Business Intelligence Data Quality Extract Transform Load (ETL) Informatica Pyspark Python (Programming Language) SQL (Programming Language) Workflow Automation Workflows

Summary: The Data Engineer role involves designing and leading scalable data architectures and pipelines to support analytics and business intelligence, with a focus on data optimization and workflow automation in a cloud-based environment. The position requires extensive experience in IT, particularly in healthcare data, and proficiency in various technologies including Python, PySpark, and AWS. The role also emphasizes collaboration across teams to meet data needs and ensure data quality and system reliability. Candidates should possess strong problem-solving and communication skills, along with a background in agile development.

Key Responsibilities:

  • Design and maintain scalable data pipelines and architectures
  • Lead data projects and ensure best practices
  • Collaborate across teams to meet data needs
  • Optimize data systems for analytics and reporting
  • Ensure data quality and system reliability in production environments

Key Skills:

  • Healthcare, Python, Pyspark, AWS, SQL
  • 8+ years of IT experience, with 5+ years in relevant technologies
  • Data lakes (Iceberg format), ETL (Informatica), and data quality
  • AWS services: S3, Glue, Redshift, Lambda, EMR, Airflow, Postgres
  • BASH/Shell scripting
  • Experience with healthcare data and leading data teams
  • Agile development experience
  • Strong problem-solving and communication skills

Salary (Rate): undetermined

City: undetermined

Country: USA

Working Arrangements: remote

IR35 Status: outside IR35

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:
Job Description



Role :Data Engineer

Mandatory Skills : Healthcare, Python, Pyspark, AWS, SQL

Exp: 13-16 years



Senior Data Engineer - Position Summary

The Senior Data Engineer designs and leads scalable data architectures and pipelines to support analytics and business intelligence. This role focuses on data optimization, workflow automation, and ensuring reliable data operations in a cloud-based environment.

Minimum Qualifications

  • 8+ years of IT experience, with 5+ years in:
  • Python, PySpark, and SQL for big data processing
  • Data lakes (Iceberg format), ETL (Informatica), and data quality
  • AWS services: S3, Glue, Redshift, Lambda, EMR, Airflow, Postgres
  • BASH/Shell scripting
  • Experience with healthcare data and leading data teams
  • Agile development experience
  • Strong problem-solving and communication skills

Responsibilities

  • Design and maintain scalable data pipelines and architectures
  • Lead data projects and ensure best practices
  • Collaborate across teams to meet data needs
  • Optimize data systems for analytics and reporting

  • Ensure data quality and system reliability in production environments

Please reach me on .


Apply
Similar Jobs
Loading data...