Senior AWS Data Engineer- Remote

Job Description

We are seeking an experienced AWS Data Engineer/ Data Engineer & Insights Analyst to design, develop, and maintain scalable data pipelines, cloud-based data solutions, and analytics platforms. The ideal candidate will have strong expertise in AWS data services, Python, SQL, big data technologies, and data integration.

The candidate will be responsible for transforming complex datasets into reliable, actionable insights that support business operations, performance measurement, and strategic decision-making. This role requires hands-on data engineering capabilities, analytical skills, and experience working with large, complex, and confidential datasets.

Responsibilities

• Design, develop, and maintain scalable data pipelines and cloud-based data architectures.
• Build and optimize data solutions using AWS services such as S3, Glue, Redshift, EMR, Athena, Lambda, and related technologies.
• Develop and manage data orchestration workflows using Apache Airflow, AWS Step Functions, or similar tools.
• Extract, transform, integrate, and process large datasets from multiple sources using SQL and big data technologies.
• Develop and maintain ETL/ELT pipelines and data integration processes.
• Implement data quality checks, validation, monitoring, logging, and alerting frameworks.
• Design and optimize data models, data structures, metadata, and data warehouse solutions.
• Work with Python, R, Java, Scala, or other programming languages to develop data processing solutions.
• Build analytical datasets and environments supporting statistical analysis, predictive modeling, and machine learning.
• Develop dashboards, reports, analytical models, and decision-support tools.
• Collaborate with data scientists, business analysts, and cross-functional teams to deliver actionable insights.
• Identify opportunities to automate processes and improve data pipeline performance, scalability, and reliability.
• Support data migration and conversion activities associated with system modernization initiatives.
• Implement data governance, data lineage, security, and privacy controls.
• Integrate data using REST APIs, messaging systems, and stream-processing technologies.

Required Qualifications

• 5+ years of hands-on experience with cloud-based data services, preferably AWS.
• Strong programming experience in Python, R, Java, C++, or Scala.
• Advanced SQL skills and experience with relational and NoSQL databases.
• Experience designing, developing, and optimizing complex data pipelines and architectures.
• Strong experience with ETL/ELT processes and data integration.
• Knowledge of big data technologies such as Hadoop, Spark, and Kafka.
• Experience with workflow orchestration tools such as Apache Airflow, Luigi, or Azkaban.
• Knowledge of data modeling techniques, including dimensional modeling, Data Vault, and Star/Snowflake schemas.
• Experience with Git, version control, and CI/CD pipelines.
• Familiarity with data cataloging and metadata management tools, such as AWS Glue Data Catalog.
• Understanding of data governance, data lineage, and data quality frameworks.
• Experience with REST API design and integration patterns.
• Knowledge of stream-processing technologies such as Spark Streaming and Storm.
• Experience developing dashboards, reports, analytical models, and decision-support solutions.
• Strong analytical, problem-solving, project management, and organizational skills.
• Ability to work independently and collaborate effectively with cross-functional teams.

Preferred Qualifications

• Experience working with higher education, student-level, employment, or workforce datasets.
• Experience integrating data from multiple sources to support analytical and research initiatives.
• Exposure to public-sector data environments, data modernization, and data migration projects.
• Experience supporting statistical analysis, predictive modeling, and machine learning initiatives.