Negotiable
Outside
Remote
USA
Summary: This role is for an AWS Lead Data Engineer who will engage in hands-on coding using various AWS tools and programming languages. The position requires extensive experience in data engineering, particularly with AWS technologies. The consultant will work exclusively on a W-2 basis and is expected to have strong problem-solving and communication skills. The role is remote and classified as outside IR35.
Key Responsibilities:
- Hands-on coding using Python, Pandas, PySpark, Terraform, AWS Glue, Lambda, S3, Redshift, and EMR.
- Design and implement data engineering solutions leveraging AWS services.
- Collaborate with teams to develop and maintain data models and ETL processes.
- Write infrastructure as code using Terraform.
- Utilize CI/CD pipelines and version control systems.
- Ensure data quality and integrity through rigorous testing and validation.
Key Skills:
- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
- 10-12 years of IT experience with 5+ years in data engineering focused on AWS technologies.
- Expertise in AWS services such as Glue, Redshift, S3, Lambda, EMR, and Athena.
- Strong programming skills in Python, Pandas, and SQL.
- Experience with database systems like AWS RDS, Postgres, and SAP HANA.
- Knowledge of data modeling, ETL processes, and data warehousing concepts.
- Familiarity with CI/CD pipelines and version control systems (e.g., Git).
- Experience writing infrastructure as code using Terraform.
- Familiarity with Glue Notebooks, Sagemaker Notebooks, Textract, Rekognition, Bedrock, and GenAI/LLM tools.
- Strong problem-solving skills and attention to detail.
- Excellent communication and collaboration skills.
Salary (Rate): undetermined
City: undetermined
Country: USA
Working Arrangements: remote
IR35 Status: outside IR35
Seniority Level: undetermined
Industry: IT
This position requires the consultant to work only on our W-2
We Need AWS Lead Data engineer who can do hands-on coding on these tools python, pandas, pyspark, Terraform, AWS Glue, Lambda, S3, Redshift, EMR
- Bachelor s or Master s degree in Computer Science, Information Technology, or a related field.
- 10-12 years IT with 5+ years of experience in data engineering with a focus on AWS technologies.
- Expertise in AWS services such as Glue, Redshift, S3, Lambda, EMR, Athena,
- Strong programming skills in Python, Pandas, SQL
- Experience with database systems such as AWS RDS, Postgres and SAP HANA.
- Knowledge of data modeling, ETL processes, and data warehousing concepts.
- Familiarity with CI/CD pipelines and version control systems (e.g., Git).
- Experience writing infrastructure as code using Terraform.
- Familiarity with Glue Notebooks, Sagemaker Notebooks, Textract, Rekognition, Bedrock, and any GenAI/LLM tools
- Strong problem-solving skills and attention to detail.
- Excellent communication and collaboration skills.