AWS Data Engineer

Summary: The AWS Data Engineer role involves migrating fraud detection workloads to AWS and designing event-driven data processing solutions. The position requires building scalable data pipelines and optimizing AWS Glue ETL pipelines. The engineer will also automate infrastructure provisioning and implement CI/CD pipelines. This role is fully remote and requires significant experience with AWS services and data engineering practices.

Key Responsibilities:

• Migrate near real-time fraud detection workloads from on-premises to AWS
• Design and implement event-driven data processing solutions
• Build and optimize AWS Glue ETL pipelines
• Develop scalable data lake architectures using Parquet and Athena
• Orchestrate workflows with AWS Step Functions
• Automate infrastructure provisioning using Terraform
• Implement CI/CD pipelines and perform end-to-end testing
• Monitor and optimize cloud applications for performance and reliability

Key Skills:

• Strong experience with AWS services: Lambda, S3, EventBridge, Kinesis (Data Streams & Firehose), Glue (ETL & Crawlers), Step Functions, Athena, Amazon Connect, and Macie
• Proficiency in Python and PySpark
• Experience building scalable data pipelines and event-driven architectures
• Hands-on experience with Glue Crawlers, Parquet, and Athena-based data lake solutions
• Experience with Kafka/EventBridge messaging platforms
• Infrastructure as Code using Terraform
• CI/CD pipeline implementation and automation

Salary (Rate): undetermined

City: undetermined

Country: undetermined

Working Arrangements: remote

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT