Negotiable
Outside
Hybrid
USA
Summary: The Data Lake Engineer role requires a seasoned professional with a minimum of 10 years of experience in the USA, focusing on AWS technologies and DevOps practices. The position is available for visa-independent consultants and offers flexibility in working arrangements, either remote or hybrid in the Dallas/Ft. Worth area. The candidate will be responsible for implementing and managing data lake solutions using various AWS services and frameworks.
Key Responsibilities:
- Implement and manage AWS data lake solutions using Lake Formation, S3, Glue, and other AWS services.
- Utilize DevOps tools such as GitLab for version control and deployment.
- Develop data processing scripts using Python and Pyspark.
- Design infrastructure as code using frameworks like CloudFormation and Terraform.
Key Skills:
- Minimum 10 years of experience in the USA.
- Proficiency in AWS services including Lake Formation, S3, Glue, Step Function, DynamoDB, IAM, and Lambda.
- Experience with DevOps tools, specifically GitLab.
- Strong programming skills in Python and Pyspark.
- Familiarity with frameworks such as Serverless, Stacker, CloudFormation, and Terraform.
Salary (Rate): undetermined
City: Dallas
Country: USA
Working Arrangements: hybrid
IR35 Status: outside IR35
Seniority Level: undetermined
Industry: IT
Job title- Data Lake Engineer
Duration: 12 Months
Location: Dallas/Ft. Worth area & TX
Technical Requirements
Minimum 10 yrs experience in USA
AWS
- Lake Formation
- S3
- Glue - Crawler, Catalog, Glue Registry, Glue Jobs
- Step Function
- DynamoDB
- IAM
- Lambda
DevOps
- GitLab
Languages
- Python (aws)
- Pyspark
Frameworks
- Serverless
- Stacker
- CloudFormation
- Terraform