AWS Cloud Developer with Data Engineering Skills
Posted Today by Intuition IT Solutions Ltd
Negotiable
Undetermined
Hybrid
Guildford, Surrey, UK
Summary: The AWS Cloud Developer with Data Engineering skills is responsible for designing, developing, and maintaining scalable data solutions on the AWS platform. This role involves collaboration with cross-functional teams to ensure optimal performance and integration of data engineering projects. The position requires a strong focus on data quality, security, and the use of AWS services for data management. Additionally, the role includes mentoring team members and promoting automation in technical processes.
Key Responsibilities:
- Design, develop, and implement data pipelines and ETL processes using AWS services.
- Collaborate directly with our FinOps teams and market units across the organization to understand data requirements and deliver solutions that meet business needs.
- Optimize and manage data storage solutions using AWS services such as S3, RDS, and NoSQL databases.
- Ensure data quality, integrity, and security across all data engineering projects.
- Monitor and troubleshoot data workflows to ensure high availability and performance.
- Design and build advanced and interactive dashboards using tools such as AWS QuickSight and Power BI.
- Knowledge of DevOps practices and CI/CD pipelines.
- Stay updated with the latest AWS technologies and best practices to continuously improve our data infrastructure.
- Create and oversee a cloud billing dashboard to track, manage and optimize cloud costs and Reserved Instance purchases.
- Build a dashboard that provides secure self-service capabilities to all teams on cloud spend.
- Solve technical problems and create viable tooling.
- Design and implement shared services in cloud infrastructure.
- Use best appropriate infrastructure automation tools to provision cloud infrastructure components.
- Attend important Agile events and finish assigned work packages/tasks.
- Ensure smooth handover of project deliverables to internal and external customers.
- Actively contributing to internal projects such as tooling and documentation.
- Mentor new team member.
- Promote the use of automation to solve technical challenges.
Key Skills:
- Bachelor's degree in computer science, Information Technology, or a related field.
- Proven experience as a Cloud Developer or Data Engineer, with a focus on AWS.
- Strong proficiency in AWS services such as EKS, EC2, S3, Lambda, Glue.
- Solid understanding of data modelling, ETL processes, and data warehousing concepts.
- Strong proficiency in Python.
- Familiarity with infrastructure as code tools like CloudFormation or Terraform.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills.
- Experience in building and utilizing REST APIs.
- Experience building and running Kubernetes Background Tasks with Batch-Jobs.
- Hands-on experience with GitHub Action.
Salary (Rate): undetermined
City: Guildford
Country: UK
Working Arrangements: hybrid
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
Detailed Description From Employer:
Job Description: As an AWS Cloud Developer with Data Engineering skills, you will be responsible for designing, developing, and maintaining scalable data solutions on the AWS platform. You will work closely with cross-functional teams to ensure seamless integration and optimal performance of our data engineering projects.
Key Responsibilities:
- Design, develop, and implement data pipelines and ETL processes using AWS services.
- Collaborate directly with our FinOps teams and market units across the organization to understand data requirements and deliver solutions that meet business needs.
- Optimize and manage data storage solutions using AWS services such as S3, RDS, and NoSQL databases.
- Ensure data quality, integrity, and security across all data engineering projects.
- Monitor and troubleshoot data workflows to ensure high availability and performance.
- Design and build advanced and interactive dashboards using tools such as AWS QuickSight and Power BI.
- Knowledge of DevOps practices and CI/CD pipelines.
- Stay updated with the latest AWS technologies and best practices to continuously improve our data infrastructure.
- Create and oversee a cloud billing dashboard to track, manage and optimize cloud costs and Reserved Instance purchases
- Build a dashboard that provides secure self-service capabilities to all teams on cloud spend
- Solve technical problems and create viable tooling
- Design and implement shared services in cloud infrastructure.
- Use best appropriate infrastructure automation tools to provision cloud infrastructure components
- Attend important Agile events and finish assigned work packages/tasks
- Ensure smooth handover of project deliverables to internal and external customers
- Actively contributing to internal projects such as tooling and documentation
- Mentor new team member
- Promote the use of automation to solve technical challenges.
Skills:
- Bachelor's degree in computer science, Information Technology, or a related field.
- Proven experience as a Cloud Developer or Data Engineer, with a focus on AWS.
- Strong proficiency in AWS services such as EKS, EC2, S3, Lambda, Glue.
- Solid understanding of data modelling, ETL processes, and data warehousing concepts.
- Strong proficiency in Python
- Familiarity with infrastructure as code tools like CloudFormation or Terraform.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills.
- Experience in building and utilizing REST APIs.
- Experience building and running Kubernetes Background Tasks with Batch-Jobs.
- Hands-on experience with GitHub Action
Preferred Qualifications:
- AWS Certified DevOps Engineer - Professional and or AWS Certified Data Engineer - Associate
- Knowledge of DevOps practices and CI/CD pipelines.
- Knowledge in using Flask framework to create dynamic websites, APIs or microservices is a plus.
NOTE: Hybrid role (2 or 3 days onsite per week)