Summary: The AWS Data Engineer role involves designing, developing, and optimizing large-scale data solutions within a modern cloud environment, specifically leveraging AWS services. The position requires collaboration with data analysts and stakeholders to translate requirements into technical solutions while ensuring data integrity and compliance with governance policies. This contract offers the opportunity to work on impactful projects that drive real-time insights for strategic business decisions. The role is hybrid, requiring one day per week onsite in Central London.
Key Responsibilities:
- Design, build and maintain scalable data pipelines and architectures within the AWS ecosystem
- Leverage services such as AWS Glue, Lambda, Redshift, EMR and S3 to support data ingestion, transformation and storage
- Work closely with data analysts, architects and business stakeholders to translate requirements into robust technical solutions
- Implement and optimise ETL/ELT processes, ensuring data integrity, consistency and quality across multiple sources
- Apply best practices in data modelling, version control, and CI/CD to deliver maintainable and reusable code
- Monitor data performance and reliability, proactively identifying opportunities to enhance efficiency and scalability
- Support the integration of data from diverse systems, including APIs and third-party platforms, into a unified architecture
- Ensure compliance with data governance, privacy and security policies throughout all stages of development
- Collaborate in an Agile environment, contributing to sprint planning, peer reviews and continuous improvement initiatives
Key Skills:
- Extensive hands-on experience with AWS data services
- Strong programming skills in Python
- Solid understanding of data modelling, warehousing and architecture design within cloud environments
- Experience building and managing ETL/ELT workflows and data pipelines at scale
- Proficiency with SQL and working knowledge of relational and non-relational databases
- Experience deploying data infrastructure using IaC tools such as Terraform or CloudFormation
- Understanding of DevOps and CI/CD pipelines for data engineering solutions
- Strong problem-solving skills, with an ability to work both independently and collaboratively within multi-disciplinary teams
Salary (Rate): £325 per day
City: London
Country: United Kingdom
Working Arrangements: hybrid
IR35 Status: outside IR35
Seniority Level: Mid-Level
Industry: IT
Detailed Description From Employer:
AWS Data Engineer Rate: Up to 325 per day (Outside IR35) Contract Length: 6 Months (with strong potential for extension) Location: Hybrid - 1 day per week onsite in Central London A leading organisation is seeking an experienced AWS Data Engineer to join their data and analytics team, contributing to the design, development and optimisation of large-scale data solutions within a modern cloud environment. This contract offers the opportunity to work on high-impact projects, delivering data platforms and pipelines that drive real-time insights and strategic business decisions. Responsibilities for the AWS Data Engineer: Design, build and maintain scalable data pipelines and architectures within the AWS ecosystem Leverage services such as AWS Glue, Lambda, Redshift, EMR and S3 to support data ingestion, transformation and storage Work closely with data analysts, architects and business stakeholders to translate requirements into robust technical solutions Implement and optimise ETL/ELT processes , ensuring data integrity, consistency and quality across multiple sources Apply best practices in data modelling, version control, and CI/CD to deliver maintainable and reusable code Monitor data performance and reliability, proactively identifying opportunities to enhance efficiency and scalability Support the integration of data from diverse systems, including APIs and third-party platforms, into a unified architecture Ensure compliance with data governance, privacy and security policies throughout all stages of development Collaborate in an Agile environment, contributing to sprint planning, peer reviews and continuous improvement initiatives Essential Skills for the AWS Data Engineer: Extensive hands-on experience with AWS data services Strong programming skills in Python Solid understanding of data modelling, warehousing and architecture design within cloud environments Experience building and managing ETL/ELT workflows and data pipelines at scale Proficiency with SQL and working knowledge of relational and non-relational databases Experience deploying data infrastructure using IaC tools such as Terraform or CloudFormation Understanding of DevOps and CI/CD pipelines for data engineering solutions Strong problem-solving skills, with an ability to work both independently and collaboratively within multi-disciplinary teams Desirable Skills for the AWS Data Engineer: Experience with Databricks , Kafka , or Kinesis for real-time data streaming Knowledge of containerisation (Docker, ECS) and modern orchestration tools such as Airflow Familiarity with machine learning model deployment pipelines or data lakehouse architectures Data Engineer, AWS Data Engineer