AWS Data Engineer - £500 Inside IR35

AWS Data Engineer - £500 Inside IR35

Posted 1 day ago by Valcon Group UK

Apply
Negotiable
Inside
Hybrid
London x2 a week, UK
Apply
Airflow Amazon S3 Amazon Web Services (AWS) Apache Airflow Apache Spark Automation AWS Elastic MapReduce (EMR) AWS Identity And Access Management (IAM) AWS Kinesis AWS Lambda Business Intelligence Business Intelligence Tools Cloud Computing Cloud Technology Continuous Integration and Continuous Delivery Data Architecture Data Governance Data Lakes Data Manipulation Datamodel Data Modeling Data Quality Data Security Data Store Data Warehousing Financial Services Infrastructure as Code (IaC) Power BI Python (Programming Language) Snowflake (Data Warehouse) Spark Streaming SQL (Programming Language) Stakeholder Management Stream Processing Terraform Workflows

Summary: The role of AWS-focused Data Engineer involves designing, building, and maintaining scalable data pipelines and cloud-based data platforms to support analytical and Business Intelligence needs within a financial services environment. The position requires collaboration with data scientists, analysts, and business stakeholders to ensure high-quality data delivery, emphasizing efficiency and automation. The successful candidate will leverage AWS tools and services to optimize data processes while adhering to compliance standards. This position offers opportunities for professional development and flexible working arrangements.

Key Responsibilities:

  • Design, build, and maintain data pipelines and ETL/ELT processes on AWS using tools such as Glue, Lambda, Step Functions, and Airflow.
  • Develop and optimise data models, data lakes, and warehouses (eg Amazon S3, Redshift, Snowflake).
  • Ensure data quality, integrity, and governance in line with regulatory and compliance standards common to financial services.
  • Work collaboratively with data analysts, data scientists, and software engineers to deliver robust, high-performance data solutions.
  • Implement monitoring, automation, and alerting for data workflows using AWS native and third-party tools.
  • Optimise data storage and retrieval for performance and cost efficiency.
  • Stay current with emerging AWS services and technologies, contributing to ongoing platform evolution.
  • Support data security and privacy initiatives, ensuring adherence to GDPR, ISO, and internal risk policies.

Key Skills:

  • Proven experience as a Data Engineer working on cloud data platforms, preferably AWS.
  • Hands-on expertise with AWS services such as Glue, S3, Redshift, Lambda, EMR, Kinesis, and IAM.
  • Strong SQL and Python skills for data manipulation, transformation, and automation.
  • Experience building and maintaining ETL/ELT pipelines and data models in large-scale environments.
  • Understanding of CI/CD principles and Infrastructure as Code (IaC) using Terraform or CloudFormation.
  • Familiarity with data governance, data quality, and data security best practices.
  • Excellent communication skills, with the ability to explain technical concepts to non-technical stakeholders.

Salary (Rate): £500 daily

City: London

Country: UK

Working Arrangements: hybrid

IR35 Status: inside IR35

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

We're looking for an experienced AWS-focused Data Engineer to join our growing Data & Analytics team. This role will play a key part in designing, building, and maintaining scalable data pipelines and cloud-based data platforms that support analytical and Business Intelligence needs across the organisation.

You'll work closely with data scientists, analysts, and business stakeholders to enable high-quality, reliable data delivery - with a focus on efficiency, automation, and best practices in a financial services environment.

Key Responsibilities

  • Design, build, and maintain data pipelines and ETL/ELT processes on AWS using tools such as Glue, Lambda, Step Functions, and Airflow.

  • Develop and optimise data models, data lakes, and warehouses (eg Amazon S3, Redshift, Snowflake).

  • Ensure data quality, integrity, and governance in line with regulatory and compliance standards common to financial services.

  • Work collaboratively with data analysts, data scientists, and software engineers to deliver robust, high-performance data solutions.

  • Implement monitoring, automation, and alerting for data workflows using AWS native and third-party tools.

  • Optimise data storage and retrieval for performance and cost efficiency.

  • Stay current with emerging AWS services and technologies, contributing to ongoing platform evolution.

  • Support data security and privacy initiatives, ensuring adherence to GDPR, ISO, and internal risk policies.

Skills & Experience

Essential:

  • Proven experience as a Data Engineer working on cloud data platforms, preferably AWS.

  • Hands-on expertise with AWS services such as Glue, S3, Redshift, Lambda, EMR, Kinesis, and IAM.

  • Strong SQL and Python skills for data manipulation, transformation, and automation.

  • Experience building and maintaining ETL/ELT pipelines and data models in large-scale environments.

  • Understanding of CI/CD principles and Infrastructure as Code (IaC) using Terraform or CloudFormation.

  • Familiarity with data governance, data quality, and data security best practices.

  • Excellent communication skills, with the ability to explain technical concepts to non-technical stakeholders.

Desirable:

  • Experience in the financial services industry, including exposure to regulated data environments and risk/audit processes.

  • Knowledge of data warehousing technologies such as Snowflake, Databricks, or Redshift Spectrum.

  • Familiarity with stream processing (Kafka, Kinesis, Spark Streaming).

  • Understanding of modern data architecture concepts (data mesh, data lakehouse, etc.).

  • Exposure to BI tools such as Tableau, Power BI, or QuickSight.

Why Join Us

  • Opportunity to work on cutting-edge AWS data technologies in a highly regulated, data-driven industry.

  • Collaborative and forward-thinking data team with a strong culture of innovation.

  • Competitive compensation package, including bonus and benefits.

  • Professional development opportunities and AWS certification support.

  • Flexible hybrid or remote working options.

Apply
Similar Jobs
Loading data...