Data Engineer (AWS Glue)

Data Engineer (AWS Glue)

Posted 1 day ago by RevTech

Apply
£565 Per day
Inside
Onsite
London Area, United Kingdom
Apply
Airflow Amazon Athena Amazon Web Services (AWS) Apache Airflow Automation AWS Glue AWS Lambda Capital Markets Data Integration Data Processing Docker (Software) Extract Transform Load (ETL) Management Nice (Unix Utility) Pyspark Python (Programming Language) React.js Scheduling Scripting TypeScript User Interface Workflows

Summary: Our client, a global consultancy, is seeking a Data Engineer for a contract role focused on ETL development and data processing using AWS tools. The position requires expertise in Python and PySpark, along with experience in scheduling workflows with Airflow. The contract is set to run until February 2027, with a requirement for three days per week onsite in London.

Key Responsibilities:

  • Develop ETL processes for data integration and transformation.
  • Utilize Python for data processing, scripting, and automation tasks.
  • Implement and manage workflows using Airflow.
  • Work with AWS Data Stack, including AWS Glue, S3, Lambda, Athena, and Glue Catalog.
  • Leverage Docker and AWS container services for deployment.
  • Collaborate on projects related to Capital Markets and UI frameworks.

Key Skills:

  • ETL Development experience.
  • Expertise in Python for data processing.
  • Strong experience with PySpark.
  • Proficiency in AWS Data Stack, particularly AWS Glue.
  • Experience with Airflow for workflow management.
  • Familiarity with Docker and AWS container services.
  • Capital Markets experience is a plus.
  • Familiarity with UI frameworks such as ReactJS, NextJS, or TypeScript.

Salary (Rate): £565 daily

City: London

Country: United Kingdom

Working Arrangements: on-site

IR35 Status: inside IR35

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

Our client are a global consultancy, they are on the lookout for a Data Engineer to come in on a contract basis.

Key Skills/Requirements:

  • ETL Development experience
  • Expert Python experience for data processing, Scripting and automation
  • Strong PySpark experience
  • AWS Data Stack: AWS Glue is essential, and other AWS tools such as S3, Lambda, Athena, Glue Catalog
  • Airflow experience for scheduling, monitoring & managing workflows
  • Docker experience and AWS container services
  • Capital Markets experience nice to have & familiarity with UI frameworks such as ReactJS, NextJS or TypeScript

Contract is running until Feb 2027 initially, paying up to £565pd (Inside IR35 via Umbrella) and will be 3 days per week onsite in London

Apply
Similar Jobs
Loading data...