Location: London

Day Rate: 450 Per day Outside IR35

Start Date: ASAP

About the Role

Join a dynamic Digital Transformation Consultancy as a Lead Data Engineer and play a pivotal role in delivering innovative, data-driven solutions for high-profile government clients. You'll be responsible for designing and implementing robust ETL pipelines, leveraging cutting-edge big data technologies, and driving excellence in cloud-based data engineering.

This role offers the opportunity to work with leading technologies, collaborate with data architects and scientists, and make a significant impact in a fast-paced, challenging environment.

Key Responsibilities:

• Design, implement, and debug ETL pipelines to process and manage complex datasets.
• Leverage big data tools, including Apache Kafka, Spark, and Airflow, to deliver scalable solutions.
• Collaborate with stakeholders to ensure data quality and alignment with business goals.
• Utilize programming expertise in Python, Scala, and SQL for efficient data processing.
• Build data pipelines using cloud-native services on AWS, including Lambda, Glue, Redshift, and API Gateway.
• Monitor and optimise data solutions using AWS CloudWatch and other tools.

What We're Looking For:

• Experience: Deep background in data engineering with hands-on expertise in big data technologies.
• Cloud Expertise: Proven experience implementing pipelines using AWS services.
• Technical Skills: Strong command of Python, Scala, SQL, and ETL tools.
• Security Clearance: Candidates must have or be eligible for SC clearance. Preference will be given to those already SC Cleared.

SC Clearance Criteria:

• Must be a British Citizen or have resided in the UK for at least 5 consecutive years and have not left the UK for more than 28 days in the last 5 years.
• Detailed employment history for the past 10 years or longer may be required.

Please apply today for immediate consideration!