Data Engineer

Summary: The Data Engineer role is focused on designing, building, and maintaining ETL/ELT pipelines and workflows, with a strong emphasis on data integration and quality. The position requires collaboration with analysts and product managers to support data-driven decisions and involves working with modern orchestration tools and cloud environments. The role is remote but requires the candidate to be based in the UK. It is offered on an outside IR35 basis for an initial duration of 6 months with potential for extension.

Key Responsibilities:

• Design, build, and maintain ETL/ELT pipelines and batch/streaming workflows.
• Integrate data from external APIs and internal systems into Snowflake and downstream tools.
• Use web scraping / browser automation to pull data from platforms that only have UI based data extract capabilities (no APIs).
• Own critical parts of our Airflow-based orchestration layer and Kafka-based event streams.
• Ensure data quality, reliability, and observability across our pipelines and platforms.
• Build shared data tools and frameworks to support analytics and reporting use cases.
• Partner closely with analysts, product managers, and other engineers to support data-driven decisions.

Key Skills:

• 3 years of experience as a Data Engineer working on data infrastructure.
• Strong Python skills and hands-on experience with SQL.
• Experience with modern orchestration tools like Airflow.
• Experience with APIs and extracting data from APIs.
• Understanding of data modelling, governance, and performance tuning in warehouse environments.
• Comfort operating in a cloud-native environment like AWS.
• Terraform experience.
• Nice to have: Snowflake, web scraping via browser automation (playwright / selenium / puppeteer for example).

Salary (Rate): £530 per day

City: Greater London

Country: England

Working Arrangements: remote

IR35 Status: outside IR35

Seniority Level: undetermined

Industry: IT