We're looking for an experienced Data Engineer to join a growing data engineering team delivering modern cloud data platforms and solutions for enterprise clients.
You'll work alongside Data Engineers and Architects to design and build scalable data pipelines, transformation frameworks and cloud-native data platforms across AWS, dbt, Snowflake.
This is a hands-on engineering role suited to someone with at least 3 years' commercial Data Engineering experience who has delivered production-grade data solutions.
Key Responsibilities
- Design, build and maintain scalable ETL/ELT data pipelines.
- Develop transformation models and data modelling frameworks using dbt.
- Build and optimise enterprise data solutions using Snowflake and/or Databricks.
- Design cloud-native data lake solutions using Amazon S3.
- Develop production data pipelines using AWS services including Glue, Lambda, Step Functions and/or MWAA (Apache Airflow).
- Build scalable data models to support analytics and business reporting.
- Develop and optimise complex SQL transformations.
- Use Python to develop data engineering solutions and automation.
- Optimise data workloads for performance, scalability and cost.
- Develop dashboards and reporting solutions using Databricks Dashboards, Snowsight or Amazon QuickSight.
- Work closely with Data Architects, Engineers and client stakeholders to deliver production solutions.
- Follow engineering best practices around version control, automated testing and CI/CD.
Essential Experience: You must have:
- 3+ years' commercial Data Engineering experience.
- Strong hands-on dbt experience - this is a key requirement.
- Strong SQL skills.
- Strong Python programming experience.
- Commercial experience with Snowflake and/or Databricks.
- Strong experience designing and building ETL/ELT pipelines.
- Commercial experience working within AWS environments.
- Experience building data lake solutions using Amazon S3.
- Experience with AWS data and orchestration services such as Glue, Lambda, Step Functions or MWAA/Airflow.
- Experience designing data pipelines for performance, scalability and reliability.
- Good understanding of data modelling principles.
- Experience with Git and CI/CD.
- Strong communication skills and the ability to work with both technical teams and client stakeholders.
Desirable Experience: Any of the following would be beneficial:
- Databricks certifications.
- Snowflake certifications.
- Consulting or client-facing delivery experience.
- Terraform or CloudFormation.
- Data governance and security knowledge.
- Experience working within Agile delivery teams.
- Databricks Dashboards, Snowsight or Amazon QuickSight.
Technology Stack
AWS | dbt | Snowflake | Databricks | Python | SQL | S3 | Glue | Lambda | Step Functions | MWAA | Airflow | Terraform | Git | CI/CD
Rate:
£500/day
Location:
London
IR35 Status:
Outside
Remote Status:
Remote
Industry:
Data & Analytics
Seniority Level:
Mid-Level