Data Engineer
Posted 1 day ago by WA Consultants
£440 Per day
Inside
Remote
London, UK
Summary: The Data Engineer role focuses on designing, building, and optimizing scalable data solutions on Google Cloud Platform (GCP). The position requires end-to-end ownership of data products, ensuring reliable data pipelines and models that meet analytics and business needs. The role promotes DevOps best practices and continuous improvement within a remote working environment. This is a 6-month rolling contract classified as inside IR35.
Key Responsibilities:
- Own the end-to-end delivery of data products, from development to support
- Design and implement scalable data pipelines and efficient data models
- Apply strong data modelling techniques and understand trade-offs
- Manage CI/CD pipelines and infrastructure using Terraform
- Build and maintain solutions on Google Cloud Platform
- Drive continuous improvement and reduce technical debt
- Collaborate with cross-functional teams to deliver data solutions
- Develop and optimise ETL/ELT processes
- Support automation using APIs and programming
Key Skills:
- Several years' experience in data engineering or similar roles
- Strong experience with GCP services including Cloud Functions, Dataflow, Dataproc and BigQuery
- Experience with data processing frameworks such as Beam, Spark, Hive or Flink
- Strong SQL skills and query optimisation experience
- Experience with ETL processes and tools
- Programming experience in Python, Java or Scala
- Knowledge of RDBMS and NoSQL databases
- Experience working with data formats such as Avro and Parquet
- Hands-on experience with CI/CD pipelines and Terraform
- Experience with data visualisation tools such as Power BI or similar
- Understanding of analytical tools including DAX, Power Pivot, Power Query and Tabular Editor
- Strong data modelling experience
Salary (Rate): £440 a day
City: London
Country: UK
Working Arrangements: remote
IR35 Status: inside IR35
Seniority Level: undetermined
Industry: IT
Data Engineer
Remote
Rate: £440 a day
Contract Type: Inside IR35
6 months Rolling Contract
Role Overview
We are looking for an experienced GCP Data Engineer to design, build, and optimise scalable data solutions. You will take end-to-end ownership of data products, delivering reliable data pipelines and models that support analytics and business needs, while promoting DevOps best practices and continuous improvement.
Key Responsibilities
- Own the end-to-end delivery of data products, from development to support
- Design and implement scalable data pipelines and efficient data models
- Apply strong data modelling techniques and understand trade-offs
- Manage CI/CD pipelines and infrastructure using Terraform
- Build and maintain solutions on Google Cloud Platform
- Drive continuous improvement and reduce technical debt
- Collaborate with cross-functional teams to deliver data solutions
- Develop and optimise ETL/ELT processes
- Support automation using APIs and programming
Required Skills and Experience
- Several years' experience in data engineering or similar roles
- Strong experience with GCP services including Cloud Functions, Dataflow, Dataproc and BigQuery
- Experience with data processing frameworks such as Beam, Spark, Hive or Flink
- Strong SQL skills and query optimisation experience
- Experience with ETL processes and tools
- Programming experience in Python, Java or Scala
- Knowledge of RDBMS and NoSQL databases
- Experience working with data formats such as Avro and Parquet
- Hands-on experience with CI/CD pipelines and Terraform
- Experience with data visualisation tools such as Power BI or similar
- Understanding of analytical tools including DAX, Power Pivot, Power Query and Tabular Editor
- Strong data modelling experience
Desirable Skills
- GCP Data Engineering certification
- Experience with modern data architectures such as data mesh or lakehouse
- Experience working in agile environments
Soft Skills
- Strong communication skills in English
- Collaborative mindset with ability to work independently
- Proactive approach to problem-solving and decision-making
Working Arrangement
Inside IR35 contract
WA Consultants is an Employment Business and an Employment Agency as described within The Conduct of Employment Agencies and Employment Businesses Regulations 2003.