Data Engineer (GCP) 100% onsite

Data Engineer (GCP) 100% onsite

Posted 2 weeks ago by WA Consultants

Apply
Negotiable
Inside
Onsite
UK (Remote)
Apply
Apache Avro Apache Beam Apache Flink Apache Hive Apache Parquet Apache Spark Application Programming Interface (API) BigQuery Cloud Computing Cloud Infrastructure Cloud Technology Continuous Integration and Continuous Delivery Data Engineering Dataflow Data Manipulation Datamodel Data Modeling Data Processing Data Visualisation DevOps Extract Transform Load (ETL) Generic Programming Google Cloud Platform (GCP) Java (Programming Language) Microsoft 365 Microsoft Excel NoSQL Power BI Powerpivot Powerquery Python (Programming Language) Query Languages Scala (Programming Language) Software Development SQL (Programming Language) Terraform

Summary: Required for a six-month contract in London, a Data Engineer is needed to take end-to-end responsibility for building, optimizing, and supporting existing and new data products. The role demands a strong DevOps mindset and experience with various data engineering tools and languages, particularly in a GCP environment. The position is classified as inside IR35 and offers a competitive hourly rate. Candidates should be fluent in English and possess relevant technical skills.

Key Responsibilities:

  • Build, optimize, and support existing and new data products.
  • Manage CI/CD pipelines, terraform, and Cloud infrastructure (GCP).
  • Design and implement efficient data models and data pipelines.
  • Utilize data query languages (SQL or similar) for data manipulation.
  • Implement ETL processes and tools.
  • Develop data-centric and API programming solutions using Python, Java, or Scala.
  • Work with NoSQL and RDBMS databases.
  • Handle different data formats such as Avro and Parquet.
  • Utilize data visualization tools effectively.
  • Leverage GCP tools including Cloud Function, Dataflow, Dataproc, and BigQuery.
  • Employ data processing frameworks like Beam, Spark, Hive, and Flink.
  • Enhance data models and visualizations using DAX measures.
  • Utilize Microsoft Excel functions such as power pivot and power query.
  • Communicate fluently in English, both written and verbal.

Key Skills:

  • DevOps mindset and principles.
  • Experience with CI/CD pipelines and terraform.
  • Proficiency in data modeling and data pipelines.
  • Knowledge of SQL or similar data query languages.
  • Understanding of ETL processes and tools.
  • Programming experience in Python, Java, or Scala.
  • Familiarity with NoSQL and RDBMS databases.
  • Experience with data formats like Avro and Parquet.
  • Proficiency in data visualization tools such as Power BI.
  • Experience with GCP tools (Cloud Function, Dataflow, Dataproc, BigQuery).
  • Knowledge of data processing frameworks (Beam, Spark, Hive, Flink).
  • GCP data engineering certification is a merit.
  • Hands-on experience with analytical tools.
  • Understanding of DAX measures and Microsoft Excel functions.
  • Fluency in English.

Salary (Rate): 55

City: London

Country: UK

Working Arrangements: on-site

IR35 Status: inside IR35

Seniority Level: undetermined

Industry: IT

Apply
Similar Jobs
Loading data...