GCP Data Engineer

GCP Data Engineer

Posted 4 days ago by PRACYVA

Negotiable
Undetermined
Undetermined
London Area, United Kingdom

Summary: The GCP Data Engineer role requires strong expertise in streaming technologies and data warehousing principles. The position involves designing and operating production data systems on cloud platforms like GCP and AWS, along with experience in distributed processing frameworks. Proficiency in programming languages such as Python, Go, and SQL is essential for success in this role.

Key Responsibilities:

  • Utilize streaming technologies such as Kafka, Pub/Sub, or Kinesis.
  • Apply data warehousing principles, including relational models, indexing, query optimization, and administration.
  • Develop and maintain production data systems on GCP and/or AWS.
  • Work with distributed processing frameworks like Spark or Beam at scale.
  • Implement programming solutions using Python, Go, and SQL.

Key Skills:

  • Strong experience with streaming technologies (Kafka, Pub/Sub, Kinesis).
  • Solid understanding of data warehousing principles.
  • Proficiency in programming languages (Python, Go, SQL).
  • Hands-on experience with GCP and/or AWS.
  • Experience with distributed processing frameworks (Spark, Beam).

Salary (Rate): undetermined

City: London Area

Country: United Kingdom

Working Arrangements: undetermined

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

Strong experience with streaming technologies such as Kafka, Pub/Sub or Kinesis

• Solid understanding of data warehousing principles, including relational models, indexing, query optimisation and administration

• Proven ability with one or more programming languages, ideally Python, Go and SQL

• Hands on experience designing and operating production data systems on GCP and/or AWS

• Experience working with distributed processing frameworks such as Spark or Beam at scale