Senior GCP Data Engineer

Senior GCP Data Engineer

Posted 1 day ago by Stack on Linkedin

Apply
Negotiable
Undetermined
Undetermined
London, England, United Kingdom
Apply
Application Programming Interface (API) Artificial Intelligence Business Requirements Cloud Computing Cloud Services Cloud Storage Cloud Technologies Cloud Technology Continuous Integration and Continuous Delivery Cyber Security Data Engineering Dataflow Data Fusion Data Lakes Datamodel Data Modeling Data Quality Data Store Data Transformation Google Cloud Google Cloud Composer Google Cloud Platform (GCP) Google Kubernetes Engine (GKE) Infrastructure as Code (IaC) Investments Python (Programming Language) Security Domain SQL (Programming Language) Terraform

Summary: An excellent opportunity has emerged for a Senior GCP Data Engineer to join the Cyber Security domain of an investment bank in London. The role focuses on leveraging engineering skills to provide top-tier data capabilities using Google Cloud technologies. Responsibilities include developing APIs, data pipelines, and data models, while ensuring data quality and performance optimization. Collaboration with product managers is essential to drive business value and transformation.

Key Responsibilities:

  • API Development: Design, develop, and maintain robust and scalable backend systems and APIs
  • Data Ingestion: Develop and maintain data pipelines to extract data from various sources and load into Google Cloud environments
  • Data Transformation: Implement data transformation processes including cleansing, normalization, and aggregation to ensure data quality and consistency
  • Data Modeling: Develop and maintain data models and schemas to support efficient data storage and retrieval on Google Cloud platforms
  • Data Integration: Integrate data from multiple sources (on-prem and cloud-based) using Cloud Composer or other tools
  • Data Lakes: Build data lakes using Google Cloud services such as BigQuery
  • Performance Optimization: Optimize data pipelines and queries for improved performance and scalability
  • Collaboration: Work with product managers to ensure superior product delivery to drive business value and transformation
  • Documentation: Document data engineering processes, data flows, and system configurations for future reference and knowledge sharing

Key Skills:

  • 8+ years of experience in data engineering with strong focus on GCP-based solutions
  • Proficiency in GCP Data & AI services (BigQuery, DataProc, Cloud SQL, DataFlow, Pub/Sub, Cloud Data Fusion, Cloud Composer, Python, SQL)
  • Experience designing, developing, and deploying scalable, secure GCP solutions
  • Ability to translate business requirements into technical specifications
  • Expertise in GCP services: Compute Engine, GKE, Cloud Storage, Cloud Functions, Cloud SQL, BigQuery
  • Implementing and managing GCP networking configurations
  • Use of IaC tools like Terraform for infrastructure automation
  • Building and managing CI/CD pipelines
  • Automating deployment processes and implementing cloud security best practices
  • Identifying and resolving performance bottlenecks

Salary (Rate): undetermined

City: London

Country: United Kingdom

Working Arrangements: undetermined

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT

Apply
Similar Jobs
Loading data...