Lead Google Cloud Platform Data Engineer
Posted 1 day ago by 1751636909
Negotiable
Outside
Remote
USA
Summary: The role is for a Lead Google Cloud Platform Data Engineer with over 20 years of experience, focusing on remote work for a duration of 6-12 months. The position requires expertise in Google Cloud Platform deployments, pipeline orchestration, and optimization of Python data pipelines. Candidates should also be skilled in managing dynamic Dataproc workflows and have experience with the Hadoop ecosystem, real-time analytics using Kafka, and Spark streaming.
Key Responsibilities:
- Lead Google Cloud Platform deployments and pipeline orchestration.
- Optimize Python data pipelines.
- Manage Composer-managed dynamic Dataproc workflows.
- Utilize the Hadoop ecosystem for data processing.
- Implement real-time analytics using Kafka and Spark streaming.
Key Skills:
- 20+ years of experience in data engineering.
- Expertise in Google Cloud Platform.
- Proficiency in Python for data pipeline optimization.
- Experience with Composer and Dataproc workflows.
- Knowledge of the Hadoop ecosystem.
- Skills in real-time analytics with Kafka and Spark streaming.
Salary (Rate): undetermined
City: undetermined
Country: USA
Working Arrangements: remote
IR35 Status: outside IR35
Seniority Level: undetermined
Industry: IT
Urgent need
Lead Google Cloud Platform Data Engineer with
20+ years experience
Remote
6-12 months
Expert in Google Cloud Platform deployments and Pipelines Orchestration and Python Data Pipelines - Optimization
Skilled in Composer-managed
dynamic Dataproc workflows
Expert in Hadoop ecosystem and
scheduling, Real-time analytics using Kafka
and Spark streaming