Negotiable
Outside
Remote
USA
Summary: We are looking for a Senior Lead Google Cloud Platform DevOps Data Engineer to spearhead the design and optimization of data infrastructure on Google Cloud Platform. This role focuses on building scalable data pipelines, implementing CI/CD automation, and enhancing DataOps and MLOps practices. The ideal candidate will provide technical leadership and collaborate with various teams to ensure high-quality data solutions. This position is fully remote and offers long-term engagement.
Key Responsibilities:
- Architect, develop, and manage Google Cloud Platform data solutions using BigQuery, Bigtable, Firestore, Dataflow, DataProc, and Cloud Storage.
- Implement and maintain CI/CD pipelines using GitHub Actions and Terraform for infrastructure automation.
- Enable real-time and batch data processing with Pub/Sub, Dataflow, and Cloud Composer.
- Collaborate with ML teams to support MLOps using Vertex AI and Generative AI tools.
- Lead DataOps initiatives ensuring high availability, scalability, and data quality across platforms.
- Provide technical leadership and mentorship to DevOps and data engineering teams.
- Effectively communicate with stakeholders and manage multiple concurrent projects.
Key Skills:
- Google Cloud Platform: BigQuery, Bigtable, Firestore, Cloud Storage, Dataflow, DataProc, Pub/Sub, Cloud Composer, DataPrep
- DataOps & MLOps: Vertex AI, Generative AI, CI/CD (GitHub), Terraform
- Languages: Python, Java, SQL
- Excellent communication and stakeholder management skills
- Proven leadership in project delivery and cross-functional collaboration
Salary (Rate): undetermined
City: undetermined
Country: USA
Working Arrangements: remote
IR35 Status: outside IR35
Seniority Level: undetermined
Industry: IT
Job Title : Senior Lead Google Cloud Platform DevOps Data Engineer
Location: Remote
Duration: Long Term
About US
At Vilwaa (), we are focused towards delivering IT services and solutions in Data Engineering, Cloud Infrastructure solutions , Digital Application Development, (IoT) - Internet of Things.
Job Description
We are seeking a highly experienced Senior Lead Google Cloud Platform DevOps Data Engineer to lead the design, deployment, and optimization of data infrastructure on Google Cloud Platform (Google Cloud Platform). This role involves building scalable data pipelines, enabling CI/CD automation, and supporting advanced DataOps and MLOps practices, including GenAI integrations.
Key Responsibilities:
- Architect, develop, and manage Google Cloud Platform data solutions using BigQuery, Bigtable, Firestore, Dataflow, DataProc, and Cloud Storage.
- Implement and maintain CI/CD pipelines using GitHub Actions and Terraform for infrastructure automation.
- Enable real-time and batch data processing with Pub/Sub, Dataflow, and Cloud Composer.
- Collaborate with ML teams to support MLOps using Vertex AI and Generative AI tools.
- Lead DataOps initiatives ensuring high availability, scalability, and data quality across platforms.
- Provide technical leadership and mentorship to DevOps and data engineering teams.
- Effectively communicate with stakeholders and manage multiple concurrent projects.
Technical Skills:
- Google Cloud Platform: BigQuery, Bigtable, Firestore, Cloud Storage, Dataflow, DataProc, Pub/Sub, Cloud Composer, DataPrep
- DataOps & MLOps: Vertex AI, Generative AI, CI/CD (GitHub), Terraform
- Languages: Python, Java, SQL
Soft Skills:
- Excellent communication and stakeholder management skills
- Proven leadership in project delivery and cross-functional collaboration