Google Cloud Platform Data Engineer
Posted 1 day ago by 1754806600
Negotiable
Outside
Remote
USA
Summary: We are looking for a skilled Google Cloud Platform Data Engineer to design, build, and maintain data pipelines and systems on Google Cloud Platform. This role focuses on ensuring efficient data flow from various sources to analytics platforms, facilitating data-driven decision-making. The ideal candidate will have extensive experience with Google Cloud services and data engineering practices. Strong collaboration and communication skills are essential for success in this position.
Key Responsibilities:
- Design, build, and maintain scalable and secure data pipelines and systems on Google Cloud Platform.
- Ensure efficient data flow from diverse sources to analytics platforms and reporting tools.
- Optimize queries, manage data structures, and handle workload management.
- Implement containerization and CI/CD for data pipelines.
- Collaborate with teams to leverage multiple tools and programming languages for data analysis.
Key Skills:
- Experience in designing and building data engineering solutions in Google Cloud Platform.
- 3+ years of hands-on experience with Google Cloud services like Big Query, Dataflow, Pub/Sub, and Cloud Storage.
- Proficiency in SQL, NoSQL, and data engineering focused on microservices.
- Experience with containerization (Docker, Kubernetes) and CI/CD.
- Strong programming skills in Python or comparable scripting languages.
- Knowledge of real-time and streaming technologies (Kafka, Spark Streaming).
- Experience with data visualization, schema design, and dimensional data modeling.
- Google Professional Data Engineer Certification is preferred.
Salary (Rate): undetermined
City: undetermined
Country: USA
Working Arrangements: remote
IR35 Status: outside IR35
Seniority Level: undetermined
Industry: IT
Position Summary
We are seeking a highly skilled and motivated Google Cloud Platform (Google Cloud Platform) Data Engineer to join our dynamic and growing team. In this role, you will be responsible for designing, building, and maintaining scalable and secure data pipelines and systems on Google Cloud Platform. Your work will ensure that data flows efficiently from diverse sources to analytics platforms and reporting tools, empowering data-driven decision-making across the organization.
Required Qualifications
Experience in designing and building data engineering solutions in Google Cloud Platform cloud environments
3+ years of hands-on experience with Google Cloud Platform services like Big Query, Dataflow, Pub/Sub, and Cloud Storage
3+ years of hands-on experience building modern data pipelines with Google Cloud Platform platform
3+ years of experience with reporting/analytic tools
3+ years of experience with Query optimization, data structures, transformation, metadata, dependency, and workload management
3+ years of experience with SQL, NoSQL
3+ years of experience in data engineering with a focus on microservices-based data solutions
3+ years of containerization (Docker, Kubernetes) and CI/CD for data pipeline
3+ years of experience with Python (or a comparable scripting language)
3+ years of experience with Big data and cloud architecture
3+ years of experience with deployment/scaling of apps on containerized environment (Kubernetes,)
3+ years of experience with real-time and streaming technology (Kafka, Spark Streaming)
Preferred Qualifications
Experience with Git, CI/CD pipeline, and other DevOps principles/best practices
Experience with bash shell scripts, UNIX utilities & UNIX Commands
Ability to leverage multiple tools and programming languages to analyze and manipulate data sets from disparate data sources
Knowledge of API development
Experience with complex systems and solving challenging analytical problems
Strong collaboration and communication skills within and across teams
Knowledge of data visualization and reporting
Experience with schema design and dimensional data modeling
Google Professional Data Engineer Certification
Knowledge of microservices
Previous healthcare experience and domain knowledge
Experience designing, building, and maintaining data processing systems
Experience architecting and building data warehouse and data lakes
Education
Bachelor's degree or equivalent work experience