Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines using Google Cloud Platform services such as Dataflow, Dataproc, and Cloud Composer (Airflow).
- Build and manage data ingestion pipelines from AWS Kinesis Data Firehose to Google Cloud Storage (GCS).
- Design, optimize, and administer PostgreSQL databases in Cloud SQL.
- Implement data masking and anonymization using Google Cloud DLP to protect sensitive information.
- Load and transform data into BigQuery for reporting and analytics.
- Configure Datastream for Change Data Capture (CDC) and database replication.
- Monitor, troubleshoot, and optimize data pipelines for performance, reliability, and cost efficiency.
- Collaborate with Data Engineers, Architects, Analysts, and Security teams to implement data governance and compliance standards.
- Develop Python and SQL-based data processing solutions.
- Participate in code reviews, testing, and production deployments.
Required Skills
- Strong experience with Google Cloud Platform (Google Cloud Platform).
- Hands-on expertise with Dataflow, Dataproc, Cloud Composer (Airflow), BigQuery, Cloud SQL, and Datastream.
- Strong PostgreSQL administration, schema design, and query optimization experience.
- Experience with AWS services, especially Kinesis Data Firehose and AWS-to-Google Cloud Platform data migration.
- Strong knowledge of ETL/ELT pipeline development.
- Proficiency in Python and SQL.
- Experience with Cloud DLP or equivalent data masking solutions.
- Understanding of data governance, security, PII handling, and compliance.
- Strong analytical, troubleshooting, and communication skills.
Preferred Skills
- Terraform or other Infrastructure as Code (IaC) tools.
- CI/CD pipeline implementation for data engineering.
- SAP data extraction and integration experience.
- Experience working in enterprise cloud migration projects.
Rate:
Not specified
Location:
Remote
IR35 Status:
Outside
Remote Status:
Remote
Industry:
Data & Analytics
Seniority Level:
Senior