Senior ETL Design Consultant (Google Cloud Platform Certified) -- 100% Remote -- C2C/W2 Profiles
Posted 4 days ago by 1764662340
Negotiable
Outside
Remote
USA
Summary: The Senior ETL Design Consultant role focuses on designing, developing, and maintaining scalable ETL/ELT pipelines on Google Cloud Platform. The position requires extensive experience in ETL processes, data integrity, and collaboration with stakeholders to deliver high-quality solutions. The role is fully remote and emphasizes the use of various Google Cloud services and best practices in ETL development. Candidates must possess strong technical skills and a solid understanding of data warehousing concepts.
Key Responsibilities:
- Design, develop, and maintain scalable ETL/ELT pipelines on Google Cloud Platform using Dataflow, BigQuery, Cloud Composer (Apache Airflow), Pub/Sub
- Optimize ingestion, transformation, and loading processes for high-volume real-time and batch data processing
- Ensure data integrity, quality, and security throughout the ETL lifecycle
- Partner with data engineers, analysts, and stakeholders to understand business needs and deliver high-quality solutions
- Implement best practices for performance tuning, error handling, and job monitoring
- Work with structured, semi-structured, and unstructured datasets; support API-based and event-driven integrations
- Automate and thoroughly document ETL workflows to improve maintainability and scalability
- Use Git and CI/CD pipelines for deployment and version control of ETL workflows
Key Skills:
- 12+ years of ETL design and development experience in enterprise environments
- Strong proficiency in SQL, Python, Apache Beam
- Hands-on with Dataflow, BigQuery, Pub/Sub, Cloud Storage, Cloud Composer
- Strong experience in advanced SQL/DML operations and query optimization
- Solid understanding of data modeling, data warehousing concepts, and data lake architectures
- Experience with Apache Airflow DAG design, including error handling and monitoring
- Knowledge of performance tuning, data partitioning, and optimization techniques
- Experience in real-time streaming ETL and event-driven architectures is a plus
- Strong analytical, troubleshooting, and communication skills
Salary (Rate): undetermined
City: undetermined
Country: USA
Working Arrangements: remote
IR35 Status: outside IR35
Seniority Level: undetermined
Industry: IT
Job Title: Senior ETL Design with Google Cloud Platform
Location: Plano, TX (Remote, CST working hours)
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines on Google Cloud Platform using Dataflow, BigQuery, Cloud Composer (Apache Airflow), Pub/Sub
- Optimize ingestion, transformation, and loading processes for high-volume real-time and batch data processing
- Ensure data integrity, quality, and security throughout the ETL lifecycle
- Partner with data engineers, analysts, and stakeholders to understand business needs and deliver high-quality solutions
- Implement best practices for performance tuning, error handling, and job monitoring
- Work with structured, semi-structured, and unstructured datasets; support API-based and event-driven integrations
- Automate and thoroughly document ETL workflows to improve maintainability and scalability
- Use Git and CI/CD pipelines for deployment and version control of ETL workflows
Required Skills
- 12+ years of ETL design and development experience in enterprise environments
- Strong proficiency in SQL, Python, Apache Beam
- Hands-on with Dataflow, BigQuery, Pub/Sub, Cloud Storage, Cloud Composer
- Strong experience in advanced SQL/DML operations and query optimization
- Solid understanding of data modeling, data warehousing concepts, and data lake architectures
- Experience with Apache Airflow DAG design, including error handling and monitoring
- Knowledge of performance tuning, data partitioning, and optimization techniques
- Experience in real-time streaming ETL and event-driven architectures is a plus
- Strong analytical, troubleshooting, and communication skills
Qualifications
- Bachelor’s or Master’s degree in Computer Science, Information Technology, or related field
- Proven experience delivering scalable ETL solutions in data warehouse ecosystems
- Ability to excel in fast-paced and agile environments