Senior ETL Designer | 100% Remote | C2C Profiles

Senior ETL Designer | 100% Remote | C2C Profiles

Posted 5 days ago by 1764662097

Apply
Negotiable
Outside
Remote
USA
Apply
Airflow Apache Airflow Automation Batch Processing BigQuery Cloud Computing Cloud Technology Continuous Integration and Continuous Delivery Dataflow Data Ingestion Data Integrity Extract Transform Load (ETL) Git (Version Control System) Google Cloud Google Cloud Composer Google Cloud Platform (GCP) Performance Tuning Platform Tools Unstructured Data Version Control Workflows

Summary: The Senior ETL Designer role involves designing, developing, and maintaining ETL pipelines on Google Cloud Platform. The position requires collaboration with various teams to optimize data processes and ensure data integrity and security. The role is fully remote and emphasizes best practices in ETL job performance and automation. Candidates should be proficient in using tools like Dataflow, BigQuery, and Cloud Composer.

Key Responsibilities:

  • Design, develop, and maintain robust ETL pipelines on Google Cloud Platform using tools like Dataflow, BigQuery, Cloud Composer (Apache Airflow), and Pub/Sub
  • Optimize data ingestion, transformation, and loading processes for high-volume, real-time, and batch data processing
  • Ensure data integrity, quality, and security throughout the ETL lifecycle
  • Collaborate with data engineers, analysts, and business teams to understand data needs and translate them into efficient ETL solutions
  • Implement best practices for performance tuning, error handling, and monitoring of ETL jobs
  • Work with structured and unstructured data sources, integrating API-based, event-driven, and batch processing workflows
  • Automate and document ETL processes to enhance maintainability and scalability
  • Utilize Git for version control and deployment of ETL workflows, ensuring smooth CI/CD integration

Key Skills:

  • Proficiency in Google Cloud Platform tools such as Dataflow, BigQuery, Cloud Composer, and Pub/Sub
  • Experience in designing and maintaining ETL pipelines
  • Strong understanding of data ingestion, transformation, and loading processes
  • Ability to ensure data integrity, quality, and security
  • Collaboration skills with data engineers, analysts, and business teams
  • Knowledge of performance tuning, error handling, and monitoring of ETL jobs
  • Experience with structured and unstructured data sources
  • Familiarity with Git for version control and CI/CD integration

Salary (Rate): undetermined

City: undetermined

Country: USA

Working Arrangements: remote

IR35 Status: outside IR35

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

Role: Senior ETL Designer

Location: 100% Remote

Key Responsibilities:
Design, develop, and maintain robust ETL pipelines on Google Cloud Platform using tools like Dataflow, BigQuery, Cloud Composer (Apache Airflow), and Pub/Sub
Optimize data ingestion, transformation, and loading processes for high-volume, real-time, and batch data processing
Ensure data integrity, quality, and security throughout the ETL lifecycle
Collaborate with data engineers, analysts, and business teams to understand data needs and translate them into efficient ETL solutions
Implement best practices for performance tuning, error handling, and monitoring of ETL jobs
Work with structured and unstructured data sources, integrating API-based, event-driven, and batch processing workflows
Automate and document ETL processes to enhance maintainability and scalability
Utilize Git for version control and deployment of ETL workflows, ensuring smooth CI/CD integration

Apply
Similar Jobs
Loading data...