ETL DataStage & Cloud Engineer
Posted Today by 1763462172
Negotiable
Outside
Remote
USA
Summary: The ETL DataStage & Cloud Engineer role involves designing, developing, and optimizing enterprise data integration solutions using IBM DataStage and cloud platforms. The position requires collaboration with cross-functional teams to create scalable ETL workflows and manage data ingestion from various sources. The ideal candidate will have extensive experience in ETL development, cloud data platforms, and data quality validation. This is a long-term contract position with flexible working arrangements.
Key Responsibilities:
- Design, develop, and maintain ETL solutions using IBM DataStage (Parallel & Server jobs).
- Work with cross-functional teams to gather requirements and translate them into scalable ETL workflows.
- Build and optimize data pipelines on cloud platforms (AWS, Azure, or Google Cloud Platform).
- Develop ELT pipelines using cloud-native tools such as:
- AWS Glue, Lambda, Redshift, S3
- Azure Data Factory, Databricks, Synapse
- Google Cloud Platform Dataflow, BigQuery, Cloud Storage
- Perform data profiling, data quality validation, and performance tuning.
- Manage data ingestion from various structured, semi-structured, and unstructured sources.
- Implement CI/CD pipelines for DataStage and cloud-based data jobs.
- Ensure data governance, security, and compliance across platforms.
- Troubleshoot production issues and support data operations.
- Collaborate with architects and business users on end-to-end data integration strategies.
Key Skills:
- 5 10+ years of experience in ETL development with IBM DataStage.
- Strong working knowledge of DataStage parallel jobs, sequences, error handling, and performance optimization.
- Hands-on experience with at least one major cloud platform (AWS/Azure/Google Cloud Platform).
- Experience with data warehousing concepts (Dimensional modeling, Star/Snowflake schemas).
- Strong SQL skills (Oracle, SQL Server, Teradata, Snowflake, or similar).
- Knowledge of cloud-native ETL/ELT tools such as:
- AWS Glue / Step Functions
- Azure Data Factory / Databricks
- Google Cloud Platform Dataflow / Cloud Composer
- Experience with job orchestration (Airflow, Control-M, Autosys, etc.).
- Familiarity with CI/CD and DevOps tools (Git, Jenkins, Terraform, etc.).
- Strong analytical and problem-solving skills.
Salary (Rate): undetermined
City: undetermined
Country: USA
Working Arrangements: remote
IR35 Status: outside IR35
Seniority Level: undetermined
Industry: IT
Position: ETL DataStage & Cloud Engineer
Location: Onsite/Remote/Hybrid (as required)
Duration: Long-term Contract / Full-Time
Work Authorization: Any
Overview
We are seeking a skilled ETL DataStage & Cloud Engineer with strong experience in IBM DataStage, cloud data platforms, and modern ETL/ELT pipelines. The ideal candidate will design, develop, and optimize enterprise data integration solutions while ensuring high performance, data quality, and scalability.
Key Responsibilities
- Design, develop, and maintain ETL solutions using IBM DataStage (Parallel & Server jobs).
- Work with cross-functional teams to gather requirements and translate them into scalable ETL workflows.
- Build and optimize data pipelines on cloud platforms (AWS, Azure, or Google Cloud Platform).
- Develop ELT pipelines using cloud-native tools such as:
- AWS Glue, Lambda, Redshift, S3
- Azure Data Factory, Databricks, Synapse
- Google Cloud Platform Dataflow, BigQuery, Cloud Storage
- Perform data profiling, data quality validation, and performance tuning.
- Manage data ingestion from various structured, semi-structured, and unstructured sources.
- Implement CI/CD pipelines for DataStage and cloud-based data jobs.
- Ensure data governance, security, and compliance across platforms.
- Troubleshoot production issues and support data operations.
- Collaborate with architects and business users on end-to-end data integration strategies.
Required Skills & Experience
- 5 10+ years of experience in ETL development with IBM DataStage.
- Strong working knowledge of DataStage parallel jobs, sequences, error handling, and performance optimization.
- Hands-on experience with at least one major cloud platform (AWS/Azure/Google Cloud Platform).
- Experience with data warehousing concepts (Dimensional modeling, Star/Snowflake schemas).
- Strong SQL skills (Oracle, SQL Server, Teradata, Snowflake, or similar).
- Knowledge of cloud-native ETL/ELT tools such as:
- AWS Glue / Step Functions
- Azure Data Factory / Databricks
- Google Cloud Platform Dataflow / Cloud Composer
- Experience with job orchestration (Airflow, Control-M, Autosys, etc.).
- Familiarity with CI/CD and DevOps tools (Git, Jenkins, Terraform, etc.).
- Strong analytical and problem-solving skills.
Preferred Qualifications
- Cloud certifications (AWS, Azure, or Google Cloud Platform).
- Experience migrating DataStage workloads to cloud-based ETL/ELT.
- Python or Shell scripting experience.
- Experience with big data ecosystems (Hadoop, Spark).
- Experience working in Agile development environments.
Soft Skills
- Excellent communication and documentation skills.
- Ability to manage multiple tasks and deadlines.
- Strong teamwork and collaboration abilities.
- Proactive, fast learner, and detail-oriented.