Senior SQL and ETL Engineer
Posted 4 days ago by Pyramid Technology Solutions, Inc.
Negotiable
Undetermined
Remote
Remote
Summary: The Senior SQL and ETL Engineer role requires a highly experienced professional with a minimum of seven years in electronic data processing systems, including leadership experience. The position focuses on developing and optimizing SQL and ETL/ELT pipelines, particularly within Azure environments. The role is remote and emphasizes extensive experience with data warehousing, big data technologies, and business intelligence platforms. Candidates must demonstrate a strong background in data quality assurance and production ETL operations.
Key Responsibilities:
- Develop and optimize SQL, PL/SQL, and T-SQL logic, including stored procedures and performance tuning.
- Work with mainframe data extraction, mapping, and conversion into ETL/ELT pipelines.
- Design, orchestrate, and deploy ETL/ELT pipelines using Azure Synapse Analytics, Azure Data Factory, SSIS, and Azure DevOps CI/CD workflows.
- Build and maintain enterprise data warehouses using Oracle, SQL Server, Teradata, or cloud data platforms.
- Utilize big data technologies such as Apache Spark, PySpark, or Hadoop for large-scale data transformation.
- Integrate structured and semi-structured data and consume APIs using Python/PySpark.
- Develop analytics-ready datasets and support business intelligence platforms like Power BI or Cognos.
- Perform data cleansing, validation, profiling, and data quality assurance for regulated environments.
- Support production ETL operations, troubleshoot pipeline failures, and ensure SLAs for reporting workloads.
Key Skills:
- Minimum of seven years of experience in electronic data processing systems.
- At least four years in a lead capacity.
- Experience with SQL, PL/SQL, and T-SQL development and optimization.
- Experience with mainframe data extraction and ETL/ELT pipelines.
- Proficiency in Azure Synapse Analytics, Azure Data Factory, SSIS, and Azure DevOps CI/CD workflows.
- Experience building enterprise data warehouses and working with big data technologies.
- Ability to integrate structured and semi-structured data and consume APIs using Python/PySpark.
- Experience developing datasets for business intelligence platforms.
- Knowledge of data cleansing, validation, and quality assurance processes.
- Experience supporting production ETL operations and troubleshooting.
Salary (Rate): undetermined
City: undetermined
Country: undetermined
Working Arrangements: remote
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
Job Role: Senior SQL and ETL Engineer
Location: Downey, CA (Remote)
Duration: 12 Months Contract
Experience Required:
This classification must have a minimum of seven (7) years of experience in electronic data processing systems study, design, and programming. At least four (4) years of that experience must have been in a lead capacity.
Additional Experience Required:
- 3 years of experience in the past 4 years developing and optimizing SQL, PL/SQL, and T-SQL logic, including stored procedures, functions, performance tuning, and advanced relational modeling across Oracle and SQL Server.
- 3 years of experience in the past 4 years working with mainframe including data extraction, mapping, and conversion into modern ETL/ELT pipelines.
- 3 years of experience in the past 4 years designing, orchestrating, and deploying ETL/ELT pipelines using Azure Synapse Analytics, Azure Data Factory, SSIS, and Azure DevOps CI/CD workflows.
- 3 years of experience in the past 4 years building and maintaining enterprise data warehouses using Oracle, SQL Server, Teradata, or cloud data platforms.
- 3 years of experience in the past 4 years working with big data technologies such as Apache Spark, PySpark, or Hadoop for large-scale data transformation.
- 3 years of experience in the past 4 years integrating structured and semi-structured data (CSV, XML, JSON, Parquet) and consuming APIs using Python/PySpark.
- 3 years of experience in the past 4 years developing analytics-ready datasets and supporting business intelligence platforms such as Power BI or Cognos, including writing optimized SQL for reporting.
- 3 years of experience in the past 4 years performing data cleansing, validation, profiling, and data quality assurance for regulated or audit-sensitive environments.
- 3 years of experience supporting production ETL operations, troubleshooting pipeline failures, conducting root cause analysis, and ensuring SLAs for daily, monthly, or regulatory reporting workloads.