Negotiable
Outside
Remote
USA
Summary: The ETL Sr Developer role focuses on optimizing the performance of Spark jobs and managing ETL/ELT pipelines using PySpark, SQL, and Databricks Workflows. The position involves working on a Data Migration Conversion project and enhancing pipeline efficiency. This role is remote and classified as outside IR35.
Key Responsibilities:
- Optimization performance of Spark jobs
- ETL/ELT pipelines using PySpark, SQL, Databricks Workflows
- Data Migration Conversion project
- Pipeline optimization
Key Skills:
- Experience with Spark jobs
- Proficiency in PySpark and SQL
- Familiarity with Databricks Workflows
- Knowledge of data migration and conversion processes
- Skills in pipeline optimization
Salary (Rate): undetermined
City: Cary
Country: USA
Working Arrangements: remote
IR35 Status: outside IR35
Seniority Level: undetermined
Industry: IT
Cary North Carolina
Job Description:
>> Optimization performance of Spark jobs
>> ETLELT pipelines using PySpark, SQL, Databricks Workflows
>> Data Migration Conversion project
>> Pipeline optimization