Key Responsibilities
- Develop and optimize data pipelines using Azure Databricks, PySpark, and ADF
- Build scalable data solutions using ADLS, Python, and SQL
- Implement data transformation, cleansing, and processing using PySpark
- Work with Unity Catalog for data governance, security, and access management
- Troubleshoot and optimize data pipelines for performance and reliability
Mandatory Skills
- Azure Databricks
- ADF
- PySpark
- SQL
- ADLS
- Python
- Unity Catalog
Rate:
£400/day
Location:
United Kingdom
IR35 Status:
Outside
Remote Status:
Remote
Industry:
Data & Analytics
Seniority Level:
Not Specified