Data Engineer/Data Engineering/Azure/Databricks/Ingestion/Pipelines/API/Azure API Management (APIM)/Python/3-month contract/Outside IR35/Fully remote/£400 - 500 per day.
One of our leading clients is looking to recruit a Data Engineer.
Location - fully remote/home based
Duration - Initial 3 month
Day Rate - £400-500 per day Outside IR35
Role/Responsibilities:
- Define and build a data lake architecture on Azure (ADLS + Databricks)
- Layered data model (bronze/silver/gold) for ingestion, processing, and reporting
- Develop ingestion patterns from API sources (batch and streaming)
- Establish data governance, metadata, and access controls
- Define storage structures, naming conventions, and schema design
- Develop API connectors and ingestion pipelines using Python
- Implement integration services feeding into the Databricks environment
- Build data transformation logic using PySpark/Python (data cleansing, standardisation, validation)
- Configure monitoring, logging, and alerting
- Execute unit and integration testing across pipelines
Core Skills:
- Azure
- Databricks
- Python
Desirable:
- Any exposure to Financial Services, Insurance or Bank/Banking would be beneficial but not essential
Rate:
Not specified
Location:
United Kingdom
IR35 Status:
Outside
Remote Status:
Remote
Industry:
Data & Analytics
Seniority Level:
Not Specified