Data Engineer
Posted 4 days ago by SIBLING
Negotiable
Outside
Onsite
London Area, United Kingdom
Summary: Sibling is looking for a Freelance Data Engineer to design a green-energy analytics platform, focusing on processing global telemetry data. The role involves building scalable ETL pipelines, optimizing Spark jobs, and deploying solutions within Azure. The candidate will collaborate with Data Science and Business stakeholders and must have strong experience in PySpark and Azure. The position is confirmed as outside IR35 and is set to run from April to December 2026.
Key Responsibilities:
- Architect and build robust, scalable ETL pipelines using PySpark and Databricks.
- Refactor existing Spark jobs for maximum performance and cost-efficiency.
- Deploy production-grade solutions within Azure (Unity Catalog, Delta Lake).
- Act as the technical bridge between Data Science and Business stakeholders.
Key Skills:
- Deep, recent experience in PySpark and large-scale Databricks environments.
- Strong Azure experience (ADF, ADLS Gen2).
- Proven track record with CI/CD, Git, and data engineering best practices.
- Right to Work in the UK (No sponsorship available).
Salary (Rate): undetermined
City: London
Country: United Kingdom
Working Arrangements: on-site
IR35 Status: outside IR35
Seniority Level: undetermined
Industry: Other
Sibling is seeking a Freelance Data Engineer to architect a green-energy analytics platform. This is a hands-on, high-scale role focused on processing global telemetry data.
Bio Architect & Code: Build robust, scalable ETL pipelines using PySpark and Databricks.
Optimize: Refactor existing Spark jobs for maximum performance and cost-efficiency.
Integrate: Deploy production-grade solutions within Azure (Unity Catalog, Delta Lake).
Collaborate: Act as the technical bridge between Data Science and Business stakeholders.
Expertise: Deep, recent experience in PySpark and large-scale Databricks environments.
Cloud: Strong Azure experience (ADF, ADLS Gen2).
DevOps: Proven track record with CI/CD, Git, and data engineering best practices.
Compliance: Must have the Right to Work in the UK (No sponsorship available).
Contract Details: Rate: Competitive Market Day Rate. Timeline: Kick-off in April, running through year-end. Assessment: Confirmed Outside IR35. Sector: Renewable Energy & Sustainability Location: Central London (3-4 Days On-site) Status: Outside IR35 Duration: April – December 2026 (Renewable) #DataEngineering #Databricks #PySpark #Azure #ContractJobs #OutsideIR35 #GreenTech