Data Engineer (Azure, Salesforce)
Posted 3 days ago by Som-3 Recruitment
£400 Per day
Inside
Remote
City of London, UK
Summary: The Data Engineer role focuses on developing scalable data pipelines and managing metadata and data quality solutions within Azure and Microsoft Purview environments for a central government project. The position is remote and classified as inside IR35, with a start date of January 8th. Candidates must have relevant experience and be able to accept the specified rate.
Key Responsibilities:
- Data pipeline development - Azure Data Factory, Databricks, Synapse
- Design, build, and maintain automated deployment pipelines - Salesforce
- Develop and maintain metadata capture processes to support data cataloguing and lineage.
- Implement and document data quality rules, retention policies, and data optimisation processes.
- Support large-scale deployment and configuration of Microsoft Purview.
- Metadata management, data lineage, and data quality frameworks.
- Configure data lineage, glossary, and metadata structures to align with governance and compliance standards (UK GDPR, ISO 27001).
- Assess current data platform performance
- Conduct benchmarking (eg, latency, throughput, cost efficiency) and implement storage/DQ optimisations.
Key Skills:
- Strong experience in data engineering within cloud environments, ideally Azure.
- Solid understanding of metadata management, data lineage, and data quality frameworks.
- Knowledge of data governance principles, including GDPR compliance and data retention policy design.
- Strong experience in the Salesforce platform - with hands-on Salesforce platform experience to design, build, and maintain automated deployment pipelines that support the transition of solutions from prototype through testing and into production
- Proficiency in data pipeline development (eg, Azure Data Factory, Databricks, Synapse, or similar).
- Experience implementing and managing Microsoft Purview or equivalent data cataloguing tools.
- Strong experience in SQL, Python, or PySpark for data manipulation and integration.
- Proven ability to optimise performance and manage large data volumes efficiently.
- Experience working in agile delivery environments with cross-functional data teams.
Salary (Rate): £400 per day
City: City of London
Country: UK
Working Arrangements: remote
IR35 Status: inside IR35
Seniority Level: undetermined
Industry: IT
Data Engineer
INSIDE IR35 - £400 per day - 8th Jan start
Remote
*please only apply if you are able to accept the rate and start date.*
Data Engineer needed for a central government project - remote, inside IR35. You will focus on implementing scalable data pipelines, metadata management, and data quality solutions within Azure and Microsoft Purview environments
Responsibilities
- Data pipeline development - Azure Data Factory, Databricks, Synapse
- Design, build, and maintain automated deployment pipelines - Salesforce
- Develop and maintain metadata capture processes to support data cataloguing and lineage.
- Implement and document data quality rules, retention policies, and data optimisation processes.
- Support large-scale deployment and configuration of Microsoft Purview.
- Metadata management, data lineage, and data quality frameworks.
- Configure data lineage, glossary, and metadata structures to align with governance and compliance standards (UK GDPR, ISO 27001).
- Assess current data platform performance
- Conduct benchmarking (eg, latency, throughput, cost efficiency) and implement storage/DQ optimisations.
Your background
- Strong experience in data engineering within cloud environments, ideally Azure.
- Solid understanding of metadata management, data lineage, and data quality frameworks.
- Knowledge of data governance principles, including GDPR compliance and data retention policy design.
- Strong experience in the Salesforce platform - with hands-on Salesforce platform experience to design, build, and maintain automated deployment pipelines that support the transition of solutions from prototype through testing and into production
- Proficiency in data pipeline development (eg, Azure Data Factory, Databricks, Synapse, or similar).
- Experience implementing and managing Microsoft Purview or equivalent data cataloguing tools.
- Strong experience in SQL, Python, or PySpark for data manipulation and integration.
- Proven ability to optimise performance and manage large data volumes efficiently.
- Experience working in agile delivery environments with cross-functional data teams.
INSIDE IR35 - £400 per day - 8th Jan start
Remote