£62,190 Per year
Undetermined
Undetermined
Leeds, England, United Kingdom
Summary: The Senior DataOps Data Engineer role in Leeds involves operationalizing and automating data workflows within a public sector organization. The position focuses on integrating CI/CD data pipelines, enforcing data governance, and optimizing costs in a Microsoft Azure environment. The role also includes mentoring colleagues and ensuring compliance with regulatory frameworks. This is an 18-month fixed-term contract with potential for permanent placement.
Key Responsibilities:
- Oversee and automate operational processes supporting data workflows developed by the Data Engineering team.
- Spearhead the development, integration, and maintenance of CI/CD data pipelines for automated deployments.
- Integrate best practices for monitoring and observability to proactively detect, analyze, and resolve issues.
- Enforce robust data governance and security protocols through tools like Azure Key Vault.
- Collaborate closely with Data Engineering, Data Science, Analytics, and DevOps teams.
- Optimize operational performance and cost management for services including Azure Data Factory and Azure Databricks.
- Serve as the domain expert in DataOps by providing strategic guidance and mentoring colleagues.
Key Skills:
- Demonstrable experience in DataOps, Data Engineering, DevOps, or related roles.
- Proven experience working with agile teams and driving automation of data workflows within Microsoft Azure.
- Hands-on expertise with Azure Data Platform components such as Azure Data Factory and Azure Databricks.
- Proficiency in developing CI/CD data pipelines and strong programming skills in Python, SQL, Bash, and PySpark.
- Strong aptitude for data pipeline monitoring and understanding of data security practices.
- Experience ensuring compliance with regulatory frameworks and implementing robust data governance measures.
- Demonstrated ability to implement Infrastructure as Code using Terraform.
Salary (Rate): £62,190.00 yearly
City: Leeds
Country: United Kingdom
Working Arrangements: undetermined
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
Senior Data Ops Data Engineer
Leeds 2/3 days per week
£55,000-£67,000+ Excellent Benefits
18 Months FTC with long term potential
Your New Company
Our large public sector organisation are seeking a senior Data Platform DataOps Engineer to serve as our clients first DataOps specialist in a growing team of Data Engineers and DevOps professionals.
In this pivotal role, you will focus on operationalising and automating their data lifecycle to ensure that data workflows perform with reliability and efficiency. You will integrate CI/CD data pipelines, streamline deployment processes, enforce robust data governance, and optimise operational costs within our Microsoft Azure environment.
Your work will be centred on proactive system monitoring, error resolution, and continuous improvements, while mentoring and guiding colleagues.
What you will be doing
- Oversee and automate the operational processes that support data workflows developed by the Data Engineering team while ensuring seamless coordination with the DevOps group.
- Spearhead the development, integration, and maintenance of CI/CD data pipelines for automated deployments.
- Integrate best practices for monitoring and observability to proactively detect, analyse, and resolve issues.
- Enforce robust data governance and security protocols through tools like Azure Key Vault, ensuring compliance with standards such as GDPR, and other regulatory frameworks.
- Collaborate closely with Data Engineering, Data Science, Analytics, and DevOps teams to align operational strategies with technical and business requirements.
- Optimize operational performance and cost management for services including Azure Data Factory, Azure Databricks, Delta Lake, and Azure Data Lake Storage.
- Serve as the domain expert in DataOps by providing strategic guidance, mentoring colleagues, and driving continuous process improvements.
What you will need
- Demonstrable experience in DataOps, Data Engineering, DevOps, or related roles focused on managing data operations in complex, data-centric environments.
- Proven experience working with agile teams and driving automation of data workflows within the Microsoft Azure ecosystem.
- Hands-on expertise with Azure Data Platform with components such as Azure Data Factory, Azure Databricks, Azure Data Lake Storage, Delta Lake, Azure SQL, Purview and APIM.
- Proficiency in developing CI/CD data pipelines and strong programming skills in Python, SQL, Bash, and PySpark for automation.
- Strong aptitude for data pipeline monitoring and an understanding of data security practices such as RBAC and encryption.
- Implemented data and pipeline observability dashboards, ensuring high data quality, and improving the efficiency of data workflows.
- Experience ensuring compliance with regulatory frameworks and implementing robust data governance measures.
- Demonstrated ability to implement Infrastructure as Code using Terraform, to provision and manage data pipelines and associated resources.
W hat you will get in return
In return, you'll receive a competitive salary of £55,280 - £62,190, plus the opportunity to take an 8% cash benefit uplift. This is an 18-month fixed-term contract with strong potential to become permanent. You'll also benefit from an excellent package that includes private medical insurance and a generous pension scheme, making this a highly attractive opportunity.
What you need to do now
If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now. If this job isn't quite right for you, but you are looking for a new position, please contact us for a confidential discussion about your career. Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept the T&C's, Privacy Policy and Disclaimers which can be found at hays.co.uk