Negotiable
Undetermined
Hybrid
Greater Sheffield Area
Summary: The Lead SQL/BQMS Consultant role involves leading an Agile team in a cross-cloud data migration project, focusing on SQL/BigQuery migration to Spark SQL on Azure. The position requires hands-on expertise in Azure Databricks and Python, along with strong team leadership skills. The consultant will be responsible for building ETL workflows and driving automation across cloud providers while collaborating with various stakeholders. This is a long-term contract position based in a hybrid working arrangement from Sheffield.
Key Responsibilities:
- Lead and contribute to a small Agile team working on a cross-cloud data migration project.
- Migrate complex BigQuery SQL transformations to Spark SQL on Azure.
- Build & execute ETL workflows using Azure Databricks and Python.
- Drive automation of SQL workflows and artefact migration across cloud providers.
- Collaborate with developers, POs, and stakeholders on quality delivery and performance optimization.
Key Skills:
- Strong SQL skills (BigQuery SQL & Spark SQL), Python, and ETL pipeline development.
- Experience with Azure and cloud data tools.
- Familiarity with CI/CD practices and automation.
- Proven team leadership and organisational capabilities.
- Comfortable with Agile/SAFe/PI Planning methodologies.
Salary (Rate): undetermined
City: Sheffield
Country: United Kingdom
Working Arrangements: hybrid
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
Job Title: Lead SQL/BQMS Consultant
Duration: long-term contract
Location: Hybrid (3 days/week from Sheffield)
Visa: UK Citizen/ILR/Dependent visa (No Visa sponsorship)
We are looking for a Lead SQL/BQMS Consultant with hands-on expertise in SQL/BigQuery migration , Azure Databricks , and Spark SQL , who also brings team leadership experience and thrives in Agile/SAFe/Scrum environments.
Key Responsibilities:
- Lead and contribute to a small Agile team working on a cross-cloud data migration project.
- Migrate complex BigQuery SQL transformations to Spark SQL on Azure.
- Build & execute ETL workflows using Azure Databricks and Python.
- Drive automation of SQL workflows and artefact migration across cloud providers.
- Collaborate with developers, POs, and stakeholders on quality delivery and performance optimization.
Key Requirements:
- Strong SQL skills (BigQuery SQL & Spark SQL), Python, and ETL pipeline development.
- Experience with Azure and cloud data tools.
- Familiarity with CI/CD practices and automation.
- Proven team leadership and organisational capabilities.
- Comfortable with Agile/SAFe/PI Planning methodologies.