Lead SQL/BQMS Consultant

Lead SQL/BQMS Consultant

Posted 1 day ago by HOK Consulting - Technical Recruitment Consultancy

Negotiable
Undetermined
Hybrid
Greater Sheffield Area

Summary: The Lead SQL/BQMS Consultant role involves leading an Agile team in a cross-cloud data migration project, focusing on SQL/BigQuery migration to Spark SQL on Azure. The position requires hands-on expertise in Azure Databricks and Python, along with strong team leadership skills. The consultant will be responsible for building ETL workflows and driving automation across cloud providers while collaborating with various stakeholders. This is a long-term contract position based in a hybrid working arrangement from Sheffield.

Key Responsibilities:

  • Lead and contribute to a small Agile team working on a cross-cloud data migration project.
  • Migrate complex BigQuery SQL transformations to Spark SQL on Azure.
  • Build & execute ETL workflows using Azure Databricks and Python.
  • Drive automation of SQL workflows and artefact migration across cloud providers.
  • Collaborate with developers, POs, and stakeholders on quality delivery and performance optimization.

Key Skills:

  • Strong SQL skills (BigQuery SQL & Spark SQL), Python, and ETL pipeline development.
  • Experience with Azure and cloud data tools.
  • Familiarity with CI/CD practices and automation.
  • Proven team leadership and organisational capabilities.
  • Comfortable with Agile/SAFe/PI Planning methodologies.

Salary (Rate): undetermined

City: Sheffield

Country: United Kingdom

Working Arrangements: hybrid

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

Job Title: Lead SQL/BQMS Consultant

Duration: long-term contract

Location: Hybrid (3 days/week from Sheffield)

Visa: UK Citizen/ILR/Dependent visa (No Visa sponsorship)

We are looking for a Lead SQL/BQMS Consultant with hands-on expertise in SQL/BigQuery migration , Azure Databricks , and Spark SQL , who also brings team leadership experience and thrives in Agile/SAFe/Scrum environments.

Key Responsibilities:

  • Lead and contribute to a small Agile team working on a cross-cloud data migration project.
  • Migrate complex BigQuery SQL transformations to Spark SQL on Azure.
  • Build & execute ETL workflows using Azure Databricks and Python.
  • Drive automation of SQL workflows and artefact migration across cloud providers.
  • Collaborate with developers, POs, and stakeholders on quality delivery and performance optimization.

Key Requirements:

  • Strong SQL skills (BigQuery SQL & Spark SQL), Python, and ETL pipeline development.
  • Experience with Azure and cloud data tools.
  • Familiarity with CI/CD practices and automation.
  • Proven team leadership and organisational capabilities.
  • Comfortable with Agile/SAFe/PI Planning methodologies.