Databrick Platform Lead

Databrick Platform Lead

Posted 2 days ago by TEKsystems

Negotiable
Undetermined
Remote
Leeds, UK

Summary: TEKsystems is seeking a Databricks Platform Lead for a 3-month contract, with potential extensions, to oversee the migration of a data platform from SAP HANA to Databricks for a UK logistics leader. The role requires both strategic oversight and hands-on technical execution to ensure the new platform meets business needs. The position involves collaboration with internal teams and stakeholders to optimize the platform's performance and scalability. Initial on-site engagement in Leeds is required, with the role primarily remote thereafter.

Key Responsibilities:

  • Lead the end-to-end migration from SAP HANA to Databricks, ensuring platform functionality is replicated and enhanced.
  • Design and implement scalable, efficient solutions based on a deep understanding of Databricks architecture.
  • Collaborate with internal teams and external consultancies to align on architecture, timelines, and deliverables.
  • Engage with stakeholders to understand business processes and translate them into scalable data solutions.
  • Identify and mitigate risks throughout the migration process.
  • Optimize the Databricks platform for performance, scalability, and cost-effectiveness.
  • Eliminate redundancies and streamline data workflows.
  • Provide technical leadership and hands-on support across the project lifecycle.
  • Attend initial on-site meetings to build relationships and gather requirements from key stakeholders.

Key Skills:

  • Proven experience leading Databricks implementations or large-scale data platform migrations.
  • Strong technical expertise in Databricks, Spark, and modern data engineering practices.
  • In-depth knowledge of Databricks architecture, including cluster management, Delta Lake, and workspace configuration.
  • Excellent stakeholder management and communication skills.
  • Deep understanding of data architecture, performance tuning, and platform optimization.
  • Experience in risk management and platform efficiency improvements.
  • Ability to work collaboratively with cross-functional teams and third-party vendors.
  • Comfortable in a fast-paced, transformation-focused environment.

Salary (Rate): undetermined

City: Leeds

Country: UK

Working Arrangements: remote

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

Job Title:

Databricks Platform Lead (3-month contract with expected extensions)

Location: Remote

(with initial on-site internal stakeholder engagement in Leeds)

Start Date: ASAP

Role Overview:

TEKsystems are working with a UK leader in logistics to recruit a highly experienced Databricks Platform Lead to join their data transformation team on a contract basis. This role is critical to the successful migration and optimization of our data platform from SAP HANA to Databricks. You will be responsible for both the strategic oversight and hands-on technical execution of this migration, ensuring the new platform is robust, efficient, and aligned with business needs.

Key Responsibilities:

Lead the end-to-end migration from SAP HANA to Databricks, ensuring platform functionality is replicated and enhanced.

Design and implement scalable, efficient solutions based on a deep understanding of Databricks architecture.

Collaborate with internal teams and external consultancies to align on architecture, timelines, and deliverables.

Engage with stakeholders to understand business processes and translate them into scalable data solutions.

Identify and mitigate risks throughout the migration process.

Optimize the Databricks platform for performance, scalability, and cost-effectiveness.

Eliminate redundancies and streamline data workflows.

Provide technical leadership and hands-on support across the project lifecycle.

Attend initial on-site meetings to build relationships and gather requirements from key stakeholders.

What We're Looking For:

Proven experience leading Databricks implementations or large-scale data platform migrations.

Strong technical expertise in Databricks, Spark, and modern data engineering practices.

In-depth knowledge of Databricks architecture, including cluster management, Delta Lake, and workspace configuration.

Excellent stakeholder management and communication skills.

Deep understanding of data architecture, performance tuning, and platform optimization.

Experience in risk management and platform efficiency improvements.

Ability to work collaboratively with cross-functional teams and third-party vendors.

Comfortable in a fast-paced, transformation-focused environment.

Desirable Skills:

Familiarity with SAP HANA data structures and architecture.

Experience with cloud platforms such as Azure, AWS, or GCP.

Job Title: Databrick Platform Lead

Location: Leeds, UK

Job Type: Contract

Trading as TEKsystems. Allegis Group Limited, Bracknell, RG12 1RT, United Kingdom. No. 2876353. Allegis Group Limited operates as an Employment Business and Employment Agency as set out in the Conduct of Employment Agencies and Employment Businesses Regulations 2003. TEKsystems is a company within the Allegis Group network of companies (collectively referred to as "Allegis Group"). Aerotek, Aston Carter, EASi, Talentis Solutions, TEKsystems, Stamford Consultants and The Stamford Group are Allegis Group brands. If you apply, your personal data will be processed as described in the Allegis Group Online Privacy Notice available at our website.

To access our Online Privacy Notice, which explains what information we may collect, use, share, and store about you, and describes your rights and choices about this, please go our website.

We are part of a global network of companies and as a result, the personal data you provide will be shared within Allegis Group and transferred and processed outside the UK, Switzerland and European Economic Area subject to the protections described in the Allegis Group Online Privacy Notice. We store personal data in the UK, EEA, Switzerland and the USA. If you would like to exercise your privacy rights, please visit the "Contacting Us" section of our Online Privacy Notice on our website for details on how to contact us. To protect your privacy and security, we may take steps to verify your identity, such as a password and user ID if there is an account associated with your request, or identifying information such as your address or date of birth, before proceeding with your request. commitments under the UK Data Protection Act, EU-U.S. Privacy Shield or the Swiss-U.S. Privacy Shield.