Summary: The Lead Data Engineer role is a contract position requiring a highly skilled individual with extensive experience in data engineering, particularly with Databricks. The successful candidate will work remotely from the UK and will be responsible for leading data migration programs and implementing scalable data pipelines. This position offers an opportunity to influence significant technical projects within a market-leading organization in the retail sector.

Key Responsibilities:

• Lead the implementation of Databricks and create a single data source.
• Develop and maintain scalable data pipelines using PySpark and SQL.
• Oversee data migration programs and ensure cloud platforms are optimized.
• Collaborate with C-Suite executives to align data strategies with business goals.
• Build and develop an internal data engineering squad.

Key Skills:

• At least 4 years of recent experience with Databricks.
• 10+ years of experience in a Data Engineer role, with hands-on lead experience.
• Proven expertise in data migration programs and delivering scalable data pipelines.
• Strong knowledge of PySpark, SQL, and DevOps/DataOps/CICD practices.

Salary (Rate): £575

City: undetermined

Country: United Kingdom

Working Arrangements: remote

IR35 Status: outside IR35

Seniority Level: Senior

Industry: IT