Technical Project Manager Databricks & Spark

Technical Project Manager Databricks & Spark

Posted 6 days ago by Avanda Group AG on JobServe

Apply
Negotiable
Undetermined
Remote
London, UK
Apply
Agile Methodology Amazon Web Services (AWS) Apache Spark Azure Databricks Cloud Computing Cloud Technology Databricks Data Governance Data Security DevOps Infrastructure as Code (IaC) Management Microsoft Azure Project Management Risk Management Scalability Stakeholder Engagement Stakeholder Management

Summary: The Technical Project Manager for Databricks & Spark will lead the delivery of a client’s Applicative Platform, requiring a blend of technical expertise and project management skills. This role involves managing Agile delivery processes, overseeing Databricks program execution, and ensuring stakeholder engagement. The position is fully remote with travel to major European cities and is contracted until the end of 2025.

Key Responsibilities:

  • Manage delivery using Agile frameworks (Scrum/Kanban), driving sprints, retrospectives, backlog grooming, and iterative planning.
  • Oversee pipeline execution, cluster usage, cost optimization, and platform governance within Databricks.
  • Coordinate cross-functional engineering teams using Apache Spark, Delta Lake, and cloud-native tooling (Azure/AWS).
  • Act as the interface between business units and technical teams, translating requirements into actionable delivery plans.
  • Ensure deliverables meet high standards for performance, security, reliability, and governance.
  • Identify and drive enhancements in delivery processes, platform scalability, and team collaboration.
  • Understand and integrate data security, data governance, and regulatory best practices into delivery pipelines.

Key Skills:

  • 10+ years of technical project management experience in enterprise or cloud-based environments.
  • Proven experience managing projects on Databricks, ideally with exposure to Delta Lake, MLflow, and Unity Catalog.
  • Solid grasp of Apache Spark concepts: job orchestration, DAGs, optimizations, cost-performance tradeoffs.
  • Strong understanding of cloud platforms (Azure and/or AWS) and DevOps principles (CI/CD, IaC).
  • Demonstrated success delivering data platforms, data transformations, or cloud migrations.
  • Skilled in stakeholder engagement, risk management, and Agile delivery.
  • Exceptional communication skills - capable of simplifying complex technical concepts for business leaders.

Salary (Rate): undetermined

City: London

Country: UK

Working Arrangements: remote

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT

Apply
Similar Jobs
Loading data...