Key Responsibilities
- Architect and optimise solutions leveraging Databricks Lakehouse Platform.
- Design scalable data pipelines supporting batch, streaming, analytics, and AI workloads.
- Provide architectural governance, standards, and best practices.
- Collaborate with senior stakeholders, programme teams, data engineers, analysts, and business leaders.
- Ensure solutions meet security, compliance, data governance, and regulatory requirements.
- Support migration of Legacy data platforms to modern cloud-based environments.
- Drive adoption of modern data engineering and analytics patterns.
- Produce architecture artefacts including HLDs, LLDs, reference architectures, and technical governance documentation.
Essential Skills & Experience
- Proven expertise with Databricks including:
- Databricks Lakehouse Architecture
- Delta Lake
- Unity Catalog
- Databricks Workflows
- Databricks SQL
- MLflow
- Data Governance and Security
- Strong cloud architecture experience within:
- Microsoft Azure (preferred)
- AWS or Google Cloud Platform
- Deep understanding of:
- Data warehousing
- Data lake architectures
- Master Data Management (MDM)
- Data modelling and metadata management
- Data integration patterns
- Experience designing enterprise-scale analytics and Business Intelligence platforms.
- Strong stakeholder management and communication skills.
- Experience leading multi-disciplinary technical teams
Rate:
£700/day
Location:
London
IR35 Status:
Inside
Remote Status:
Hybrid
Industry:
Data & Analytics
Seniority Level:
Not Specified