Key Responsibilities
- Platform Architecture & Governance: Design, maintain, and secure an enterprise-scale, multi-domain workspace architecture on Databricks utilizing Unity Catalog, DABs, and Azure network isolates (VNet/Private Link).
- Azure & Enterprise Identity: Implement enterprise identity federation using Azure Entra ID (AAD), SCIM provisioning, service principals, SSO, and group synchronization.
- Data Engineering & dbt Governance: Oversee dbt Core / dbtHub on Databricks , enforcing data contracts, schema rules, native testing patterns, and automated CI/CD integrations via GitHub Actions.
- Cross-Team Strategy Alignment: Collaborate closely with the EDG/Nucleus parent platform team to align core infrastructure, networking, and platform strategy.
- Hands-On Enablement & Mentoring: Translate architectural strategy into implementation-ready designs while actively engaging in hands-on pairing with platform engineering teams to drive delivery.
Required Qualifications & Technical Expertise
- Databricks Platform Architecture: Expert-level mastery of Unity Catalog, workspace governance, RBAC, compute policies, DABs, and Databricks-native security models.
- Azure Infrastructure & Security: Deep hands-on experience with Azure ADLS Gen2, Azure Key Vault, Private Link, and VNet integration for data platforms.
- dbt Ecosystem Mastery: Proven track record running dbt on Databricks, including contracts, schema enforcement, native testing frameworks, and dbtHub integration.
- Multi-Tenant Architecture: Proven experience architecting enterprise-scale, multi-domain shared workspace environments across global teams.
- Enterprise Identity Federation: Direct experience configuring Azure Entra ID (AAD), SCIM provisioning, service principals, SSO, and group synchronization.
- DevOps & CI/CD: Hands-on capability building automated pipelines with GitHub Actions for data platform infrastructure and dbt workflows.
IR35 Status:
Not specified
Seniority Level:
Not Specified