Summary: The role of Data Architect – Databricks Specialist involves leading the design and delivery of a scalable data platform within a financial consultancy. The position requires deep expertise in Databricks and collaboration with various stakeholders to ensure compliance with regulatory standards. The architect will also provide technical leadership and champion best practices in data governance and performance optimization. This is a critical role in a high-profile data transformation program.

Key Responsibilities:

• Lead the architecture and design of a next-gen data platform using Databricks and Delta Lake
• Collaborate with stakeholders including data engineers, analysts, and business leads to define data requirements and architecture patterns
• Ensure the platform is scalable, secure, and aligned to financial regulatory standards
• Develop architectural artefacts (diagrams, documentation, guidelines)
• Provide technical leadership and mentorship to engineering teams
• Champion best practices in data quality, lineage, governance, and performance tuning
• Integrate with a wider Azure ecosystem (e.g. Azure Data Lake, Synapse, Power BI)

Key Skills:

• Proven experience as a Data Architect in enterprise environments
• Extensive hands-on experience with Databricks (including SQL, PySpark, Delta Lake)
• Solid background in data warehousing, data lakes, and big data frameworks
• Strong knowledge of Azure cloud services, especially in data integration
• Experience working in regulated environments (e.g. financial services, insurance, banking)
• Excellent communication skills, capable of engaging with technical and non-technical stakeholders alike
• Comfortable working in agile, fast-paced delivery environments
• Familiarity with CI/CD pipelines, Infrastructure as Code (e.g. Terraform, ARM)
• Exposure to data governance tools like Unity Catalog, Purview, Collibra
• Knowledge of data privacy regulations (GDPR, financial compliance)

Salary (Rate): undetermined

City: London

Country: United Kingdom

Working Arrangements: remote

IR35 Status: undetermined

Seniority Level: undetermined

Industry: Consulting