Databricks Platform Engineer
Summary: The Databricks Platform Engineer role requires over 8 years of experience in Platform Engineering or Cloud Engineering, with a strong focus on Databricks Workspace Administration and Data Governance. The position involves managing access control, performance tuning, and implementing advanced Databricks capabilities. Candidates should possess hands-on experience with cloud platforms and Infrastructure as Code practices, alongside strong analytical and communication skills.
Key Responsibilities:
- Manage Databricks Workspace Administration, Unity Catalog, and Cluster Policies.
- Configure and manage access control, permissions, security, and compliance across the Databricks platform.
- Optimize platform performance through tuning, monitoring, and troubleshooting.
- Implement advanced Databricks capabilities, including Genie, Lakehouse Apps, and Delta Lake.
- Utilize cloud platforms such as AWS, Azure, or Google Cloud Platform.
- Apply Infrastructure as Code (Terraform) and CI/CD pipelines in automation processes.
- Script using Python, Bash, or PowerShell for various tasks.
- Monitor platform health and performance using observability tools.
- Maintain excellent stakeholder management and communication skills.
Key Skills:
- 8+ years of experience in Platform Engineering or Cloud Engineering.
- Expertise in Databricks Workspace Administration and Data Governance.
- Experience with access control and security management on Databricks.
- Proficiency in performance tuning and cost optimization.
- Hands-on experience with cloud platforms (AWS, Azure, Google Cloud Platform).
- Strong knowledge of Infrastructure as Code (Terraform) and CI/CD practices.
- Proficiency in scripting languages (Python, Bash, PowerShell).
- Experience with monitoring and observability tools.
- Relevant Databricks or cloud platform certifications.
- Excellent analytical and problem-solving skills.
Salary (Rate): £75,000 yearly
City: undetermined
Country: undetermined
Working Arrangements: remote
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
Job Description:
- 8+ years of experience in Platform Engineering, Cloud Engineering, or Data Platform Administration.
- Strong hands-on expertise in Databricks Workspace Administration, Unity Catalog, Cluster Policies, and enterprise Data Governance.
- Experience configuring and managing access control, permissions, security, and compliance across the Databricks platform.
- Proficiency in platform performance tuning, monitoring, troubleshooting, and cost optimization.
- Experience implementing advanced Databricks capabilities, including Genie, Lakehouse Apps, Delta Lake, and Lakehouse Architecture.
- Hands-on experience with cloud platforms such as AWS, Azure, or Google Cloud Platform (Google Cloud Platform).
- Strong experience with Infrastructure as Code (Terraform), CI/CD pipelines, automation, and Git/DevOps best practices.
- Proficiency in scripting using Python, Bash, or PowerShell.
- Experience with monitoring and observability tools for platform health and performance.
- Relevant Databricks or cloud platform certifications are a plus.
- Excellent analytical, problem-solving, communication, and stakeholder management skills.
Similar Jobs
Apologies, there are currently no similar jobs available.