Databricks Admin with GCP/AWS
Posted 2 weeks ago by Axiom Software Solutions Ltd
Negotiable
Inside
Onsite
Leeds, UK
Summary: The role of Databricks Admin with GCP/AWS involves managing and supporting the Databricks platform, ensuring optimal performance for data analytics, machine learning, and data engineering activities. The position requires collaboration with various teams to configure and maintain the platform, manage security, and troubleshoot issues. This is a contract role based in Leeds, requiring in-office presence three days a week. The role is classified as inside IR35.
Key Responsibilities:
- Designing, implementing, and maintaining the Databricks platform.
- Providing operational support including platform set-up, configuration, and workspace administration.
- Monitoring resource utilization and troubleshooting service issues.
- Managing security and changes within the platform.
- Collaborating with data engineering teams for data ingestion and transformation.
- Managing privileges and access controls at various levels of the Databricks account.
- Installing, configuring, and maintaining Databricks clusters and workspaces.
- Ensuring compliance with security and patching best practices.
- Administering interfaces with Google Cloud Platform.
Key Skills:
- 3+ years of production support of the Databricks platform.
- 2+ years of experience with AWS/Azure/GCP PaaS administration (preferred).
- 2+ years of experience in automation frameworks such as Terraform (preferred).
- Strong understanding of data analytics and machine learning processes.
- Experience in managing security and compliance within cloud environments.
Salary (Rate): £400 daily
City: Leeds
Country: UK
Working Arrangements: on-site
IR35 Status: inside IR35
Seniority Level: undetermined
Industry: IT
Databricks Admin with GCP/AWS
Contract role : 6+ Months - Inside Ir35
Leeds- Mandatory 3 days/week
Rate 400 P/d
Job Description:
Responsibilities will include designing, implementing, and maintaining the Databricks platform, and providing operational support. Operational support responsibilities include platform set-up and configuration, workspace administration, resource monitoring, providing technical support to data engineering, Data Science/ML, and Application/integration teams, performing restores/recoveries, troubleshooting service issues, determining the root causes of issues, and resolving issues.
. The position will also involve the management of security and changes.
. The position will work closely with the Team Lead, other Databricks Administrators, System Administrators, and Data Engineers/Scientists/Architects/Modelers/Analysts.
Primary skill -
* Databricks Admin with GCP/AWS
?
Responsibilities:
. Responsible for the administration, configuration, and optimization of the Databricks platform to enable data analytics, machine learning, and data engineering activities within the organization.
. Collaborate with the data engineering team to ingest, transform, and orchestrate data.
. Manage privileges over the entire Databricks account, as well as at the workspace level, Unity Catalog level and SQL warehouse level.
. Create workspaces, configure cloud resources, view usage data, and manage account identities, settings, and subscriptions.
. Install, configure, and maintain Databricks clusters and workspaces.
. Maintain Platform currency with security, compliance, and patching best practices.
. Monitor and manage cluster performance, resource utilization, platform costs, and troubleshoot issues to ensure optimal performance.
. Implement and manage access controls and security policies to protect sensitive data.
. Manage schema data with Unity Catalog - create, configure, catalog, external storage, and access permissions.
. Administer interfaces with Google Cloud Platform.
Required Skills:
. 3+ years of production support of the Databricks platform
Preferred:
. 2+ years of experience of AWS/Azure/GCP PaaS admin
. 2+ years of experience in automation frameworks such as Terraform