AWS Databricks Administrator

AWS Databricks Administrator

Posted 4 days ago by Ubique Systems on Linkedin

Apply
£56 Per hour
Undetermined
Undetermined
Coventry, England, United Kingdom
Apply
Access Controls Amazon Elastic Compute Cloud Amazon Web Services (AWS) Ansible Apache Spark Automation AWS Identity And Access Management (IAM) AWS Lambda Azure Databricks Big Data Computer Science Continuous Integration and Continuous Delivery Databricks Datadog Data Engineering Data Processing Data Security DevOps Extract Transform Load (ETL) Git (Version Control System) Information Technology Jenkins Management Python (Programming Language) Scala (Programming Language) SQL (Programming Language) Terraform Virtual Private Cloud

Summary: The AWS Databricks Administrator is responsible for providing daily support for the Databricks platform on AWS, ensuring data security, and optimizing performance and cost-efficiency. The role involves managing AWS infrastructure, automating processes, and collaborating with engineering and DevOps teams to resolve complex issues. The position requires strong expertise in Databricks and AWS services, along with proficiency in data engineering and DevOps practices. A bachelor's degree and over five years of relevant experience are essential for this role.

Key Responsibilities:

  • Provide daily support for the Databricks platform running on AWS, ensuring data security and access controls are maintained.
  • Monitor and troubleshoot clusters, workspaces, jobs, and other Databricks resources.
  • Handle incidents, requests, and changes in Databricks environments.
  • Collaborate with engineering and DevOps teams to resolve complex platform issues.
  • Analyse workloads and optimize Databricks clusters for performance and cost-efficiency.
  • Manage and configure AWS services (e.g., S3, EC2, IAM, Lambda) that integrate with Databricks.
  • Develop and maintain automation scripts for platform maintenance and monitoring.
  • Implement CI/CD pipelines for Databricks deployments using tools like Jenkins, Git, or Terraform.

Key Skills:

  • Bachelor’s degree in computer science, Information Technology, or related field.
  • 5+ years of experience supporting Databricks or similar data platforms.
  • Strong expertise in Databricks on AWS: cluster management, job execution, Spark optimization.
  • Hands-on experience with AWS services like EC2, S3, IAM, Lambda, RDS, VPC.
  • Proficiency in Python, Scala, or SQL for data engineering tasks.
  • Solid understanding of Apache Spark, ETL pipelines, and big data processing.
  • Familiarity with DevOps practices, automation tools (Terraform, Ansible), and CI/CD pipelines.
  • Experience with monitoring and logging tools (CloudWatch, Datadog, or similar).
  • Strong problem-solving and troubleshooting skills.
  • Excellent written and verbal communication skills.

Salary (Rate): £56.00

City: Coventry

Country: United Kingdom

Working Arrangements: undetermined

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT

Apply
Similar Jobs
Loading data...