DevOps/Data Platform Engineer - Marketing Data

DevOps/Data Platform Engineer - Marketing Data

Posted 5 days ago by Robson Bale Ltd

Apply
Negotiable
Undetermined
Undetermined
London, UK
Apply
Apache Hive Apache Spark Azure Databricks Azure Data Factory C# (Programming Language) Cloud Computing Cloud Infrastructure Cloud Technology Continuous Integration and Continuous Delivery Databricks DevOps Generic Programming Gitlab Hadoop Distributed File System (HDFS) Infrastructure as Code (IaC) JavaScript (Programming Language) Jenkins Microsoft Azure Platform as a Service (PaaS) Scripting Software Development Stakeholder Management Teamcity Terraform

Summary: The role of DevOps/Data Platform Engineer involves supporting a centralized Master Data repository for client profiles and marketing preferences. The engineer will focus on developing data pipelines, managing cloud infrastructure, and automating processes to ensure efficient data distribution across marketing platforms.

Key Responsibilities:

  • Build and maintain CI/CD pipelines using GitLab, TeamCity, or Jenkins.
  • Implement Infrastructure-as-Code (IaC) using Terraform and Scripting (Shell/PowerShell).
  • Work with Azure services (Data Factory, Databricks, PaaS, DevOps, Vau AKS desirable).
  • Support Cloudera platform components: Hue, Hive, HDFS, Spark.
  • Collaborate with architects to design and enhance end-to-end solutions.
  • Manage master data and ensure data flows accurately to downstream systems.
  • Communicate effectively with teams and stakeholders across different seniority levels.

Key Skills:

  • Strong Terraform, Shell/Powershell scripting, and IaC experience.
  • Experience with Azure Data Factory, Azure Databricks, and cloud PaaS.
  • Experience with Cloudera/Hue/Hive/HDFS/Spark highly desirable.
  • Knowledge of major programming languages (Java, C#, JavaScript) is a plus.
  • Strong problem-solving and structured approach to tackling challenges.
  • Excellent communication and teamwork skills, with experience handling internal clients.

Salary (Rate): undetermined

City: London

Country: UK

Working Arrangements: undetermined

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

We are looking for a DevOps/Data Platform Engineer to support a centralized Master Data repository for client profiles and marketing preferences. You will work on data pipelines, cloud infrastructure, and automation to manage and distribute data to multiple marketing platforms.

Key Responsibilities:

  • Build and maintain CI/CD pipelines using GitLab, TeamCity, or Jenkins.

  • Implement Infrastructure-as-Code (IaC) using Terraform and Scripting (Shell/PowerShell).

  • Work with Azure services (Data Factory, Databricks, PaaS, DevOps, Vau AKS desirable).

  • Support Cloudera platform components: Hue, Hive, HDFS, Spark.

  • Collaborate with architects to design and enhance end-to-end solutions.

  • Manage master data and ensure data flows accurately to downstream systems.

  • Communicate effectively with teams and stakeholders across different seniority levels.

Skills & Experience:

  • Strong Terraform, Shell/Powershell scripting, and IaC experience.

  • Experience with Azure Data Factory, Azure Databricks, and cloud PaaS.

  • Experience with Cloudera/Hue/Hive/HDFS/Spark highly desirable.

  • Knowledge of major programming languages (Java, C#, JavaScript) is a plus.

  • Strong problem-solving and structured approach to tackling challenges.

  • Excellent communication and teamwork skills, with experience handling internal clients.

Apply
Similar Jobs
Loading data...