All Jobs Vacancy

Data Engineer / Data Platform Engineer

Posted 1 day ago by Certain Advantage

Key Responsibilities

  • Help migrate infrastructure and data-platform workloads from legacy infrastructure to modern infrastructure.
  • Help move the data-platform infrastructure and workloads to AWS us-east-2 (USE2), including required connectivity, deployment, and operational prerequisites.
  • Enable secure, governed accessibility of legacy data to target data-platform consumers and downstream systems.
  • Modernize the data-platform architecture, tooling, orchestration, storage, and operational practices to align with company standards.
  • Support Snowflake, Confluent/Kafka, AWS, and data-platform infrastructure migration and operations across stage and production.
  • Participate in production troubleshooting, incident response, documentation, runbook creation, and cross-team migration coordination.
  • Use Terraform/IaC, GitLab, monitoring and documented processes to deliver repeatable and auditable changes.

Essential Skills

  • Senior-level, hands-on experience in production data-platform engineering, with a platform/DevOps-leaning background and strong data experience.
  • Strong Python, bash and SQL skills
  • Production experience with both Snowflake and Confluent/Kafka, with a focus on DevOps and operations. (Deep experience in one and working knowledge of the other is fine, i.e.
  • Deep Snowflake and AWS, with working Kafka knowledge (topics, connectors, schemas), OR
  • Deep Kafka/Confluent and AWS, with working Snowflake knowledge.
  • Experience operating or migrating production systems across development, stage and production environments.
  • Strong troubleshooting, incident-response, testing, documentation and cross-team communication skills.
  • Experience with least-privilege access, change control, secrets handling and secure operational practices.

Nice-to-Have Skills

  • Apache Spark and Hadoop/Hive/HQL, including modernizing or migrating legacy workloads
  • Snowpark, dbt alternatives, AWS Glue, Monte Carlo, or other data-quality and catalog tools
  • Migrating legacy Airflow, Hadoop or Hive workloads to cloud-native or managed platforms
  • Experience working across a company migration or acquisition and aligning systems to a new organization’s standards
  • Familiarity with Snowflake-to-Iceberg or Snowflake-to-data-lake migration patterns.
Rate:
Not specified
Location:
United Kingdom
IR35 Status:
Not specified
Remote Status:
Remote
Industry:
Data & Analytics
Seniority Level:
Senior

Take-Home Pay

Not Available

Visit calculators for additional details

Share job