Data Engineer

Data Engineer

Posted 2 days ago by IO Associates

£500 Per day
Undetermined
Remote
England, UK

Summary: The role of Data Engineer involves delivering a high-impact data engineering programme with expertise in Databricks, AWS, Azure, and stakeholder communication. This is a fully remote, 6-month contract position suited for individuals who excel in fast-paced, multi-cloud environments. The ideal candidate will be responsible for designing and building data pipelines, developing scalable ETL/ELT frameworks, and collaborating with senior stakeholders. Strong hands-on experience with Databricks and cloud services is essential for success in this role.

Key Responsibilities:

  • Design & build pipelines using Databricks, Python, SQL, and cloud-native services across AWS and Azure
  • Develop scalable ETL/ELT frameworks and optimise performance across distributed compute
  • Implement Lakehouse best practice including Delta Lake, medallion architecture, and governance patterns
  • Collaborate with senior stakeholders to translate business requirements into technical delivery
  • Ensure platform reliability through monitoring, optimisation, and CI/CD deployment standards

Key Skills:

  • Databricks engineering - strong hands-on experience
  • Azure data stack - Data Lake, ADF, Functions, DevOps
  • AWS data services - Glue, Lambda, S3, EMR (or equivalent)
  • Python & SQL - production-grade coding
  • CI/CD - Git-based workflows, automated deployments
  • Stakeholder communication - able to operate autonomously and influence senior teams

Salary (Rate): £500 daily

City: undetermined

Country: UK

Working Arrangements: remote

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

I am looking for a Data Engineer with strong Databricks, AWS, Azure, and stakeholder communication skills to deliver a high-impact data engineering programme. This is a 6-month contract, fully remote, and suited to someone who thrives in fast-paced, multi-cloud environments.

Key Responsibilities

  • Design & build pipelines using Databricks, Python, SQL, and cloud-native services across AWS and Azure

  • Develop scalable ETL/ELT frameworks and optimise performance across distributed compute

  • Implement Lakehouse best practice including Delta Lake, medallion architecture, and governance patterns

  • Collaborate with senior stakeholders to translate business requirements into technical delivery

  • Ensure platform reliability through monitoring, optimisation, and CI/CD deployment standards


?? Essential Skills & Experience

  • Databricks engineering - strong hands-on experience

  • Azure data stack - Data Lake, ADF, Functions, DevOps

  • AWS data services - Glue, Lambda, S3, EMR (or equivalent)

  • Python & SQL - production-grade coding

  • CI/CD - Git-based workflows, automated deployments

  • Stakeholder communication - able to operate autonomously and influence senior teams

The ideal candidate is someone who is confident navigating multi-cloud environments, can own delivery end-to-end, and communicates clearly with both technical and non-technical stakeholders. You want someone who can drop in, stabilise, optimise, and accelerate delivery from day one. Please apply ASAP as I have slots this week!