Data Architect - AWS / Databricks
12-Month Contract | Outside IR35 | Remote (hybrid for the first few weeks)
I'm currently looking for an experienced Data Architect to join a major data platform transformation programme on an initial 12-month contract.
The role will focus on designing and optimising a scalable, secure AWS data platform, with Databricks acting as the central processing and analytics engine.
You'll be responsible for defining the technical architecture, ensuring the platform is high-performing and cost-effective, and helping guide the engineering team in delivering robust data pipelines using Medallion Architecture.
Key Responsibilities
- Design and develop scalable data architecture across AWS and Databricks.
- Define best practices for Databricks architecture, configuration and optimisation.
- Oversee the development of high-performance ETL/ELT pipelines.
- Ensure data is structured and managed effectively across Bronze, Silver and Gold layers.
- Advise on Databricks compute, clusters, storage and governance.
Key Skills & Experience
- Strong experience as a Data Architect or Senior Data Engineer.
- Extensive hands-on experience with Databricks and AWS.
- Strong understanding of Medallion Architecture and Lakehouse environments.
- Solid ETL/ELT and data pipeline architecture experience.
- Experience with Delta Lake, PySpark and Databricks optimisation.
- Strong understanding of data governance, security and access control.
Please note you will be expected to be on site in Leeds 1-2 times a week for first few weeks of the contract.