Data Engineer

AWS & DATABRICKS DATA ARCHITECT

ABOUT DIGIMASTERS

Digimasters Ltd was founded in 2017 as a digital transformation consultancy focused on technology, business process optimisation and data analytics. Digimasters works across all industries and provides experience in organisations of all sizes. Primarily based in London, UK, we work in many regions including the US, EU, APAC and the Middle East. Digimasters takes on additional talent during large programmes of work. For our engagements with clients in Architecture, Engineering, and Construction (AEC), as well as other sectors, we have several roles supporting the delivery of technology, business change, and data programmes.

ROLE

The AWS & Databricks Data Architect is responsible for leading the design and deployment of modern data platforms leveraging AWS cloud products and the Databricks Lakehouse Platform. Experience with advanced cloud and data engineering technologies, plus a keen attention to robust and scalable architecture, are essential for this role. The AWS & Databricks Data Architect will work directly with consultants and client teams, reporting to the Managing Director and taking technical direction from the client’s Data + A.I. Lead Consultant.

RESPONSIBILITIES

• Develops and implements cloud and data strategies that align with Digimasters business goals, leveraging AWS’s full stack of data and analytics services together with the Databricks Lakehouse Platform.
• Designs scalable, secure, and resilient cloud-based data solutions to enable analytics, A.I./machine learning, and business intelligence.
• Designs and implements a comprehensive data platform using Databricks on AWS, including Delta Lake, data warehouses, and data lakehouse methodologies.
• Champions best practices in data modelling, governance, and integration, focusing on transformation layers and data quality (bronze, silver, gold tiers or equivalent).
• Collaborates effectively with cross-functional teams, including data engineers, analysts, data scientists, and governance specialists, to deliver first-class data solutions.
• Optimises data architecture for scalability, security, performance, and cost-effectiveness within a hybrid or cloud-first environment.
• Provides expert advice and guidance on maximising AWS and Databricks capabilities for data management and analytics.
• Mentors data engineers and architects within the wider team and contributes to community of practice development.
• Works with Digimasters’ Data + A.I. Lead Consultant to establish best practices for cloud governance, security, and regulatory compliance (e.g., GDPR, CCPA).
• Ensures data solutions meet robust standards for performance, scalability, and maintainability.

EXPECTATIONS IN THE ROLE

The following skills and proficiency levels are essential for this position:

• Extensive Experience with AWS: 7–10 years of hands-on experience in cloud and data architecture, with a strong focus on AWS cloud services and data ecosystem.
• Expertise in Databricks: Deep working knowledge of the Databricks Lakehouse Platform on AWS, including Delta Lake, data pipelines, and notebook-driven development.
• Lakehouse/Data Architecture Proficiency: Track record in designing and building lakehouse data architectures (bronze, silver, gold layers) to ensure accuracy, accessibility, and performance.
• Collaborative Teamwork: Strong ability to work effectively within multidisciplinary teams including data engineers, data scientists, business analysts, and governance professionals.
• Data Architecture Optimisation: Experience optimising data architectures in cloud/hybrid environments for cost, scalability, and security.
• Innovative Problem-Solving: A proactive and creative mindset to tackle complex data challenges and deliver best-in-class solutions.

QUALIFICATIONS

• Bachelor’s degree in Computer Science, Data Science, Engineering, or a related field.
• Minimum of 7 years’ proven experience in cloud and data architecture, with significant specialisation in AWS and Databricks-based solutions.
• Relevant certifications (e.g., AWS Certified Solutions Architect, AWS Data Analytics Specialty, Databricks Data Engineer Associate) are highly desirable.
• Deep knowledge of AWS data and analytics services, including S3, Glue, Redshift, Lambda, Athena, and Step Functions.
• Strong experience with Databricks, Delta Lake, and modern data pipeline/ELT development.
• Solid understanding of data modelling, pipeline orchestration, and integration best practices.
• Experience with A.I., machine learning frameworks, and data-driven decision-making.
• Ability to work collaboratively and influence in dynamic, multidisciplinary teams.
• A hands-on, pragmatic approach with a passion for solving real-world business data challenges.

This is a Hybrid role and does require candidates to work in central London as well as remotely. We do not sponsor visas so you must be eligible to already work in the UK.