Principal Data Engineer

Principal Data Engineer

Posted 1 day ago by BEDE GAMING LIMITED

Negotiable
Undetermined
Hybrid
Newcastle Upon Tyne, England, United Kingdom

Summary: The Principal Data Engineer role at Bede involves leading the design and evolution of a next-generation data platform, focusing on architecture, platform design, and technical strategy. This position requires a blend of technical leadership and hands-on involvement in building scalable data environments while collaborating with cross-functional teams. The ideal candidate will have a strong background in data engineering practices and a passion for solving complex challenges. The role offers flexibility with remote work while encouraging occasional office presence in Newcastle-upon-Tyne.

Key Responsibilities:

  • Lead the design and implementation of scalable, secure, and cost-effective Databricks environments and infrastructure.
  • Define and own the technical roadmap for the data platform, aligning architectural decisions with business objectives.
  • Champion the non-functional qualities of data products, including supportability, maintainability, security, compliance, performance, and reliability.
  • Drive progress towards Service Level Objectives (SLOs) to ensure system robustness and resilience.
  • Partner with Principal Engineers and technical architects to design data solutions aligned with product and business goals.
  • Collaborate with engineers and cross-functional teams to remove blockers and support project delivery.
  • Maintain high-quality, accessible technical documentation across BI and data solutions.
  • Act as a visible, positive, and trusted voice across the business.
  • Contribute to high-level estimations and technical planning.
  • Work with Solution Architects and Business Analysts to design scalable solutions.
  • Collaborate with team leads to finalize solution designs and guide teams through delivery.
  • Provide hands-on support during build phases, including pair-programming and code reviews.
  • Support incident response and partner with Service Delivery to resolve critical issues.
  • Rapidly develop a deep understanding of BI products and share knowledge across the business.
  • Own the publication and maintenance of high-quality technical documentation.
  • Stay ahead of the curve by continuously learning and sharing best practices in data engineering.

Key Skills:

  • Proven experience designing and architecting large-scale data platforms, including Databricks environments.
  • Deep understanding of Databricks internals and best practices for optimization.
  • Strong Python skills for data engineering and understanding of software-development best practices.
  • Familiarity with modern data architecture principles.
  • Experience defining and owning technical roadmaps aligned with business strategy.
  • Excellent communication and collaboration skills.
  • Strong self-management and ability to juggle multiple workstreams.
  • A self-starting mindset with ownership and proactive problem-solving.

Salary (Rate): undetermined

City: Newcastle-upon-Tyne

Country: United Kingdom

Working Arrangements: hybrid

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

Department: Intel

Employment Type: Permanent

Location: Newcastle-upon-Tyne

Reporting To: Head of Data

Description

We’re looking for a Principal Data Engineer to help shape and evolve Bede’s next-generation data platform. This is a technical leadership role focused on architecture, platform design, and technical strategy, ideal for someone who thrives on solving complex challenges and shaping the future of data engineering practices. Reporting to the Head of Data, you’ll be a trusted technical authority responsible for designing robust, scalable data environments, defining technical roadmaps, and setting engineering standards for how our data platform operates. You’ll work at a strategic level but remain close enough to technology to guide teams, prototype solutions, and solve critical technical problems. Important note: This is not a pure data pipeline development role. We’re seeking someone who enjoys working on platform architecture, automation and engineering strategy. This role can be based remotely, though we’re looking for someone who’s still interested in coming into our Newcastle-upon-Tyne office from time to time to stay connected with the team.

What you'll be doing

Core Responsibilities

  • Lead the design and implementation of scalable, secure, and cost-effective Databricks environments and infrastructure, including cluster configuration, workspace governance, and performance tuning.
  • Define and own the technical roadmap for the data platform, aligning architectural decisions with business objectives and future growth.
  • Champion the non-functional qualities of our data products - supportability, maintainability, security, compliance, performance, and reliability.
  • Drive progress towards Service Level Objectives (SLOs), ensuring our systems are robust and resilient.
  • Partner with Principal Engineers and technical architects to shape and design data solutions aligned to product and business goals.
  • Collaborate with engineers and cross-functional teams to remove blockers and support project delivery.
  • Maintain high-quality, accessible technical documentation across BI and data solutions.
  • Act as a visible, positive, and trusted voice across the business - a clear communicator and collaborator.

Design & Scoping

  • Contribute to high-level estimations and technical planning.
  • Ensure solutions align with Bede’s wider technical strategy and roadmap.
  • Work with Solution Architects and Business Analysts to design thoughtful, scalable solutions.
  • Apply architectural practices such as domain modelling to ensure systems are clean, future-proof, and well-encapsulated.

Execution

  • Collaborate with team leads to finalise solution designs and guide teams through delivery.
  • Provide hands-on support during build phases, including pair-programming, prototyping, reviewing code, and ensuring robust test coverage.
  • Support incident response when needed, partnering with Service Delivery to resolve critical issues efficiently.

Knowledge Sharing & Documentation

  • Rapidly develop a deep understanding of our BI products and share knowledge across the business.
  • Own the publication and maintenance of high-quality technical documentation, including data contracts, integration guides, and internal roadmaps.
  • Contribute to onboarding and knowledge transfer for internal and customer-facing teams.
  • Stay ahead of the curve, continuously learning and sharing modern best practices in data engineering, architecture, cloud infrastructure, and tooling.

What we are looking for

  • Proven experience designing and architecting large-scale data platforms, including building and configuring Databricks clusters and environments, not just using Databricks for pipelines.
  • Deep understanding of Databricks internals and best practices for cost, performance, and security optimisation.
  • Strong Python skills for data engineering, but also an understanding of software-development best practices such as unit testing, automated testing, defining and enforcing coding standards, modularity and abstraction.
  • Familiarity with modern data architecture principles (e.g. Lakehouse, data contracts, domain-driven design).
  • Experience defining and owning technical roadmaps and aligning technical decisions with business strategy.
  • Curiosity and engagement with new technologies, with an active professional network in the data engineering or architecture communities.
  • Excellent communication and collaboration skills - you’re approachable, professional, and able to bridge technical and non-technical discussions.
  • Strong self-management, able to juggle multiple workstreams, deliver to deadlines, and stay focused on outcomes.
  • A self-starting mindset - you take ownership, solve problems proactively, and deliver without needing to be micromanaged.

What we can offer you

Here at Bede, we offer a great benefits package and a competitive salary as you would expect from a forward-thinking and people-centric organisation. What sets us apart is our desire to look after our people in the best way we can and to ensure we are offering the best to our colleagues by asking for feedback, so you’ll be pleased to know our benefits package is always being reviewed.

A friendly, flexible and trust-based approach to working

25 days annual leave, plus 8 bank holidays and a typically very generous Christmas break

The use of a mobile phone or tablet of your choice, with the monthly contract covered by us

‘Select Enhanced’ Bupa private healthcare - access from day 1 which covers all pre-existing conditions

Fully matched private pension scheme (up to 8% matched)

Life Assurance which pays out x4 of your salary to a nominated person(s)

Employee Assistance Programme - Beders have access to support and practical advice on a variety of issues that might impact their life (provided by Bupa)

Innovation time - Engineers have regular opportunities to spend time developing skills and innovating.

A great office life! Free snacks and refreshments in the office every day as well as regular food van visits from the best places in Newcastle

Access to Calm - the #1 app for meditation and sleep

Lots of social events - inside and outside of the working day

Referral Programme - help us grow our team with talented individuals and be rewarded with a referral payment of £3,000 (pre-tax)

Bede swag - from Zoodies to t-shirts and even our much loved Bede socks!

Bede Holidays - extra discretionary days off through the year as an extra special thank you