Data Engineer - Python, SQL, Airflow, dbt - Banking

Data Engineer - Python, SQL, Airflow, dbt - Banking

Posted 1 week ago by Rothstein Recruitment

Negotiable
Undetermined
Undetermined
London Area, United Kingdom

Summary: The Data Engineer role at an established bank involves designing, building, and maintaining a scalable on-premise data warehouse and data engineering platform. The position requires hands-on experience with Python, SQL, Apache Airflow, and dbt, focusing on building robust data pipelines and supporting analytics and reporting. The ideal candidate should be comfortable working in a Unix/Linux environment and have experience with Microsoft BI tools. This role is suited for someone who thrives in a production-focused environment and values documentation and governance.

Key Responsibilities:

  • Designing and building ETL/ELT pipelines using Python and SQL
  • Developing and orchestrating workflows using Apache Airflow
  • Building and maintaining dbt models, macros, tests and documentation
  • Working in a Unix/Linux environment for scheduling, scripting and deployment
  • Supporting CI/CD pipelines and version control processes
  • Translating business requirements into clear technical specifications
  • Administering and supporting data analytics platforms
  • Building and maintaining solutions across SSIS, SSRS, SSAS and T-SQL
  • Supporting dashboards, reporting and visualisation requirements
  • Performing testing, troubleshooting and issue resolution
  • Producing clear technical documentation
  • Working closely with stakeholders across technology, data, analytics and business teams
  • Operating in line with the bank’s risk, compliance and change-control frameworks

Key Skills:

  • Strong Python programming for data pipelines, APIs and scripting
  • Advanced SQL, ideally T-SQL or PL/SQL
  • Apache Airflow, including DAG configuration, maintenance and optimisation
  • dbt, including models, macros, tests and documentation
  • ETL/ELT design and data warehousing
  • Unix/Linux environments
  • On-premise or infrastructure-aware data platforms
  • CI/CD, version control and test automation
  • Docker or containerisation
  • Microsoft BI stack: SSIS, SSRS, SSAS and T-SQL
  • Power BI, Tableau, Qlik or similar reporting/visualisation tools
  • Banking or financial services experience, particularly in regulated environments

Salary (Rate): undetermined

City: London Area

Country: United Kingdom

Working Arrangements: undetermined

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

Data Engineer - Python, SQL, Airflow, dbt - Banking

An established bank is looking for a hands-on Data Engineer to help design, build and maintain a scalable on-premise data warehouse and modern data engineering platform. This is a strong opportunity for someone who enjoys building robust data pipelines, working close to the infrastructure, and supporting business-critical analytics and reporting. The environment is non-cloud / on-prem , so this will suit someone comfortable working with Unix/Linux, scheduling, scripting, deployment and production support. You will work with Python, SQL, Apache Airflow and dbt , while also supporting a wider Microsoft BI environment including SSIS, SSRS, SSAS and T-SQL . You will be responsible for designing and building reliable data pipelines, developing transformation logic, maintaining data models, and supporting the bank’s analytics and reporting platforms.

Key responsibilities include:

  • Designing and building ETL/ELT pipelines using Python and SQL
  • Developing and orchestrating workflows using Apache Airflow
  • Building and maintaining dbt models, macros, tests and documentation
  • Working in a Unix/Linux environment for scheduling, scripting and deployment
  • Supporting CI/CD pipelines and version control processes
  • Translating business requirements into clear technical specifications
  • Administering and supporting data analytics platforms
  • Building and maintaining solutions across SSIS, SSRS, SSAS and T-SQL
  • Supporting dashboards, reporting and visualisation requirements
  • Performing testing, troubleshooting and issue resolution
  • Producing clear technical documentation
  • Working closely with stakeholders across technology, data, analytics and business teams
  • Operating in line with the bank’s risk, compliance and change-control frameworks

The ideal candidate

You do not need to tick every box, but you should have strong hands-on data engineering experience and be comfortable working in a controlled, production-focused environment. We are particularly interested in people with experience across:

  • Strong Python programming for data pipelines, APIs and scripting
  • Advanced SQL, ideally T-SQL or PL/SQL
  • Apache Airflow, including DAG configuration, maintenance and optimisation
  • dbt, including models, macros, tests and documentation
  • ETL/ELT design and data warehousing
  • Unix/Linux environments
  • On-premise or infrastructure-aware data platforms
  • CI/CD, version control and test automation
  • Docker or containerisation
  • Microsoft BI stack: SSIS, SSRS, SSAS and T-SQL
  • Power BI, Tableau, Qlik or similar reporting/visualisation tools
  • Banking or financial services experience would be useful, particularly if you have worked in a regulated environment with strong governance, auditability, data quality and change-control requirements. However, strong hands-on data engineering experience is the priority.

Good fit for someone who is

  • A practical, hands-on Data Engineer
  • Comfortable owning production data pipelines
  • Strong technically, but able to work with business stakeholders
  • Used to controlled environments where documentation, testing and governance matter
  • Comfortable with both modern data engineering tooling and established BI platforms
  • Interested in building reliable, scalable data solutions rather than just dashboards

Data Engineer, BI Data Engineer, Data Warehouse Engineer, Python, SQL, T-SQL, PL/SQL, Apache Airflow, Airflow DAGs, dbt, ETL, ELT, data warehouse, data pipelines, Unix, Linux, Docker, CI/CD, SSIS, SSRS, SSAS, Microsoft BI, Power BI, Tableau, Qlik, banking, financial services, regulated environment.