The Opportunity
We're looking for a hands-on Senior Data Engineer/Power BI Developer to join a high-performing data and analytics team, delivering enterprise-grade solutions across trading, risk, finance and post-trade reporting.
Key Responsibilities
- Design, develop and optimise ETL/ELT pipelines using Azure Databricks, PySpark, Python and SQL.
- Build curated Delta Lake and Lakehouse data products using medallion architecture principles.
- Create Microsoft Fabric Lakehouses, notebooks, Dataflow Gen2 ingestion flows and Direct Lake reporting models.
- Develop enterprise Power BI datasets, semantic models and dashboards using advanced DAX, Power Query M and star schema modelling.
- Implement row-level security, access controls, validation checks and governance for production reporting.
- Optimise SQL, Spark, Fabric and Power BI workloads for performance, scalability and cost efficiency.
- Work closely with trading, risk, finance and business stakeholders to understand requirements and deliver production-ready solutions.
- Support release management, CI/CD, documentation and operational monitoring using Git and Azure DevOps.
- Troubleshoot data and reporting issues and provide ongoing production support.
Essential Skills & Experience
- Strong hands-on Azure Databricks experience, including Delta Lake, Unity Catalog, notebooks, workflows, cluster tuning and production-grade PySpark.
- Strong Microsoft Fabric experience, including Lakehouse, OneLake, shortcuts, Dataflow Gen2, Fabric notebooks, Direct Lake and SQL Analytics Endpoint.
- Advanced Power BI skills including DAX, semantic modelling, Power Query M, RLS, incremental refresh, aggregation strategies and performance tuning.
- Advanced SQL skills including CTEs, window functions, stored procedures, query optimisation and large-volume analytical processing.
- Experience across the Azure Data Platform, including ADLS Gen2 and Azure Data Factory.
- Experience with Git, Azure DevOps and CI/CD pipelines.
- Proven ability to deliver data solutions end-to-end, from ingestion and transformation through to reporting.
- Strong stakeholder communication, documentation and production support experience.
- Experience working in an enterprise environment with a focus on security, governance, reliability and performance.
Desirable Experience
- Energy trading, commodities, risk, product control, finance or settlement reporting.
- Operational monitoring, reconciliation, audit or management reporting.
- Experience with dbt, Great Expectations, Microsoft Purview, Tabular Editor, DAX Studio or Fabric Data Warehouse.
- Relevant certifications such as Databricks Certified Data Engineer, Microsoft DP-600, PL-300 or DP-203.
What Makes This Role Attractive
You'll be joining a team working on enterprise-scale data and analytics solutions, using some of the latest Microsoft cloud data technologies.
The role offers the opportunity to work across both data engineering and business intelligence, with real ownership of production data products and close exposure to senior business stakeholders.
If you're a senior data professional who can combine strong engineering capability with advanced Power BI development and stakeholder engagement, this could be an excellent opportunity.