All Jobs Vacancy

Microsoft Fabric Data Engineer

Posted 1 day ago by Robert Half

Robert Half have partnered with a UK-based workplace design, build and architecture consultancy investing in a new AI and transformation function to develop the data and AI platforms that will power intelligent business workflows.

This is an opportunity for a Microsoft Fabric Data Engineer to join on an initial 6-month contract, playing a key role in developing the organisation's data and AI capabilities, with a focus on Fabric IQ, Retrieval-Augmented Generation (RAG), Context Engineering and semantic data layers. The role will be highly consultative, working closely with business stakeholders to shape technical solutions and deliver scalable, AI-ready data platforms.

Responsibilities

  • Design, develop and optimise enterprise-scale data solutions using Microsoft Fabric, including Lakehouse, Warehouse, OneLake and Medallion Architecture.
  • Build scalable ETL/ELT pipelines using Fabric Data Factory, Dataflows Gen2, PySpark, SQL and notebooks.
  • Explore and implement Microsoft Fabric IQ capabilities to support semantic modelling, business context and AI-driven applications.
  • Design and develop Retrieval-Augmented Generation (RAG) solutions, preparing structured and unstructured enterprise data for LLM-powered applications.
  • Implement data ingestion, chunking, embeddings, vector search and retrieval strategies to support accurate, context-aware AI responses.
  • Develop Context Engineering solutions to enrich enterprise data with business definitions, metadata and relationships, enabling AI agents to access relevant, trusted information.
  • Build and maintain semantic data layers, including Power BI semantic models, to establish consistent business definitions, metrics and relationships.
  • Support the integration of semantic models, knowledge graphs and enterprise data with Generative AI and agentic workflows.
  • Implement data governance, security, quality and performance optimisation across the data platform.
  • Work closely with technical teams and business stakeholders to understand requirements, shape solutions and deliver projects from concept through to production.

Profile

  • Strong hands-on experience with Microsoft Fabric, including Lakehouse, Warehouse, OneLake, Data Factory and Power BI.
  • Advanced SQL, Python/PySpark and data engineering skills, with experience building scalable data pipelines and Medallion Architectures.
  • Ideally experience with Microsoft Fabric IQ, including semantic modelling, ontology-driven approaches and AI-ready business context.
  • Experience or strong understanding of Retrieval-Augmented Generation (RAG), including embeddings, vector databases, document processing and retrieval strategies.
  • Knowledge of Context Engineering, particularly preparing and structuring enterprise data for LLMs and AI agents.
  • Experience designing semantic data layers, business data models and reusable data products.
  • Familiarity with Azure OpenAI, Azure AI Search, Microsoft Foundry or equivalent AI technologies.
  • Understanding of knowledge graphs, GraphRAG, Model Context Protocol (MCP) and agentic AI architectures would be advantageous.
  • Experience with data governance, CI/CD, Git, Azure DevOps and cloud-native data architectures.
  • Strong communication and stakeholder engagement skills, with a consultative approach and the ability to translate business requirements into technical solutions.

Company

  • The organisation is investing in a new AI and transformation function, focused on developing modern data, semantic and agentic platforms to support AI-powered business workflows.
  • 6-month contract
  • Outside IR35
  • Hybrid working - onsite required
Rate:
Not specified
Location:
London
IR35 Status:
Outside
Remote Status:
Hybrid
Industry:
Data & Analytics
Seniority Level:
Not Specified

Take-Home Pay

Not Available

Visit calculators for additional details

Share job