Job Summary
We are seeking an experienced Microsoft Fabric Data Engineer to help migrate an existing SQL-based data platform to Microsoft Fabric. The role will focus on building scalable data pipelines, implementing a Medallion Architecture, and developing analytics-ready data solutions using Fabric, OneLake, Spark, and Fabric Warehouse.
Key Responsibilities
- Migrate data from Azure SQL, SQL Server, and legacy ETL platforms to Microsoft Fabric.
- Develop and manage data pipelines using Fabric Data Factory.
- Build Bronze, Silver, and Gold layers using Lakehouse and OneLake.
- Develop data transformations using PySpark and SQL.
- Design and optimize Fabric Data Warehouse solutions.
- Implement incremental loads, CDC, partitioning, and performance optimization.
- Ensure data quality, reliability, and consistency across pipelines.
- Support RBAC, workspace security, data governance, lineage, and Microsoft Purview.
- Implement CI/CD for Fabric artifacts using Git and Azure DevOps.
- Collaborate with BI teams, architects, administrators, and business stakeholders.
- Provide production support and troubleshoot data pipeline issues.
Required Skills
- 5+ years of experience in Azure Data Engineering.
- Strong hands-on experience with Microsoft Fabric.
- Expertise in Fabric Data Factory, OneLake, Lakehouse, Spark/PySpark, and Fabric Warehouse.
- Strong SQL and relational database experience.
- Experience with ETL/ELT, data migration, and modern data architecture.
- Understanding of Medallion Architecture and cloud data platforms.
- Experience with Git/Azure DevOps and CI/CD.
Preferred Skills
- Power BI and data modeling.
- Microsoft Purview and data governance.
- CDC or streaming technologies.
- Microsoft Fabric / Azure Data Engineer certification.