Data Architect with Azure Data Factory (ADF), Azure Databricks and SAP HANA/BW

Job Summary

We are seeking a highly experienced Data Architect with expertise in Azure Data Factory (ADF), Azure Databricks, and SAP to lead enterprise-scale cloud data migration and modernization initiatives. The ideal candidate should have strong experience designing Azure data platforms, migrating enterprise workloads across environments (Dev, QA, Prod), integrating SAP data sources, and leading data engineering teams.

Required Skills

• 15+ years of experience in Data Engineering/Data Architecture.
• Strong hands-on experience with Azure Data Factory (ADF).
• Extensive experience with Azure Databricks architecture and development.
• Mandatory experience with SAP HANA and/or SAP BW as enterprise source systems.
• Strong knowledge of Azure Data Lake Storage Gen2 (ADLS Gen2).
• Experience designing enterprise data lakes and modern Azure data platforms.
• Expertise in ETL/ELT pipeline development and orchestration.
• Strong SQL, Python, and Spark/PySpark skills.
• Experience with Azure Synapse Analytics, Azure SQL, and Azure DevOps.
• Excellent leadership and stakeholder management skills.

Key Responsibilities

• Design and implement enterprise-scale Azure data architecture using Azure Data Factory, Azure Databricks, and Azure Data Lake Storage Gen2.
• Create, develop, and migrate enterprise data pipelines across Development, QA, and Production environments.
• Design and implement Databricks Medallion Architecture (Bronze, Silver, Gold) for scalable and governed data processing.
• Develop migration strategies and deployment frameworks for seamless promotion across Dev, QA, and Production environments.
• Configure and develop ADF pipelines to ingest data from SAP HANA, SAP BW, and other enterprise source systems.
• Create reusable pipeline configurations and metadata-driven ETL frameworks.
• Build scalable ingestion pipelines to move SAP data into Azure Data Lake Storage Gen2.
• Perform data transformation, cleansing, validation, enrichment, and optimization using Azure Databricks.
• Design enterprise data models and optimize data storage for analytics and reporting.
• Collaborate with SAP functional and technical teams to ensure reliable data extraction and integration.
• Lead a team of Data Engineers, provide technical guidance, perform architecture reviews, and ensure best practices.
• Implement monitoring, performance tuning, security, governance, and CI/CD deployment for Azure data platforms.

Mandatory Skills

• Azure Data Factory (ADF)
• Azure Databricks
• Databricks Medallion Architecture (Bronze, Silver, Gold)
• SAP HANA
• SAP BW
• Azure Data Lake Storage Gen2 (ADLS Gen2)
• Azure Synapse Analytics
• SQL
• Python / PySpark
• ETL / ELT
• Data Migration
• Data Architecture
• Azure DevOps
• Team Leadership

Preferred Skills

• SAP Datasphere
• SAP Data Intelligence
• Power BI
• Microsoft Azure Certifications
• Agile/Scrum

Must-Have Experience

• Designing Azure-based enterprise data platforms.
• Developing ADF pipelines to connect and ingest data from SAP HANA/BW.
• Implementing Databricks Medallion Architecture.
• Managing migrations across Dev, QA, and Production environments.
• Building enterprise data lakes using Azure Data Lake Storage Gen2.
• Transforming and preparing SAP data for downstream analytics and reporting.
• Leading enterprise data engineering teams and architecture initiatives.