Job Description
Engagement Overview
Our client is undertaking a strategic modernization initiative to migrate their enterprise data quality, MDM, and data integration workloads from SAS DataFlux dfPower Studio Data Management Studio and the DataFlux Data Management Server to the Databricks Lakehouse Platform We are seeking a Senior Onshore DataFlux Solution Architect to lead the architectural strategy target state design and migration blueprint for this multi-phase program
Key Responsibilities
- Lead end to end solution architecture for the DataFlux to Databricks migration including current state assessment gap analysis target state design and migration roadmap
- Partner with the client 39s enterprise architecture data governance and security teams to align on Unity Catalog design lineage RBAC and PII handling
- Provide technical leadership and mentorship to a blended onshore offshore engineering team conduct design reviews and enforce engineering standards
DataFlux Expertise Non Negotiable
10 years of enterprise data architecture experience with a minimum of 5 years of hands on experience designing and deploying solutions on SAS DataFlux dfPower Studio and/or Data Management Studio).
Master Data Management MDM
Strong architectural experience across MDM domains Customer/Party Product Location Vendor Employee and Reference Data
Databricks amp Modern Data Stack
Production experience architecting solutions on Databricks including Delta Lake Unity Catalog Delta Live Tables Workflows and the medallion architecture pattern
Strong PySpark and Spark SQL skills able to design performant patterns for large scale matching deduplication and DQ workloads
Working knowledge of cloud platforms Azure AWS or Google Cloud Platform and modern ingestion tools Fivetran ADF, Airflow dbt
Data Domains amp Governance
Broad fluency across data quality data governance data modeling 3NF dimensional Data Vault and metadata management
Preferred Qualifications
- Prior experience leading at least one DataFlux modernization or sunset program
- Databricks certifications Data Engineer Professional Solutions Architect Professional
- Experience in healthcare payer financial services or insurance verticals
Engagement Details: Location Onshore US based hybrid with periodic client site travel