Job Description
Position: Databricks Architect (Healthcare Domain)
Location: Remote
Required Skills & Experience
- 15+ years of overall experience in Data Engineering, Data Architecture, Data Warehousing, Analytics, or Business Intelligence.
- Strong hands-on experience with AWS cloud services and enterprise-scale Databricks implementations.
- Proven experience serving as a Lead Architect or Principal Architect for enterprise data platform initiatives.
- Advanced expertise in Python, PySpark, Spark SQL, Apache Spark, Delta Lake, and distributed data processing.
- Deep hands-on experience with Databricks Architecture, Unity Catalog, Delta Live Tables (DLT), Databricks Workflows, Databricks Asset Bundles, and cluster optimization.
- Proven experience designing and implementing enterprise-scale data pipelines and metadata-driven frameworks.
- Extensive expertise in ETL/ELT architecture, orchestration, optimization, and data platform operations.
- Strong knowledge of Lakehouse Architecture and Medallion Framework (Bronze, Silver, Gold).
- Experience designing dimensional models, enterprise data warehouses, semantic layers, and analytical solutions.
- Experience with batch processing, streaming, incremental loads, CDC, and real-time data processing frameworks.
- Strong understanding of data quality, governance, lineage, reconciliation, metadata management, and platform observability.
- Hands-on experience with CI/CD pipelines, source control, Infrastructure as Code, and automated deployments.
- Strong experience architecting large-scale healthcare data platforms involving: Claims Data, Clinical Data, EMR/EHR Systems, Patient Data, Provider Data, Member Data.
- Knowledge of healthcare interoperability standards and regulations including: HL7, FHIR, ICD-10, CPT, HIPAA.
- Experience implementing enterprise data governance, MDM, data cataloging, and security frameworks.
- Strong understanding of data security, privacy, encryption, role-based access controls, and PHI protection.
- Experience migrating legacy data warehouses and ETL platforms to AWS and Databricks Lakehouse environments.
- Excellent communication, stakeholder management, presentation, and customer-facing consulting skills.
- Experience leading and mentoring cross-functional Data Engineering teams.
- Ability to own architecture decisions from project initiation through deployment and production support.
- Willingness and ability to work onsite and engage directly with business stakeholders.