Job description
We need a senior Data Architect with deep experience in healthcare clinical data and strong Databricks skills. This person will work directly with the client and lead the design of a clinical data platform for predictive analytics. They/ll also coordinate the work of the offshore team.
Key responsibilities
- Act as the main technical contact for client stakeholders. Lead discovery workshops, gather requirements and present architecture decisions.
- Understand the client's clinical data landscape and turn business and clinical needs into data models that support predictive analytics.
- Design and own the end-to-end data architecture on Databricks, including the Lakehouse, Delta Lake, the medallion (Bronze/Silver/Gold) layers and Unity Catalog.
- Structure clinical data (EHR/EMR, encounters, diagnoses, procedures, labs, medications) so it's ready for predictive use cases such as readmission risk, risk stratification and care gaps.
- Work with data science teams to define feature engineering, feature stores and MLflow-based model pipelines.
- Lead and coordinate the offshore team. Assign work, review designs and code, and keep delivery on track across time zones.
- Set and enforce data governance, data quality, lineage and HIPAA/PHI security standards.
- Give the client regular status updates, raise risks and dependencies early, and support governance reviews.
- Take part in solutioning, estimates and roadmap discussions to help grow the engagement.
Required skills & experience
- 12+ years in data engineering or architecture, including at least 5 years in healthcare clinical data.
- Strong knowledge of clinical data standards: HL7, FHIR, CCD, ICD-10, CPT, LOINC, SNOMED and RxNorm.
- Hands-on Databricks expertise: Spark/PySpark, SQL, Delta Lake, Unity Catalog. workflows and MLflow.
- Experience building data foundations for predictive analytics and machine learning in a healthcare setting.
- Good working knowledge of a cloud platform (Azure or AWS) and HIPAA compliance requirements.
- Excellent communication and stakeholder management skills, with proven experience leading onshore-offshore delivery models.