Highly seasoned Databricks data engineer
Hands on DLT/LDP, delta lake, unity catalog, DAB, spark advance performance tuning and building modular engineering frameworks. Foundry experience is secondary and a good addition
with emphasis on the following requirements:
- Solid data engineering fundamentals and proven hands-on Databricks experience, specifically across:
- Performance tuning & optimization (Spark internals, join strategies, skew handling)
- Efficient use of LDP APIs (CDF, CDC)
- Data quality frameworks (expectations, quarantine logic, alerting)
- Compliance & governance (PII/PHI masking, access controls) and finally, orchestrating and stitching these pipelines together