Job Description
We are seeking a Senior Databricks Data Engineer with recent, hands-on experience designing and building large-scale data platforms using Databricks, Spark, PySpark, and cloud technologies. The ideal candidate will have deep core data engineering experience combined with strong knowledge of Databricks security, governance, Unity Catalog, and fine-grained data access controls.
Required Skills
- 10+ years of Data Engineering experience with strong recent hands-on development.
- 7+ years of hands-on Databricks experience, preferably in large-scale enterprise environments.
- Expert-level Apache Spark/PySpark experience.
- Strong Python and SQL development skills.
- Deep experience with Delta Lake, Databricks Workflows, and Databricks data pipelines.
- Strong hands-on experience with Unity Catalog.
- Demonstrated experience implementing row-level filtering, column masking, RBAC, permissions, and fine-grained data security in Databricks.
- Experience working with large-scale data volumes and complex enterprise data environments.
- Strong experience with AWS or Azure, including S3/ADLS and cloud security.
- Experience with data governance, lineage, data quality, and enterprise security standards.
- Experience with CI/CD, Git, Terraform, or other DevOps/IaC technologies is preferred.
- Strong troubleshooting and problem-solving skills.
Rate:
Not specified
Location:
Remote
IR35 Status:
Not specified
Remote Status:
Remote
Industry:
Data & Analytics
Seniority Level:
Senior