Job Responsibilities
- Lead the design and development of scalable data engineering solutions using Databricks.
- Develop and optimize PySpark, Spark SQL, and Delta Lake pipelines.
- Build and manage ETL/ELT workflows and data lakehouse architecture.
- Work with Azure/AWS, Databricks Workflows, Unity Catalog, and cloud storage.
- Optimize performance, data quality, and cost of Databricks workloads.
- Mentor engineers and provide technical leadership.
- Collaborate with architects, analysts, and business teams.
Required Skills
Databricks, PySpark, Spark SQL, Delta Lake, Python, SQL, ETL/ELT, Data Lakehouse, Azure/AWS, Unity Catalog, CI/CD, Git.
Rate:
Not specified
Location:
Dallas
IR35 Status:
Outside
Remote Status:
Not specified
Industry:
Data & Analytics
Seniority Level:
Not Specified