Role: Databricks Data/ETL Architect
Location: Remote
Duration: Long term
Requires Skills/ Qualifications:
We are seeking a Databricks Data/ETL Architect to design, develop, and maintain scalable data pipelines and ETL processes that support analytics and business intelligence initiatives.
The ideal candidate will have strong experience with Databricks, Apache Spark, and modern data engineering practices in cloud environments.
Experience developing streaming pipelines using Databricks Autoloader or Structured Streaming
Responsibilities include developing data ingestion, transformation, and integration solutions, optimizing ETL workflows, ensuring data quality, and collaborating with cross-functional teams to deliver reliable data platforms.
Data Modeling experience designing Delta Lake tables and the Bronze-Silver-Gold Medallion Architecture
Candidates should be proficient in Python, SQL, and distributed data processing frameworks.
Experience with cloud service provider (Azure) services used in Databricks' implementations
Experience with Azure Data Services (Azure Data Factory, Azure Data Lake, Synapse, etc.), GitHub for version control, and CI/CD pipeline implementation is highly desirable.
Knowledge of data modeling, performance tuning, and Agile development methodologies is a plus.