AI developer for building agents on Databricks data
Posted 2 days ago by GHK Technologies Inc.
Negotiable
Undetermined
Remote
Remote
Summary: The role is for an experienced AI Developer tasked with building agents on Databricks data using Dash Application or a custom UI. This position is part of a significant enterprise data warehouse modernization initiative, transitioning from a legacy SQL-based system to Databricks. The developer will be involved in re-engineering ETL pipelines and data models rather than performing a simple migration. The position is remote, with the exception of local candidates who may need to work one day onsite in San Francisco, CA.
Key Responsibilities:
- Build AI agents on Databricks data using Dash Application or a custom UI.
- Participate in the modernization of the enterprise data warehouse from a SQL-based system to Databricks.
- Re-engineer ETL pipelines and data models.
- Collaborate with cross-functional teams to ensure successful implementation of data solutions.
Key Skills:
- 8–10 years of software development and deployment experience.
- Hands-on experience in building AI agents, SQL, and Databricks.
- Proficiency in Databricks, Azure Data Factory (ADF), and DataStage.
- Advanced SQL and Python programming skills.
- Knowledge of BI tools such as SSAS cubes, Cognos, Tableau, and Thoughtspot.
- Expertise in building AI agents on Databricks data.
Salary (Rate): undetermined
City: undetermined
Country: USA
Working Arrangements: remote
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
W2 Contract (long term duration)
Location: Remote from anywhere in USA/Canada (except for local candidates who work one day onsite in San Francisco, CA near BART)
Looking for an experienced AI Developer for building agents on Databricks data using Dash Application or a custom UI. Client is spearheading a large-scale enterprise data warehouse (EDW) modernization initiative of migration from a 20-year-old SQL-based EDW to Databricks. Plan is for Full re-engineering of ETL pipelines and data models rather than a simple "lift-and-shift" migration.
Requirements & Qualifications
Experience: 8–10 years in software development and deployment, with of hands-on experience in building AI agents, SQL and Databricks.
Technical Stack:
Platforms: Databricks, Azure Data Factory (ADF), DataStage.
Languages: Advanced SQL and Python.
BI & Tools: Knowledge of SSAS cubes, Cognos, Tableau, and Thoughtspot.
Skills: Expertise in building AI agents on Databricks data using Dash Application or a custom UI.