(Mostly Remote)Required Technical Lead with Databricks and AI Experience, Boston, MA (1 day(Tuesday) in a week onsite)
Job Description: Looking for heavy Databricks integrating with AI.
- Databrick and data engineering depth is so important- if they have integrated anything into Databricks, they will do well. If they don’t have SMP, LexisNexis, that is ok, as long as they have something similar
- Databricks/data engineering
- Glean/AI platforms
- third party data licensing/usage rights
- Work with TEAMS senior leaders to map Client's portfolio of third-party subscription services, including cost, contract terms, licensing constraints, and permitted data usage.
- Translate contract requirements into clear, practical rules that technology and AI Teams can build against.
- Set the integration principles
- Create guiding principles for how third-party data is integrated into our evolving architecture with Glean, agents, Databricks, Claude and ChatGPT.
- Define how Client's proprietary internal applications that use third-party data are differentiated from the raw subscription data, including what can be derived, stored, surfaced, and shared.
- Document guidelines and a repeatable integration pattern so future sources are onboarded consistently.
- Shape the case team experience
- Work with TEAMS stakeholders to understand the experience they want to offer case Teams, and convert it into clear requirements.
- Partner closely with the TEAMS innovation team, a key stakeholder, so integration choices support their priorities and pilots.
- Deliver with technology and AI Teams
- Work with technology and AI Teams to integrate sources appropriately, reviewing designs and implementations against the agreed principles.
- Stay hands-on: prototype, review data models and code, and validate that integrations behave as contracts allow.
- Give TEAMS and technology leaders concise updates on progress, risks, trade-offs, and decisions needed.
Qualifications
- 10+ or more years of experience in data architecture, data engineering, or technical product leadership, with significant hands-on delivery
- Hands-on experience with a modern data platform such as Databricks, plus strong SQL and Python skills
- Experience integrating data into enterprise search, AI assistants, or agent-based solutions; familiarity with Glean or comparable platforms is a strong plus
- Working knowledge of data licensing, subscription models, and usage rights, with the ability to turn contract terms into technical guardrails
- Track record of setting architecture principles or standaTeams that multiple Teams adopt
- Experience working with third-party data providers or information services, ideally in a professional services or research environment
- Bachelor's degree or equivalent professional experience in a technical or related field