Position Summary
We are seeking an AI/ML Platform Program Manager to support a large enterprise AI team. This role will help define AI use cases, create evaluation artifacts, coordinate agentic AI platform evaluations, and drive adoption across business teams.
Key Responsibilities
- Work with business teams to convert workflows into practical AI use cases.
- Create system prompts, agent definitions, runbooks, test scenarios, evaluation rubrics, and synthetic datasets.
- Support evaluation and comparison of enterprise agentic AI platforms.
- Coordinate vendors, testing progress, dependencies, and blockers.
- Translate AI platform capabilities for business and technical stakeholders.
- Drive AI adoption, onboarding, documentation, and change-management activities.
Required Qualifications
- 8+ years of overall experience, including strong experience in technical program management, solutions engineering, AI enablement, or related roles.
- Strong knowledge of Generative AI, LLMs, Agentic AI, Prompt Engineering, RAG, MCP, and tool/function calling.
- Experience with LLM evaluations, golden datasets, synthetic data, test cases, rubrics, or LLM-as-a-Judge.
- Working knowledge of Python, JSON, YAML, Markdown, and spreadsheets.
- Strong stakeholder management and cross-functional coordination skills.
- Experience with Jira, Confluence, Azure DevOps, or similar tools.
- Must be authorized to work in the United States.
Preferred Qualifications
Experience with ChatGPT Enterprise, Claude Enterprise, Microsoft Copilot, Azure OpenAI, AWS Bedrock, LangChain/LangGraph, Semantic Kernel, LangSmith, promptfoo, or NIST AI RMF is a plus.
Rate:
Not specified
Location:
United States
IR35 Status:
Outside
Remote Status:
Remote
Industry:
AI & Machine Learning
Seniority Level:
Senior