Job Description
Experience: 12+ Years
Strong python, lang chain, (google adk, claude sdk or similar), AgentCore, bedrock experience a must
Node, FastAPI, React, Next.js, RESTful Apis, Swagger, GraphQL is a must
Design and build the conversational orchestration layer: LLM prompting, tool/function calling, agentic workflows, memory, and multimodal handling (voice, image, audio, video, text).
Agent/Skill/Prompt/MCP registries integration experience
Prompt caching, semantic caching, prompt compression, usage optimization techniques are a must
Integrate and benchmark foundation models across providers, balancing quality, latency, and cost, with fallback and routing logic.
Run and evaluate local models
Implement guardrails for safety, hallucination control, prompt-injection defense, and brand-appropriate responses, including streaming responses optimized for browser and mobile.
Deliver production-grade APIs and SDKs consumed by web and mobile clients, with strong observability and graceful degradation.
Run experiments (prompt variants, fine-tuning, distillation, evals) and translate findings into measurable product improvements.