Generative AI Engineer

Generative AI Engineer

Posted 1 week ago by 1751470997

Negotiable
Outside
Hybrid
USA

Summary: The role of Generative AI Engineer involves supporting enterprise-wide AI initiatives by developing robust GenAI workflows and automating processes across various platforms. The ideal candidate will have extensive software engineering experience, particularly in Generative AI and cloud technologies, and will work closely with an AI Center of Excellence. This position requires a blend of architectural knowledge and hands-on implementation skills. The role is designed for a self-driven individual who can navigate complex AI solutions and collaborate effectively within a team.

Key Responsibilities:

  • Design and develop GenAI solutions using prompt engineering, Retrieval-Augmented Generation (RAG), and custom pipelines
  • Design and develop interoperable AI agents using Model Context Protocol (MCP) and Google A2A
  • Automate workflows involving parsing unstructured content such as emails, documents, and web pages into highly accurate and reliable structured content
  • Automate building documents using data and content from various diverse sources
  • Build enterprise-wide reusable services and components
  • Design and build MCP hosts, clients, and servers
  • Establish frameworks for automated LLM testing
  • Create regression test suites to detect drift or prompt breakage
  • Integrate with internal and external web services using secure authentication and authorization mechanisms
  • Adopt and ensure safe practices to protect against prompt injections, jailbreaks, and conform to enterprise security guidelines
  • Experience with agile methodologies and ability to independently document user stories in the absence of Business Analyst
  • Collaborate with the AI CoE team to ensure scalability, reusability, and alignment with governance standards

Key Skills:

  • Very strong Python skills
  • Strong hands-on experience with LLM APIs (OpenAI, Azure OpenAI, Gemini, Anthropic, etc.) using Python and Python-based frameworks
  • Strong hands-on experience in prompt engineering, context construction, grounding strategies
  • Strong hands-on experience with Retrieval Augmented Generation (RAG) extracting, chunking, and creating embeddings from unstructured documents from diverse sources including O365 (email, word, excel), PDFs, and webpages
  • Comfortable building Model Context Protocol (MCP) clients, servers, and hosts
  • Strong expertise in building REST APIs and integrating with internal/external APIs
  • Hands-on experience with Intelligent Document Processing and/or OCR technologies on complex documents
  • Knowledge of Google A2A
  • Deep experience in AWS (Lambda, Bedrock, Step Functions, API Gateway, IAM)
  • Strong experience with monitoring using LangSmith, CloudWatch, or other similar GenAI observability tools
  • Excellent GenAI foundations and concepts
  • Clear understanding of enterprise data privacy, AI governance, and observability

Salary (Rate): undetermined

City: undetermined

Country: USA

Working Arrangements: hybrid

IR35 Status: outside IR35

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

We?re seeking an experienced strong Generative AI Engineer to support enterprise-wide AI enablement initiatives. This role will focus on building robust GenAI and agentic AI workflows, automating workflows and working across diverse platforms like AWS, Microsoft 365, MS Copilot, and other 3rd party GenAI platforms and libraries.

The ideal candidate is highly self-driven and comfortable operating across architecture, and hands-on implementation. This is a high-impact role supporting an AI Center of Excellence (CoE) at scale.

Experience:

? Over 10 years of robust software engineering experience, including 2 to 3 years of dedicated hands-on work in Generative AI and Retrieval-Augmented Generation (RAG) architecture

? Over 3 years of cloud native experience preferably on AWS.

? Over 5 years of hands-on experience with Python

? Experience building interoperable Agentic AI Proof of Concepts using Model Context Protocol (MCP) and/or Google A2A.

Key Responsibilities:

? Design and develop GenAI solutions using prompt engineering, Retrieval-Augmented Generation (RAG), and custom pipelines

? Design and develop interoperable AI agents using Model Context Protocol (MCP) and Google A2A

? Automate workflows involving parsing unstructured content such as emails, documents, and web pages in to highly accurate and reliable structured content

? Automate building documents using data and content from various diverse sources

? Build enterprise-wide reusable services and components

? Design and build MCP hosts, clients and servers

? Establish frameworks for automated LLM testing

? Create regression test suites to detect drift or prompt breakage

? Integrate with internal and external web services using secure authentication and authorization mechanisms

? Adopt and ensure safe practices to protect against prompt injections, jailbreaks, and conform to enterprise security guidelines

? Experience with agile methodologies and ability to independently document user stories in the absence of Business Analyst

? Collaborate with the AI CoE team to ensure scalability, reusability, and alignment with governance standards

Required Skills:

? Very strong Python skills.

? Strong hands-on experience with LLM APIs (OpenAI, Azure OpenAI, Gemini, Anthropic, etc.) using Python and Python based frameworks

? Strong hands-on experience in prompt engineering, context construction, grounding strategies

? Strong hands-on experience with Retrieval Augmented Generation (RAG) extracting, chunking and create embeddings from unstructured documents from diverse sources including O365(email, word, excel), PDFs, and webpages.

? Comfortable building Model Context Protocol (MCP) clients, servers and hosts.

? Strong Expertise in building REST APIs and integrating with internal/external APIs

? Hands-on experience with Intelligent Document Processing and/or OCR technologies on complex documents

? Knowledge of Google A2A

? Deep experience in AWS (Lambda, Bedrock, Step Functions, API Gateway, IAM)

? Strong experience with monitoring using LangSmith, CloudWatch, or other similar GenAI observability tools

? Excellent GenAI foundations and concepts

? Clear understanding of enterprise data privacy, AI governance, and observability

Nice to Have:

? Experience with Microsoft Copilot extensibility (Graph connectors, plugins, or adaptive cards)

? Ability to build and orchestrate AI-to-AI interactions using Google A2A, integrating multiple agents or tools

? Strong traditional ML Experience

Success Profile:

? You?re a builder who can translate fuzzy business needs into elegant GenAI and Agentic AI workflows

? You?re a problem solver who?s comfortable navigating across cloud platforms, tools, and data sources

? You?re collaborative, with the ability to work independently while aligning with enterprise AI goals

Benefits:

York Solutions Offers a generous benefits package for eligible full-time employees:

  • BCBS Medical with 3 Plans to choose from (PPO and High deductible PPO plans with Health Savings Program)
  • Delta Dental plan with 2 free cleanings and insurance discounts
  • Eye Med Vision with annual check-ups and discounts on lens
  • Life and Accidental Death Insurance paid by company
  • John Hancock 401(k) Retirement Plan with discretionary company match up to 5%
  • Voluntary Insurance programs such as: Hospital Indemnity, Identity Protection, Legal Insurance, Long Term Care, and Pet Insurance.
  • Flexible work environment with some remote working opportunities
  • Strong fun and teamwork environment
  • Learning, development, and career growth