Agentforce QA Engineer (Voice Testing)
Posted Today by K2 Partnering
Negotiable
Undetermined
Remote
Remote
Summary: We are looking for a detail-oriented Agentforce QA Engineer specializing in Voice Testing to oversee the quality assurance of our AI voice systems. This role involves designing advanced testing methodologies and validating voice-enabled agents to ensure optimal customer experiences. The position requires a strong analytical mindset and technical skills to evaluate various aspects of voice interactions. The role is remote and has a duration of 3 months with a possibility of extension.
Key Responsibilities:
- Validate voice-enabled autonomous agents using the Agentforce Testing Center, testing reasoning traces, conversational turn-taking, and Topic/Instruction/Action (TIA) execution accuracy.
- Conduct comprehensive Voice Testing within the Voice Preview engine and via telephony endpoints, evaluating Automatic Speech Recognition (ASR) mapping, latency, and Natural Language Understanding (NLU) accuracy.
- Audit and test Prompt Builder configurations, executing variance and regression tests to identify potential LLM hallucinations, off-script deviations, or scoring drops.
- Verify end-to-end integration flows across Service Cloud Voice telephony connections (e.g., Amazon Connect, Genesys), ensuring seamless call routing, transcription generation, and real-time human agent escalation pathways.
- Validate back-end data consistency by verifying that voice interactions trigger the appropriate Salesforce Flows, update standard fields, and successfully log data into VoiceCall records.
Key Skills:
- Experience in quality assurance and testing of voice-enabled systems.
- Strong analytical and technical skills in AI and voice technologies.
- Familiarity with Salesforce and Service Cloud Voice infrastructure.
- Knowledge of Automatic Speech Recognition (ASR) and Natural Language Understanding (NLU).
- Ability to design and implement advanced testing methodologies.
Salary (Rate): undetermined
City: undetermined
Country: India
Working Arrangements: remote
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
Position: Agentforce QA Engineer (Voice Testing)
Duration: 3 months with a possibility of extension
Location: India remote
Role overview:
Role Overview:
We are seeking an analytical and technically sharp Agentforce QA Engineer specializing in Voice Testing to lead the quality assurance and validation of our autonomous AI voice systems. In this role, you will do much more than execute standard manual test scripts — you will design and implement advanced testing methodologies for modern, next-generation AI interactions. You will leverage the Agentforce Testing Center, Service Cloud Voice infrastructure, and prompt valuation techniques to ensure our real-time voice-activated agents provide precise, secure, and natural customer experiences.
Responsibilities:
- Validate voice-enabled autonomous agents using the Agentforce Testing Center, testing reasoning traces, conversational turn-taking, and Topic/Instruction/Action (TIA) execution accuracy.
- Conduct comprehensive Voice Testing within the Voice Preview engine and via telephony endpoints, evaluating Automatic Speech Recognition (ASR) mapping, latency, and Natural Language Understanding (NLU) accuracy.
- Audit and test Prompt Builder configurations, executing variance and regression tests to identify potential LLM hallucinations, off-script deviations, or scoring drops.
- Verify end-to-end integration flows across Service Cloud Voice telephony connections (e.g., Amazon Connect, Genesys), ensuring seamless call routing, transcription generation, and real-time human agent escalation pathways.
- Validate back-end data consistency by verifying that voice interactions trigger the appropriate Salesforce Flows, update standard fields, and successfully log data into VoiceCall records.
Preferred Certifications:
- Salesforce Certified Agentforce Specialist
- Salesforce Certified AI Specialist / AI Associate
- Any equivalent Salesforce Consultant or Service Cloud Voice certification (a major plus given telephony routing and contact center setup validation requirements)