Parloa QA Automation lead

Job Description

We are seeking an experienced Parloa QA Automation lead specializing in AI Voice Agents, Parloa, and IVR Testing to validate AI-powered voice agents, conversational applications, and interactive voice response systems.

The ideal candidate will have strong expertise in functional testing, test automation, end-to-end voice workflows, and AI-driven conversational applications. This role focuses on validating prompts, speech recognition, conversational responses, and integrations with CRM systems, APIs, and backend applications to ensure reliable and high-quality customer experiences.

Primary Skills

• Parloa Testing
• IVR Testing
• Functional Testing
• Test Automation
• AI Voice Agent Testing
• Conversational AI Testing
• End-to-End Testing

Secondary Skills

• Regression Testing
• Integration Testing
• Smoke and Sanity Testing
• Prompt Validation
• Intent and Entity Testing
• Speech Recognition Testing
• Dialog Management
• API Testing
• CRM Integration Testing
• Backend Application Testing
• JIRA
• Azure DevOps
• Oracle SQL
• TestComplete
• Multilingual and Multichannel Testing
• AI Response Validation

Key Responsibilities

• Analyze business and functional requirements for AI voice agents, chatbots, IVR systems, and conversational applications.
• Design test scenarios, test cases, and test data covering positive, negative, boundary, and edge cases.
• Perform functional, integration, regression, smoke, sanity, and end-to-end testing.
• Validate conversational flows, prompts, intents, entities, dialog management, and expected AI responses.
• Test end-to-end voice workflows to ensure accurate execution and successful business process completion.
• Evaluate speech recognition accuracy, response quality, and conversational behavior, including dynamic AI-generated responses.
• Validate multilingual and multichannel customer interactions across supported platforms.
• Develop and maintain automated test scripts and frameworks for repeatable conversational workflows.
• Identify opportunities to automate repetitive voice-agent and prompt-based testing activities.
• Test integrations with CRM platforms, APIs, backend systems, and third-party services.
• Log, track, investigate, and retest defects using JIRA, Azure DevOps, or equivalent tools.
• Collaborate with Business Analysts, Developers, AI Engineers, and Product Owners to resolve defects and improve quality.
• Validate business, security, and accessibility requirements as applicable.
• Prepare test execution reports and provide release readiness assessments.
• Support User Acceptance Testing (UAT) and production validation activities.

Required Qualifications

• 8–10 years of experience in Quality Assurance, software testing, and functional testing.
• Hands-on experience with Parloa and/or IVR testing.
• Strong understanding of AI voice agents, chatbots, conversational agents, and voice-based applications.
• Experience testing conversational workflows, prompts, intents, entities, and dialog management.
• Experience with functional, integration, regression, smoke, sanity, and end-to-end testing.
• Practical experience with test automation tools, frameworks, and automated test script development.
• Ability to validate dynamic and non-deterministic AI-generated responses.
• Experience testing speech recognition, voice interaction workflows, and conversational response quality.
• Knowledge of API integrations, CRM systems, backend applications, and third-party services.
• Experience with defect tracking and test management tools such as JIRA or Azure DevOps.
• Strong analytical, troubleshooting, and problem-solving skills.

Preferred Qualifications

• Experience with AI agents and digital conversational platforms.
• Knowledge of Oracle SQL for data validation and backend testing.
• Experience with TestComplete or similar automation tools.
• Exposure to performance, ERP, and CRM testing.
• Experience validating multilingual and multichannel customer interactions.