All roles

Quality Assurance Engineer (AWS Lex and Google Dialogflow)

Remote · USA Full-time New today

About the position We are looking for a Quality Assurance Engineer with experience in testing conversational AI platforms such as AWS Lex and Google Dialogflow (CX/ES). The candidate will be responsible for functional, regression, and end-to-end testing of steering and skill bots, ensuring that virtual agent solutions deliver accurate, consistent, and high-quality customer experiences. The ideal candidate should be able to understand conversation design, NLU behavior, and bot architecture, and collaborate effectively with developers, solution architects, and business teams to validate and optimize bot performance.

Responsibilities

  • Design and execute test plans, test cases, and scripts for AWS Lex and Google Dialogflow bots (steering and skill bots).
  • Perform functional, regression, and integration testing across multiple bot use cases and channels (voice, chat, web).
  • Validate conversation flows, intent mapping, slot filling, fulfillment logic, and API integrations.
  • Collaborate with development teams to review requirements, conversation designs, and user stories.
  • Test multi-bot orchestration setups between steering bots and skill bots to ensure seamless user journeys.
  • Verify voice interactions in platforms such as Amazon Connect or Google CCAI integrations.
  • Track and report defects, performance issues, and test coverage using standard QA tools.
  • Participate in UAT and assist in creating test summary reports and automation scripts where applicable.
  • Ensure bots meet expected accuracy, response time, and quality benchmarks.

Requirements

  • 4+ years of hands-on experience with IVR testing tools such as CYARA Velocity, CYARA Virtual Agent, and CYARA Cruncher.
  • 2+ years hands-on testing experience in AWS Lex (V1/V2) and Google Dialogflow CX/ES.
  • Familiarity with conversation design concepts, intent recognition, and NLU model testing.
  • Experience testing integrations involving AWS Lambda, API Gateway, or Google Cloud Functions.
  • Knowledge of API testing tools (e.g., Postman, REST Assured) and automation frameworks (e.g., Selenium, PyTest).
  • Solid understanding of bot architecture and bot orchestration workflows.
  • Strong understanding of QA methodologies, defect management, and test documentation.
  • Experience with Agile testing practices and collaboration tools like Jira and Confluence.
  • Excellent communication, analytical thinking, and problem-solving skills.

Nice-to-haves

  • Exposure to automation testing for conversational AI using frameworks such as Botium, TestMyBot, or Voiceflow QA tools.
  • Familiarity with Google CCAI, Amazon Connect, or Genesys Cloud integrations.
  • Experience in performance and load testing for voice/chat bots.
  • Knowledge of CI/CD pipelines, CloudWatch, or Dialogflow Analytics for monitoring bot behavior.
  • Basic scripting knowledge in Python or JavaScript for test automation.

Benefits

  • Culture of Relentless Performance: join an unstoppable technology development team with a 99% project success rate and more than 30% year-over-year revenue growth.
  • Competitive Pay and Benefits: enjoy a comprehensive compensation and benefits package, including health insurance, and a relocation program.
  • Work From Anywhere Culture: make the most of the flexibility that comes with remote work.
  • Growth Mindset: reap the benefits of a range of professional development opportunities, including certification programs, mentorship and talent investment programs, internal mobility and internship opportunities.
  • Global Impact: collaborate on impactful projects for top global clients and shape the future of industries.
  • Welcoming Multicultural Environment: be a part of a dynamic, global team and thrive in an inclusive and supportive work environment with open communication and regular team-building company social events.
  • Social Sustainability Values: join our sustainable business practices focused on five pillars, including IT education, community empowerment, fair operating practices, environmental sustainability, and gender equality.

Apply tot his job Apply To this Job

Related roles

Senior Data Scientist, AI

Remote · USA Full-time

Senior Systems Engineer - High-Performance AI and Networking Applications

Remote · USA Full-time

Principal Software Engineer - AI in SDLC Tech Lead

Remote · USA Full-time

Principal Product Manager, AI

Remote · USA Full-time

Manager - Solution Owner (Data, Technology, and AI)

Remote · USA Full-time

Artificial Intelligence & Machine Learning Systems Engineer-Cognitive Electronic Warfare (EW)

Remote · USA Full-time

Senior Engineering Manager - Marketplaces DNA (Data & AI)

Remote · USA Full-time

Senior AI System Engineer

Remote · USA Full-time

Senior Managing Consultant - Business Strategy/AI Advisor

Remote · USA Full-time

Staff, Advanced Analytics, Product

Remote · USA Full-time

Experienced Part-time Customer Service & Sales Representative – Flexible Scheduling & Career Development Opportunities at blithequark

Remote · USA Full-time

Senior Vice President, Regulatory Affairs New Remote, US

Remote · USA Full-time

Internal Consulting Associate

Remote · USA Full-time

Experienced Entry-Level Online Customer Service Specialist – Delivering Exceptional Experiences for blithequark Customers

Remote · USA Full-time

Experienced Administrative Assistant - Data Entry HYBRID Professional for Dynamic Resource Lab Support and Data Management Expertise

Remote · USA Full-time

Liquidity Risk Management Associate

Remote · USA Full-time

Part-Time blithequark Data Entry Remote Jobs - Flexible Opportunities for Career Growth and Work-Life Balance

Remote · USA Full-time

Experienced Remote Data Entry Clerk - Social Media Advertising Analysis with blithequark

Remote · USA Full-time

Part-time Chat Specialist for Automotive and Recreational Vehicle Sales, Service, and Finance – arenaflex – College Station, TX

Remote · USA Full-time

Experienced Remote Customer Support and Leadership Development Associate - Entry Level Opportunity for Career Growth and Professional Development

Remote · USA Full-time