QA Engineer (AI Voice)

Lingaro
Poland
RemoteCareer-pivot friendly

Who this role is best for

Geared toward QA professionals comfortable with voice and conversational AI testing, with a preference for candidates who can work in Poland or remotely and thrive in a collaborative, inclusive environment.

Best fit for

  • Candidates with QA experience in voice or conversational AI and a background in API testing and automation.
    — “At least 1 year of experience in testing voice or conversational AI.”
  • Individuals who can identify and flag risks early and have strong documentation skills for defect logging.
    — “Log defects with clear reproduction steps and transcripts, and follow them to closure.”
  • People who are experienced in testing across multiple markets and can adapt to varying configurations.
    — “Experience validating customer journeys across multiple markets is a plus.”

Things to consider

  • The role demands a minimum of 3 years in QA, with voice testing experience being a strong indicator of suitability.
    — “At least 3 years of experience in software QA.”
  • Candidates must be fluent in English at least at B2 level for effective communication.
    — “English at least B2.”

How to stand out

  • Highlight experience with LLM evaluation tools and voice testing platforms in your resume.
    — “Experience with LLM evaluation tools (Promptfoo, DeepEval, LangSmith) is a plus.”
  • Emphasize your ability to troubleshoot using logs and transcripts in your interview responses.
    — “Troubleshooting from logs and transcripts.”
  • Showcase your understanding of AI variability and how to test for differing outputs.
    — “Understanding why the same input can produce different AI outputs, and how to test for it.”
Pace · SteadyCollaboration · MediumAutonomy · MediumDecision Impact · Team

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

  • Ran E2E, API, integration, regression and release tests
  • Logged defects with clear reproduction steps
  • Flagged risks and blockers early
Typical background
At least 3 years of experience in software QAAt least 1 year of experience in testing voice or conversational AI

Skills & requirements

Required

Software QAVoice Agent TestingAPI TestingAutomation In Python Or Javascript/typescriptJira Or Azure Devops

Preferred

Voice Testing PlatformsLLM Evaluation ToolsTelephony Basics

Stack & domain

PythonJavaScriptTypeScriptIstqbAIVoice

About the role

Original posting from Lingaro via Lever

Growth through diversity, equity, and inclusion. As an ethical business, we do what is right — including ensuring equal opportunities and fostering a safe, respectful workplace for each of us. We believe diversity fuels both personal and business growth. We're committed to building an inclusive community where all our people thrive regardless of their backgrounds, identities, or other personal characteristics.

What you'll be doing:

  • Run E2E, API, integration, regression and release tests on voice journeys across markets and configurations.
  • Prepare test data and expected outcomes, and support business testers during UAT.
  • Run and extend the automated suites and evaluation sets designed by the Senior.
  • Log defects with clear reproduction steps and transcripts, and follow them to closure.
  • Flag risks and blockers early.

What we're looking for:

  • At least 3 years of experience in software QA.
  • At least 1 year of experience in testing voice or conversational AI. 
  • Hands-on voice agent testing: speech recognition and speech output basics, intents, latency, reading transcripts.
  • Understanding why the same input can produce different AI outputs, and how to test for it.
  • API testing and basic automation in Python or JavaScript/TypeScript.
  • Jira or Azure DevOps and a test management tool.Troubleshooting from logs and transcripts.
  • Clear written and verbal communication.
  • Voice testing platforms (Hamming, Cekura, Coval, Botium) is a plus.
  • Experience with LLM evaluation tools (Promptfoo, DeepEval, LangSmith) is a plus.
  • Experience with Telephony basics (SIP, Twilio, Azure Communication Services) is a plus.
  • ISTQB certification is a plus.
  • Experience in Responsible-AI testing (PII, bias, safety) is a plus.
  • Experience validating customer journeys across multiple markets is a plus.
  • English at least B2.

We offer:

  • Stable employment. On the market since 2008, 1500+ talents currently on board in 7 global sites.
  • “Office as an option” model. You can choose to work remotely or in the office.  
  • Workation. Enjoy working from inspiring locations in line with our workation policy. 
  • Great Place to Work® certified employer.
  • Flexibility regarding working hours and your preferred form of contract.  
  • Comprehensive online onboarding program with a “Buddy” from day 1.   
  • Cooperation with top-tier engineers and experts.  
  • Unlimited access to the Udemy learning platform from day 1.
  • Certificate training programs. Lingarians earn 500+ technology certificates yearly. 
  • Upskilling support. Capability development programs, Competency Centers, knowledge sharing sessions, community webinars, 110+ training opportunities yearly.
  • Grow as we grow as a company. 76% of our managers are internal promotions.  
  • A diverse, inclusive, and values-driven community.   
  • Autonomy to choose the way you work. We trust your ideas.  
  • Create our community together. Refer your friends to receive bonuses.  
  • Activities to support your well-being and health.
  • Plenty of opportunities to donate to charities and support the environment. 
  • Modern office equipment. Purchased for you or available to borrow, depending on your location.

Source: Lingaro careers (Lever)

Similar roles

More roles at Lingaro