QA Runner

Test every Qualtrics survey link before it goes live.

A free Chrome extension for survey programmers, researchers and Qualtrics partners.

QA Runner answers every question on each page, clicks Next until the end, and follows test plans that pin the answers driving your routing. It checks required questions as it goes and hands you the evidence as CSV files.

No account. No server. No AI guessing. Everything runs in your browser, and the same seed always gives the same answers. Privacy details

Runs in your browser
3 scenarios, 1 route found
Pirai QA Runner
Customer experience survey · preview link
QID1 · Single Choice · pinned
Overall satisfaction
Very dissatisfied
QID2 · Multiple Choice
Services used
Front desk, Other: text filled in
QID3 · Matrix
Rate the following
3 of 3 statements answered
QID5 · Required check
Would you visit us again?
Marked required, but not enforced
Scenario 3 of 3 reached the follow up page. 1 required issue found.

Clicking through a survey link by hand takes hours, and still misses things.

Every route needs its own pass. Required settings and Other boxes are easy to miss. And when a client asks what was tested, the only answer is "we clicked through it".

WITHOUT QA RUNNER

Someone answers every page by hand, once for each route through the survey, and starts again after every change. Required questions that aren't enforced slip through. Questions that never appear go unnoticed. There's no record of which answers were tried.

WITH QA RUNNER

QA Runner answers every page for you and runs each route as its own scenario, in a fresh session. Required settings are checked as it goes. Every answer it gives is logged, and the same seed reproduces any run exactly after a fix.

From survey link to signed off routes in four steps.

A quick run checks the whole survey. A test plan proves the routes that matter.

1

Open your survey link

Install QA Runner from the Chrome Web Store, open a Qualtrics preview or live link, and click the extension icon. The side panel recognises the survey and the link type.

2

Run it to the end

Click Run to end. QA Runner answers every question on each page, checks each answer went in, clicks Next, and keeps going until the end of the survey.

3

Build a test plan

Load every question from the survey builder or a QSF, pick the questions that drive your routing, and choose the answers to try. QA Runner turns them into scenarios.

4

Review and download

Each scenario shows whether its pinned questions were shown and answered. Download the results, every answer given and the required checks as CSV files.

Watch QA Runner test a survey from first page to last

A customer experience survey with routing, required questions and an Other box, run, planned and checked.

Every question answered on the page, with each one confirmed in the panel.

Every question answered on the page, with each one confirmed in the panel.

Every question type in Qualtrics' current survey layout.

Each type is answered the way a respondent would, then checked to make sure the answer went in.

Single and Multiple Choice

One or several answers per question, with Other, please specify text filled in.

Dropdowns

Dropdown lists, on their own or inside a matrix table.

Text Entry and Forms

Single line, multi line, essay, password and form fields.

Matrix Tables

Likert single and multi answer, bipolar, constant sum and text entry grids.

MaxDiff

One different statement chosen for each column, as MaxDiff requires.

Sliders

Handle, bar and star sliders, set to values within their range.

Side by Side

Each column answered with its own widget, from radios to text.

Pick, Group and Rank

Items dragged into groups with real mouse input, the way respondents do it.

Built for the way survey testing really works.

From a quick run on a new link to proving every route before a client signs off.

Test Plans

Pick the questions that drive your routing and the answers to try. QA Runner builds the scenarios and runs each one in a fresh session.

Load the Whole Survey

Load every question from your open Qualtrics survey builder tab, or from a QSF, and pick questions from any page, not just the one in front of you.

Required Question Checks

Finds questions that are required but not enforced, enforced but not marked, and Other boxes that need text. Works even when the asterisk is hidden.

Repeatable Runs

Answers come from a seed, so the same seed gives the same answers every time. Rerun a plan after a fix and compare.

Evidence You Can Share

Download the results, a readable log of every answer given, and the required checks as CSV files, ready for Excel and client sign off.

Routing You Can See

Each scenario reports whether every pinned question was shown and answered, so a question that never appears stands out straight away.

Real Drag and Drop

Pick, group and rank questions only accept real mouse input. QA Runner provides it, so those questions are answered too.

Plans as Files

Download a test plan with the survey it was made for, share it with your team, and upload it again for the next round of testing.

Private by Design

Everything runs in your browser. No account, no tracking, and nothing is sent to Pirai AI or any other server.

Free to use.

No account, no subscription, no usage limits.

Free
Chrome extension for Qualtrics

Install it from the Chrome Web Store and test your first survey link in minutes. Use preview links for testing: runs on live links are recorded as responses and count towards quotas.

Add to Chrome

For teams who launch surveys that have to work first time.

Qualtrics Partners and Agencies

Test every client survey before launch and hand over evidence of what was checked, without hours of clicking through links.

Market Research and Programming Teams

Prove screeners, routing and follow up questions behave as the questionnaire says, and catch required settings and Other boxes before anyone else does.

CX and EX Programme Teams

Check recurring and translated surveys quickly every time a question, block or piece of logic changes.

Frequently asked questions

What is Pirai QA Runner?

Pirai QA Runner is a free Chrome extension that tests Qualtrics survey links. It answers every question on each page, clicks Next until the end of the survey, follows test plans you create, and reports what worked, all from a side panel in Chrome.

Does QA Runner use AI to answer surveys?

No. Answers come from a seed, so the same seed on the same survey always gives the same answers, and any run can be repeated exactly. Questions you pin in a test plan always get the answers you chose.

Will test runs show up in my survey data?

On preview links, no. On live links, each run is submitted as a real response and counts towards quotas, the same as if you answered the survey yourself. The panel turns amber on live links as a reminder, so use the preview link where you can.

What is a test plan?

A test plan lists the questions that drive your survey routing and the answers to try for each. QA Runner turns it into scenarios, runs each one in a fresh session, and reports whether every pinned question was shown and answered. Plans can be downloaded as files to reuse or share.

Can QA Runner check required questions?

Yes. With required checks turned on, QA Runner clicks Next before answering and records which questions block it. It reports questions that are required but not enforced, enforced but not marked, and Other, please specify boxes that need text. It reads the required setting even when the asterisk is hidden.

Do I need to share my Qualtrics login?

No. QA Runner never asks for or reads your password or cookies. When you load questions from the survey builder, the request runs inside your own signed in builder tab.

Which question types are supported?

Multiple choice, dropdowns, text entry, forms, matrix tables (Likert, bipolar, dropdown, constant sum, text entry and MaxDiff), sliders, side by side, and pick, group and rank, in Qualtrics' current survey layout.

Where does my survey data go?

Nowhere. Everything runs in your browser, and nothing is sent to Pirai AI or any other server. Results are saved to your computer only when you download them.

How much does QA Runner cost?

Pirai QA Runner is free.

Read exactly what QA Runner handles, and what it never collects, in our privacy policy.

Have a survey link to test?

Add QA Runner to Chrome and run your first survey in minutes. Testing on another survey platform, or want a walkthrough for your team? Send us a note.