Running surveys in Testmode (r9)

The Testmode toolbar is a suite of advanced testing tools.

To access Testmode, go to Build > Test Survey in your survey's navigation menu. You must have a survey role of Panel Field Manager, Researcher, Fielder, or Maker to access this applet.

For a brief overview of using Testmode tools in IS Pro, see the following video.

Overview

Running a survey in "Testmode" allows users to perform "power testing" before launching to live respondents. 

• Testmode offers tools for easy navigation, such as displaying question numbers, back buttons, and the ability to jump directly to specific sections.
• Stored values for respondent-facing questions and hidden variables are shown in the Testmode window, eliminating the need to compare the data with reports and exports.
• Records can be cloned for efficient testing of multiple paths.
• Data generated in Testmode is excluded from reports during the Field stage.
• Testers with appropriate permissions can view SPL and warnings while testing, allowing them to review and verify the code.
• Tester feedback can be submitted directly on each page as needed.
• When Testmode is launched, a test ID is generated by default. If needed, you can specify a unique respondent ID for a test record by editing the URL.
• If additional languages are available, you can switch between them and test them on screen.
• Depending on your survey role, you may only have permission to test the Published version of the survey.

Selecting languages

If any translations are created for the survey, a dropdown menu appears directly beneath the search field. The menu includes the base language, as well as any other translated versions created with the Translations applet. If the translation has not been uploaded yet, the base language will be displayed in testing.

Testing draft or published versions

Certain survey roles — Makers and those with IntelliBuilder Editor and View Dev Links add-on roles — can view Draft versions of the survey in Testmode. Other survey roles can only view the latest Published version. If applicable, a dropdown will appear in the toolbar, allowing you to switch between versions.

Showing SPL and warnings

Your survey's source code (SPL) and warnings are hidden by default. However, if you have the survey role of Maker, you can view the code for the question(s) displayed on each survey page by clicking the Show SPL & Warnings toggle. 

Turning this option on will also highlight any errors found in the code with a yellow rectangle placed beneath the question. If a caution or warning is found, the programmer should review the code and attempt to resolve the issue.

Viewing and editing record data

In Testmode, you can review a test record's full dataset and edit the saved values for questions or variables. 

To change a question's answer, click the icon to launch the Record data modal. Click inside the light blue cell for the question you want to edit, select/input the new answer(s), and click outside the cell to automatically save your changes.

Viewing feedback log

When testers leave feedback in the Leave tester feedback link in the upper-right corner of the screen, these notes are compiled in the Feedback Log. If there is an unresolved comment, an orange circle appears next to the button, indicating the number of unresolved comments. Click on the button to launch the Feedback Log modal and review the comments.

To resolve a comment, click on the orange "Unresolved" rectangle, and it will then turn blue and read "Resolved". If you click this by accident, you can easily revert it by clicking a second time.

Additional testing information

At the bottom of the toolbar, you'll find several minimized sections with additional information. Click the downward arrow to expand any section. These sections won't automatically display, even if they contain information.

Notes From Programmer

Survey Programmers (SPs) often use the testnote tag to create notes for testers. If there is a note for the survey page you are viewing, it will be displayed. Once you advance past the page, the note will be removed.

Termination Logic

If a term if tag or term decorator is found in the SPL, the termination logic will be displayed.

New Values

When a page is submitted, any hidden variables on it (e.g., quotas or variables using selectby) will be displayed here to show you what value(s) were stored based on your answer.

Other Draft Survey Links

There are four sets of links available to test the latest draft version of the survey:

• Testmode link: This is the Testmode link and toolbar. A login is required, and the data is stored as test data.
• No-Login Link: Question numbers are not displayed. No login is required, and the data is stored as test data.
• No-Login Link (QIDs): Question numbers are displayed. No login is required, and the data is stored as test data.
• Live Link: This link is identical to the No-Login Link on screen; however, the data is stored as real respondent data.

Click the Open link to open a new test record in a new browser tab, or click Copy to copy the link to your clipboard and paste it later. 

You can also click QR to display a QR code that can be scanned with a mobile device.