Test levels and 'testmode' (r9)

All record/respondent IDs have a value stored in the system variable testmode. The value stored equals the test levels described in the overview of test levels below. For example, a test level 2 will have a value of '2' stored in the testmode field and indicates the data came from a manual tester.

All data with a testmode value greater than '0' is considered test data and is automatically hidden when the survey stage is set to Field. The test data still exists, but it is not visible in reports unless an explicit filter is used.

Overview of test levels 

Test 1

Also known as a "No Login Link," the test level 1 link is what the survey looks like to actual respondents. It imitates a live survey, but it stores test data. Question numbers are hidden, and there are no additional UI elements/tools. Anybody can access this view of the survey, even without a user account. Test records created with a test level 1 link have a respondent ID automatically generated by the software with the format TEST10001. This ID will automatically increment by 1; for example, TEST10002, TEST10003, etc.

Test 1.1

Test level 1.1 is identical to test level 1, except question numbers are shown. Referred to as a "No Login Link (QIDs)," this is useful for stakeholders without user accounts since they will be able to reference question numbers in their testing feedback. Test records created with a test level 1.1 link have a respondent ID automatically generated by the software with the format TEST1-10001 and will automatically increment by 1.

Test 2

Known as a "Testmode" link, test level 2 is for advanced testing in the Test Survey applet/Testmode dashboard. There are special tools that accompany this mode, and it is available to survey Makers, Researchers, Fielders, and Panel Field Managers. This test level has a unique URL which requires logging in with the user account. Test records created with a test level 2 link have a respondent ID automatically generated by the software with the format TEST20001 and will automatically increment by 1.

Test 3

Test level 3 indicates a record has been reclassified as a "manual test record" in the Data Management applet.

Test 4

Test level 4 indicates a record was generated by Dummy Data (data auto-populated by the system). Test records created in Dummy Data have a respondent ID automatically generated by the software with the format TEST40001 and will automatically increment by 1.

Test 0

Test level 0 means a the respondent came from a "Live Link," regardless of the survey stage. Such records will appear in data in both the Build and Field stages, regardless of when the record was generated.

Viewing test data in reports

All data with a testmode value greater than '0' is considered test data and is automatically hidden when the survey stage is in the Field stage. You can use the following example data cut expressions to view test data in the reports while fielding.

All test data, including Dummy Data

$testmode > 0

Test data, excluding Dummy Data

$testmode > 0 and $testmode < 4

Displaying content based on 'testmode'

Conditions may also be placed on the testmode variable in the source code so that text or questions will only be displayed if the testmode value is greater than 0.

condition

The following example uses the condition tag and testmode to show a message to testers that will only appear if they access the survey with test link.

startgroup: TEST
condition: $testmode > 0

This text displays to testers.

endgroup: TEST

showif

The next example uses the showif tag and testmode to show a question that will only appear if testers access the survey with test link.

CONCEPT. Concept selector - for testing only
type: radio
optsfrom: system.1to5 {text: Concept [id]}
showif: $testmode > 0