Version Notice: This article covers features in our r9/IS Pro platform. If you're looking for information on this topic related to r8, see Understanding respondent statuses.
Respondent statuses are designed to provide basic information about a survey respondent. By default, every individual respondent within a survey data set is assigned a status. This status indicates if the respondent is still progressing through the survey, stopped, or finished. There are a handful of statuses which are included in every survey data set which are meant to illustrate these various states for each respondent. You can quickly see all respondent statuses aggregated in a bar chart for a given survey's data set in the Status tile on the Metrics tab of Fielding Overview, as well as in various reports.
Tip! It is useful to be able to test termination and quota logic prior to fielding and to be able to change answers and still advance through the survey. When this is needed, the survey should be ran in Testmode.
Open statuses
The following status types are considered "open":
Label | Status | Description |
---|---|---|
Initiated |
I |
Initiated respondents are those who have clicked into the survey via an invite link, but have not advanced past the first page. Respondents switch from I to P (In Progress) once the first Continue button is clicked. Note, setting respondents to status I via the |
Loaded | L | Respondents will be assigned this status if they have been added to the survey data set by an administrative user, but not actually activated by a respondent invite link. |
Max Cap | M | Respondents who attempt to click into a survey when there are more respondents In Progress (P) than the allowed Maximum Capacity will be classified as M and shown a message that "The survey is currently full. Please check back in a little while." See Survey Configuration for more information. |
Inactive | N | Inactive (N) respondents are formerly In Progress respondents who have not responded to the survey for 30 minutes. In the event that they return to the survey, their status will change back to In Progress. |
In Progress |
P |
Respondents are considered In Progress if they have started the survey but have not yet reached a closed status. They remain as a status P for up to 30 minutes of inactivity before becoming Inactive. |
Note: For respondents who are classified as P or N, only the first 5 minutes of inactive time will count towards a respondent's length of interview time (a.k.a., LOI). The timer will also be stopped if the respondent leaves the survey page or focuses on an application other than their browser. The timer will then resume when the focus is returned, or the next time a key is pressed or the mouse is clicked on a survey page.
For additional information on elapsed survey times, see Timer variables.
Closed statuses
The following statuses are considered "closed":
Label | Status | Description |
---|---|---|
Bad/Attention Checks | B | This status is often called "Quality Fail status" by panels and clients. When attention checks are failed, respondents are marked with this status to indicate there was a failure of these checks. |
Completed |
C |
Completed respondents qualify as such when they have answered all of the required questions and have reached the final page of the survey, wherein they see the survey complete ending message or a sample provider redirect. |
Duplicate | D | Respondents are considered Duplicates when they have triggered the duplicate check via CheatSweep, which examines whether each respondent's isid cookie is unique. |
Possible Fraud | F | Possible Fraud statuses indicate that the CheatSweep tool has reclassified the respondent from a status of Complete based on the threshold set for the survey in question. |
Targetable Quota | G | Targetable Quota statuses are for respondents who hit a quota stop for a quota that includes the targetable: y tag. For more information, see targetable. |
Speeder | J | A respondent that completes the survey under a certain time period is considered a Speeder, meaning they likely took the survey too fast and did not properly read questions before responding. |
Total Cap | O |
Respondents will qualify as Total Cap if an overall capacity has been set on the number of completes allowed for a survey, and that capacity has been reached. Total Cap is different from regular quotas because it assigns a custom status. The custom status permits respondents to re-enter the survey, and be re-statused to P (In Progress) if the Total Cap is lifted. |
Over Quota |
Q |
Over Quota respondents are those that hit a quota stop in the survey when the answers they provided placed them in a survey quota bucket that is at, or over, the maximum set in the Quota Manager. For more information, see Quotas overview. |
Terminated |
T |
Terminated respondents are those whose answers failed to meet a survey's qualifying criteria, usually by meeting the conditions of a |
Expunged | X | Respondents may be classified as Expunged if they were part of a panel that conducts quality reviews of completes and were removed as an invalid respondent. Once classified as X, these respondents will still exist in the data set, but will not count towards quotas. |
CB Overquota | Z | Also known as Click Balance Over Quota, these respondents are those that hit a click balancing quota stop in the survey because the answers that they provided placed them in a survey quota bucket that is at, or over, the maximum set in the Quota Manager. |
Statuses and CheatSweep
CheatSweep can reclassify a Completed respondent to status F, Possible Fraud. CheatSweep does not reclassify other statuses. It is important to note that in order to have an accurate formula and avoid bias, CheatSweep includes data from statuses C (Completed), F (Possible Fraud), B (Bad/Attention Checks), J (Speeder), and X (Expunged) in its calculations, but these statuses are not swept (reclassified) by CheatSweep.
Defining custom statuses
By default, IntelliSurvey includes many common options for the respondent status field ('status'). To define additional statuses, use the setstatus
widget. For more information about creating and using custom statuses, see endsurvey
. Note that custom statuses can only be closed, not open.
Comments
0 comments
Please sign in to leave a comment.