A Page report is organized by survey page, listing the questions included on each page, and includes aggregate metadata collected from all survey takers. This information can be used to answer questions about the respondent experience.
Chief among these questions are:
- How long are respondents spending on a given question or page?
- Where are respondents having difficulty satisfying validation requirements?
- What questions have the highest impact on attrition?
The Page Reports applet is accessible by selecting Page under the Reports button group.
Tip! Page statistical data is only calculated for pages that have been seen by more than 10 respondents.
Page Reports home grid
The Page Reports applet contains a grid listing all pages in the survey and the questions displayed on each page. By default, results for all pages, all questions, and all respondents (all statuses) are shown.
Each survey page is on its own row, and each row displays data points which provide insight into how respondents are interacting with that page. The grid's data columns include the following.
| Column | Description |
|---|---|
| Page # | The survey page number where the question/table is found. |
| Question(s) on Page | The question/table ID(s) that appear on the survey page. Pages that display free text or messages will only display a dash in this column. |
| Inactive Count | The number of respondents who have changed from status "P" (In Progress) to status "N" (Inactive) on the page. For more information on respondent statuses, see Understanding respondent statuses. |
| Abandonment Rate | The percentage of respondents who went inactive on this page out of the total number of respondents who saw the page. |
| Page Views (%) | The percentage of respondents who saw this page out of the total number of completes. |
| Validation Failures Per Submission | The number of times the page failed to advance based on the respondent's answer not fulfilling the requirements, divided by the total number of times the page has been viewed. |
| Respondent Time (secs) | The average time (in seconds) respondents spent on this page. |
| Server Time (secs) |
The average time (in seconds) it takes the server to process a submitted page and render the next page for the respondent. |
| Respondent Report | An Excel report with completed respondent data for that page. It includes a list of respondent IDs and their respective error count and time on page. Clicking the icon allows the user to download a report of all the respondents' results for that page. |
| Min Load Time (s) | The fastest load time experienced (in seconds), where load time is the amount of time between when the respondent request was received by IntelliSurvey and when that request is served. Does not include network transit time. Column does not display by default. |
| Max Load Time (s) | The slowest load time experienced (in seconds), where load time is the amount of time between when the respondent request was received by IntelliSurvey and when that request is served. Does not include network transit time. Column does not display by default. |
| Median Load Time (s) | The median load time experienced (in seconds), where load time is the amount of time between when the respondent request was received by IntelliSurvey and when that request is served. Does not include network transit time. Column does not display by default. |
As in other places in the IntelliSurvey interface, data columns can be sorted by clicking the column header. Once clicked, the data will be reorganized by that column. When the data is sorted by a column, an arrow will appear in the column header. Clicking the arrow again will sort it in reverse order.
Column width can also be adjusted. To adjust the column width, bring your cursor over the lines dividing the columns in the column headers. A width icon will appear. When it does, click and drag the column to resize it to the desired width.
Click the sort arrow next to Columns to hide or show additional columns. As mentioned in the grid above, there are three additional columns – Min Load Time, Max Load Time, and Median Load Time – that are hidden by default. These columns can be selected to be displayed if needed, as shown below.
Page preview
On the right side of the applet interface, the selected page shows a preview of the question(s) displayed on each page. Free text or messages such as the survey's completion message may also be previewed.
Creating a report
To create a new Page report, click on the Filters button. This will activate the Record Selector and Field Selector. Use the Record Selector filter to define which records to include (Completed, IDs, Date/Time, or Data Cut), then use the Field Selector filter to determine which fields to include (All Questions, All Questions and Record Data, By Chapter, By Field Type, or Individually). Note that unlike other reporting applets, Page Reports does not default to Completed for the Record Selector, but instead defaults to all respondent records.
Once the desired filters have been applied, press Apply to generate the new report.
Actions
Saving reports
To save a Page report, click Actions > Save . The Save Report modal will appear, prompting the user to add a file name in the Description field and to add any additional users in the User Access section. Click Save to finish saving the report.
The User Access option allows users with the correct permissions to designate which users may access the report. If not set, anyone with the survey role of Manager+ can view all reports; meanwhile all other users with lesser survey permissions can only see reports created by users within their same organization/domain. The modal is broken into three sections - Domain, which lists all domains from all users with access to the survey (with the exception of IntelliSurvey); Individuals, which lists all individual emails in alphabetical order; and Default, which is an un-editable section of users with permanent access to the report. Any users that already have access by default will be included at the bottom of the list, and their access cannot be removed. Lastly, a user must already have access to the survey to be added to the report. To provide access to a user, simply check the box next to the individual's domain or next to the individual's email.
Tip! If a client typically asks to add more users at various stages of a project (e.g., adds new colleagues for data analysis at the end of a project) it is helpful to grant access to the client's domain so that all current and future users from that organization have access.
Note that reports made while in Dev mode (development mode) or that have yet to be published will be saved as "Dev only," which may affect visibility for some lower-access users. Additionally, if a report is saved while in Dev mode, new users cannot be added once permissions are set.
Click Save to continue.
To check or amend which users can access a file post-saving, go to Actions > User Access. Note, this option will not appear in the Actions menu unless the report has been saved. To add or remove users, check or uncheck the boxes next to their names as needed. Be sure to save all changes after.
Note: Like other reporting applets, Frequency reports may be created for Dev or Pub versions of the survey by using the Dev/Pub toggle in the applet header. If the most recent version of the survey has been published, the toggle will be inactive. For more on Dev/Pub, see Dev and Pub Mode.
Note: If a report was saved while in Dev mode, new users cannot be added once permissions are set.
Once a report has been saved, the filters will disappear, and a light blue bar will appear below the applet header with the report's Description (name) and the text "SAVED REPORT" showing. Buttons will also appear that allow the user to edit the report or copy a URL address to paste into emails or other documents.
Tip! Saved reports can also be accessed for viewing or editing via the Deliverables applet.
If an open report is edited by clicking the Edit Report button, the user should go to Actions > Save to save the latest changes. If a new report name is given, the report created will be considered a new, distinct report from the one edited and the previous saved report will still appear in Deliverables under the original name. However, if the same report name is used, a second modal will appear to confirm the user's intentions. Keep the description unchanged to replace the report, or change the name to save a copy.
Excel download
To download a copy of the report, click Actions > Excel. A modal will appear letting the user known when the report is ready for download.
The Respondent report
The Respondent Report export is available by clicking the download icon () in the corresponding column of the page you wish to export. It provides a by-respondent table for that page's question(s) in an Excel format of two data points for the page, and includes data from all completed respondents.
The two data points included are:
- Error Count – The number of failed validation attempts by the respondent.
- Time on Page – The elapsed time in milliseconds that the respondent spent on the page.
Comments
0 comments
Please sign in to leave a comment.