The Effect of the Survey Length on the Response Quality

Abstract

To measure the effect that the survey length has on the response quality, several statistical indices were used. In Experiment 1, the survey length was 30-minute long, containing 192 items from various inventories. Three different types of questions were used in the survey: 5-Likert point scale items, open-ended questions, and stem-and-branch questions. Standard deviation and entropy analyses showed significant decrease in response quality when the items were located at the latter part of questionnaire. The open-ended questions also showed significant decrease in the analysis. Straight-line responses, middle responses significantly increased toward the end of the survey. In Experiment 2, the survey was lengthened to 60 minutes, containing 505 items from various inventories compiled. Standard deviation, entropy, and open-ended questions analyses showed significant decrease in response quality toward the end of survey. Missing values analysis, straight-line responses and middle responses showed significant increase.