A new experiment on the use of images to answer web survey questions
Published in Journal of the Royal Statistical Society: Series A, 2022
Recommended citation: Bosch, O.J., Revilla, M., Qureshi, D.D. & Höhne, J.K. (2022) A new experiment on the use of images to answer web survey questions. Journal of the Royal Statistical Society: Series A (Statistics in Society), 1–26. Available from: https://doi.org/10.1111/rssa.12856 https://doi.org/10.1111/rssa.12856
Abstract:Images might provide richer and more objective information than text answers to open-ended survey questions. Little is known, nonetheless, about the consequences for data quality of asking participants to answer open-ended questions with images. Therefore, this paper addresses three research questions: (1) What is the effect of answering web survey questions with images instead of text on breakoff, noncompliance with the task, completion time and question evaluation? (2) What is the effect of including a motivational message on these four aspects? (3) Does the impact of asking to answer with images instead of text vary across device types? To answer these questions, we implemented a 2 × 3 between-subjectweb survey experiment (N =3043) in Germany. Half of the sample was required to answer using PCs and the other half with smartphones. Within each device group, respondents were randomly assigned to (1) a control group answering open-ended questions with text; (2) a treatment group answering open-ended questions with images; and (3) another treatment group answering open-ended questions with images but prompted with a motivational message. Results show that asking participants to answer with images significantly increases participants’