The Effects of Open-Ended Probes on Closed Survey Questions in Web Surveys
Abstract
Probes are follow-ups to survey questions used to gain insights on respondents’ understanding of and responses to these questions. They are usually administered as open-ended questions, primarily in the context of questionnaire pretesting. Due to the decreased cost of data collection for open-ended questions in web surveys, researchers have argued for embedding more open-ended probes in large-scale web surveys. However, there are concerns that this may cause reactivity and impact survey data. The study presents a randomized experiment in which identical survey questions were run with and without open-ended probes. Embedding open-ended probes resulted in higher levels of survey break off, as well as increased backtracking and answer changes to previous questions. In most cases, there was no impact of open-ended probes on the cognitive processing of and response to survey questions. Implications for embedding open-ended probes into web surveys are discussed.
Ingestion failed: Traceback (most recent call last): File "/srv/app/app/worker.py", line 85, in run_once process_job(db, job) File "/srv/app/app/worker.py", line 39, in process_job pdf_path, info = fetch_pdf_temp(candidate["url"]) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/srv/app/app/downloader.py", line 129, in fetch_pdf_temp raise ValueError(f"PDF source returned HTTP {response.status_code}.") ValueError: PDF source returned HTTP 403.
No local PDF is available.
GROBID Extracted text; discontinued.
This text is generated from TEI extraction for accessibility, search, and TTS. Formulas, tables, figures, page layout, and references may not perfectly match the original PDF.
No accessible text representation is available. The text extraction service has been discontinued for the time being. If you require this service, for accessibility or any other reason, please submit an issue/request on this page.
Metadata
Issues
No public issues have been filed for this DOI.
Submit an issue
Record history
| When | Event | Field | Old | New |
|---|---|---|---|---|
| 2026-06-18 19:37:53.011249+00:00 | identifier_assigned | DSEID | DSEID-001-4202144 |