Comparing Readability Measures and Computer-Assisted Question Evaluation Tools for Self-Administered Survey Questions

Autor/inn/en	Stenger, Rachel; Olson, Kristen; Smyth, Jolene D.
Titel	Comparing Readability Measures and Computer-Assisted Question Evaluation Tools for Self-Administered Survey Questions
Quelle	In: Field Methods, 35 (2023) 4, S.287-302 (16 Seiten) PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Stenger, Rachel) ORCID (Olson, Kristen)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1525-822X
DOI	10.1177/1525822X221124469
Schlagwörter	Readability; Readability Formulas; Computer Assisted Testing; Evaluation Methods; Surveys; Response Rates (Questionnaires); Test Construction; Test Items; Prediction; Flesch Kincaid Grade Level Formula + Suchen Sie Ihr Suchwort? Lesbarkeit; Survey; Umfrage; Befragung; Antwortkontrolle; Testaufbau; Test content; Testaufgabe; Vorhersage
Abstract	Questionnaire designers use readability measures to ensure that questions can be understood by the target population. The most common measure is the Flesch-Kincaid Grade level, but other formulas exist. This article compares six different readability measures across 150 questions in a self-administered questionnaire, finding notable variation in calculated readability across measures. Some question formats, including those that are part of a battery, require important decisions that have large effects on the estimated readability of survey items. Other question evaluation tools, such as the Question Understanding Aid (QUAID) and the Survey Quality Predictor (SQP), may identify similar problems in questions, making readability measures less useful. We find little overlap between QUAID, SQP, and the readability measures, and little differentiation in the tools' prediction of item nonresponse rates. Questionnaire designers are encouraged to use multiple question evaluation tools and develop readability measures specifically for survey questions. (As Provided).
Anmerkungen	SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01