Validity and Judgment Bias in Visual Analysis of Single-Case Data

Autor/inn/en	Wilbert, Jürgen; Bosch, Jannis; Lüke, Timo
Titel	Validity and Judgment Bias in Visual Analysis of Single-Case Data
Quelle	In: International Journal for Research in Learning Disabilities, 5 (2021) 1, S.13-24 (12 Seiten) PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	2325-565X
Schlagwörter	Data Analysis; Reliability; Validity; Visual Aids; Evaluative Thinking; Graphs; Accuracy; Preservice Teachers; Foreign Countries; Germany + Suchen Sie Ihr Suchwort? Auswertung; Reliabilität; Gültigkeit; Anschauungsmaterial; Grafische Darstellung; Ausland; Deutschland
Abstract	Analysis of data from single-case intervention studies commonly involves visual analysis. Previous research indicates that visual analysis may suffer from low reliability and unpromising error rates. We investigated the reliability and validity of visual analysis and explored to what extent data trends affect judgments. We administered a within-subject experiment in which 186 teacher-education students visually analyzed specifically constructed single-case graphs that included either an intervention effect, a trend effect, both effects, or no effect. Participants identified intervention effects in 75% of the graphs, regardless of the existence of a trend. Type I error rates were low (5%) in graphs without a trend but increased fivefold (25%) for graphs with a trend. Inter- and intra-rater reliability was low, particularly when a trend was present in the data. (As Provided).
Anmerkungen	International Academy for Research in Learning Disabilities. e-mail: ijrld@bc.edu; Web site: http://www.iarld.com/home/the-journal-thalamus
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01