The Impact of Ignoring Multilevel Data Structure on the Estimation of Dichotomous Item Response Theory Models

Autor/inn/en	Lee, Hyung Rock; Lee, Sunbok; Sung, Jaeyun
Titel	The Impact of Ignoring Multilevel Data Structure on the Estimation of Dichotomous Item Response Theory Models
Quelle	In: International Journal of Assessment Tools in Education, 6 (2019) 1, S.92-108 (17 Seiten) PDF als Volltext kostenfreie Datei Verfügbarkeit
Zusatzinformation	ORCID (Lee, Hyung Rock) ORCID (Lee, Sunbok) ORCID (Sung, Jaeyun)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	2148-7456
Schlagwörter	Item Response Theory; Computation; Error of Measurement; Test Bias; Statistical Analysis; Hierarchical Linear Modeling + Suchen Sie Ihr Suchwort? Item-Response-Theorie; Messfehler; Testkritik; Statistische Analyse
Abstract	Applying single-level statistical models to multilevel data typically produces underestimated standard errors, which may result in misleading conclusions. This study examined the impact of ignoring multilevel data structure on the estimation of item parameters and their standard errors of the Rasch, two-, and three-parameter logistic models in item response theory (IRT) to demonstrate the degree of such underestimation in IRT. Also, the Lord's chi-square test using the underestimated standard errors was used to test differential item functioning (DIF) to show the impact of such underestimation on the practical applications of IRT. The results of simulation studies showed that, in the most severe case of multilevel data, the standard error estimate from the standard single-level IRT models was about half of the minimal asymptotic standard error, and the type I error rate of the Lord's chi-square test was inflated up to 0.35. The results of this study suggest that standard single-level IRT models may seriously mislead our conclusions in the presence of multilevel data, and therefore multilevel IRT models need to be considered as alternatives. (As Provided).
Anmerkungen	International Journal of Assessment Tools in Education. Pamukkale University, Faculty of Education, Kinikli Campus, Denizli 20070, Turkey. e-mail: ijate.editor@gmail.com; Web site: https://ijate.net/index.php/ijate
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01