An Empirical Study for the Statistical Adjustment of Rater Bias

Autor/in	Ilhan, Mustafa
Titel	An Empirical Study for the Statistical Adjustment of Rater Bias
Quelle	In: International Journal of Assessment Tools in Education, 6 (2019) 2, S.193-201 (9 Seiten) PDF als Volltext kostenfreie Datei Verfügbarkeit
Zusatzinformation	ORCID (Ilhan, Mustafa)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	2148-7456
Schlagwörter	Statistical Analysis; Item Response Theory; Evaluators; Bias; Computation; Difficulty Level; Test Items; Grade 8; Mathematics Teachers; Achievement Tests; Mathematics Tests + Suchen Sie Ihr Suchwort? Statistische Analyse; Item-Response-Theorie; Schwierigkeitsgrad; Test content; Testaufgabe; School year 08; 8. Schuljahr; Schuljahr 08; Mathematics; Teacher; Teachers; Mathematik; Lehrer; Lehrerin; Lehrende; Achievement test; Achievement; Testing; Test; Tests; Leistungsbeurteilung; Leistungsüberprüfung; Leistung; Testdurchführung; Testen
Abstract	This study investigated the effectiveness of statistical adjustments applied to rater bias in many-facet Rasch analysis. Some changes were first made in the dataset that did not include "rater × examinee" bias to cause to have "rater × examinee" bias. Later, bias adjustment was applied to rater bias included in the data file, and the effectiveness of the statistical adjustment was further examined. The outcomes pertaining to the datasets with and without bias, and to which the bias adjustment was applied, were compared. It was concluded that diversities created by "rater × examinee" bias in examinees' ability estimation, item difficulty indices and measures of rater severity and leniency were, to a large extent, eliminated by bias adjustment. This result indicates that the bias adjustment using many-facet Rasch analysis is a viable way to control rater bias. (As Provided).
Anmerkungen	International Journal of Assessment Tools in Education. Pamukkale University, Faculty of Education, Kinikli Campus, Denizli 20070, Turkey. e-mail: ijate.editor@gmail.com; Web site: https://ijate.net/index.php/ijate
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01