A Comparison of the Added Value of Subscores across Two Subscore Augmentation Methods

Autor/inn/en	Afsharrad, Mohammad; Pishghadam, Reza; Baghaei, Purya
Titel	A Comparison of the Added Value of Subscores across Two Subscore Augmentation Methods
Quelle	In: International Journal of Language Testing, 13 (2023), S.109-125 (17 Seiten) PDF als Volltext kostenfreie Datei Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
Schlagwörter	Comparative Analysis; Scores; Value Added Models; Psychometrics; Evaluation Criteria; English (Second Language); Second Language Learning; High Stakes Tests; Language Proficiency; Language Tests; Foreign Countries; College Entrance Examinations; College Admission; Majors (Students); Multiple Choice Tests; Test Items; Teacher Education Programs; Language Teachers; Translation; English Literature; Iran + Suchen Sie Ihr Suchwort? Psychometry; Psychometrie; English as second language; English; Second Language; Englisch als Zweitsprache; Zweitsprachenerwerb; Language skill; Language skills; Sprachkompetenz; Language test; Sprachtest; Ausland; Aufnahmeprüfung; Hochschulzugang; Hochschulzulassung; Zulassung; Multiple choice examinations; Multiple-choice tests, Multiple-choice examinations; Multiple-Choice-Verfahren; Test content; Testaufgabe; Language teacher; Sprachunterricht; Englische literatur
Abstract	Testing organizations are faced with increasing demand to provide subscores in addition to the total test score. However, psychometricians argue that most subscores do not have added value to be worth reporting. To have added value, subscores need to meet a number of criteria: they should be reliable, distinctive, and distinct from each other and from the total score. In this study, the quality of subscores from two subscore augmentation models (Wainer and Yen) was compared in terms of distinctness and variability. The reliabilities of the Wainer-augmented subscores were also examined. The models were applied to a high-stakes English language proficiency test in Iran. The results of the study showed that Yen better-satisfied subscore distinctness while Wainer best-preserved variability and had high-reliability subscores. In other words, Yen-augmented subscores had lower correlations while Wainer-augmented subscores better discriminated examinees with different ability levels. Thus, none of the examined models of subscoring satisfied all criteria. The results of the study are discussed and suggestions for future research are provided. (As Provided).
Anmerkungen	Tabaran Institute of Higher Education. Shariati 60, Shariati Blvd, Ghasem Abad, Mashhad, Khorasan Razavi, Iran. Tel: +98 (51) 35227215; e-mail: ijlt@tabaran.ac.ir; Web site: http://www.ijlt.ir/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01