Applying Rasch Model and Generalizability Theory to Study Modified-Angoff Cut Scores

Autor/inn/en	Arce, Alvaro J.; Wang, Ze
Titel	Applying Rasch Model and Generalizability Theory to Study Modified-Angoff Cut Scores
Quelle	In: International Journal of Testing, 12 (2012) 1, S.44-60 (17 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1530-5058
DOI	10.1080/15305058.2011.614366
Schlagwörter	Generalizability Theory; Item Response Theory; Cutting Scores; Scaling; Raw Scores; Standard Setting (Scoring); Test Items; Difficulty Level; Error of Measurement + Suchen Sie Ihr Suchwort? Item-Response-Theorie; Scale construction; Skalenkonstruktion; Bewertungsskala; Test content; Testaufgabe; Schwierigkeitsgrad; Messfehler
Abstract	The traditional approach to scale modified-Angoff cut scores transfers the raw cuts to an existing raw-to-scale score conversion table. Under the traditional approach, cut scores and conversion table raw scores are not only seen as interchangeable but also as originating from a common scaling process. In this article, we propose an alternative approach to scale cut scores that first explores the interchangeability between raw cuts and raw scores and then verifies that both sets of scores share a common metric. The two approaches are compared with Rasch measurement model and Generalizability theory using real data from a standard setting study. The two approaches show nontrivial differences in their locations of scaled cut scores, but variability of their scaled cut scores remains comparable. The results illustrate the importance of verifying that panelists' judgment of item difficulties and empirical item difficulties are on a common metric prior to the scaling of standard setting cuts. (Contains 5 tables and 2 figures.) (As Provided).
Anmerkungen	Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10