Using the Many-Facet Rasch Model to Evaluate Standard-Setting Judgments: Setting Performance Standards for Advanced Placement® Examinations Slides presented at the Annual Meeting of the American Educational Research Association (AERA) (Vancouver, BC, Apr 15, 2012).

Autor/inn/en	Kaliski, Pamela; Wind, Stefanie A.; Engelhard, George, Jr.; Morgan, Deanna; Plake, Barbara; Reshetar, Rosemary
Institution	College Board
Titel	Using the Many-Facet Rasch Model to Evaluate Standard-Setting Judgments: Setting Performance Standards for Advanced Placement® Examinations Slides presented at the Annual Meeting of the American Educational Research Association (AERA) (Vancouver, BC, Apr 15, 2012).
Quelle	(2012), (22 Seiten) PDF als Volltext kostenfreie Datei Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Monographie
Schlagwörter	Konferenzschrift; Nachschlagewerk; Advanced Placement Programs; Achievement Tests; Item Response Theory; Models; Standard Setting; Science Tests; Test Items; Difficulty Level; Standards; Validity; Advanced Placement Examinations (CEEB) + Suchen Sie Ihr Suchwort? Achievement test; Achievement; Testing; Test; Tests; Leistungsbeurteilung; Leistungsüberprüfung; Leistung; Testdurchführung; Testen; Item-Response-Theorie; Analogiemodell; Standardisierung; Test content; Testaufgabe; Schwierigkeitsgrad; Standard; Gültigkeit
Abstract	The Many-Facet Rasch (MFR) Model is traditionally used to evaluate the quality of ratings on constructed response assessments; however, it can also be used to evaluate the quality of judgments from panel-based standard setting procedures. The current study illustrates the use of the MFR Model by examining the quality of ratings obtained from a standard setting employing the Multiple Yes-No (MYN) modified Angoff standard setting procedure to set the cuts on the Advanced Placement® (AP®) Environmental Science exam. The locations of the panelists, judged item difficulties, rounds, and performance standards using the MFR Model were examined. Results revealed evidence of acceptable quality of the ratings obtained from the panelists. Thus, the current study provides an important contribution of validity evidence for the AP Environmental Science standard setting, as well as an illustration of the utility of the MFR Model to evaluate standard setting judgments. (As Provided).
Anmerkungen	College Board. 250 Vesey Street, New York, NY 10281. Tel: 212-713-8000; e-mail: research@collegeboard.org; Web site: http://research.collegeboard.org
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01