Literaturnachweis - Detailanzeige
| Autor/inn/en | Russell, Michael; Moncaleano, Sebastian |
|---|---|
| Titel | Examining the Impact of a Consensus Approach to Content Alignment Studies |
| Quelle | In: Practical Assessment, Research & Evaluation, 25 (2020), Artikel 4 (17 Seiten)Infoseite zur Zeitschrift
PDF als Volltext kostenfreie Datei |
| Sprache | englisch |
| Dokumenttyp | gedruckt; online; Zeitschriftenaufsatz |
| ISSN | 1531-7714 |
| Schlagwörter | Test Content; Test Items; Discussion; Test Validity; Standard Setting (Scoring); Methods; Achievement Tests; Massachusetts; Massachusetts Comprehensive Assessment System |
| Abstract | Although both content alignment and standard-setting procedures rely on content-expert panel judgements, only the latter employs discussion among panel members. This study employed a modified form of the Webb methodology to examine content alignment for twelve tests administered as part of the Massachusetts Comprehensive Assessment System (MCAS). This modification required panel members to discuss items for which there was no consensus regarding the item's depth of knowledge or targeted standard. After the discussion, panel members were allowed to change their original ratings. The number of changes that occurred were analyzed considering the number of items discussed and the size of the panel. Moreover, we evaluated the impact these changes had on the overall judgments of alignment as reported by Webb's Web Alignment Tool (WAT). Findings suggest that discussion among panel members between rating rounds positively increased agreement among panel members' ratings but had minimal effects on the overall judgments of content alignment for 11 of the 12 tests evaluated. (As Provided). |
| Anmerkungen | Center for Educational Assessment. 813 North Pleasant Street, Amherst, MA 01002. e-mail: pare@umass.edu; Tel: 413-577-2180; Web site: https://scholarworks.umass.edu/pare |
| Erfasst von | ERIC (Education Resources Information Center), Washington, DC |
| Update | 2024/1/01 |
Literaturbeschaffung und Bestandsnachweise in Bibliotheken prüfen
Permalink als QR-Code
Inhalt auf sozialen Plattformen teilen (nur vorhanden, wenn Javascript eingeschaltet ist)
Teile diese Seite:
