Literaturnachweis - Detailanzeige
Autor/in | Lamprianou, Iasonas |
---|---|
Titel | Investigation of Rater Effects Using Social Network Analysis and Exponential Random Graph Models |
Quelle | In: Educational and Psychological Measurement, 78 (2018) 3, S.430-459 (30 Seiten)Infoseite zur Zeitschrift
PDF als Volltext |
Sprache | englisch |
Dokumenttyp | gedruckt; online; Zeitschriftenaufsatz |
ISSN | 0013-1644 |
DOI | 10.1177/0013164416689696 |
Schlagwörter | Social Networks; Network Analysis; Comparative Analysis; Innovation; Evaluators; Simulation; High Stakes Tests; Graphs; Language Tests; Classification; Evaluation Methods; Mathematical Models; Goodness of Fit; Statistical Analysis |
Abstract | It is common practice for assessment programs to organize qualifying sessions during which the raters (often known as "markers" or "judges") demonstrate their consistency before operational rating commences. Because of the high-stakes nature of many rating activities, the research community tends to continuously explore new methods to analyze rating data. We used simulated and empirical data from two high-stakes language assessments, to propose a new approach, based on social network analysis and exponential graph models, to evaluate the readiness of a group of raters for operational rating. The results of this innovative approach are compared with the results of a Rasch analysis, which is a well-established approach for the analysis of such data. We also demonstrate how the new approach can be practically used to investigate important research questions such as whether rater severity is stable across rating tasks. The merits of the new approach, and the consequences for practice are discussed. (As Provided). |
Anmerkungen | SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com |
Erfasst von | ERIC (Education Resources Information Center), Washington, DC |
Update | 2020/1/01 |