Literaturnachweis - Detailanzeige
Autor/in | Corradi, David |
---|---|
Titel | Excellence Bias Related to Rating Scales with Summative Jury Assessment |
Quelle | In: Assessment & Evaluation in Higher Education, 48 (2023) 5, S.627-641 (15 Seiten)Infoseite zur Zeitschrift
PDF als Volltext |
Zusatzinformation | ORCID (Corradi, David) |
Sprache | englisch |
Dokumenttyp | gedruckt; online; Zeitschriftenaufsatz |
ISSN | 0260-2938 |
DOI | 10.1080/02602938.2022.2112653 |
Schlagwörter | Court Litigation; Educational Practices; Higher Education; Rating Scales; Summative Evaluation; Student Evaluation; Competence; Psychometrics; Item Response Theory; Test Validity; Test Reliability; Test Bias; Scoring Rubrics |
Abstract | Juries are a high-stake practice in higher education to assess complex competencies. However common, research remains behind in detailing the psychometric qualities of juries, especially when using rubrics or rating scales as an assessment tool. In this study, I analyze a case of a jury assessment (N = 191) of product development where both internal teaching staff and external judges assess and fill in an analytic rating scale. Using polytomous item response theory (IRT) analysis developed for the analysis of heterogeneous juries (i.e. jury response theory or JRT), this study attempts to provide insight into the validity and reliability of the used assessment tool. The results indicate that JRT helps detect unreliable response patterns that indicate an excellence bias, i.e. a tendency not to score in the highest response category. This article concludes with a discussion on how to counter such bias when using rating scales or rubrics for summative assessment. (As Provided). |
Anmerkungen | Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals |
Erfasst von | ERIC (Education Resources Information Center), Washington, DC |
Update | 2024/1/01 |