Benchmark Rating Procedure, Best of Both Worlds? Comparing Procedures to Rate Text Quality in a Reliable and Valid Manner

Autor/inn/en	Bouwer, Renske; Koster, Monica; van den Bergh, Huub
Titel	Benchmark Rating Procedure, Best of Both Worlds? Comparing Procedures to Rate Text Quality in a Reliable and Valid Manner
Quelle	In: Assessment in Education: Principles, Policy & Practice, 30 (2023) 3-4, S.302-319 (18 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Bouwer, Renske) ORCID (van den Bergh, Huub)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0969-594X
DOI	10.1080/0969594X.2023.2241656
Schlagwörter	Benchmarking; Writing Evaluation; Evaluation Methods; Elementary School Students; Holistic Approach; Scores; Reliability + Suchen Sie Ihr Suchwort? Holistischer Ansatz; Reliabilität
Abstract	Assessing students' writing performance is essential to adequately monitor and promote individual writing development, but it is also a challenge. The present research investigates a benchmark rating procedure for assessing texts written by upper-elementary students. In two studies we examined whether a benchmark rating procedure (1) leads to reliable and generalisable scores that converge with holistic and analytic ratings, and (2) can be used for rating texts varying in topic and genre. Results support evidence that benchmark ratings are a valid indicator of text quality as they converge with holistic and analytic scores. They are also associated with less rater variance and less task-specific variance, leading to reliable and generalisable ratings. Moreover, a benchmark scale can be used for rating different tasks with the same reliability, at least when texts are written in the same genre. Taken together, a benchmark rating procedure ensures meaningful and useful information on students' writing. (As Provided).
Anmerkungen	Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01