Investigating the Consistency between Students' and Teachers' Ratings for the Assessment of Problem-Solving Skills with Many-Facet Rasch Measurement Model

Autor/inn/en	Saritas Akyol, Seyhan; Karakaya, Ismail
Titel	Investigating the Consistency between Students' and Teachers' Ratings for the Assessment of Problem-Solving Skills with Many-Facet Rasch Measurement Model
Quelle	In: Eurasian Journal of Educational Research, (2021) 91, S.281-300 (20 Seiten) PDF als Volltext kostenfreie Datei Verfügbarkeit
Zusatzinformation	ORCID (Saritas Akyol, Seyhan) ORCID (Karakaya, Ismail)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1302-597X
Schlagwörter	Problem Solving; Item Response Theory; Self Evaluation (Individuals); Peer Evaluation; Secondary School Students; Grade 6; Secondary School Teachers; Student Evaluation; Foreign Countries; Secondary School Mathematics; Interrater Reliability; Turkey (Ankara) + Suchen Sie Ihr Suchwort? Problemlösen; Item-Response-Theorie; Sekundarschüler; School year 06; 6. Schuljahr; Schuljahr 06; Schulnote; Studentische Bewertung; Ausland; Interrater-Reliabilität
Abstract	Purpose: To assess students' problem-solving skills, this study aims to investigate the consistency between self- and peer-ratings in consideration of the teachers' ratings in the process. Method: This study was a descriptive study which examines the mathematical problem-solving skills with the MFRM model concerning self-, peer- and teachers' ratings. The study group consisted of 57 sixth grade students studying in a secondary school in Ankara. The data collection procedure was as follows: i) the students were trained in how to use rubric during the first week, ii) they practiced the rubric and a performance task in the second week and, iii) three performance tasks were applied in the following consecutively. These tasks included non-routine problem situations and two analytical rubrics were developed. For data analysis, student, steps, rater type, and task were determined as facets and rater was defined as dummy facet, and reliability statistics related to each facet were estimated. Findings: Ratings of performance tasks obtained from three-week data collection had high reliability coefficients according to MFRM modeling. The findings showed that self-, peer- and teachers' ratings vary in terms of generosity/severity according to the weeks given the rater types. Generally, self-raters were the most generous raters, whereas teachers were the most severe raters. In addition, generosity/severity of peer-raters gets closer to generosity/severity of teachers from the first task to the third one. Implications for Research and Practice: This research strengthens the possibility that peer-rating can provide reliable rating through appropriate training and practices. (As Provided).
Anmerkungen	ANI Publishing Company. Kizilirmak Sokak 10/A Bakanliklar, Ankara, Turkey 06440. Tel: +90-312-425-8150; Fax: +90-312-425-8111; e-mail: aniyayincilik@aniyayincilik.com.tr; Web site: http://www.ejer.com.tr
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01