The Affordances of Multivariate Elo-Based Learner Modeling in Game-Based Assessment

Autor/inn/en	Ruiperez-Valiente, Jose A.; Kim, Yoon Jeon; Baker, Ryan S.; Martinez, Pedro A.; Lin, Grace C.
Titel	The Affordances of Multivariate Elo-Based Learner Modeling in Game-Based Assessment
Quelle	In: IEEE Transactions on Learning Technologies, 16 (2023) 2, S.152-165 (14 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Ruiperez-Valiente, Jose A.)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
DOI	10.1109/TLT.2022.3203912
Schlagwörter	Affordances; Game Based Learning; Student Evaluation; Multivariate Analysis; Educational Technology; Task Analysis; Computation; Learning Analytics; Geometry; Puzzles; Algorithms + Suchen Sie Ihr Suchwort? Schulnote; Studentische Bewertung; Multivariate Analyse; Unterrichtsmedien; Aufgabenanalyse; Geometrie; Legespiel; Algorithm; Algorithmus
Abstract	Previous research and experiences have indicated the potential that games have in educational settings. One of the possible uses of games in education is as game-based assessments (GBA), using game tasks to generate evidence about skills and content knowledge that can be valuable. There are different approaches in the literature to implement the assessment machinery of these GBA, all of them having strengths and drawbacks. In this article, we propose using multivariate Elo-based learner modeling, as we believe it has a strong potential in the context of GBA for three aims: first, to simultaneously measure students competence across several knowledge components in a game; second, to predict task performance; and finally, to estimate task difficulty within the game. To do so, we present our GBA Shadowspect, which is focused on solving geometry puzzles, and we depict our implementation using data collected from several high schools across the USA. We obtain high-performing results (AUC of 0.87) and demonstrate that the model enables analysis of how each student's competency evolves after each puzzle attempt. Moreover, the model provides accurate estimations of each task's difficulty, enabling iterative improvement of the game design. This study highlights the potential that multivariate Elo-based learner modeling has within the context of GBA, sharing lessons learned, and encouraging future researchers in the field to consider this algorithm to build their assessment machinery. (As Provided).
Anmerkungen	Institute of Electrical and Electronics Engineers, Inc. 445 Hoes Lane, Piscataway, NJ 08854. Tel: 732-981-0060; Web site: http://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=4620076
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01