When Is Deep Learning the Best Approach to Knowledge Tracing?

Autor/inn/en	Gervet, Theophile; Koedinger, Ken; Schneider, Jeff; Mitchell, Tom
Titel	When Is Deep Learning the Best Approach to Knowledge Tracing?
Quelle	In: Journal of Educational Data Mining, 12 (2020) 3, S.31-54 (24 Seiten) PDF als Volltext kostenfreie Datei Verfügbarkeit
Zusatzinformation	ORCID (Gervet, Theophile) ORCID (Schneider, Jeff) ORCID (Mitchell, Tom)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	2157-2100
Schlagwörter	Learning Processes; Intelligent Tutoring Systems; Feedback (Response); Knowledge Level; Prediction; Markov Processes; Comparative Analysis; Data Analysis; Bayesian Statistics; Academic Achievement + Suchen Sie Ihr Suchwort? Learning process; Lernprozess; Intelligentes Tutorsystem; Wissensbasis; Vorhersage; Markowscher Prozess; Auswertung; Schulleistung
Abstract	Intelligent tutoring systems (ITSs) teach skills using learning-by-doing principles and provide learners with individualized feedback and materials adapted to their level of understanding. Given a learner's history of past interactions with an ITS, a learner performance model estimates the current state of a learner's knowledge and predicts her future performance. The advent of increasingly large scale datasets has turned deep learning models for learner performance prediction into competitive alternatives to classical Markov process and logistic regression models. In an extensive empirical comparison on nine real-world datasets, we ask which approach makes the most accurate predictions and in what conditions. Logistic regression--with the right set of features--leads on datasets of moderate size or containing or containing a very large number of interactions per student, whereas Deep Knowledge Tracing leads on datasets of large size or where precise temporal information matters most. Markov process methods, like Bayesian Knowledge Tracing, lag behind other approaches. We follow this analysis with ablation studies to determine what components of leading algorithms explain their performance and a discussion of model calibration (reliability), which is crucial for downstream applications of learner performance prediction models. (As Provided).
Anmerkungen	International Educational Data Mining. e-mail: jedm.editor@gmail.com; Web site: http://jedm.educationaldatamining.org/index.php/JEDM
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01