Exploring Latent States of Problem-Solving Competence Using Hidden Markov Model on Process Data

Autor/inn/en	Xiao, Yue; He, Qiwei; Veldkamp, Bernard; Liu, Hongyun
Titel	Exploring Latent States of Problem-Solving Competence Using Hidden Markov Model on Process Data
Quelle	In: Journal of Computer Assisted Learning, 37 (2021) 5, S.1232-1247 (16 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Xiao, Yue) ORCID (He, Qiwei) ORCID (Veldkamp, Bernard) ORCID (Liu, Hongyun)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0266-4909
DOI	10.1111/jcal.12559
Schlagwörter	Problem Solving; Competence; Markov Processes; Test Wiseness; Cognitive Processes; Test Items; Adults; Program for the International Assessment of Adult Competencies (PIAAC) + Suchen Sie Ihr Suchwort? Problemlösen; Kompetenz; Markowscher Prozess; Cognitive process; Kognitiver Prozess; Test content; Testaufgabe
Abstract	The response process of problem-solving items contains rich information about respondents' behaviours and cognitive process in the digital tasks, while the information extraction is a big challenge. The aim of the study is to use a data-driven approach to explore the latent states and state transitions underlying problem-solving process to reflect test-takers' behavioural patterns, and to investigate how these states and state transitions could be associated with test-takers' performance. We employed the Hidden Markov Modelling approach to identify test takers' hidden states during the problem-solving process and compared the frequency of states and/or state transitions between different performance groups. We conducted comparable studies in two problem-solving items with a focus on the US sample that was collected in PIAAC 2012, and examined the correlation between those frequencies from two items. Latent states and transitions between them underlying the problem-solving process were identified and found significantly different by performance groups. The groups with correct responses in both items were found more engaged in tasks and more often to use efficient tools to solve problems, while the group with incorrect responses was found more likely to use shorter action sequences and exhibit hesitative behaviours. Consistent behavioural patterns were identified across items. This study demonstrates the value of data-driven based HMM approach to better understand respondents' behavioural patterns and cognitive transmissions underneath the observable action sequences in complex problem-solving tasks. (As Provided).
Anmerkungen	Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01