Specifying and Refining a Measurement Model for a Computer-Based Interactive Assessment

Autor/inn/en	Levy, Roy; Mislevy, Robert J.
Titel	Specifying and Refining a Measurement Model for a Computer-Based Interactive Assessment
Quelle	In: International Journal of Testing, 4 (2004) 4, S.333-369 (37 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1530-5058
Schlagwörter	Computer Assisted Testing; Markov Processes; Computer Networks; Bayesian Statistics; Item Response Theory; Test Items; Student Evaluation; Knowledge Level + Suchen Sie Ihr Suchwort? Markowscher Prozess; Computernetz; Computernetze; Kommunikationsnetz; Item-Response-Theorie; Test content; Testaufgabe; Schulnote; Studentische Bewertung; Wissensbasis
Abstract	The challenges of modeling students' performance in computer-based interactive assessments include accounting for multiple aspects of knowledge and skill that arise in different situations and the conditional dependencies among multiple aspects of performance. This article describes a Bayesian approach to modeling and estimating cognitive models in such situations, both in terms of statistical machinery and actual instrument development. The method taps the knowledge of experts to provide initial estimates for the probabilistic relations among the variables in a multivariate latent variable model and refines these estimates using Markov chain Monte Carlo procedures. This process is illustrated in the context of Networking Performance Skill System (NetPASS), a computer-based interactive assessment in the domain of computer networking. We describe a parameterization of the relations in NetPASS via an ordered polytomous item-response model and detail the updating of the model with observed data via Bayesian statistical procedures ultimately being provided by Markov chain Monte Carlo estimation. (Author).
Anmerkungen	Lawrence Erlbaum Associates, Inc., Journal Subscription Department, 10 Industrial Avenue, Mahwah, NJ 07430-2262. Tel: 800-926-6579 (Toll Free); e-mail: journals@erlbaum.com.
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10