A General Diagnostic Model Applied to Language Testing Data. Research Report. ETS RR-05-16

Autor/in	von Davier, Matthias
Titel	A General Diagnostic Model Applied to Language Testing Data. Research Report. ETS RR-05-16
Quelle	In: ETS Research Report Series, (2005), (39 Seiten)Infoseite zur Zeitschrift PDF als Volltext kostenfreie Datei Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	2330-8516
Schlagwörter	Models; Diagnostic Tests; Language Tests; Language Proficiency; Generalization; Markov Processes; Monte Carlo Methods; Maximum Likelihood Statistics; Item Response Theory; Multivariate Analysis; Simulation; Computer Assisted Testing; English (Second Language); Second Language Learning; Profiles; Language Skills; Test Items; Test of English as a Foreign Language + Suchen Sie Ihr Suchwort? Analogiemodell; Diagnostic test; Diagnostischer Test; Language test; Sprachtest; Language skill; Language skills; Sprachkompetenz; Markowscher Prozess; Monte-Carlo-Methode; Item-Response-Theorie; Multivariate Analyse; Simulation program; Simulationsprogramm; English as second language; English; Second Language; Englisch als Zweitsprache; Zweitsprachenerwerb; Charakterisierung; Profilanalyse; Test content; Testaufgabe
Abstract	Probabilistic models with more than one latent variable are designed to report profiles of skills or cognitive attributes. Testing programs want to offer additional information beyond what a single test score can provide using these skill profiles. Many recent approaches to skill profile models are limited to dichotomous data and have made use of computationally intensive estimation methods like the Markov chain Monte Carlo (MCMC), since standard maximum likelihood (ML) estimation techniques were deemed infeasible. This paper presents a class of general diagnostic models (GDMs) that can be estimated with customary ML techniques and applies to polytomous response variables as well as to skills with two or more proficiency levels. The model and the algorithm for estimating model parameters handles directly missing responses without the need of collapsing categories or recording the data. Within the class of GDMs, compensatory as well as noncompensatory models may be specified. This report uses one member of this class of diagnostic models, a compensatory diagnostic model that is parameterized similar to the generalized partial credit model (GPCM). Many well-known models, such as uni- and multivariate versions of the Rasch model and the two parameter logistic item response theory (2PL-IRT) model, the GPCM, and the FACETS model, as well as a variety of skill profile models, are special cases of this member of the class of GDMs. This paper describes an algorithm that capitalizes on using tools from item response theory for scale linking, item fit, and parameter estimation. In addition to an introduction to the class of GDMs and to the partial credit instance of this class for dichotomous and polytomous skill proles, this paper presents a parameter recovery study using simulated data and an application to real data from the field test for TOEFL® Internet-based testing (iBT). (As Provided).
Anmerkungen	Educational Testing Service. Rosedale Road, MS19-R Princeton, NJ 08541. Tel: 609-921-9000; Fax: 609-734-5410; e-mail: RDweb@ets.org; Web site: https://www.ets.org/research/policy_research_reports/ets
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01