The Construction and Validation of a Q-Matrix for a High-Stakes Reading Comprehension Test: A G-DINA Study

Autor/inn/en	Tonekaboni, Fateme Roohani; Ravand, Hamdollah; Rezvani, Reza
Titel	The Construction and Validation of a Q-Matrix for a High-Stakes Reading Comprehension Test: A G-DINA Study
Quelle	In: International Journal of Language Testing, 11 (2021) 1, S.58-87 (30 Seiten) PDF als Volltext kostenfreie Datei Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	2476-5880
Schlagwörter	Reading Comprehension; Reading Tests; High Stakes Tests; Inferences; Test Validity; Cognitive Processes; Guidelines; Item Analysis; Test Items; Specialists; Test Construction; Diagnostic Tests; College Entrance Examinations; English (Second Language); Second Language Learning; Second Language Instruction; College Second Language Programs; Masters Programs; Multiple Choice Tests; Reading Rate; Foreign Countries; Iran + Suchen Sie Ihr Suchwort? Leseverstehen; Lesetest; Inference; Inferenz; Testvalidität; Cognitive process; Kognitiver Prozess; Richtlinien; Itemanalyse; Test content; Testaufgabe; Testaufbau; Diagnostic test; Diagnostischer Test; Aufnahmeprüfung; English as second language; English; Second Language; Englisch als Zweitsprache; Zweitsprachenerwerb; Fremdsprachenunterricht; Magister course; Magisterstudiengang; Multiple choice examinations; Multiple-choice tests, Multiple-choice examinations; Multiple-Choice-Verfahren; Reading readiness; Reading speed; Lesegeschwindigkeit; Ausland
Abstract	Investigating the processes underlying test performance is a major source of data supporting the explanation inference in the validity argument (Chappelle, 2021). One way of modeling the cognitive processes underlying test performance is by constructing a Q-matrix, which is essentially about summarizing the attributes explaining test-takers' response behavior. The current study documents the construction and validation of a Q-matrix for a high stakes test of reading within a generalized-deterministic inputs, noisy "and" gate (G-DINA) model framework. To this end, the attributes underlying the 20 items of the reading comprehension test were specified through retrospective verbal reports and domain experts' judgments. In the ensuing stage, the Q-matrix thus developed along with item response data of 2625 test-takers were subjected to empirical analysis using the procedure suggested by de la Torre and Chiu (2016). Item-level results showed that, except for one item, the processes underlying the other items were captured by compensatory and additive models. This finding has significant implications for model selection for DCM practitioners. (As Provided).
Anmerkungen	Tabaran Institute of Higher Education. Shariati 60, Shariati Blvd, Ghasem Abad, Mashhad, Khorasan Razavi, Iran. Tel: +98 (51) 35227215; e-mail: ijlt@tabaran.ac.ir; Web site: http://www.ijlt.ir/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01