Literaturnachweis - Detailanzeige
| Autor/inn/en | Forthmann, Boris; Förster, Natalie; Schütze, Birgit; Hebbecker, Karin; Flessner, Janis; Peters, Martin T.; Souvignier, Elmar |
|---|---|
| Titel | How Much "g" Is in the Distractor? Re-Thinking Item-Analysis of Multiple-Choice Items |
| Quelle | In: Journal of Intelligence, 8 (2020), Artikel 11 (36 Seiten)
PDF als Volltext kostenfreie Datei |
| Zusatzinformation | ORCID (Forthmann, Boris) ORCID (Hebbecker, Karin) ORCID (Peters, Martin T.) |
| Dokumenttyp | gedruckt; online; Zeitschriftenaufsatz |
| ISSN | 2079-3200 |
| Schlagwörter | Test Items; Item Analysis; Multiple Choice Tests; Intelligence Tests; Undergraduate Students; Business Schools; Foreign Countries; Difficulty Level; Cognitive Processes; Effect Size; France; Raven Progressive Matrices |
| Abstract | Distractors might display discriminatory power with respect to the construct of interest (e.g., intelligence), which was shown in recent applications of nested logit models to the short-form of Raven's progressive matrices and other reasoning tests. In this vein, a simulation study was carried out to examine two effect size measures (i.e., a variant of Cohen's [omega] and the canonical correlation R[subscript CC]) for their potential to detect distractors with ability-related discriminatory power. The simulation design was adopted to item selection scenarios relying on rather small sample sizes (e.g., N = 100 or N = 200). Both suggested effect size measures (Cohen's [omega] only when based on two ability groups) yielded acceptable to conservative type-I-error rates, whereas, the canonical correlation outperformed Cohen's [omega] in terms of empirical power. The simulation results further suggest that an effect size threshold of 0.30 is more appropriate as compared to more lenient (0.10) or stricter thresholds (0.50). The suggested item-analysis procedure is illustrated with an analysis of twelve Raven's progressive matrices items in a sample of N = 499 participants. Finally, strategies for item selection for cognitive ability tests with the goal of scaling by means of nested logit models are discussed. (As Provided). |
| Anmerkungen | MDPI AG. Klybeckstrasse 64, 4057 Basel, Switzerland. e-mail: indexing@mdpi.com; e-mail: jintelligence@mdpi.com; Web site: https://www.mdpi.com/journal/jintelligence |
| Erfasst von | ERIC (Education Resources Information Center), Washington, DC |
| Update | 2024/1/01 |
Literaturbeschaffung und Bestandsnachweise in Bibliotheken prüfen
Permalink als QR-Code
Inhalt auf sozialen Plattformen teilen (nur vorhanden, wenn Javascript eingeschaltet ist)
Teile diese Seite:
