Literaturnachweis - Detailanzeige
Autor/inn/en | Howell, Heather; Phelps, Geoffrey; Croft, Andrew J.; Kirui, David; Gitomer, Drew |
---|---|
Titel | Cognitive Interviews as a Tool for Investigating the Validity of Content Knowledge for Teaching Assessments. Research Report. ETS RR-13-19 |
Quelle | In: ETS Research Report Series, (2013), (106 Seiten)Infoseite zur Zeitschrift
PDF als Volltext |
Sprache | englisch |
Dokumenttyp | gedruckt; online; Zeitschriftenaufsatz |
ISSN | 2330-8516 |
Schlagwörter | Interviews; Knowledge Base for Teaching; Test Validity; Elementary School Teachers; Mathematics Teachers; English Teachers; Scores; Coding; Inferences; Language Arts; Grade 4; Grade 5; Grade 6 Interviewing; Interviewtechnik; Teaching theory; Theory of teaching; Unterrichtstheorie; Testvalidität; Elementary school; Teacher; Teachers; Grundschule; Volksschule; Lehrer; Lehrerin; Lehrende; Mathematics; Mathematik; English language lessons; Englischunterricht; Codierung; Programmierung; Inference; Inferenz; Sprachkultur; School year 04; 4. Schuljahr; Schuljahr 04; School year 05; 5. Schuljahr; Schuljahr 05; School year 06; 6. Schuljahr; Schuljahr 06 |
Abstract | This report provides a description of a cognitive interview study investigating validity of assessments designed to measure "content knowledge for teaching" (CKT). The report is intended both to provide information on the validity of the CKT measures and to provide guidance to researchers interested in replicating the design. The study takes an argument-based approach to investigating validity by first articulating interpretive arguments that are central to the CKT measurement theory and then using the cognitive interview data to evaluate these arguments (Kane, 2006). The study is based on 30 interviews of elementary mathematics teachers and 30 interviews of elementary English language arts teachers. Teachers were selected using previous CKT assessment scores to represent high- and low-scoring groups for each subject. The cognitive interviews were conducted separately for each subject and responses were coded and then analyzed to investigate the scoring and extrapolation inferences for the validity argument. Findings strongly support the scoring inference, providing evidence that the item keying for the items is correct. Results also indicate that the participants reasoned about the item in ways that conformed with the reasoning outlined in the "task design rationales" (TDR) for each item. These TDRs represent what reasoning should look like for each of these items for a respondent drawing on the desired CKT knowledge. As such, conformity with the TDRs supports the extrapolation inference, providing evidence that the reasoning used by the participant represents the underlying knowledge and skill domain we intend to measure through CKT assessments. The study design, instruments, methods, and results are described in detail, with discussion included to support researchers interested in replicating or capitalizing on the study design. (As Provided). |
Anmerkungen | Educational Testing Service. Rosedale Road, MS19-R Princeton, NJ 08541. Tel: 609-921-9000; Fax: 609-734-5410; e-mail: RDweb@ets.org; Web site: https://www.ets.org/research/policy_research_reports/ets |
Erfasst von | ERIC (Education Resources Information Center), Washington, DC |
Update | 2020/1/01 |