Evidence of the Generalization and Construct Representation Inferences for the "GRE"® Revised General Test Sentence Equivalence Item Type. ETS GRE® Board Research Report. ETS GRE®-17-02. ETS Research Report. RR-17-05

Autor/inn/en	Bejar, Isaac I.; Deane, Paul D.; Flor, Michael; Chen, Jing
Titel	Evidence of the Generalization and Construct Representation Inferences for the "GRE"® Revised General Test Sentence Equivalence Item Type. ETS GRE® Board Research Report. ETS GRE®-17-02. ETS Research Report. RR-17-05
Quelle	In: ETS Research Report Series, (2017), (27 Seiten)Infoseite zur Zeitschrift PDF als Volltext kostenfreie Datei Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	2330-8516
Schlagwörter	College Entrance Examinations; Graduate Study; Generalization; Inferences; Test Items; Sentences; Evidence; Vocabulary; Test Validity; Scores; Test Construction; Difficulty Level; Psychometrics; Syntax; Semantics; Word Frequency; Item Response Theory; Familiarity; Prediction; Models; Regression (Statistics); Statistical Analysis; Graduate Record Examinations + Suchen Sie Ihr Suchwort? Aufnahmeprüfung; Aufbaustudium; Graduiertenstudium; Hauptstudium; Inference; Inferenz; Test content; Testaufgabe; Sentence analysis; Satzanalyse; Evidenz; Wortschatz; Testvalidität; Testaufbau; Schwierigkeitsgrad; Psychometry; Psychometrie; Semantik; Word analysis; Frequency; Wortanalyse; Häufigkeit; Item-Response-Theorie; Vorhersage; Analogiemodell; Regression; Regressionsanalyse; Statistische Analyse
Abstract	The report is the first systematic evaluation of the sentence equivalence item type introduced by the "GRE"® revised General Test. We adopt a validity framework to guide our investigation based on Kane's approach to validation whereby a hierarchy of inferences that should be documented to support score meaning and interpretation is evaluated. We present evidence relevant to the generalization inference as well as evidence of construct representation. We analyzed the pool of sentence equivalence items in three studies. The first and second studies focused on the generalization inference and sought to document the construction principles behind the sentence equivalence items, specifically the nature of the vocabulary tested. The third study focused on construct representation and evaluated the contribution of the stem, the keys, and the distractors to item difficulty. We concluded that the vocabulary tested by the sentence equivalence items is appropriate given the purpose of the GRE, namely, to assist in the selection of graduate students. The difficulty of the items was shown to be, in part, a function of the familiarity of the vocabulary as well as the context in which the vocabulary is tested, which we argue is positive validity evidence. (As Provided).
Anmerkungen	Educational Testing Service. Rosedale Road, MS19-R Princeton, NJ 08541. Tel: 609-921-9000; Fax: 609-734-5410; e-mail: RDweb@ets.org; Web site: https://www.ets.org/research/policy_research_reports/ets
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01