A Comparison of Traditional Test Blueprinting and Item Development to Assessment Engineering in a Licensure Context

Autor/in	Masters, James S.
Titel	A Comparison of Traditional Test Blueprinting and Item Development to Assessment Engineering in a Licensure Context
Quelle	(2010), (119 Seiten) PDF als Volltext Verfügbarkeit Ph.D. Dissertation, The University of North Carolina at Greensboro
Sprache	englisch
Dokumenttyp	gedruckt; online; Monographie
ISBN	978-1-1097-7381-1
Schlagwörter	Hochschulschrift; Dissertation; Test Items; Adaptive Testing; Pretesting; Program Effectiveness; Psychometrics; Comparative Analysis; Item Banks; Test Construction; Item Response Theory; Licensing Examinations (Professions) + Suchen Sie Ihr Suchwort? Thesis; Dissertations; Academic thesis; Test content; Testaufgabe; Vortest; Psychometry; Psychometrie; Testaufbau; Item-Response-Theorie
Abstract	With the need for larger and larger banks of items to support adaptive testing and to meet security concerns, large-scale item generation is a requirement for many certification and licensure programs. As part of the mass production of items, it is critical that the difficulty and the discrimination of the items be known without the need for pretesting. One approach to solving this need is item templating, an assessment engineering (AE) approach that is intended to control item difficulty and other psychometric operating characteristics for a class of items developed from each template. There are important advantages that can accrue to having exchangeable items that operate in a psychometrically similar manner in terms of item bank development (reduced time and lower cost to develop), pretesting efficiency, test security, and so forth. This study describes one method to use AE and item templates in a licensure context to yield sets of items with statistical characteristics that match the needs of the program with reduced need for pilot testing. It is shown that item variants developed in this method fit the Rasch calibration/scoring model as well, if not better than items developed in traditional ways and that the item variants from the same template yield similar classical and IRT statistics. One key result of the study is a method to use AE to evaluate the performance of item writers over time. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com/en-US/products/dissertations/individuals.shtml.] (As Provided).
Anmerkungen	ProQuest LLC. 789 East Eisenhower Parkway, P.O. Box 1346, Ann Arbor, MI 48106. Tel: 800-521-0600; Web site: http://www.proquest.com/en-US/products/dissertations/individuals.shtml
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10