Numerical Differentiation Methods for Computing Error Covariance Matrices in Item Response Theory Modeling: An Evaluation and a New Proposal

Autor/inn/en	Tian, Wei; Cai, Li; Thissen, David; Xin, Tao
Titel	Numerical Differentiation Methods for Computing Error Covariance Matrices in Item Response Theory Modeling: An Evaluation and a New Proposal
Quelle	In: Educational and Psychological Measurement, 73 (2013) 3, S.412-439 (28 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	Weitere Informationen
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0013-1644
DOI	10.1177/0013164412465875
Schlagwörter	Item Response Theory; Computation; Matrices; Statistical Inference; Numbers; Accuracy; Mathematics; College Entrance Examinations; Simulation; Mathematics Tests; Maximum Likelihood Statistics; Monte Carlo Methods; Law School Admission Test; Program for International Student Assessment + Suchen Sie Ihr Suchwort? Item-Response-Theorie; Matrizenrechnung; Inferential statistics; Schließende Statistik; Zahlenraum; Mathematik; Aufnahmeprüfung; Simulation program; Simulationsprogramm; Monte-Carlo-Methode; Law school; Assessment; Admission criteria; Admission procedures; Rechtswissenschaft; Fachbereich; Eignungsprüfung; Eignungstest; Hochschulzulassung
Abstract	In item response theory (IRT) modeling, the item parameter error covariance matrix plays a critical role in statistical inference procedures. When item parameters are estimated using the EM algorithm, the parameter error covariance matrix is not an automatic by-product of item calibration. Cai proposed the use of Supplemented EM algorithm for computing the item parameter error covariance matrix. This method has been subsequently implemented in commercial IRT software programs such as IRTPRO and flexMIRT. Jamshidian and Jennrich noted that Supplemented EM is among a class of methods based on numerically differentiating the EM map, and they proposed noniterative alternatives, such as forward difference and Richardson extrapolation, that are mathematically simpler and may lead to a reduction in computational burden when compared with Supplemented EM. However, the relative merits of the various numerical differentiation methods have not been evaluated in the context of IRT modeling. We perform such an evaluation, using both simulated and empirical data. It is found that the accuracy of the simpler noniterative alternatives is heavily dependent on the choice of the numerical differentiation perturbation constants. On the other hand, Supplemented EM consistently maintains accuracy and does not require the selection of perturbation constants. Furthermore, when implemented with an adaptive iteration scheme, an updated Supplemented EM algorithm can be as computationally efficient as the alternatives. The expected (Fisher) information matrix, while accurate, requires too heavy computation for realistic test lengths. Therefore, we recommend the routine use of the updated Supplemented EM algorithm in IRT applications. (Contains 5 tables and 2 figures.) (As Provided).
Anmerkungen	SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10