A Psychometric Analysis of Signal Detection Measures from Ratings versus Repeated and Nonrepeated Forced Choices

Autor/inn/en	Macho, Siegfried; Ledermann, Thomas
Titel	A Psychometric Analysis of Signal Detection Measures from Ratings versus Repeated and Nonrepeated Forced Choices
Quelle	In: Journal of Experimental Psychology: Learning, Memory, and Cognition, 48 (2022) 12, S.1923-1946 (24 Seiten) PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Macho, Siegfried)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0278-7393
DOI	10.1037/xlm0001043
Schlagwörter	Psychometrics; Measures (Individuals); Recognition (Psychology); Memory; Familiarity; Accuracy; Models; Measurement Techniques; Evaluation Criteria; College Students; Foreign Countries; Switzerland + Suchen Sie Ihr Suchwort? Psychometry; Psychometrie; Messdaten; Recognition; Wiedererkennen; Gedächtnis; Analogiemodell; Messtechnik; Collegestudent; Ausland; Schweiz
Abstract	An analysis of the covariance and mean structure of signal detection measures for assessing recognition performance was conducted using data from ratings and repeated k-alternative forced choices (k-AFC). Measures were parameters of the unequal variance signal detection (UVSDT) and dual process signal detection (DPSDT) model and functions thereof, as well as area measures computed from the empirical receiver operating characteristic (ROC) curve. General sensitivity measures computed from UVSDT model parameters revealed reliabilities of about 0.70 based on 120 test trials. Doubling the number of test trials did not result in a substantial increase of reliability. Halving the number of test trials reduced the reliabilities to about 0.60. General sensitivity measures based on estimated parameters of the SDT models were slightly more favorable to measures based on the empirical ROC curve. General sensitivity measures resulting from different tasks exhibited similar reliabilities yet differed in size, with the measures from repeated k-AFC tasks being lower than those from the rating tasks. Considering the first selection of the k-AFC tasks only, assuming equal variance of the old and new familiarity distribution, resulted in sensitivity measures of similar size and reliability as those resulting from the rating tasks. Measures d' (familiarity-based sensitivity) and [rho] (recollection probability) of the DPSDT model revealed reliabilities that were, in general, inacceptable low. This was particularly pronounced for the measures from the k-AFC tasks. The joint analysis of d' and [rho] of the DPSDT model revealed that both measure the same latent construct. (As Provided).
Anmerkungen	American Psychological Association. Journals Department, 750 First Street NE, Washington, DC 20002. Tel: 800-374-2721; Tel: 202-336-5510; Fax: 202-336-5502; e-mail: order@apa.org; Web site: http://www.apa.org
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01