Person Misfit and Person Reliability in Rating Scale Measures: The Role of Response Styles

Autor/inn/en	Zou, Tongtong; Bolt, Daniel M.
Titel	Person Misfit and Person Reliability in Rating Scale Measures: The Role of Response Styles
Quelle	In: Measurement: Interdisciplinary Research and Perspectives, 21 (2023) 3, S.167-180 (14 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1536-6367
DOI	10.1080/15366367.2022.2114243
Schlagwörter	Item Response Theory; Rating Scales; Response Style (Tests); Measurement; Test Reliability; Test Validity; Goodness of Fit; Personality Traits; Extraversion Introversion + Suchen Sie Ihr Suchwort? Item-Response-Theorie; Rating-Skala; Antwortverhalten; Messverfahren; Testreliabilität; Testvalidität; Individual characteristics; Personality characteristic; Persönlichkeitsmerkmal
Abstract	Person misfit and person reliability indices in item response theory (IRT) can play an important role in evaluating the validity of a test or survey instrument at the respondent level. Prior empirical comparisons of these indices have been applied to binary item response data and suggest that the two types of indices return very similar results. In this paper, however, we demonstrate an important applied distinction between these methods when applied to polytomously-scored rating scale items, namely their varying sensitivities to response style tendencies. Using several empirical datasets, we illustrate settings in which these indices are in one case highly correlated and in two other cases weakly correlated. In the datasets showing a weak correlation between indices, the primary distinction appears due to the effects of response style behavior, whereby respondents whose response styles are less common (e.g. a disproportionate selection of the midpoint response) are found to misfit using Drasgow et al's l[subscript z] person misfit index, but often show high levels of reliability from a person reliability perspective; just the opposite frequently occurs for respondents that over-select the rating scale extremes. It is suggested that person misfit reporting should be supplemented with an evaluation of person reliability to best understand the validity of measurement at the respondent level when using IRT models with rating scale measures. (As Provided).
Anmerkungen	Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01