The Reliability of Simultaneous versus Individual Data Collection during Stuttering Assessment

Autor/inn/en	Davidow, Jason H.; Ye, Jun; Edge, Robin L.
Titel	The Reliability of Simultaneous versus Individual Data Collection during Stuttering Assessment
Quelle	In: International Journal of Language & Communication Disorders, 58 (2023) 4, S.1251-1267 (17 Seiten) PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Davidow, Jason H.)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1368-2822
DOI	10.1111/1460-6984.12860
Schlagwörter	Graduate Students; Measurement; Reliability; Group Activities; Stuttering; Measures (Individuals); Data Collection; Methods; Incidence; Error of Measurement; Verbal Communication; Time; Control Groups; Interrater Reliability; Evaluation; Speech Impairments + Suchen Sie Ihr Suchwort? Graduate Study; Student; Students; Aufbaustudium; Graduiertenstudium; Hauptstudium; Studentin; Messverfahren; Reliabilität; Gruppenaktivität; Stammer; Stottern; Messdaten; Data capture; Datensammlung; Method; Methode; Vorkommen; Messfehler; Zeit; Interrater-Reliabilität; Evaluierung; Speech impairment; Speech handicap; Speech handicaps; Language handicps; Language impairments; Sprachbehinderung
Abstract	Background: Speech-language pathologists often multitask in order to be efficient with their commonly large caseloads. In stuttering assessment, multitasking often involves collecting multiple measures simultaneously. Aims: The present study sought to determine reliability when collecting multiple measures simultaneously versus individually. Methods & Procedures: Over two time periods, 50 graduate students viewed videos of four persons who stutter (PWS) and counted the number of stuttered syllables and total number of syllables uttered, and rated speech naturalness. Students were randomly assigned to one of two groups: the simultaneous group, in which all measures were gathered during one viewing; and the individual group, in which one measure was gathered per viewing. Relative and absolute intra- and inter-rater reliability values were calculated for each measure. Outcomes & Results: The following results were notable--better intra-rater relative reliability for the number of stuttered syllables for the individual group (intraclass correlation coefficient (ICC) = 0.839) compared with the simultaneous group (ICC = 0.350), smaller intra-rater standard error of measurement (SEM) (i.e., better absolute reliability) for the number of stuttered syllables for the individual group (7.40) versus the simultaneous group (15.67), and better inter-rater absolute reliability for the total number of syllables for the individual group (88.29) compared with the simultaneous group (125.05). Absolute reliability was unacceptable for all measures across both groups. Conclusions & Implications: These findings show that judges are likely to be more reliable when identifying stuttered syllables in isolation than when simultaneously collecting them with total syllables spoken and naturalness data. Results are discussed in terms of narrowing the reliability gap between data collection methods for stuttered syllables, improving overall reliability of stuttering measurements, and a procedural change when implementing widely used stuttering assessment protocols. (As Provided).
Anmerkungen	Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01