Challenges in Rating Signed Production: A Mixed-Methods Study of a Swiss German Sign Language Form-Recall Vocabulary Test

Autor/inn/en	Batty, Aaron Olaf; Haug, Tobias; Ebling, Sarah; Tissi, Katja; Sidler-Miserez, Sandra
Titel	Challenges in Rating Signed Production: A Mixed-Methods Study of a Swiss German Sign Language Form-Recall Vocabulary Test
Quelle	In: Language Testing, 40 (2023) 2, S.352-374 (23 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Batty, Aaron Olaf) ORCID (Haug, Tobias)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0265-5322
DOI	10.1177/02655322221122774
Schlagwörter	Sign Language; Language Tests; Standard Setting; Barriers; Recall (Psychology); Adult Students; Language Variation; German; Evaluators; Specialists; Vocabulary Development; Foreign Countries; Computational Linguistics; Second Language Learning; Second Language Instruction; Deafness; Translation; Native Language; Speech Communication; Switzerland + Suchen Sie Ihr Suchwort? Gebärdensprache; Language test; Sprachtest; Standardisierung; Abberufung; Adult; Adults; Student; Students; Erwachsenenalter; Studentin; Schüler; Schülerin; Sprachenvielfalt; Deutscher; Wortschatzarbeit; Ausland; Linguistics; Computerlinguistik; Zweitsprachenerwerb; Fremdsprachenunterricht; Gehörlosigkeit; Taubstummheit; Schweiz
Abstract	Sign languages present particular challenges to language assessors in relation to variation in signs, weakly defined citation forms, and a general lack of standard-setting work even in long-established measures of productive sign proficiency. The present article addresses and explores these issues via a mixed-methods study of a human-rated form-recall sign vocabulary test of 98 signs for beginning adult learners of Swiss German Sign Language (DSGS), using post-test qualitative rater interviews to inform interpretation of the results of quantitative analysis of the test ratings using many-facets Rasch measurement. Significant differences between two expert raters were observed on three signs. The follow-up interview revealed disagreement on the criterion of correctness, despite the raters' involvement in the development of the base lexicon of signs. The findings highlight the challenges of using human ratings to assess the production not only of sign language vocabulary, but of minority languages generally, and underscore the need for greater effort expended on the standardization of sign language assessment. (As Provided).
Anmerkungen	SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01