Prosodic Temporal Alignment of Co-Speech Gestures to Speech Facilitates Referent Resolution

Autor/inn/en	Jesse, Alexandra; Johnson, Elizabeth K.
Titel	Prosodic Temporal Alignment of Co-Speech Gestures to Speech Facilitates Referent Resolution
Quelle	In: Journal of Experimental Psychology: Human Perception and Performance, 38 (2012) 6, S.1567-1581 (15 Seiten) PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0096-1523
DOI	10.1037/a0027921
Schlagwörter	Speech; Nonverbal Communication; Suprasegmentals; Time; Visual Perception; Auditory Perception; Ambiguity (Context); Foreign Countries; Netherlands + Suchen Sie Ihr Suchwort? Speaking; Sprechen; Non-verbal communication; Nonverbale Kommunikation; Zeit; Visuelle Wahrnehmung; Auditive Wahrnehmung; Akustische Wahrnehmung; Akustik; Ausland; Niederlande
Abstract	Using a referent detection paradigm, we examined whether listeners can determine the object speakers are referring to by using the temporal alignment between the motion speakers impose on objects and their labeling utterances. Stimuli were created by videotaping speakers labeling a novel creature. Without being explicitly instructed to do so, speakers moved the creature during labeling. Trajectories of these motions were used to animate photographs of the creature. Participants in subsequent perception studies heard these labeling utterances while seeing side-by-side animations of two identical creatures in which only the target creature moved as originally intended by the speaker. Using the cross-modal temporal relationship between speech and referent motion, participants identified which creature the speaker was labeling, even when the labeling utterances were low-pass filtered to remove their semantic content or replaced by tone analogues. However, when the prosodic structure was eliminated by reversing the speech signal, participants no longer detected the referent as readily. These results provide strong support for a prosodic cross-modal alignment hypothesis. Speakers produce a perceptible link between the motion they impose upon a referent and the prosodic structure of their speech, and listeners readily use this prosodic cross-modal relationship to resolve referential ambiguity in word-learning situations. (Contains 1 table and 6 figures.) (As Provided).
Anmerkungen	American Psychological Association. Journals Department, 750 First Street NE, Washington, DC 20002-4242. Tel: 800-374-2721; Tel: 202-336-5510; Fax: 202-336-5502; e-mail: order@apa.org; Web site: http://www.apa.org/publications
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10