Exposure to asynchronous audiovisual speech extends the temporal window for audiovisual integration

TitleExposure to asynchronous audiovisual speech extends the temporal window for audiovisual integration
Publication TypeJournal Article
Year of Publication2005
AuthorsNavarra J, Vatakis A, Zampini M, Soto-Faraco S, Humphreys W, Spence C
JournalCognitive Brain Research
Volume25
Issue2
Pagination499–507
Date Published10/2005
ISSN09266410
Keywordsasynchrony, multisensory integration, music, Speech, temporal order judgment, temporal recalibration
Abstract

We examined whether monitoring asynchronous audiovisual speech induces a general temporal recalibration of auditory and visual sensory processing. Participants monitored a videotape featuring a speaker pronouncing a list of words (Experiments 1 and 3) or a hand playing a musical pattern on a piano (Experiment 2). The auditory and visual channels were either presented in synchrony, or else asynchronously (with the visual signal leading the auditory signal by 300 ms; Experiments 1 and 2). While performing the monitoring task, participants were asked to judge the temporal order of pairs of auditory (white noise bursts) and visual stimuli (flashes) that were presented at varying stimulus onset asynchronies (SOAs) during the session. The results showed that, while monitoring desynchronized speech or music, participants required a longer interval between the auditory and visual stimuli in order to perceive their temporal order correctly, suggesting a widening of the temporal window for audiovisual integration. The fact that no such recalibration occurred when we used a longer asynchrony (1000 ms) that exceeded the temporal window for audiovisual integration (Experiment 3) supports this conclusion.

URLhttp://dx.doi.org/10.1016/j.cogbrainres.2005.07.009
DOI10.1016/j.cogbrainres.2005.07.009