Neural correlates of audiovisual speech processing in a second language

TitleNeural correlates of audiovisual speech processing in a second language
Publication TypeJournal Article
Year of Publication2013
AuthorsBarrós-Loscertales A, Visser M, Ventura-Campos N, Alsius A, Pallier C, Avila-Rivera C, Soto-Faraco S
JournalBrain and Language
Date Published09/2013
KeywordsA, Audiovisual, audiovisual congruent, audiovisual incongruent, Audiovisual speech, Auditory, AV, AVc, AVi, B, baseline, bilingualism, fMRI, L1, L2, MSI, multisensory interaction, native language, non-native language, posterior superior temporal sulcus, pSTS, STG, superior temporal gyrus, V, Visual

Neuroimaging studies of audiovisual speech processing have exclusively addressed listeners' native language (L1). Yet, several behavioural studies now show that AV processing plays an important role in non-native (L2) speech perception. The current fMRI study measured brain activity during auditory, visual, audiovisual congruent and audiovisual incongruent utterances in L1 and L2. BOLD responses to congruent AV speech in the pSTS were stronger than in either unimodal condition in both L1 and L2. Yet no differences in AV processing were expressed according to the language background in this area. Instead, the regions in the bilateral occipital lobe had a stronger congruency effect on the BOLD response (congruent higher than incongruent) in L2 as compared to L1. According to these results, language background differences are predominantly expressed in these unimodal regions, whereas the pSTS is similarly involved in AV integration regardless of language dominance.

DOI 10.1016/j.bandl.2013.05.009