Skip to Main content Skip to Navigation
Journal articles

Dual Neural Routing of Visual Facilitation in Speech Processing: Visual facilitation of speech processing

Abstract : Viewing our interlocutor facilitates speech perception, unlike for instance when we telephone. Several neural routes and mechanisms could account for this phenomenon. Using magnetoencephalography (MEG), we show that when seeing the interlocutor, latencies of auditory responses (M100) are the shorter the more predictable speech is from visual input, whether the auditory signal was congruent or not. Incongruence of auditory and visual input affected auditory responses about 20 ms after latency shortening was detected, indicating that initial content-dependent auditory facilitation by vision is followed by a feedback signal that reflects the error between expected and received auditory input (prediction error). We then used functional magnetic resonance imaging and confirmed that distinct routes of visual information to auditory processing underlie these two functional mechanisms. Functional connectivity between visual motion and auditory areas depended on the degree of visual predictability, whereas connectivity between the superior temporal sulcus and both auditory and visual motion areas was driven by audio-visual incongruence. These results establish two distinct mechanisms by which the brain uses potentially predictive visual information to improve auditory perception. A fast direct cortico-cortical pathway conveys visual motion parameters to auditory cortex, and a slower and indirect feedback pathway signals the error between visual prediction and auditory input.
Document type :
Journal articles
Complete list of metadatas

Cited literature [36 references]  Display  Hide  Download

https://www.hal.inserm.fr/inserm-00429667
Contributor : Luc Arnal <>
Submitted on : Tuesday, November 3, 2009 - 6:40:10 PM
Last modification on : Wednesday, October 14, 2020 - 4:12:13 AM
Long-term archiving on: : Thursday, June 17, 2010 - 7:16:09 PM

File

Arnal_J.Neurosci_2009.pdf
Publisher files allowed on an open archive

Identifiers

Collections

Citation

Luc Arnal, Benjamin Morillon, Christian Kell, Anne-Lise Giraud. Dual Neural Routing of Visual Facilitation in Speech Processing: Visual facilitation of speech processing. Journal of Neuroscience, Society for Neuroscience, 2009, 29 (43), pp.13445-13453. ⟨10.1523/JNEUROSCI.3194-09.2009⟩. ⟨inserm-00429667⟩

Share

Metrics

Record views

472

Files downloads

611