musique contemporaine

Ircam - articles scientifiques notice originale

Integration of auditory and visual information in the recognition of realistic objects






document numérique

Accès sur site

  • Version numérique intégrale de l'article

Cette ressource est disponible chez l'organisme suivant : Ircam - Centre Pompidou



Integration of auditory and visual information in the recognition of realistic objects


Suied, Clara (auteur)
Bonneel, Nicolas (auteur)
Viaud-Delmon, Isabelle (auteur)





Audiovisual   Reaction time   Object recognition   Spatial disparity   Multisensory integration   Simon effect   Human


Recognizing a natural object requires one to pool information from various sensory modalities, and to ignore information from competing objects. That the same semantic knowledge can be accessed through different modalities makes it possible to explore the retrieval of supramodal object concepts. Here, object-recognition processes were investigated by manipulating the relationships between sensory modalities, specifically, semantic content, and spatial alignment between auditory and visual information. Experiments were run under realistic virtual environment. Participants were asked to react as fast as possible to a target object presented in the visual and/or the auditory modality and to inhibit a distractor object (go/no-go task). Spatial alignment had no effect on object-recognition time. The only spatial effect observed was a stimulus–response compatibility between the auditory stimulus and the hand position. Reaction times were significantly shorter for semantically congruent bimodal stimuli than would be predicted by independent processing of information about the auditory and visual targets. Interestingly, this bimodal facilitation effect was twice as large as found in previous studies that also used information- rich stimuli. An interference effect was observed (i.e. longer reaction times to semantically incongruent stimuli than to the corresponding unimodal stimulus) only when the distractor was auditory. When the distractor was visual, the semantic incongruence did not interfere with object recognition. Our results show that immersive displays with large visual stimuli may provide large multimodal integration effects, and reveal a possible asymmetry in the attentional filtering of irrelevant auditory and visual information.


Article paru dans : Experimental Brain Research


Envoyer la notice

Bookmark and Share 

Identifiant OAI


Date de la notice

2010-02-25 01:00:00

Identifiant portail