musique contemporaine

Ircam - articles scientifiques notice originale

Integration of auditory and visual information in the recognition of realistic objects

Type

text
 

Genre(s)

article
 

Forme(s)

document numérique
 

Accès sur site

  • Version numérique intégrale de l'article
 

Cette ressource est disponible chez l'organisme suivant : Ircam - Centre Pompidou

Identification

Titre

Integration of auditory and visual information in the recognition of realistic objects
 

Nom(s)

Suied, Clara (auteur)
 
Bonneel, Nicolas (auteur)
 
Viaud-Delmon, Isabelle (auteur)
 

Publication

2009
 

Description

Sujet(s)

Audiovisual   Reaction time   Object recognition   Spatial disparity   Multisensory integration   Simon effect   Human
 

Résumé

Recognizing a natural object requires one to pool information from various sensory modalities, and to ignore information from competing objects. That the same semantic knowledge can be accessed through different modalities makes it possible to explore the retrieval of supramodal object concepts. Here, object-recognition processes were investigated by manipulating the relationships between sensory modalities, specifically, semantic content, and spatial alignment between auditory and visual information. Experiments were run under realistic virtual environment. Participants were asked to react as fast as possible to a target object presented in the visual and/or the auditory modality and to inhibit a distractor object (go/no-go task). Spatial alignment had no effect on object-recognition time. The only spatial effect observed was a stimulus–response compatibility between the auditory stimulus and the hand position. Reaction times were significantly shorter for semantically congruent bimodal stimuli than would be predicted by independent processing of information about the auditory and visual targets. Interestingly, this bimodal facilitation effect was twice as large as found in previous studies that also used information- rich stimuli. An interference effect was observed (i.e. longer reaction times to semantically incongruent stimuli than to the corresponding unimodal stimulus) only when the distractor was auditory. When the distractor was visual, the semantic incongruence did not interfere with object recognition. Our results show that immersive displays with large visual stimuli may provide large multimodal integration effects, and reveal a possible asymmetry in the attentional filtering of irrelevant auditory and visual information.
 

Note(s)

Article paru dans : Experimental Brain Research
 

Localisation

Envoyer la notice

Bookmark and Share 
 

Identifiant OAI

 

Date de la notice

2010-02-25 01:00:00
 

Identifiant portail

 

Contact