musique contemporaine

Ircam - articles scientifiques notice originale

Towards a Gesture-Sound Cross-Modal Analysis

Type

text
 

Genre(s)

article
 

Forme(s)

document numérique
 

Cette ressource est disponible chez l'organisme suivant : Ircam - Centre Pompidou

Identification

Titre

Towards a Gesture-Sound Cross-Modal Analysis
 

Nom(s)

Caramiaux, Baptiste (auteur)
 
Bevilacqua, Frédéric (auteur)
 
Schnell, Norbert (auteur)
 

Publication

Springer Verlag, 2010
 

Description

Sujet(s)

Gesture analysis   Gesture-Sound Relationship   Sound Perception   Canonical Correlation Analysis
 

Résumé

This article reports on the exploration of a method based on canonical correlation analysis (CCA) for the analysis of the relationship between gesture and sound in the context of music performance and listening. This method is a first step in the design of an analysis tool for gesture-sound relationships. In this exploration we used motion capture data recorded from sub jects performing free hand movements while listening to short sound examples. We assume that even though the relationship between gesture and sound might be more complex, at least part of it can be revealed and quantified by linear multivariate regression applied to the motion capture data and audio descriptors extracted from the sound examples. After outlining the theoretical background, the article shows how the method allows for pertinent reasoning about the relationship between gesture and sound by analysing the data sets recorded from multiple and individual subjects.
 

Note(s)

Article paru dans : Gesture in Embodied Communication and Human-Computer Interaction - LNAI 5934
 

Localisation

Envoyer la notice

Bookmark and Share 
 

Identifiant OAI

 

Date de la notice

2011-03-11 01:00:00
 

Identifiant portail

 

Contact