AudioVisual Mappings

The goal of this project is to study the representation of sound processes and musical structures in 3D virtual environments. For this purpose, we run user studies on mappings between simple graphical parameters and perceptive sound parameters. We then combine these mappings on 3D musical objects, relying on work done in the Information Visualization field, and study their perceptive independence.

These objects are called 3D Reactive Widgets. They are connected to sound processes and allow for both visualization and manipulation of their sound parameters thanks to a set of audiovisual mappings.

We also explore shapes which can be used to visualize complex structures or to display multidimensional sound properties.

  • In collaboration with
    • Myriam Desainte-Catherine , Sound and Music Modelling team, LaBRI
    • Martin Hachet, Potioc Team, INRIA, LaBRI
  • Publications
    • Combining audiovisual mappings for 3D musical interaction pdf
      Florent Berthaut, Myriam Desainte-Catherine, Martin Hachet
      Proceedings of ICMC 2010
    • Widgets Réactifs 3D pdf
      Florent Berthaut, Martin Hachet, Myriam Desainte-Catherine
      Journées d'informatique musicale , mars 2008


Images, Sounds and Videos available under the Free Art License
Website powered by PmWiki