With advances in immersive displays and gesture tracking technologies, many novel interfaces for musical and visual expression have been developed, which often explore combinations of audio and visual productions. One category of such interfaces is musical drawing, in which artists simultaneously produce both visual and sonic content. Since it deals with two different sensory channels, one of the main problematic is to find the right balance between the sonic and the visual aspects of a project.
In her Phd thesis, Esther Gruy explores physical interaction devices and audiovisual mappings that open creative opportunities for musical and visual expression in extended reality.
Videos
Papers
- titre
- Extended Reality Audio-Visual Instruments: Design Framework and Case Study
- auteur
- Esther Gruy, Florent Berthaut
- article
- New Interfaces for Musical Expression (NIME), Jun 2026, London, United Kingdom
- Accès au texte intégral et bibtex
-
- titre
- Exploring the Use of Auditory Feedback as a Guide for 3D Drawing in Extended Reality
- auteur
- Esther Gruy, Florent Berthaut
- article
- International Conference on Artificial Reality and Telexistence & Eurographics Symposium on Virtual Environments (ICAT-EGVE 2025), Dec 2025, Karlskrona, Sweden
- Accès au texte intégral et bibtex
-
- titre
- Musical Drawing in 2D and 3D: Dimensions and Perspectives
- auteur
- Esther Gruy, Florent Berthaut
- article
- Audio Mostly, Sep 2024, Milan (Italie), France. pp.181-188, ⟨10.1145/3678299.3678317⟩
- Accès au texte intégral et bibtex
-
- titre
- MagneTip: Reintroducing a Physical Interaction Loop for 3D Musical Drawing in Extended Reality
- auteur
- Esther Gruy, Florent Berthaut
- article
- New Interfaces for Musical Expression, Sep 2024, Utrecht (Netherlands), France. ⟨10.5281/zenodo.13904763⟩
- Accès au texte intégral et bibtex
-