Embodying complexity through movement sonification

2011 ◽  
Author(s):  
Jelle Stienstra ◽  
Kees Overbeeke ◽  
Stephan Wensveen
Keyword(s):  
Movement Sonification

scholarly journals Sensori-Motor Learning with Movement Sonification: Perspectives from Recent Interdisciplinary Studies

2016 ◽  
Vol 10 ◽  
Author(s):  
Frédéric Bevilacqua ◽  
Eric O. Boyer ◽  
Jules Françoise ◽  
Olivier Houix ◽  
Patrick Susini ◽  
...  
Keyword(s):  
Motor Learning ◽  
Interdisciplinary Studies ◽  
Movement Sonification

scholarly journals If motion sounds: Movement sonification based on inertial sensor data

2012 ◽  
Vol 34 ◽  
pp. 556-561 ◽  
Author(s):  
Heike Brock ◽  
Gerd Schmitz ◽  
Jan Baumann ◽  
Alfred O. Effenberg
Keyword(s):  
Inertial Sensor ◽  
Sensor Data ◽  
Movement Sonification

Motor Variability in Complex Gesture Learning: Effects of Movement Sonification and Musical Background

2022 ◽  
Vol 19 (1) ◽  
pp. 1-21
Author(s):  
Wanyu Liu ◽  
Michelle Agnes Magalhaes ◽  
Wendy E. Mackay ◽  
Michel Beaudouin-Lafon ◽  
Frédéric Bevilacqua
Keyword(s):  
Direct Action ◽  
Feedback Condition ◽  
Learning Effects ◽  
Specific Design ◽  
Motor Variability ◽  
Future Studies ◽  
Musical Background ◽  
Movement Sonification ◽  
Lower Variability ◽  
Action Music

With the increasing interest in movement sonification and expressive gesture-based interaction, it is important to understand which factors contribute to movement learning and how. We explore the effects of movement sonification and users’ musical background on motor variability in complex gesture learning. We contribute an empirical study in which musicians and non-musicians learn two gesture sequences over three days, with and without movement sonification. Results show the interlaced interaction effects of these factors and how they unfold in the three-day learning process. For gesture 1, which is fast and dynamic with a direct “action-sound” sonification, movement sonification induces higher variability for both musicians and non-musicians on day 1. While musicians reduce this variability to a similar level as no auditory feedback condition on day 2 and day 3, non-musicians remain to have significantly higher variability. Across three days, musicians also have significantly lower variability than non-musicians. For gesture 2, which is slow and smooth with an “action-music” metaphor, there are virtually no effects. Based on these findings, we recommend future studies to take into account participants’ musical background, consider longitudinal study to examine these effects on complex gestures, and use awareness when interpreting the results given a specific design of gesture and sound.

Design space exploration of hardware platforms for interactive low latency movement sonification

2015 ◽  
Vol 10 (1) ◽  
pp. 1-11 ◽  
Author(s):  
Hans-Peter Brückner ◽  
Sebastian Lesse ◽  
Wolfgang Theimer ◽  
Holger Blume
Keyword(s):  
Design Space Exploration ◽  
Design Space ◽  
Space Exploration ◽  
Low Latency ◽  
Movement Sonification ◽  
Hardware Platforms

Movement Sonification: Effects on Perception and Action

2005 ◽  
Vol 12 (2) ◽  
pp. 53-59 ◽  
Author(s):  
A.O. Effenberg
Keyword(s):  
Perception And Action ◽  
Movement Sonification
Sign in / Sign up

Export Citation Format

Share Document