Multimodal Feedback Pen Shaped Interface and MR Application with Spatial Reality Display

2021 ◽  
Author(s):  
Jun Momose ◽  
Yuta Koda ◽  
Hideki Mori ◽  
Morio Kakiuchi ◽  
Kotaro Imamura ◽  
...  
Keyword(s):  
2005 ◽  
Vol 20 (2) ◽  
pp. 82-88
Author(s):  
Kathleen Riley ◽  
Edgar E Coons ◽  
David Marcarian

Piano students working to improve technique often practice the same passage over and over to achieve accuracy, increase speed, or perfect interpretive nuance. However, without proper skeletal alignment of hands, arms, and shoulders and balance between the muscles involved, such repetition may lead to difficulties with, rather than mastery of, technique and stylistic interpretation and even physical injury. A variety of technologies have been developed to monitor skeletal alignment and muscle balance that serve to help students and teachers make needed corrections during performance by providing immediate biofeedback. This paper describes and illustrates a multimodal use of these biofeedback technologies and the powerful advantages of such a multimodal approach in making the student and teacher not only aware of improper alignments and balances in real time (or for later review) but also aware of approaches to correct them and improve musical outcome. The modalities consist of hearing playback through a Disklavier piano; simultaneous visual feedback displayed as a piano roll screen of what was played; video recording synchronized with the Disklavier and piano roll feedback; motion analysis of the arms, hands, and fingers; and electromyographic recordings of the muscle actions involved.


Author(s):  
Jon Ram Bruun-Pedersen ◽  
Morten G. Andersen ◽  
Mathias M. Clemmensen ◽  
Mads K. Didriksen ◽  
Emil J. Wittendorff ◽  
...  

2017 ◽  
Vol 4 ◽  
pp. 205566831772963 ◽  
Author(s):  
Asif Hussain ◽  
Sivakumar Balasubramanian ◽  
Nick Roach ◽  
Julius Klein ◽  
Nathanael Jarrassé ◽  
...  

Introduction Over recent years, task-oriented training has emerged as a dominant approach in neurorehabilitation. This article presents a novel, sensor-based system for independent task-oriented assessment and rehabilitation (SITAR) of the upper limb. Methods The SITAR is an ecosystem of interactive devices including a touch and force–sensitive tabletop and a set of intelligent objects enabling functional interaction. In contrast to most existing sensor-based systems, SITAR provides natural training of visuomotor coordination through collocated visual and haptic workspaces alongside multimodal feedback, facilitating learning and its transfer to real tasks. We illustrate the possibilities offered by the SITAR for sensorimotor assessment and therapy through pilot assessment and usability studies. Results The pilot data from the assessment study demonstrates how the system can be used to assess different aspects of upper limb reaching, pick-and-place and sensory tactile resolution tasks. The pilot usability study indicates that patients are able to train arm-reaching movements independently using the SITAR with minimal involvement of the therapist and that they were motivated to pursue the SITAR-based therapy. Conclusion SITAR is a versatile, non-robotic tool that can be used to implement a range of therapeutic exercises and assessments for different types of patients, which is particularly well-suited for task-oriented training.


2021 ◽  
Author(s):  
Cigdem Turan ◽  
Dorothea Koert ◽  
Karl David Neergaard ◽  
Rudolf Lioutikov

2021 ◽  
Vol 123 (3) ◽  
pp. 1-24
Author(s):  
Christy Wessel Powell

Background With standardization ever squeezing creative curricula in K–1 classrooms, creating time for a play-based multimodal writing curriculum that leverages children's strengths as storytellers is revolutionary. Due in part to accountability policy pressures, print-based writing and verbocentric writing feedback are still often privileged in school curricula. And yet, children are natural whole-body storytellers who will be asked to write and present ideas in all sorts of forms. In order to leverage children's storytelling strengths, we need to teach writing through multiple modes: This means expanding both writing instruction and the types of feedback offered to writers in primary classrooms. Research Questions This study examines two questions: How is feedback being given, and what impact does it have on children's storytelling? How is play/storying being sanctioned? Setting & Participants The study took place in a K–1 classroom in an inquiry-based, project-based school in the U.S. Midwest during a month-long storytelling workshop unit. Participants included two co-teachers and 46 children aged 5 to 7. Research Design This qualitative study used ethnographic methods and participant observation. Data Collection & Analysis Video data were collected during workshop each day for one month, including minilessons, writing time, and share time, which is the focus of this article. Discourse analysis and a multimodality theoretical lens were used to analyze how children gave one another feedback on their stories through embodied demonstration, gesture, acting, out, or copying one another's storytelling devices. Findings Findings indicate that children's acting/embodiment, humor/parody, and copying all worked as effective forms of multimodal feedback, which ultimately functioned as teaching for developing peers’ storytelling strategies and skills. However, teachers inadvertently privileged language alone via narration, or language with demonstration in feedback sessions. Conclusions Teacher/researcher collaborations should explore ways to reimagine forms of writer's feedback that include and account for demonstration, copying, and impromptu performance and that, ultimately, open up the definition of what counts as writing at school. Um, you should work on making your story, like, real. Because, um, you're going all over the place [wiggles entire body to illustrate]—Allen, age 6


Sign in / Sign up

Export Citation Format

Share Document