Facilitating the Musician's Engagement with New Musical Interfaces: Counteractions in Music Performance

2017 ◽  
Vol 41 (2) ◽  
pp. 69-82 ◽  
Author(s):  
Koray Tahiroğlu ◽  
Juan Carlos Vasquez ◽  
Johan Kildal

The level of engagement of a musician performing on an instrument is related to the degree of satisfaction derived from that activity. With our work, we aim to assist musicians performing live on a new musical instrument, Network of Interactive Sonic Agents (NOISA), by helping them maintain or increase their level of engagement with the activity. The NOISA system can learn from performers through observation and estimate their engagement level in real time. The new response module, which includes new sound design, comparison of gestures, and audio-analysis features, can also decide what action to take, and when to implement it, to help the performer recover from lowering engagement levels. We report on a formative user study that evaluates the impact of this response module.

Author(s):  
Daniele Di Mitri ◽  
Jan Schneider ◽  
Hendrik Drachsler

AbstractThis paper describes the CPR Tutor, a real-time multimodal feedback system for cardiopulmonary resuscitation (CPR) training. The CPR Tutor detects training mistakes using recurrent neural networks. The CPR Tutor automatically recognises and assesses the quality of the chest compressions according to five CPR performance indicators. It detects training mistakes in real-time by analysing a multimodal data stream consisting of kinematic and electromyographic data. Based on this assessment, the CPR Tutor provides audio feedback to correct the most critical mistakes and improve the CPR performance. The mistake detection models of the CPR Tutor were trained using a dataset from 10 experts. Hence, we tested the validity of the CPR Tutor and the impact of its feedback functionality in a user study involving additional 10 participants. The CPR Tutor pushes forward the current state of the art of real-time multimodal tutors by providing: (1) an architecture design, (2) a methodological approach for delivering real-time feedback using multimodal data and (3) a field study on real-time feedback for CPR training. This paper details the results of a field study by quantitatively measuring the impact of the CPR Tutor feedback on the performance indicators and qualitatively analysing the participants’ questionnaire answers.


2021 ◽  
Author(s):  
◽  
Christopher Wratt

<p>In video games, audio is often a vital element in the creation of immersive gaming experiences. One set of techniques that are particularly well suited to attaining this immersion are procedural audio techniques. These techniques enable enhanced immersion through supporting close synchronisation between player and game state in ways that are difficult to achieve with other game audio techniques. While this is the case, there is a lack of GUI and script-based tools that support the use of such techniques. This thesis explores this lack, and documents the development of two new video game tools for the creation of procedurally generated audio.  The first of these tools is a Musical Instrument Digital Interface (MIDI) library that supports the playback and real-time manipulation of MIDI files in the Unity game engine. The tool achieves real-time procedural audio, yet fails to meet required levels of time accuracy and is only a partial success. The second tool developed is a plugin hosting application that enables the use of the popular audio plugin format, VST2, in the Unity game engine. The tool succeeds in achieving VST2 effect plugin loading and, at the time of the completion of this thesis, is the only tool capable of embedding such plugins into applications developed in a major game engine. This will be of significant benefit to game developers who wish to achieve a high degree of immersivity in the music and sound design in their games.</p>


2021 ◽  
Author(s):  
◽  
Christopher Wratt

<p>In video games, audio is often a vital element in the creation of immersive gaming experiences. One set of techniques that are particularly well suited to attaining this immersion are procedural audio techniques. These techniques enable enhanced immersion through supporting close synchronisation between player and game state in ways that are difficult to achieve with other game audio techniques. While this is the case, there is a lack of GUI and script-based tools that support the use of such techniques. This thesis explores this lack, and documents the development of two new video game tools for the creation of procedurally generated audio.  The first of these tools is a Musical Instrument Digital Interface (MIDI) library that supports the playback and real-time manipulation of MIDI files in the Unity game engine. The tool achieves real-time procedural audio, yet fails to meet required levels of time accuracy and is only a partial success. The second tool developed is a plugin hosting application that enables the use of the popular audio plugin format, VST2, in the Unity game engine. The tool succeeds in achieving VST2 effect plugin loading and, at the time of the completion of this thesis, is the only tool capable of embedding such plugins into applications developed in a major game engine. This will be of significant benefit to game developers who wish to achieve a high degree of immersivity in the music and sound design in their games.</p>


2021 ◽  
Author(s):  
Paul Stapleton ◽  
John Bowers ◽  
Ada Pultz Melbye

Link to performance: https://vimeo.com/640946914/cf858052e1AbstractThis performance-lecture was originally presented at the DRHA (Digital Research in the Humanities and Arts) conference in 2021 in Berlin. 3BP (Paul Stapleton, Adam Pultz Melbye and John Bowers) presents three views on the creation of an online performance ecology that allows the trio to improvise together, despite living in three separate locations. Rather than trying to overcome the instabilities and artefacts introduced by the fluctuations in data transfer, 3BP describe how such properties become native to the trios understanding of its own practice, affording new areas of creative exploration and consideration. The trio draws on Karen Barad’s use of terms such as diffraction and apparatus to discuss how music-making and improvisation embedded in run-away technologies affords emergent behaviour that transcends reflection to allow for diverse and unstable non-linear performances.BiosPaul Stapleton is an improviser and sound artist originally from Southern California. He designs and performs with a variety of modular metallic sound sculptures, custom made electronics and found objects in settings ranging from Echtzeitmusik venues in Berlin to the annual NIME conference. Paul is currently Professor of Music at SARC in Belfast, where he teaches and supervises research in new musical instrument design, music performance, sound design and critical improvisation studies. 
www.paulstapleton.net Adam Pultz Melbye is a double bass player, composer and audio programmer based in Berlin, currently undertaking a practice-led PhD at Sonic Arts Research Centre in Belfast.&nbsp; Adam has released three solo albums and appear on another 40+ releases. He has created sound installations, composed music for film, theatre and dance, and performed in Europe, the US, Japan and Australia, his work appearing at Murray Art Museum Albury (Australia), The Danish National Gallery and Wien Modern (Austria).
www.adampultz.com John Bowers is an artist-researcher with an academic background in the social and computing sciences, design, music and critical theory. As an improvising musician, he works with modular synthesisers, home-brew electronics, reconstructions of antique image and sound-making devices, self-made software, field recordings, esoteric sensor systems, and spoken text. He often combines performance with walking and the investigation of selected sites to research an imagined discipline he calls ‘mythogeosonics’. He has performed at festivals including the Venice Biennale, Experimental Intermedia New York, Transmediale/CTM Vorspiel Berlin, Piksel Bergen, Electropixel Nantes, BEAM London, Aldeburgh Festival and Spill Ipswich, and toured with the Rambert Dance Company performing David Tudor’s music to Merce Cunningham’s Rainforest.


Author(s):  
Ruxandra Calapod Ioana ◽  
Irina Bojoga ◽  
Duta Simona Gabriela ◽  
Ana-Maria Stancu ◽  
Amalia Arhire ◽  
...  

2019 ◽  
Vol 2019 ◽  
pp. 790-791
Author(s):  
Cunhyeong Ci ◽  
◽  
Hyo-Gyoo Kim ◽  
Seungbae Park ◽  
Heebok Lee
Keyword(s):  

Diabetes ◽  
2020 ◽  
Vol 69 (Supplement 1) ◽  
pp. 778-P
Author(s):  
ZIYU LIU ◽  
CHAOFAN WANG ◽  
XUEYING ZHENG ◽  
SIHUI LUO ◽  
DAIZHI YANG ◽  
...  

2007 ◽  
Vol 30 (4) ◽  
pp. 51 ◽  
Author(s):  
A. Baranchuk ◽  
G. Dagnone ◽  
P. Fowler ◽  
M. N. Harrison ◽  
L. Lisnevskaia ◽  
...  

Electrocardiography (ECG) interpretation is an essential skill for physicians as well as for many other health care professionals. Continuing education is necessary to maintain these skills. The process of teaching and learning ECG interpretation is complex and involves both deductive mechanisms and recognition of patterns for different clinical situations (“pattern recognition”). The successful methodologies of interactive sessions and real time problem based learning have never been evaluated with a long distance education model. To evaluate the efficacy of broadcasting ECG rounds to different hospitals in the Southeastern Ontario region; to perform qualitative research to determine the impact of this methodology in developing and maintaining skills in ECG interpretation. ECG rounds are held weekly at Kingston General Hospital and will be transmitted live to Napanee, Belleville, Oshawa, Peterborough and Brockville. The teaching methodology is based on real ECG cases. The audience is invited to analyze the ECG case and the coordinator will introduce comments to guide the case through the proper algorithm. Final interpretation will be achieved emphasizing the deductive process and the relevance of each case. An evaluation will be filled out by each participant at the end of each session. Videoconferencing works through a vast array of internet LANs, WANs, ISDN phone lines, routers, switches, firewalls and Codecs (Coder/Decoder) and bridges. A videoconference Codec takes the analog audio and video signal codes and compresses it into a digital signal and transmits that digital signal to another Codec where the signal is decompressed and retranslated back into analog video and audio. This compression and decompression allows large amounts of data to be transferred across a network at close to real time (384 kbps with 30 frames of video per second). Videoconferencing communication works on voice activation so whichever site is speaking has the floor and is seen by all the participating sites. A continuous presence mode allows each site to have the same visual and audio involvement as the host site. A bridged multipoint can connect between 8 and 12 sites simultaneously. This innovative methodology for teaching ECG will facilitate access to developing and maintaining skills in ECG interpretation for a large number of health care providers. Bertsch TF, Callas PW, Rubin A. Effectiveness of lectures attended via interactive video conferencing versus in-person in preparing third-year internal medicine clerkship students for clinical practice examinations. Teach Learn Med 2007; 19(1):4-8. Yellowlees PM, Hogarth M, Hilty DM. The importance of distributed broadband networks to academic biomedical research and education programs. Acad Psychaitry 2006;30:451-455


1998 ◽  
Vol 37 (1) ◽  
pp. 347-354 ◽  
Author(s):  
Ole Mark ◽  
Claes Hernebring ◽  
Peter Magnusson

The present paper describes the Helsingborg Pilot Project, a part of the Technology Validation Project: “Integrated Wastewater” (TVP) under the EU Innovation Programme. The objective of the Helsingborg Pilot Project is to demonstrate implementation of integrated tools for the simulation of the sewer system and the wastewater treatment plant (WWTP), both in the analyses and the operational phases. The paper deals with the programme for investigating the impact of real time control (RTC) on the performance of the sewer system and wastewater treatment plant. As the project still is in a very early phase, this paper focuses on the modelling of the transport of pollutants and the evaluation of the effect on the sediment deposition pattern from the implementation of real time control in the sewer system.


Energies ◽  
2021 ◽  
Vol 14 (11) ◽  
pp. 3274
Author(s):  
Jose Rueda Torres ◽  
Zameer Ahmad ◽  
Nidarshan Veera Kumar ◽  
Elyas Rakhshani ◽  
Ebrahim Adabi ◽  
...  

Future electrical power systems will be dominated by power electronic converters, which are deployed for the integration of renewable power plants, responsive demand, and different types of storage systems. The stability of such systems will strongly depend on the control strategies attached to the converters. In this context, laboratory-scale setups are becoming the key tools for prototyping and evaluating the performance and robustness of different converter technologies and control strategies. The performance evaluation of control strategies for dynamic frequency support using fast active power regulation (FAPR) requires the urgent development of a suitable power hardware-in-the-loop (PHIL) setup. In this paper, the most prominent emerging types of FAPR are selected and studied: droop-based FAPR, droop derivative-based FAPR, and virtual synchronous power (VSP)-based FAPR. A novel setup for PHIL-based performance evaluation of these strategies is proposed. The setup combines the advanced modeling and simulation functions of a real-time digital simulation platform (RTDS), an external programmable unit to implement the studied FAPR control strategies as digital controllers, and actual hardware. The hardware setup consists of a grid emulator to recreate the dynamic response as seen from the interface bus of the grid side converter of a power electronic-interfaced device (e.g., type-IV wind turbines), and a mockup voltage source converter (VSC, i.e., a device under test (DUT)). The DUT is virtually interfaced to one high-voltage bus of the electromagnetic transient (EMT) representation of a variant of the IEEE 9 bus test system, which has been modified to consider an operating condition with 52% of the total supply provided by wind power generation. The selected and programmed FAPR strategies are applied to the DUT, with the ultimate goal of ascertaining its feasibility and effectiveness with respect to the pure software-based EMT representation performed in real time. Particularly, the time-varying response of the active power injection by each FAPR control strategy and the impact on the instantaneous frequency excursions occurring in the frequency containment periods are analyzed. The performed tests show the degree of improvements on both the rate-of-change-of-frequency (RoCoF) and the maximum frequency excursion (e.g., nadir).


Sign in / Sign up

Export Citation Format

Share Document