Toward enabling a natural interaction between human musicians and musical performance robots: Implementation of a real-time gestural interface

Author(s):  
Klaus Petersen ◽  
Jorge Solis ◽  
Atsuo Takanishi
Leonardo ◽  
2021 ◽  
pp. 1-7
Author(s):  
John Carpenter ◽  
Rusty Lansford

Abstract Scientists today can collect more data than they can perceive using traditional visualization methods. New technologies and sensors allow researchers to gather dynamic, complex multi-dimensional data sets---all of which must be carefully studied to reveal their hidden patterns and narratives. The authors have utilized an immersive platform to design a new visualization for real-time, intuitive, spatial manipulations of time-based volumetric data sets via a wand-based gestural interface. The resulting work resolves microscopic tissue structures at a human scale in a room-based pixel space, facilitating research, discovery, and in-person teaching and collaboration.


2020 ◽  
Vol 17 (2) ◽  
pp. 93-110
Author(s):  
Tomáš Chudý

Communication, at least that which is potentially human-independent, makes the issue of what is actually communicated come to the fore. The whole set-up is new: real-time filtration and selection cast doubt on the idea of communication of objective representations. That is why the bundle signal-data-information-sign-message must be analysed, taking into account the possibility that communicative quanta can teleact by themselves. Distinguishing technogenic interactivity and natural interaction produces the concept of infogenic man, which facilitates a new definition of information as opposed to signal, but also serves well if applied to machine communication. A feature that helps discern data and information is the increase of complexity level. The key to communication, taking into account the machine context, is the interest in being “wired”; Luhmann’s theory of communication, based on triple selection (information, conveyance, understanding), is especially well-positioned to meet the demands of today’s technogenic communication. Non-linearity and analysis of the mechanisms for putting up with contingency are among the advantages of Luhmann’s theory, which also provides a framework to capture and distinguish the human and technogenic communicative factors.


Author(s):  
Qian Ma ◽  
Barbara Millet

Immersive dashboards facilitate the presentation of large-scale complex data while offering natural interaction and real-time interactivity supporting immediate use. Few studies, however, have investigated the use of immersive dashboards to improve the visualization and analysis of abstract data. This study provides a systematic review of the literature on designing immersive dashboards for abstract data visualization and analytics. Twenty publications met the inclusion criteria. This review identifies guidelines for improving immersive dashboard design.


Author(s):  
Hugo Paquete

This essay presents the methodologies, meanings and challenges in the development of the “Dromology of Orbital Bodies”, Hugo Paquete project, started between 2019-2020 and still ongoing. The project aims to track military and commercial satellites, by converting their movement information in real time by a process of data sonification received from the hacked satellites. Therefore, this essay presents the technical challenges in the project building, as well some of the obtained sonic results. Also is presented the dimension of conceptual meanings associated with the project from a philosophical and critical point of view, in a combination of conceptual approach and technical exploration where concepts such as chronoscopic time, cyberpunk, gray ecology and acoustemology are related as conceptual frames, of a time where the sound happens mediated by technology. The presented concepts are influences in the production, composition and musical performance processes that I develop with special interest in systems theory and where unpredictability operates alongside real-time relationships. In this experimentation I use sound granularization and compositional aesthetic techniques historically centered in a noise and micro post-digital rhythm aesthetics.


Proceedings ◽  
2019 ◽  
Vol 27 (1) ◽  
pp. 27 ◽  
Author(s):  
Filippini ◽  
Spadolini ◽  
Cardone ◽  
Merla

Over the recent years, Social Robots (SRs) have become more and more prominent in everyday human lives. The main goal of a SR is to interact and communicate with human by following social behaviors and affective interaction. However, they still encounter significant limitations in pursuing a natural interaction, mainly due to their hard task of recognizing and understanding human emotions thus ensuring an appropriate response. The aim of this study was to enrich the SR with affective computing capability and real time assessment of the interlocutor’s psychophysiological state, by means of computational psychophysiology based on thermal infrared imaging.


Author(s):  
Kanmanus Ongvisatepaiboon ◽  
Jonathan H. Chan

Abstract – Massive Open Online Course (MOOC) is becoming increasingly popular. There are different forms of MOOC and many online courses created by various institutions around the world. The traditional methods of generating high quality MOOC content tend to be timeconsuming and are not easy for the lecturers to engage in natural interaction with the content. This paper presents a framework and proposes the use of the Chroma-Keying technique that would enable the lecturers to see the outcome in real-time and the use of simple hand gestures to control changing of slides.  


Sign in / Sign up

Export Citation Format

Share Document