scholarly journals L'Arte Di Interazione Musicale: New Musical Possibilities Through Multimodal Techniques

2021 ◽  
Author(s):  
◽  
Jordan Natan Hochenbaum

<p>Multimodal communication is an essential aspect of human perception, facilitating the ability to reason, deduce, and understand meaning. Utilizing multimodal senses, humans are able to relate to the world in many different contexts. This dissertation looks at surrounding issues of multimodal communication as it pertains to human-computer interaction. If humans rely on multimodality to interact with the world, how can multimodality benefit the ways in which humans interface with computers? Can multimodality be used to help the machine understand more about the person operating it and what associations derive from this type of communication? This research places multimodality within the domain of musical performance, a creative field rich with nuanced physical and emotive aspects. This dissertation asks, what kinds of new sonic collaborations between musicians and computers are possible through the use of multimodal techniques? Are there specific performance areas where multimodal analysis and machine learning can benefit training musicians? In similar ways can multimodal interaction or analysis support new forms of creative processes? Applying multimodal techniques to music-computer interaction is a burgeoning effort. As such the scope of the research is to lay a foundation of multimodal techniques for the future. In doing so the first work presented is a software system for capturing synchronous multimodal data streams from nearly any musical instrument, interface, or sensor system. This dissertation also presents a variety of multimodal analysis scenarios for machine learning. This includes automatic performer recognition for both string and drum instrument players, to demonstrate the significance of multimodal musical analysis. Training the computer to recognize who is playing an instrument suggests important information is contained not only within the acoustic output of a performance, but also in the physical domain. Machine learning is also used to perform automatic drum-stroke identification; training the computer to recognize which hand a drummer uses to strike a drum. There are many applications for drum-stroke identification including more detailed automatic transcription, interactive training (e.g. computer-assisted rudiment practice), and enabling efficient analysis of drum performance for metrics tracking. Furthermore, this research also presents the use of multimodal techniques in the context of everyday practice. A practicing musician played a sensoraugmented instrument and recorded his practice over an extended period of time, realizing a corpus of metrics and visualizations from his performance. Additional multimodal metrics are discussed in the research, and demonstrate new types of performance statistics obtainable from a multimodal approach. The primary contributions of this work include (1) a new software tool enabling musicians, researchers, and educators to easily capture multimodal information from nearly any musical instrument or sensor system; (2) investigating multimodal machine learning for automatic performer recognition of both string players and percussionists; (3) multimodal machine learning for automatic drum-stroke identification; (4a) applying multimodal techniques to musical pedagogy and training scenarios; (4b) investigating novel multimodal metrics; (5) lastly this research investigates the possibilities, affordances, and design considerations of multimodal musicianship both in the acoustic domain, as well as in other musical interface scenarios. This work provides a foundation from which engaging musical-computer interactions can occur in the future, benefitting from the unique nuances of multimodal techniques.</p>

2021 ◽  
Author(s):  
◽  
Jordan Natan Hochenbaum

<p>Multimodal communication is an essential aspect of human perception, facilitating the ability to reason, deduce, and understand meaning. Utilizing multimodal senses, humans are able to relate to the world in many different contexts. This dissertation looks at surrounding issues of multimodal communication as it pertains to human-computer interaction. If humans rely on multimodality to interact with the world, how can multimodality benefit the ways in which humans interface with computers? Can multimodality be used to help the machine understand more about the person operating it and what associations derive from this type of communication? This research places multimodality within the domain of musical performance, a creative field rich with nuanced physical and emotive aspects. This dissertation asks, what kinds of new sonic collaborations between musicians and computers are possible through the use of multimodal techniques? Are there specific performance areas where multimodal analysis and machine learning can benefit training musicians? In similar ways can multimodal interaction or analysis support new forms of creative processes? Applying multimodal techniques to music-computer interaction is a burgeoning effort. As such the scope of the research is to lay a foundation of multimodal techniques for the future. In doing so the first work presented is a software system for capturing synchronous multimodal data streams from nearly any musical instrument, interface, or sensor system. This dissertation also presents a variety of multimodal analysis scenarios for machine learning. This includes automatic performer recognition for both string and drum instrument players, to demonstrate the significance of multimodal musical analysis. Training the computer to recognize who is playing an instrument suggests important information is contained not only within the acoustic output of a performance, but also in the physical domain. Machine learning is also used to perform automatic drum-stroke identification; training the computer to recognize which hand a drummer uses to strike a drum. There are many applications for drum-stroke identification including more detailed automatic transcription, interactive training (e.g. computer-assisted rudiment practice), and enabling efficient analysis of drum performance for metrics tracking. Furthermore, this research also presents the use of multimodal techniques in the context of everyday practice. A practicing musician played a sensoraugmented instrument and recorded his practice over an extended period of time, realizing a corpus of metrics and visualizations from his performance. Additional multimodal metrics are discussed in the research, and demonstrate new types of performance statistics obtainable from a multimodal approach. The primary contributions of this work include (1) a new software tool enabling musicians, researchers, and educators to easily capture multimodal information from nearly any musical instrument or sensor system; (2) investigating multimodal machine learning for automatic performer recognition of both string players and percussionists; (3) multimodal machine learning for automatic drum-stroke identification; (4a) applying multimodal techniques to musical pedagogy and training scenarios; (4b) investigating novel multimodal metrics; (5) lastly this research investigates the possibilities, affordances, and design considerations of multimodal musicianship both in the acoustic domain, as well as in other musical interface scenarios. This work provides a foundation from which engaging musical-computer interactions can occur in the future, benefitting from the unique nuances of multimodal techniques.</p>


2017 ◽  
Vol 225 (4) ◽  
pp. 324-335 ◽  
Author(s):  
Dimitrios Barkas ◽  
Xenia Chryssochoou

Abstract. This research took place just after the end of the protests following the killing of a 16-year-old boy by a policeman in Greece in December 2008. Participants (N = 224) were 16-year-olds in different schools in Attiki. Informed by the Politicized Collective Identity Model ( Simon & Klandermans, 2001 ), a questionnaire measuring grievances, adversarial attributions, emotions, vulnerability, identifications with students and activists, and questions about justice and Greek society in the future, as well as about youngsters’ participation in different actions, was completed. Four profiles of the participants emerged from a cluster analysis using representations of the conflict, emotions, and identifications with activists and students. These profiles differed on beliefs about the future of Greece, participants’ economic vulnerability, and forms of participation. Importantly, the clusters corresponded to students from schools of different socioeconomic areas. The results indicate that the way young people interpret the events and the context, their levels of identification, and the way they represent society are important factors of their political socialization that impacts on their forms of participation. Political socialization seems to be related to youngsters’ position in society which probably constitutes an important anchoring point of their interpretation of the world.


2011 ◽  
pp. 4-20
Author(s):  
M. Ershov

With signs of normalization seemingly in place in the world economy, a number of problems show the possibility of aggravation in the future. The volume of derivatives in American banks grows significantly, high risk instruments are back in place and their use becomes more active, global imbalances increase. All of the above requires thorough approaches when creating mechanisms which can neutralize external shocks for the Russian economy and make it possible to develop in the new post-crisis environment.


Author(s):  
Kunal Parikh ◽  
Tanvi Makadia ◽  
Harshil Patel

Dengue is unquestionably one of the biggest health concerns in India and for many other developing countries. Unfortunately, many people have lost their lives because of it. Every year, approximately 390 million dengue infections occur around the world among which 500,000 people are seriously infected and 25,000 people have died annually. Many factors could cause dengue such as temperature, humidity, precipitation, inadequate public health, and many others. In this paper, we are proposing a method to perform predictive analytics on dengue’s dataset using KNN: a machine-learning algorithm. This analysis would help in the prediction of future cases and we could save the lives of many.


CCIT Journal ◽  
2014 ◽  
Vol 8 (1) ◽  
pp. 101-115
Author(s):  
Untung Rahardja ◽  
Khanna Tiara ◽  
Ray Indra Taufik Wijaya

Education is an important factor in human life. According to Ki Hajar Dewantara, education is a civilizing process that a business gives high values ??to the new generation in a society that is not only maintenance but also with a view to promote and develop the culture of the nobility toward human life. Education is a human investment that can be used now and in the future. One other important factor in supporting human life in addition to education, which is technology. In this globalization era, technology has touched every joint of human life. The combination of these two factors will be a new innovation in the world of education. The innovation has been implemented by Raharja College, namely the use of the method iLearning (Integrated Learning) in the learning process. Where such learning has been online based. ILearning method consists of TPI (Ten Pillars of IT iLearning). Rinfo is one of the ten pillars, where it became an official email used by the whole community’s in Raharja College to communicate with each other. Rinfo is Gmail, which is adapted from the Google platform with typical raharja.info as its domain. This Rinfo is a medium of communication, as well as a tool to support the learning process in Raharja College. Because in addition to integrated with TPi, this Rinfo was connected also support with other learning tools, such as Docs, Drive, Sites, and other supporting tools.


2020 ◽  
Vol 10 (4) ◽  
pp. 38-43
Author(s):  
MARIETA EPREMYAN ◽  

The article examines the epistemological roots of conservative ideology, development trends and further prospects in political reform not only in modern Russia, but also in other countries. The author focuses on the “world” and Russian conservatism. In the course of the study, the author illustrates what opportunities and limitations a conservative ideology can have in political reform not only in modern Russia, but also in the world. In conclusion, it is concluded that the prospect of a conservative trend in the world is wide enough. To avoid immigration and to control the development of technology in society, it is necessary to adhere to a conservative policy. Conservatism is a consolidating ideology. It is no coincidence that the author cites as an example the understanding of conservative ideology by the French due to the fact that Russia has its own vision of the ideology of conservatism. If we say that conservatism seeks to preserve something and respects tradition, we must bear in mind that traditions in different societies, which form some kind of moral imperatives, cannot be a single phenomenon due to different historical destinies and differing religious views. Considered from the point of view of religion, Muslim and Christian conservatism will be somewhat confrontational on some issues. The purpose of the work was to consider issues related to the role, evolution and prospects of conservative ideology in the political reform of modern countries. The author focuses on Russia and France. To achieve this goal, the method of in-depth interviews with experts on how they understand conservatism was chosen. Already today, conservatism is quite diverse. It is quite possible that in the future it will transform even more and acquire new reflections.


The Eye ◽  
2019 ◽  
Vol 21 (128) ◽  
pp. 19-22
Author(s):  
Gregory DeNaeyer

The world-wide use of scleral contact lenses has dramatically increased over the past 10 year and has changed the way that we manage patients with corneal irregularity. Successfully fitting them can be challenging especially for eyes that have significant asymmetries of the cornea or sclera. The future of scleral lens fitting is utilizing corneo-scleral topography to accurately measure the anterior ocular surface and then using software to design lenses that identically match the scleral surface and evenly vault the cornea. This process allows the practitioner to efficiently fit a customized scleral lens that successfully provides the patient with comfortable wear and improved vision.


2018 ◽  
Vol 12 ◽  
pp. 85-98
Author(s):  
Bojan Kostadinov ◽  
Mile Jovanov ◽  
Emil STANKOV

Data collection and machine learning are changing the world. Whether it is medicine, sports or education, companies and institutions are investing a lot of time and money in systems that gather, process and analyse data. Likewise, to improve competitiveness, a lot of countries are making changes to their educational policy by supporting STEM disciplines. Therefore, it’s important to put effort into using various data sources to help students succeed in STEM. In this paper, we present a platform that can analyse student’s activity on various contest and e-learning systems, combine and process the data, and then present it in various ways that are easy to understand. This in turn enables teachers and organizers to recognize talented and hardworking students, identify issues, and/or motivate students to practice and work on areas where they’re weaker.


2019 ◽  
Vol 63 (1) ◽  
pp. 39-49
Author(s):  
Philip Harrison

Abstract The bulk of the scholarly literature on city-regions and their governance is drawn from contexts where economic and political systems have been stable over an extended period. However, many parts of the world, including all countries in the BRICS, have experienced far-reaching national transformations in the recent past in economic and/or political systems. The national transitions are complex, with a mix of continuity and rupture, while their translation into the scale of the city-region is often indirect. But, these transitions have been significant for the city-region, providing a period of opportunity and institutional fluidity. Studies of the BRICS show that outcomes of transitions are varied but that there are junctures of productive comparison including the ways in which the nature of the transitions create new path dependencies, and way in which interests across territorial scales soon consolidate, producing new rigidities in city-region governance.


Sign in / Sign up

Export Citation Format

Share Document