A General Framework for Visualization of Sound Collections in Musical Interfaces

While audio data play an increasingly central role in computer-based music production, interaction with large sound collections in most available music creation and production environments is very often still limited to scrolling long lists of file names. This paper describes a general framework for devising interactive applications based on the content-based visualization of sound collections. The proposed framework allows for a modular combination of different techniques for sound segmentation, analysis, and dimensionality reduction, using the reduced feature space for interactive applications. We analyze several prototypes presented in the literature and describe their limitations. We propose a more general framework that can be used flexibly to devise music creation interfaces. The proposed approach includes several novel contributions with respect to previously used pipelines, such as using unsupervised feature learning, content-based sound icons, and control of the output space layout. We present an implementation of the framework using the SuperCollider computer music language, and three example prototypes demonstrating its use for data-driven music interfaces. Our results demonstrate the potential of unsupervised machine learning and visualization for creative applications in computer music.

What Pd Can't Teach; What It Can

Pure Data's long appeal is partly owed to its visual layout and intuitive mode of use. This might lead one to consider it a useful pedagogical tool, even if it now meets stiff competition from glitzier and more user-friendly applications. In the author's experience, however, Pd's ambiguous location on the spectrum of virtualization makes it bad for teaching but gives it a far more important function for composers. In occupying an uncanny valley between the digital-as-digital and the digital-as-analog, it resists the general tendency of digital technology to obscure awareness of itself, that is, of the digital computer as the current high watermark of a longer history of rationalization. It thus pushes composers of computer music back towards the questions that are at the heart of their work. This dynamic is illustrated by the author's experience of developing and tinkering with a novel technique of sound synthesis.

Pd and Audio Programming in the 21st Century

In celebration of the 25th anniversary of Pure Data, this essay discusses the development of audio programming up to the present, and considers the role that Pd can continue to play in the computer music of the future.

Musical Hyperrealism: Exploring Noah Creshevsky’s compositions through Jean Baudrillard’s ideas

While a familiar term in art history, philosophy and cultural studies, ‘hyperrealism’ is rarely applied to music. This is despite Noah Creshevsky’s use of the term to describe his unique compositional process and aesthetic approach. A composer of electroacoustic music and founder of the Brooklyn College Center for Computer Music, Creshevsky has described his musical hyperrealism as a ‘language constructed from sounds that are found in our shared environment (“realism”), handled in ways that are somehow exaggerated or excessive (“hyper”)’. In this article, I summarise the ideas behind Creshevsky’s hyperreal music and compare them to philosopher Jean Baudrillard’s theorisation of the hyperreal. Numerous similarities between Creshevsky and Baudrillard’s ideas will be made evident. The first half of this article focuses on Creshevsky’s sampling of sounds as ‘simulacra’ and how the interweaving textures and melodies that Creshevsky makes out of these samples are similar to ‘simulations’. In the article’s second half, Creshevsky’s creation of disembodied ‘superperformers’ is addressed and related to Baudrillard’s transhumanism. Towards the end of the article, Creshevsky’s aesthetic more broadly and what he calls ‘hyperdrama’ are linked to Baudrillard’s ‘transaesthetics’, before a concluding note addressing Baudrillard and Creshevsky’s different dispositions towards hyperrealism.

Contemporary Approaches to Live Computer Music: The Evolution of the Performer Composer

<p>This thesis examines contemporary approaches to live computer music, and the impact they have on the evolution of the composer performer. How do online resources and communities impact the design and creation of new musical interfaces used for live computer music? Can we use machine learning to augment and extend the expressive potential of a single live musician? How can these tools be integrated into ensembles of computer musicians? Given these tools, can we understand the computer musician within the traditional context of acoustic instrumentalists, or do we require new concepts and taxonomies? Lastly, how do audiences perceive and understand these new technologies, and what does this mean for the connection between musician and audience? The focus of the research presented in this dissertation examines the application of current computing technology towards furthering the field of live computer music. This field is diverse and rich, with individual live computer musicians developing custom instruments and unique modes of performance. This diversity leads to the development of new models of performance, and the evolution of established approaches to live instrumental music. This research was conducted in several parts. The first section examines how online communities are iteratively developing interfaces for computer music. Several case studies are presented as examples of how online communities are helping to drive new developments in musical interface design. This thesis also presents research into designing real-time interactive systems capable of creating a virtual model of an existing performer, that then allows the model’s output to be contextualized by a second performer’s live input. These systems allow for a solo live musician’s single action to be multiplied into many different, but contextually dependent, actions. Additionally, this thesis looks at contemporary approaches to local networked ensembles, the concept of shared social instruments, and the ways in which the previously described research can be used in these ensembles. The primary contributions of these efforts include (1) the development of several new open-source interfaces for live computer music, and the examination of the effect that online communities have on the evolution of musical interfaces; (2) the development of a novel approach to search based interactive musical agents; (3) examining how networked music ensembles can provided new forms of shared social instruments.</p>

Contemporary Approaches to Live Computer Music: The Evolution of the Performer Composer

<p>This thesis examines contemporary approaches to live computer music, and the impact they have on the evolution of the composer performer. How do online resources and communities impact the design and creation of new musical interfaces used for live computer music? Can we use machine learning to augment and extend the expressive potential of a single live musician? How can these tools be integrated into ensembles of computer musicians? Given these tools, can we understand the computer musician within the traditional context of acoustic instrumentalists, or do we require new concepts and taxonomies? Lastly, how do audiences perceive and understand these new technologies, and what does this mean for the connection between musician and audience? The focus of the research presented in this dissertation examines the application of current computing technology towards furthering the field of live computer music. This field is diverse and rich, with individual live computer musicians developing custom instruments and unique modes of performance. This diversity leads to the development of new models of performance, and the evolution of established approaches to live instrumental music. This research was conducted in several parts. The first section examines how online communities are iteratively developing interfaces for computer music. Several case studies are presented as examples of how online communities are helping to drive new developments in musical interface design. This thesis also presents research into designing real-time interactive systems capable of creating a virtual model of an existing performer, that then allows the model’s output to be contextualized by a second performer’s live input. These systems allow for a solo live musician’s single action to be multiplied into many different, but contextually dependent, actions. Additionally, this thesis looks at contemporary approaches to local networked ensembles, the concept of shared social instruments, and the ways in which the previously described research can be used in these ensembles. The primary contributions of these efforts include (1) the development of several new open-source interfaces for live computer music, and the examination of the effect that online communities have on the evolution of musical interfaces; (2) the development of a novel approach to search based interactive musical agents; (3) examining how networked music ensembles can provided new forms of shared social instruments.</p>

Spectral Music Design

This volume offers a complete guide to a computational approach to spectral music-making. It provides, in a stepwise manner, a [ ] to the signal processing techniques and their application to computer music. The book begins with a series of fundamental definitions, delineating the basic concepts of spectral audio. This includes both a technical and a historical appreciation of the ideas related to the spectrum. The core of the text is formed by six chapters on the techniques of spectral musical signal processing. These are thoroughly illustrated with examples and code excerpts using the Python and Csound languages. This section of the book traces a path from the Fourier theorem to the consideration of non-deterministic signals, also in a step-by-step way discussing the various elements of spectral audio. The final part of the book is dedicated to the aesthetics of spectral music, and methods of design and composition, which apply the ideas and techniques explored earlier in the volume.