A Divide and Conquer Approach to Automatic Music Transcription Using Neural Networks

2019 ◽  
pp. 220-231
Author(s):  
André Gil ◽  
Carlos Grilo ◽  
Gustavo Reis ◽  
Patrício Domingues
Keyword(s):  
Neural Networks ◽  
Divide And Conquer ◽  
Music Transcription ◽  
Automatic Music Transcription

scholarly journals Automatic onset detection using convolutional neural networks

2019 ◽  
Author(s):  
Willy Cornelissen ◽  
Maurício Loureiro
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Ground Truth ◽  
Onset Detection ◽  
Ground Truth Data ◽  
Music Transcription ◽  
Automatic Music Transcription ◽  
Information Research ◽  
Music Research ◽  
Music Information

A very significant task for music research is to estimate instants when meaningful events begin (onset) and when they end (offset). Onset detection is widely applied in many fields: electrocardiograms, seismographic data, stock market results and many Music Information Research(MIR) tasks, such as Automatic Music Transcription, Rhythm Detection, Speech Recognition, etc. Automatic Onset Detection(AOD) received, recently, a huge contribution coming from Artificial Intelligence (AI) methods, mainly Machine Learning and Deep Learning. In this work, the use of Convolutional Neural Networks (CNN) is explored by adapting its original architecture in order to apply the approach to automatic onset detection on audio musical signals. We used a CNN network for onset detection on a very general dataset, well acknowledged by the MIR community, and examined the accuracy of the method by comparison to ground truth data published by the dataset. The results are promising and outperform another methods of musical onset detection.

scholarly journals A Comparison of Deep Learning Methods for Timbre Analysis in Polyphonic Automatic Music Transcription

Electronics ◽  
2021 ◽  
Vol 10 (7) ◽  
pp. 810
Author(s):  
Carlos Hernandez-Olivan ◽  
Ignacio Zay Pinilla ◽  
Carlos Hernandez-Lopez ◽  
Jose R. Beltran
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Neural Networks ◽  
State Of The Art ◽  
High Impact ◽  
Critical Problem ◽  
Music Transcription ◽  
Automatic Music Transcription ◽  
Music Information ◽  
Method Show

Automatic music transcription (AMT) is a critical problem in the field of music information retrieval (MIR). When AMT is faced with deep neural networks, the variety of timbres of different instruments can be an issue that has not been studied in depth yet. The goal of this work is to address AMT transcription by analyzing how timbre affect monophonic transcription in a first approach based on the CREPE neural network and then to improve the results by performing polyphonic music transcription with different timbres with a second approach based on the Deep Salience model that performs polyphonic transcription based on the Constant-Q Transform. The results of the first method show that the timbre and envelope of the onsets have a high impact on the AMT results and the second method shows that the developed model is less dependent on the strength of the onsets than other state-of-the-art models that deal with AMT on piano sounds such as Google Magenta Onset and Frames (OaF). Our polyphonic transcription model for non-piano instruments outperforms the state-of-the-art model, such as for bass instruments, which has an F-score of 0.9516 versus 0.7102. In our latest experiment we also show how adding an onset detector to our model can outperform the results given in this work.

scholarly journals Automatic Music Transcription: An Overview

2019 ◽  
Vol 36 (1) ◽  
pp. 20-30 ◽  
Author(s):  
Emmanouil Benetos ◽  
Simon Dixon ◽  
Zhiyao Duan ◽  
Sebastian Ewert
Keyword(s):  
Music Transcription ◽  
Automatic Music Transcription

scholarly journals Chord-aware automatic music transcription based on hierarchical Bayesian integration of acoustic and language models

2018 ◽  
Vol 7 ◽  
Author(s):  
Yuta Ojima ◽  
Eita Nakamura ◽  
Katsutoshi Itoyama ◽  
Kazuyoshi Yoshii
Keyword(s):  
Latent Variables ◽  
Language Model ◽  
Language Models ◽  
Sequential Dependency ◽  
Acoustic Model ◽  
Hierarchical Bayesian ◽  
Generative Process ◽  
Music Transcription ◽  
Automatic Music Transcription ◽  
Music Audio

This paper describes automatic music transcription with chord estimation for music audio signals. We focus on the fact that concurrent structures of musical notes such as chords form the basis of harmony and are considered for music composition. Since chords and musical notes are deeply linked with each other, we propose joint pitch and chord estimation based on a Bayesian hierarchical model that consists of an acoustic model representing the generative process of a spectrogram and a language model representing the generative process of a piano roll. The acoustic model is formulated as a variant of non-negative matrix factorization that has binary variables indicating a piano roll. The language model is formulated as a hidden Markov model that has chord labels as the latent variables and emits a piano roll. The sequential dependency of a piano roll can be represented in the language model. Both models are integrated through a piano roll in a hierarchical Bayesian manner. All the latent variables and parameters are estimated using Gibbs sampling. The experimental results showed the great potential of the proposed method for unified music transcription and grammar induction.

scholarly journals A Shift-Invariant Latent Variable Model for Automatic Music Transcription

2012 ◽  
Vol 36 (4) ◽  
pp. 81-94 ◽  
Author(s):  
Emmanouil Benetos ◽  
Simon Dixon
Keyword(s):  
Latent Variable ◽  
Markov Models ◽  
Variable Model ◽  
Data Set ◽  
Music Transcription ◽  
Transcription System ◽  
Automatic Music Transcription ◽  
Error Metrics ◽  
Frequency Modulations ◽  
Time Varying Pitch

In this work, a probabilistic model for multiple-instrument automatic music transcription is proposed. The model extends the shift-invariant probabilistic latent component analysis method, which is used for spectrogram factorization. Proposed extensions support the use of multiple spectral templates per pitch and per instrument source, as well as a time-varying pitch contribution for each source. Thus, this method can effectively be used for multiple-instrument automatic transcription. In addition, the shift-invariant aspect of the method can be exploited for detecting tuning changes and frequency modulations, as well as for visualizing pitch content. For note tracking and smoothing, pitch-wise hidden Markov models are used. For training, pitch templates from eight orchestral instruments were extracted, covering their complete note range. The transcription system was tested on multiple-instrument polyphonic recordings from the RWC database, a Disklavier data set, and the MIREX 2007 multi-F0 data set. Results demonstrate that the proposed method outperforms leading approaches from the transcription literature, using several error metrics.

Sign in / Sign up

Export Citation Format

Share Document