scholarly journals One deep music representation to rule them all? A comparative analysis of different representation learning strategies

2019 ◽  
Vol 32 (4) ◽  
pp. 1067-1093 ◽  
Author(s):  
Jaehun Kim ◽  
Julián Urbano ◽  
Cynthia C. S. Liem ◽  
Alan Hanjalic
2021 ◽  
Vol 7 (3) ◽  
pp. 49
Author(s):  
Daniel Carlos Guimarães Pedronette ◽  
Lucas Pascotti Valem ◽  
Longin Jan Latecki

Visual features and representation learning strategies experienced huge advances in the previous decade, mainly supported by deep learning approaches. However, retrieval tasks are still performed mainly based on traditional pairwise dissimilarity measures, while the learned representations lie on high dimensional manifolds. With the aim of going beyond pairwise analysis, post-processing methods have been proposed to replace pairwise measures by globally defined measures, capable of analyzing collections in terms of the underlying data manifold. The most representative approaches are diffusion and ranked-based methods. While the diffusion approaches can be computationally expensive, the rank-based methods lack theoretical background. In this paper, we propose an efficient Rank-based Diffusion Process which combines both approaches and avoids the drawbacks of each one. The obtained method is capable of efficiently approximating a diffusion process by exploiting rank-based information, while assuring its convergence. The algorithm exhibits very low asymptotic complexity and can be computed regionally, being suitable to outside of dataset queries. An experimental evaluation conducted for image retrieval and person re-ID tasks on diverse datasets demonstrates the effectiveness of the proposed approach with results comparable to the state-of-the-art.


2020 ◽  
Vol 9 (1) ◽  
pp. 283-288
Author(s):  
Yu Sun

This paper aims to discuss the problem of nationally oriented teaching of Russian grammar to Chinese students. The author analyzes the works that are devoted to the study of Chinese students cognitive and psychological characteristics. The analysis revealed specific learning strategies that Chinese students use when learning a foreign language. When training a mono-ethnic group, the national-oriented approach is considered optimal. To implement this approach, a comparative analysis of systems of contacting languages is necessary to determine the zones of interlanguage and intralanguage interferences. The most important factor in the effectiveness of the educational process is the adequacy of the teachers ideas about students from different regions. The author concludes that in order to maintain motivation for mastering the Russian language and optimize the learning process as a whole when developing curricula and class books for Chinese students, it is necessary to strive to make the learning process not only effective, but also as comfortable as possible for students. Taking into account Chinese students cognitive and psychological characteristics will not only contribute to the development of strong grammar skills, but will also ensure the development of oral speech skills in Russian. The paper provides recommendations for intensifying the process of teaching Russian grammar to Chinese students. The following research methods were used: a comparative analysis, an analysis and a synthesis.


Author(s):  
Khawla Seddiki ◽  
Philippe Saudemont ◽  
Frédéric Precioso ◽  
Nina Ogrinc ◽  
Maxence Wisztorski ◽  
...  

AbstractRapid and accurate clinical diagnosis of pathological conditions remains highly challenging. A very important component of diagnosis tool development is the design of effective classification models with Mass spectrometry (MS) data. Some popular Machine Learning (ML) approaches have been investigated for this purpose but these ML models require time-consuming preprocessing steps such as baseline correction, denoising, and spectrum alignment to remove non-sample-related data artifacts. They also depend on the tedious extraction of handcrafted features, making them unsuitable for rapid analysis. Convolutional Neural Networks (CNNs) have been found to perform well under such circumstances since they can learn efficient representations from raw data without the need for costly preprocessing. However, their effectiveness drastically decreases when the number of available training samples is small, which is a common situation in medical applications. Transfer learning strategies extend an accurate representation model learnt usually on a large dataset containing many categories, to a smaller dataset with far fewer categories. In this study, we first investigate transfer learning on a 1D-CNN we have designed to classify MS data, then we develop a new representation learning method when transfer learning is not powerful enough, as in cases of low-resolution or data heterogeneity. What we propose is to train the same model through several classification tasks over various small datasets in order to accumulate generic knowledge of what MS data are, in the resulting representation. By using rat brain data as the initial training dataset, a representation learning approach can have a classification accuracy exceeding 98% for canine sarcoma cancer cells, human ovarian cancer serums, and pathogenic microorganism biotypes in 1D clinical datasets. We show for the first time the use of cumulative representation learning using datasets generated in different biological contexts, on different organisms, in different mass ranges, with different MS ionization sources, and acquired by different instruments at different resolutions. Our approach thus proposes a promising strategy for improving MS data classification accuracy when only small numbers of samples are available as a prospective cohort. The principles demonstrated in this work could even be beneficial to other domains (astronomy, archaeology…) where training samples are scarce.


2019 ◽  
Author(s):  
Stephan Spiegel ◽  
Imtiaz Hossain ◽  
Christopher Ball ◽  
Xian Zhang

AbstractMotivationThe clustering of biomedical images according to their phenotype is an important step in early drug discovery. Modern high-content-screening devices easily produce thousands of cell images, but the resulting data is usually unlabelled and it requires extra effort to construct a visual representation that supports the grouping according to the presented morphological characteristics.ResultsWe introduce a novel approach to visual representation learning that is guided by metadata. In high-context-screening, meta-data can typically be derived from the experimental layout, which links each cell image of a particular assay to the tested chemical compound and corresponding compound concentration. In general, there exists a one-to-many relationship between phenotype and compound, since various molecules and different dosage can lead to one and the same alterations in biological cells.Our empirical results show that metadata-guided visual representation learning is an effective approach for clustering biomedical images. We have evaluated our proposed approach on both benchmark and real-world biological data. Furthermore, we have juxtaposed implicit and explicit learning techniques, where both loss function and batch construction differ. Our experiments demonstrate that metadata-guided visual representation learning is able to identify commonalities and distinguish differences in visual appearance that lead to meaningful clusters, even without image-level annotations.NotePlease refer to the supplementary material for implementation details on metadata-guided visual representation learning strategies.


2020 ◽  
Vol 5 (1) ◽  
pp. 44
Author(s):  
Leonardus Hendra Aha ◽  
Muhardjito Muhardjito ◽  
Sunaryono Sunaryono

<p><strong>Abstract:</strong> The purpose of this study is to look at the problem solving abilities and the representation abilities between students who learn with multi-presentation learning strategies with the conceptual problem solving approach and students who learn with conventional learning. Total sample is 68 students selected using the simple random sampling technique. This study used a quasi experimental method with a pretest-posttest control group design. Data was collected using tests, both before treatment and after treatment. The results of the study were differences in problem solving abilities and representation abilities in both classes. In addition, problem solving abilities and representation abilities of students who learn with multi representation learning strategies with conceptual problem solving approaches are higher than students who learn with conventional learning.</p><strong>Abstrak:<em> </em></strong>Penelitian ini bertujuan untuk mengetahui perbedaan kemampuan pemecahan masalah dan kemampuan representasi antara siswa yang belajar dengan strategi pembelajaran multirepresentasi dengan pendekatan <em>conceptual problem solving </em>dan siswa yang belajar dengan pembelajaran konvensional. Sampel dalam penelitian ini berjumlah 68 siswa yang dipilih dengan teknik <em>simple random sampling. </em>Penelitian ini merupakan penelitian kuantitatif dengan metode eksperimen kuasi. Desain dalam penelitian ini adalah <em>pretest-posttest control group design</em>. Data dikumpulkan dengan menggunakan tes, baik sebelum perlakuan maupun setelah perlakuan. Hasil penelitian terdapat perbedaan kemampuan pemecahan masalah dan kemampuan representasi siswa yang belajar dengan strategi pembelajaran multirepresentasi dengan pendekatan <em>conceptual problem solving </em>dan siswa yang belajar dengan pembelajaran konvensional. Selain itu, kemampuan pemecahan masalah dan kemampuan representasi siswa yang belajar dengan strategi pembelajaran multirepresentasi dengan pendekatan <em>conceptual problem solving </em>lebih tinggi dari siswa yang belajar dengan pembelajaran konvensional.


2021 ◽  
Author(s):  
Xiaomin Fang ◽  
Lihang Liu ◽  
Jieqiong Lei ◽  
Donglong He ◽  
Shanzhuo Zhang ◽  
...  

Abstract Effective molecular representation learning is of great importance to facilitate molecular property prediction, which is a fundamental task for the drug and material industry. Recent advances in graph neural networks (GNNs) have shown great promise in applying GNNs for molecular representation learning. Moreover, a few recent studies have also demonstrated successful applications of self-supervised learning methods to pre-train the GNNs to overcome the problem of insufficient labeled molecules. However, existing GNNs and pre-training strategies usually treat molecules as topological graph data without fully utilizing the molecular geometry information. Whereas, the three-dimensional (3D) spatial structure of a molecule, a.k.a molecular geometry, is one of the most critical factors for determining molecular physical, chemical, and biological properties. To this end, we propose a novel Geometry Enhanced Molecular representation learning method (GEM) for Chemical Representation Learning (ChemRL). At first, we design a geometry-based GNN architecture that simultaneously models atoms, bonds, and bond angles in a molecule. To be specific, we devised double graphs for a molecule: The first one encodes the atom-bond relations; The second one encodes bond-angle relations. Moreover, on top of the devised GNN architecture, we propose several novel geometry-level self-supervised learning strategies to learn spatial knowledge by utilizing the local and global molecular 3D structures. We compare ChemRL-GEM with various state-of-the-art (SOTA) baselines on different molecular benchmarks and exhibit that ChemRL-GEM can significantly outperform all baselines in both regression and classification tasks. For example, the experimental results show an overall improvement of 8.8% on average compared to SOTA baselines on the regression tasks, demonstrating the superiority of the proposed method.


Sign in / Sign up

Export Citation Format

Share Document