scholarly journals A Deep-Learning Method for Radar Micro-Doppler Spectrogram Restoration

Sensors ◽  
2020 ◽  
Vol 20 (17) ◽  
pp. 5007
Author(s):  
Yuan He ◽  
Xinyu Li ◽  
Runlong Li ◽  
Jianping Wang ◽  
Xiaojun Jing
Keyword(s):  
Deep Learning ◽  
Motion Capture ◽  
Radio Frequency Interference ◽  
Learning Method ◽  
High Quality ◽  
Generative Adversarial Network ◽  
Qualitative And Quantitative ◽  
Adversarial Network ◽  
Simulated Motion ◽  
Coarse To Fine

Radio frequency interference, which makes it difficult to produce high-quality radar spectrograms, is a major issue for micro-Doppler-based human activity recognition (HAR). In this paper, we propose a deep-learning-based method to detect and cut out the interference in spectrograms. Then, we restore the spectrograms in the cut-out region. First, a fully convolutional neural network (FCN) is employed to detect and remove the interference. Then, a coarse-to-fine generative adversarial network (GAN) is proposed to restore the part of the spectrogram that is affected by the interferences. The simulated motion capture (MOCAP) spectrograms and the measured radar spectrograms with interference are used to verify the proposed method. Experimental results from both qualitative and quantitative perspectives show that the proposed method can mitigate the interference and restore high-quality radar spectrograms. Furthermore, the comparison experiments also demonstrate the efficiency of the proposed approach.

scholarly journals A De Novo Molecular Generation Method Using Latent Vector Based Generative Adversarial Network

2019 ◽  
Author(s):  
Oleksii Prykhodko ◽  
Simon Viet Johansson ◽  
Panagiotis-Christos Kotsias ◽  
Esben Jannik Bjerrum ◽  
Ola Engkvist ◽  
...  
Keyword(s):  
Deep Learning ◽  
De Novo ◽  
Chemical Space ◽  
Learning Method ◽  
Training Set ◽  
Generative Adversarial Network ◽  
Structure Generation ◽  
Adversarial Network ◽  
Molecule Design ◽  
Novel Structures

<p>Recently deep learning method has been used for generating novel structures. In the current study, we proposed a new deep learning method, LatentGAN, which combine an autoencoder and a generative adversarial neural network for doing de novo molecule design. We applied the method for structure generation in two scenarios, one is to generate random drug-like compounds and the other is to generate target biased compounds. Our results show that the method works well in both cases, in which sampled compounds from the trained model can largely occupy the same chemical space of the training set and still a substantial fraction of the generated compound are novel. The distribution of drug-likeness score for compounds sampled from LatentGAN is also similar to that of the training set.</p>

scholarly journals HeartNet: Self Multi-Head Attention Mechanism via Convolutional Network with Adversarial Data Synthesis for ECG-based Arrhythmia Classification

2021 ◽  
Author(s):  
Taki Hasan Rafi ◽  
Young Woong-Ko
Keyword(s):  
Deep Learning ◽  
Attention Mechanism ◽  
Classification Systems ◽  
Insufficient Data ◽  
Learning Method ◽  
Generative Adversarial Network ◽  
Convolutional Network ◽  
Data Synthesis ◽  
Adversarial Network ◽  
Main Challenge

Cardiovascular disease is now one of the leading causes of morbidity and mortality in humans. Electrocardiogram (ECG) is a reliable tool for monitoring the health of the cardiovascular system. Currently, there has been a lot of focus on accurately categorizing heartbeats. There is a high demand on automatic ECG classification systems to assist medical professionals. In this paper we proposed a new deep learning method called HeartNet for developing an automatic ECG classifier. The proposed deep learning method is compressed by multi-head attention mechanism on top of CNN model. The main challenge of insufficient data label is solved by adversarial data synthesis adopting generative adversarial network (GAN) with generating additional training samples. It drastically improves the overall performance of the proposed method by 5-10% on each insufficient data label category. We evaluated our proposed method utilizing MIT-BIH dataset. Our proposed method has shown 99.67 ± 0.11 accuracy and 89.24 ± 1.71 MCC trained with adversarial data synthesized dataset. However, we have also utilized two individual datasets such as Atrial Fibrillation Detection Database and PTB Diagnostic Database to see the performance of our proposed model on ECG classification. The effectiveness and robustness of proposed method are validated by extensive experiments, comparison and analysis. Later on, we also highlighted some limitations of this work.

scholarly journals ChainLineNet: Deep-Learning-Based Segmentation and Parameterization of Chain Lines in Historical Prints

2021 ◽  
Vol 7 (7) ◽  
pp. 120
Author(s):  
Aline Sindel ◽  
Thomas Klinke ◽  
Andreas Maier ◽  
Vincent Christlein
Keyword(s):  
Deep Learning ◽  
Transmitted Light ◽  
Horizontal Line ◽  
Generative Adversarial Network ◽  
Qualitative And Quantitative ◽  
Adversarial Network ◽  
Line Region ◽  
Fourier Filtering ◽  
Line Segmentation ◽  
Line Fitting

The paper structure of historical prints is sort of a unique fingerprint. Paper with the same origin shows similar chain line distances. As the manual measurement of chain line distances is time consuming, the automatic detection of chain lines is beneficial. We propose an end-to-end trainable deep learning method for segmentation and parameterization of chain lines in transmitted light images of German prints from the 16th Century. We trained a conditional generative adversarial network with a multitask loss for line segmentation and line parameterization. We formulated a fully differentiable pipeline for line coordinates’ estimation that consists of line segmentation, horizontal line alignment, and 2D Fourier filtering of line segments, line region proposals, and differentiable line fitting. We created a dataset of high-resolution transmitted light images of historical prints with manual line coordinate annotations. Our method shows superior qualitative and quantitative chain line detection results with high accuracy and reliability on our historical dataset in comparison to competing methods. Further, we demonstrated that our method achieves a low error of less than 0.7 mm in comparison to manually measured chain line distances.

scholarly journals A De Novo Molecular Generation Method Using Latent Vector Based Generative Adversarial Network

2019 ◽  
Author(s):  
Oleksii Prykhodko ◽  
Simon Viet Johansson ◽  
Panagiotis-Christos Kotsias ◽  
Esben Jannik Bjerrum ◽  
Ola Engkvist ◽  
...  
Keyword(s):  
Deep Learning ◽  
De Novo ◽  
Chemical Space ◽  
Learning Method ◽  
Training Set ◽  
Generative Adversarial Network ◽  
Structure Generation ◽  
Adversarial Network ◽  
Molecule Design ◽  
Novel Structures

<p>Recently deep learning method has been used for generating novel structures. In the current study, we proposed a new deep learning method, LatentGAN, which combine an autoencoder and a generative adversarial neural network for doing de novo molecule design. We applied the method for structure generation in two scenarios, one is to generate random drug-like compounds and the other is to generate target biased compounds. Our results show that the method works well in both cases, in which sampled compounds from the trained model can largely occupy the same chemical space of the training set and still a substantial fraction of the generated compound are novel. The distribution of drug-likeness score for compounds sampled from LatentGAN is also similar to that of the training set.</p>

Seismic image processing through the generative adversarial network

2019 ◽  
Vol 7 (3) ◽  
pp. SF15-SF26
Author(s):  
Francesco Picetti ◽  
Vincenzo Lipari ◽  
Paolo Bestagini ◽  
Stefano Tubaro
Keyword(s):  
Machine Learning ◽  
Neural Networks ◽  
Image Processing ◽  
Deep Learning ◽  
Proof Of Concept ◽  
High Quality ◽  
Generative Adversarial Network ◽  
Adversarial Network ◽  
Seismic Image ◽  
Geophysical Imaging

The advent of new deep-learning and machine-learning paradigms enables the development of new solutions to tackle the challenges posed by new geophysical imaging applications. For this reason, convolutional neural networks (CNNs) have been deeply investigated as novel tools for seismic image processing. In particular, we have studied a specific CNN architecture, the generative adversarial network (GAN), through which we process seismic migrated images to obtain different kinds of output depending on the application target defined during training. We have developed two proof-of-concept applications. In the first application, a GAN is trained to turn a low-quality migrated image into a high-quality one, as if the acquisition geometry was much more dense than in the input. In the second example, the GAN is trained to turn a migrated image into the respective deconvolved reflectivity image. The effectiveness of the investigated approach is validated by means of tests performed on synthetic examples.

scholarly journals Modeling and evaluating beat gestures for social robots

2021 ◽  
Author(s):  
Unai Zabala ◽  
Igor Rodriguez ◽  
José María Martínez-Otzeta ◽  
Elena Lazkano
Keyword(s):  
Motion Capture ◽  
Motion Capture System ◽  
Generative Adversarial Network ◽  
Adversarial Network ◽  
Desirable Feature ◽  
Quantitative Results ◽  
Path Lengths ◽  
End Effectors ◽  
The One ◽  
Made In

AbstractNatural gestures are a desirable feature for a humanoid robot, as they are presumed to elicit a more comfortable interaction in people. With this aim in mind, we present in this paper a system to develop a natural talking gesture generation behavior. A Generative Adversarial Network (GAN) produces novel beat gestures from the data captured from recordings of human talking. The data is obtained without the need for any kind of wearable, as a motion capture system properly estimates the position of the limbs/joints involved in human expressive talking behavior. After testing in a Pepper robot, it is shown that the system is able to generate natural gestures during large talking periods without becoming repetitive. This approach is computationally more demanding than previous work, therefore a comparison is made in order to evaluate the improvements. This comparison is made by calculating some common measures about the end effectors’ trajectories (jerk and path lengths) and complemented by the Fréchet Gesture Distance (FGD) that aims to measure the fidelity of the generated gestures with respect to the provided ones. Results show that the described system is able to learn natural gestures just by observation and improves the one developed with a simpler motion capture system. The quantitative results are sustained by questionnaire based human evaluation.

scholarly journals An Underwater Image Enhancement Algorithm Based on Generative Adversarial Network and Natural Image Quality Evaluation Index

2021 ◽  
Vol 9 (7) ◽  
pp. 691
Author(s):  
Kai Hu ◽  
Yanwen Zhang ◽  
Chenghang Weng ◽  
Pengsheng Wang ◽  
Zhiliang Deng ◽  
...  
Keyword(s):  
Image Quality ◽  
Image Enhancement ◽  
Quality Evaluation ◽  
High Efficiency ◽  
Natural Image ◽  
High Quality ◽  
Generative Adversarial Network ◽  
Image Quality Evaluation ◽  
Adversarial Network ◽  
Underwater Image

When underwater vehicles work, underwater images are often absorbed by light and scattered and diffused by floating objects, which leads to the degradation of underwater images. The generative adversarial network (GAN) is widely used in underwater image enhancement tasks because it can complete image-style conversions with high efficiency and high quality. Although the GAN converts low-quality underwater images into high-quality underwater images (truth images), the dataset of truth images also affects high-quality underwater images. However, an underwater truth image lacks underwater image enhancement, which leads to a poor effect of the generated image. Thus, this paper proposes to add the natural image quality evaluation (NIQE) index to the GAN to provide generated images with higher contrast and make them more in line with the perception of the human eye, and at the same time, grant generated images a better effect than the truth images set by the existing dataset. In this paper, several groups of experiments are compared, and through the subjective evaluation and objective evaluation indicators, it is verified that the enhanced image of this algorithm is better than the truth image set by the existing dataset.

scholarly journals An Imbalanced Image Classification Method for the Cell Cycle Phase

Information ◽  
2021 ◽  
Vol 12 (6) ◽  
pp. 249
Author(s):  
Xin Jin ◽  
Yuanwen Zou ◽  
Zhongbing Huang
Keyword(s):  
Cell Cycle ◽  
Deep Learning ◽  
Image Classification ◽  
Classification Accuracy ◽  
Data Augmentation ◽  
Cycle Phase ◽  
Generative Adversarial Network ◽  
Adversarial Network ◽  
Cellular Life

The cell cycle is an important process in cellular life. In recent years, some image processing methods have been developed to determine the cell cycle stages of individual cells. However, in most of these methods, cells have to be segmented, and their features need to be extracted. During feature extraction, some important information may be lost, resulting in lower classification accuracy. Thus, we used a deep learning method to retain all cell features. In order to solve the problems surrounding insufficient numbers of original images and the imbalanced distribution of original images, we used the Wasserstein generative adversarial network-gradient penalty (WGAN-GP) for data augmentation. At the same time, a residual network (ResNet) was used for image classification. ResNet is one of the most used deep learning classification networks. The classification accuracy of cell cycle images was achieved more effectively with our method, reaching 83.88%. Compared with an accuracy of 79.40% in previous experiments, our accuracy increased by 4.48%. Another dataset was used to verify the effect of our model and, compared with the accuracy from previous results, our accuracy increased by 12.52%. The results showed that our new cell cycle image classification system based on WGAN-GP and ResNet is useful for the classification of imbalanced images. Moreover, our method could potentially solve the low classification accuracy in biomedical images caused by insufficient numbers of original images and the imbalanced distribution of original images.

Sign in / Sign up

Export Citation Format

Share Document