scholarly journals One "Ruler" for All Languages: Multi-Lingual Dialogue Evaluation with Adversarial Multi-Task Learning

2018 ◽  
Author(s):  
Xiaowei Tong ◽  
Zhenxin Fu ◽  
Mingyue Shang ◽  
Dongyan Zhao ◽  
Rui Yan
Keyword(s):  
Neural Network ◽  
Feature Extraction ◽  
Recent Work ◽  
Challenging Problem ◽  
Open Domain ◽  
Dialogue System ◽  
Shared Feature ◽  
Task Learning ◽  
Proposed Model

Automatic evaluating the performance of Open-domain dialogue system is a challenging problem. Recent work in neural network-based metrics has shown promising opportunities for automatic dialogue evaluation. However, existing methods mainly focus on monolingual evaluation, in which the trained metric is not flexible enough to transfer across different languages. To address this issue, we propose an adversarial multi-task neural metric (ADVMT) for multi-lingual dialogue evaluation, with shared feature extraction across languages. We evaluate the proposed model in two different languages. Experiments show that the adversarial multi-task neural metric achieves a high correlation with human annotation, which yields better performance than monolingual ones and various existing metrics.

Automatic Segmentation and Classification of COVID-19 CT Image Using Deep Learning and Multi-Scale Recurrent Neural Network Based Classifier

2021 ◽  
Vol 11 (10) ◽  
pp. 2618-2625
Author(s):  
R. T. Subhalakshmi ◽  
S. Appavu Alias Balamurugan ◽  
S. Sasikala
Keyword(s):  
Neural Network ◽  
Feature Extraction ◽  
Deep Learning ◽  
Recurrent Neural Network ◽  
Automatic Segmentation ◽  
Ct Images ◽  
Superior Performance ◽  
Multi Scale ◽  
Proposed Model ◽  
Class Labels

In recent times, the COVID-19 epidemic turn out to be increased in an extreme manner, by the accessibility of an inadequate amount of rapid testing kits. Consequently, it is essential to develop the automated techniques for Covid-19 detection to recognize the existence of disease from the radiological images. The most ordinary symptoms of COVID-19 are sore throat, fever, and dry cough. Symptoms are able to progress to a rigorous type of pneumonia with serious impediment. As medical imaging is not recommended currently in Canada for crucial COVID-19 diagnosis, systems of computer-aided diagnosis might aid in early COVID-19 abnormalities detection and help out to observe the disease progression, reduce mortality rates potentially. In this approach, a deep learning based design for feature extraction and classification is employed for automatic COVID-19 diagnosis from computed tomography (CT) images. The proposed model operates on three main processes based pre-processing, feature extraction, and classification. The proposed design incorporates the fusion of deep features using GoogLe Net models. Finally, Multi-scale Recurrent Neural network (RNN) based classifier is applied for identifying and classifying the test CT images into distinct class labels. The experimental validation of the proposed model takes place using open-source COVID-CT dataset, which comprises a total of 760 CT images. The experimental outcome defined the superior performance with the maximum sensitivity, specificity, and accuracy.

scholarly journals Super-resolution Ultrasound Imaging Scheme Based on a Symmetric Series Convolutional Neural Network

2021 ◽  
Author(s):  
Lakpa Dorje Tamang
Keyword(s):  
Neural Network ◽  
Feature Extraction ◽  
Convolutional Neural Network ◽  
Ultrasound Image ◽  
Similarity Index ◽  
Super Resolution ◽  
Input Image ◽  
Feature Maps ◽  
Proposed Model ◽  
Reconstruction Performance

In this paper, we propose a symmetric series convolutional neural network (SS-CNN), which is a novel deep convolutional neural network (DCNN)-based super-resolution (SR) technique for ultrasound medical imaging. The proposed model comprises two parts: a feature extraction network (FEN) and an up-sampling layer. In the FEN, the low-resolution (LR) counterpart of the ultrasound image passes through a symmetric series of two different DCNNs. The low-level feature maps obtained from the subsequent layers of both DCNNs are concatenated in a feed forward manner, aiding in robust feature extraction to ensure high reconstruction quality. Subsequently, the final concatenated features serve as an input map to the latter 2D convolutional layers, where the textural information of the input image is connected via skip connections. The second part of the proposed model is a sub-pixel convolutional (SPC) layer, which up-samples the output of the FEN by multiplying it with a multi-dimensional kernel followed by a periodic shuffling operation to reconstruct a high-quality SR ultrasound image. We validate the performance of the SS-CNN with publicly available ultrasound image datasets. Experimental results show that the proposed model achieves an exquisite reconstruction performance of ultrasound image over the conventional methods in terms of peak signal-to-noise ratio (PSNR), and structural similarity index (SSIM), while providing compelling SR reconstruction time.

Abnormal Event Detection in a Surveillance Scene Using Convolutional Neural Network

2021 ◽  
Vol 11 (4) ◽  
pp. 1-20
Author(s):  
Kinjal V. Joshi ◽  
Narendra M. Patel
Keyword(s):  
Neural Network ◽  
Feature Extraction ◽  
Convolutional Neural Network ◽  
Event Detection ◽  
Characteristic Curve ◽  
Research Area ◽  
Support Vector ◽  
Abnormal Event Detection ◽  
Proposed Model ◽  
Benchmark Datasets

Automatic abnormal event detection in a surveillance scene is very significant because of more consciousness about public safety. Because of usefulness and complexity, currently, it is an open research area. In this manuscript, the authors have proposed a novel convolutional neural network (CNN) model to detect an abnormal event in a surveillance scene. In this work, CNN is used in two ways. Firstly, it is used for both feature extraction and classification. In a second way, CNN is used for feature extraction, and support vector machine (SVM) is used for classification. Without any pre-processing, the proposed model gives better results compared to state-of-the-art methods. Experiments are carried out on four different publicly available benchmark datasets and one combined dataset, which contains all images of four datasets. The performance is measured by accuracy and area under the ROC (receiver operating characteristic) curve (AUC). The experimental results determine the efficacy of the proposed model.

scholarly journals Fault Diagnosis and Fault Frequency Determination of Permanent Magnet Synchronous Motor Based on Deep Learning

Sensors ◽  
2021 ◽  
Vol 21 (11) ◽  
pp. 3608
Author(s):  
Chiao-Sheng Wang ◽  
I-Hsi Kao ◽  
Jau-Woei Perng
Keyword(s):  
Neural Network ◽  
Feature Extraction ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Permanent Magnet ◽  
Support Vector ◽  
One Dimensional ◽  
Proposed Model ◽  
Wide Range ◽  
Fault State

The early diagnosis of a motor is important. Many researchers have used deep learning to diagnose motor applications. This paper proposes a one-dimensional convolutional neural network for the diagnosis of permanent magnet synchronous motors. The one-dimensional convolutional neural network model is weakly supervised and consists of multiple convolutional feature-extraction modules. Through the analysis of the torque and current signals of the motors, the motors can be diagnosed under a wide range of speeds, variable loads, and eccentricity effects. The advantage of the proposed method is that the feature-extraction modules can extract multiscale features from complex conditions. The number of training parameters was reduced so as to solve the overfitting problem. Furthermore, the class feature map was proposed to automatically determine the frequency component that contributes to the classification using the weak learning method. The experimental results reveal that the proposed model can effectively diagnose three different motor states—healthy state, demagnetization fault state, and bearing fault state. In addition, the model can detect eccentric effects. By combining the current and torque features, the classification accuracy of the proposed model is up to 98.85%, which is higher than that of classical machine-learning methods such as the k-nearest neighbor and support vector machine.

scholarly journals Dynamic Multi-Task Learning with Convolutional Neural Network

2017 ◽  
Author(s):  
Yuchun Fang ◽  
Zhengyan Ma ◽  
Zhaoxiang Zhang ◽  
Xu-Yao Zhang ◽  
Xiang Bai
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Large Scale ◽  
Flexible Structure ◽  
Strong Assumption ◽  
Task Learning ◽  
Proposed Model ◽  
Task Transfer ◽  
Incremental Training ◽  
Traditional Approaches

Multi-task learning and deep convolutional neural network (CNN) have been successfully used in various fields. This paper considers the integration of CNN and multi-task learning in a novel way to further improve the performance of multiple related tasks. Existing multi-task CNN models usually empirically combine different tasks into a group which is then trained jointly with a strong assumption of model commonality. Furthermore, traditional approaches usually only consider small number of tasks with rigid structure, which is not suitable for large-scale applications. In light of this, we propose a dynamic multi-task CNN model to handle these problems. The proposed model directly learns the task relations from data instead of subjective task grouping. Due to its flexible structure, it supports task-wise incremental training, which is useful for efficient training of massive tasks. Specifically, we add a new task transfer connection (TTC) between the layers of each task. The learned TTC is able to reflect the correlation among different tasks guiding the model dynamically adjusting the multiplexing of the information among different tasks. With the help of TTC, multiple related tasks can further boost the whole performance for each other. Experiments demonstrate that the proposed dynamic multi-task CNN model outperforms traditional approaches.

scholarly journals Super-resolution Ultrasound Imaging Scheme Based on a Symmetric Series Convolutional Neural Network

2021 ◽  
Author(s):  
Lakpa Dorje Tamang
Keyword(s):  
Neural Network ◽  
Feature Extraction ◽  
Convolutional Neural Network ◽  
Ultrasound Image ◽  
Similarity Index ◽  
Super Resolution ◽  
Input Image ◽  
Feature Maps ◽  
Proposed Model ◽  
Reconstruction Performance

In this paper, we propose a symmetric series convolutional neural network (SS-CNN), which is a novel deep convolutional neural network (DCNN)-based super-resolution (SR) technique for ultrasound medical imaging. The proposed model comprises two parts: a feature extraction network (FEN) and an up-sampling layer. In the FEN, the low-resolution (LR) counterpart of the ultrasound image passes through a symmetric series of two different DCNNs. The low-level feature maps obtained from the subsequent layers of both DCNNs are concatenated in a feed forward manner, aiding in robust feature extraction to ensure high reconstruction quality. Subsequently, the final concatenated features serve as an input map to the latter 2D convolutional layers, where the textural information of the input image is connected via skip connections. The second part of the proposed model is a sub-pixel convolutional (SPC) layer, which up-samples the output of the FEN by multiplying it with a multi-dimensional kernel followed by a periodic shuffling operation to reconstruct a high-quality SR ultrasound image. We validate the performance of the SS-CNN with publicly available ultrasound image datasets. Experimental results show that the proposed model achieves an exquisite reconstruction performance of ultrasound image over the conventional methods in terms of peak signal-to-noise ratio (PSNR), and structural similarity index (SSIM), while providing compelling SR reconstruction time.

scholarly journals Deep Learning-Based Caution Area Traffic Prediction with Automatic Identification System Sensor Data

Sensors ◽  
2018 ◽  
Vol 18 (9) ◽  
pp. 3172 ◽  
Author(s):  
Kwang-Il Kim ◽  
Keon Lee
Keyword(s):  
Neural Network ◽  
Feature Extraction ◽  
Sensor Data ◽  
Automatic Identification ◽  
Identification System ◽  
Medium Term ◽  
Ship Traffic ◽  
Proposed Model ◽  
Ship Movement

In a crowded harbor water area, it is a major concern to control ship traffic for assuring safety and maximizing the efficiency of port operations. Vessel Traffic Service (VTS) operators pay much attention to caution areas like ship route intersections or traffic congestion area in which there are some risks of ship collision. They want to control the traffic of the caution area at a proper level to lessen risk. Inertial ship movement makes swift changes in direction and speed difficult. It is hence important to predict future traffic of the caution area earlier on so as to get enough time for control actions on ship movements. In the harbor area, VTS stations collect a large volume of Automatic Identification Service (AIS) sensor data, which contain information about ship movement and ship attributes. This paper proposes a new deep neural network model called Ship Traffic Extraction Network (STENet) to predict the medium-term traffic and long-term traffic of the caution area. The STENet model is trained with AIS sensor data. The STENet model is organized into a hierarchical architecture in which the outputs of the movement and contextual feature extraction modules are concatenated and fed into a prediction module. The movement module extracts the features of overall ship movements with a convolutional neural network. The contextual modules consist of five separated fully-connected neural networks, each of which receives an associated attribute. The separation of feature extraction modules at the front phase helps extract the effective features by preventing unrelated attributes from crosstalking. To evaluate the performance of the proposed model, the developed model is applied to a real AIS sensor dataset, which has been collected over two years at a Korean port called Yeosu. In the experiments, four methods have been compared including two new methods: STENet and VGGNet-based models. For the real AIS sensor dataset, the proposed model has shown 50.65% relative performance improvement on average for the medium-term predictions and 57.65% improvement on average for the long-term predictions over the benchmark method, i.e., the SVR-based method.

Detection and localization of helipad in autonomous UAV landing: a coupled visual-inertial approach with artificial intelligence

2020 ◽  
Vol 71 (7) ◽  
pp. 828-839
Author(s):  
Thinh Hoang Dinh ◽  
Hieu Le Thi Hong
Keyword(s):  
Neural Network ◽  
Unmanned Aerial Vehicles ◽  
Fiducial Marker ◽  
Localization Algorithm ◽  
Challenging Problem ◽  
Autonomous Landing ◽  
Aerial Vehicles ◽  
Set Up ◽  
Detection And Localization ◽  
Rotary Wing

Autonomous landing of rotary wing type unmanned aerial vehicles is a challenging problem and key to autonomous aerial fleet operation. We propose a method for localizing the UAV around the helipad, that is to estimate the relative position of the helipad with respect to the UAV. This data is highly desirable to design controllers that have robust and consistent control characteristics and can find applications in search – rescue operations. AI-based neural network is set up for helipad detection, followed by optimization by the localization algorithm. The performance of this approach is compared against fiducial marker approach, demonstrating good consensus between two estimations

Sign in / Sign up

Export Citation Format

Share Document