scholarly journals Structural Damage Detection Based on Real-Time Vibration Signal and Convolutional Neural Network

2020 ◽  
Vol 10 (14) ◽  
pp. 4720 ◽  
Author(s):  
Zhiqiang Teng ◽  
Shuai Teng ◽  
Jiqiao Zhang ◽  
Gongfa Chen ◽  
Fangsen Cui
Keyword(s):  
Neural Network ◽  
Experimental Data ◽  
Convolutional Neural Network ◽  
Real Time ◽  
Structural State ◽  
Detection Method ◽  
Steel Frame ◽  
Engineering Practice ◽  
Detection Accuracy ◽  
Vibration Signals

The traditional methods of structural health monitoring (SHM) have obvious disadvantages such as being time-consuming, laborious and non-synchronizing, and so on. This paper presents a novel and efficient approach to detect structural damages from real-time vibration signals via a convolutional neural network (CNN). As vibration signals (acceleration) reflect the structural response to the changes of the structural state, hence, a CNN, as a classifier, can map vibration signals to the structural state and detect structural damages. As it is difficult to obtain enough damage samples in practical engineering, finite element analysis (FEA) provides an alternative solution to this problem. In this paper, training samples for the CNN are obtained using FEA of a steel frame, and the effectiveness of the proposed detection method is evaluated by inputting the experimental data into the CNN. The results indicate that, the detection accuracy of the CNN trained using FEA data reaches 94% for damages introduced in the numerical model and 90% for damages in the real steel frame. It is demonstrated that the CNN has an ideal detection effect for both single damage and multiple damages. The combination of FEA and experimental data provides enough training and testing samples for the CNN, which improves the practicability of the CNN-based detection method in engineering practice.

scholarly journals A Real-time Driver Fatigue Detection Method Based on Two-Stage Convolutional Neural Network

2020 ◽  
Vol 53 (2) ◽  
pp. 15374-15379
Author(s):  
Hu He ◽  
Xiaoyong Zhang ◽  
Fu Jiang ◽  
Chenglong Wang ◽  
Yingze Yang ◽  
...  
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Real Time ◽  
Detection Method ◽  
Driver Fatigue ◽  
Two Stage ◽  
Fatigue Detection

A real-time music detection method based on convolutional neural network using Mel-spectrogram and spectral flux

2021 ◽  
Vol 263 (1) ◽  
pp. 5910-5918
Author(s):  
Yiya Hao ◽  
Yaobin Chen ◽  
Weiwei Zhang ◽  
Gong Chen ◽  
Liang Ruan
Keyword(s):  
Neural Network ◽  
Online Education ◽  
Convolutional Neural Network ◽  
Real Time ◽  
Speech Intelligibility ◽  
Classical Music ◽  
Detection Method ◽  
Automatic Gain Control ◽  
Real Time Processing ◽  
Spectral Flux

Audio processing, including speech enhancement system, improves speech intelligibility and quality in real-time communication (RTC) such as online meetings and online education. However, such processing, primarily noise suppression and automatic gain control, is harmful to music quality when the captured signal is music instead of speech. A music detector can solve the issue above by switching off the speech processing when the music is detected. In RTC scenarios, the music detector should be low-complexity and cover various situations, including different types of music, background noises, and other acoustical environments. In this paper, a real-time music detection method with low-computation complexity is proposed, based on a convolutional neural network (CNN) using Mel-spectrogram and spectral flux as input features. The proposed method achieves overall 90.63% accuracy under different music types (classical music, instruments solos, singing-songs, etc.), speech languages (English and Mandarin), and noise types. The proposed method is constructed on a lightweight CNN model with a small feature size, which guarantees real-time processing.

scholarly journals Enhanced Deep Learning Architectures for Face Liveness Detection for Static and Video Sequences

Entropy ◽  
2020 ◽  
Vol 22 (10) ◽  
pp. 1186
Author(s):  
Ranjana Koshy ◽  
Ausif Mahmood
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Real Time ◽  
Anisotropic Diffusion ◽  
Short Term Memory ◽  
Total Error ◽  
Detection Accuracy ◽  
Test Accuracy ◽  
Replay Attack ◽  
Liveness Detection

Face liveness detection is a critical preprocessing step in face recognition for avoiding face spoofing attacks, where an impostor can impersonate a valid user for authentication. While considerable research has been recently done in improving the accuracy of face liveness detection, the best current approaches use a two-step process of first applying non-linear anisotropic diffusion to the incoming image and then using a deep network for final liveness decision. Such an approach is not viable for real-time face liveness detection. We develop two end-to-end real-time solutions where nonlinear anisotropic diffusion based on an additive operator splitting scheme is first applied to an incoming static image, which enhances the edges and surface texture, and preserves the boundary locations in the real image. The diffused image is then forwarded to a pre-trained Specialized Convolutional Neural Network (SCNN) and the Inception network version 4, which identify the complex and deep features for face liveness classification. We evaluate the performance of our integrated approach using the SCNN and Inception v4 on the Replay-Attack dataset and Replay-Mobile dataset. The entire architecture is created in such a manner that, once trained, the face liveness detection can be accomplished in real-time. We achieve promising results of 96.03% and 96.21% face liveness detection accuracy with the SCNN, and 94.77% and 95.53% accuracy with the Inception v4, on the Replay-Attack, and Replay-Mobile datasets, respectively. We also develop a novel deep architecture for face liveness detection on video frames that uses the diffusion of images followed by a deep Convolutional Neural Network (CNN) and a Long Short-Term Memory (LSTM) to classify the video sequence as real or fake. Even though the use of CNN followed by LSTM is not new, combining it with diffusion (that has proven to be the best approach for single image liveness detection) is novel. Performance evaluation of our architecture on the REPLAY-ATTACK dataset gave 98.71% test accuracy and 2.77% Half Total Error Rate (HTER), and on the REPLAY-MOBILE dataset gave 95.41% accuracy and 5.28% HTER.

Multi-collaborative Regression Convolutional Neural Network for Vehicle Angle Detection

2020 ◽  
Vol 13 (8) ◽  
pp. 1227-1241
Author(s):  
Guoqiang Chen ◽  
Mengchao Liu ◽  
Hongpeng Zhou ◽  
Bingxin Bai
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Real Time ◽  
Autonomous Vehicles ◽  
Training Sample ◽  
Detection Accuracy ◽  
Detection Error ◽  
Detection Failure ◽  
Pose Detection ◽  
Parking Lot

Background: The vehicle pose detection plays an important role in monitoring vehicle behavior and the parking situation. The real-time detection of vehicle pose with high accuracy is of great importance. Objective: The goal of the work is to construct a new network to detect the vehicle angle based on the regression Convolutional Neural Network (CNN). The main contribution is that several traditional regression CNNs are combined as the Multi-Collaborative Regression CNN (MCR-CNN), which greatly enhances the vehicle angle detection precision and eliminates the abnormal detection error. Methods: Two challenges with respect to the traditional regression CNN have been revealed in detecting the vehicle pose angle. The first challenge is the detection failure resulting from the conversion of the periodic angle to the linear angle, while the second is the big detection error if the training sample value is very small. An MCR-CNN is proposed to solve the first challenge. And a 2- stage method is proposed to solve the second challenge. The architecture of the MCR-CNN is designed in detail. After the training and testing data sets are constructed, the MCR-CNN is trained and tested for vehicle angle detection. Results: The experimental results show that the testing samples with the error below 4° account for 95% of the total testing samples based on the proposed MCR-CNN. The MCR-CNN has significant advantages over the traditional vehicle pose detection method. Conclusion: The proposed MCR-CNN cannot only detect the vehicle angle in real-time, but also has a very high detection accuracy and robustness. The proposed approach can be used for autonomous vehicles and monitoring of the parking lot.

scholarly journals High-Speed Ship Detection in SAR Images Based on a Grid Convolutional Neural Network

2019 ◽  
Vol 11 (10) ◽  
pp. 1206 ◽  
Author(s):  
Tianwen Zhang ◽  
Xiaoling Zhang
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Real Time ◽  
High Speed ◽  
Earth Observation ◽  
Detection Accuracy ◽  
Processing Unit ◽  
Sar Images ◽  
Ship Detection ◽  
Detection Speed

As an active microwave sensor, synthetic aperture radar (SAR) has the characteristic of all-day and all-weather earth observation, which has become one of the most important means for high-resolution earth observation and global resource management. Ship detection in SAR images is also playing an increasingly important role in ocean observation and disaster relief. Nowadays, both traditional feature extraction methods and deep learning (DL) methods almost focus on improving ship detection accuracy, and the detection speed is neglected. However, the speed of SAR ship detection is extraordinarily significant, especially in real-time maritime rescue and emergency military decision-making. In order to solve this problem, this paper proposes a novel approach for high-speed ship detection in SAR images based on a grid convolutional neural network (G-CNN). This method improves the detection speed by meshing the input image, inspired by the basic thought of you only look once (YOLO), and using depthwise separable convolution. G-CNN is a brand new network structure proposed by us and it is mainly composed of a backbone convolutional neural network (B-CNN) and a detection convolutional neural network (D-CNN). First, SAR images to be detected are divided into grid cells and each grid cell is responsible for detection of specific ships. Then, the whole image is input into B-CNN to extract features. Finally, ship detection is completed in D-CNN under three scales. We experimented on an open SAR Ship Detection Dataset (SSDD) used by many other scholars and then validated the migration ability of G-CNN on two SAR images from RadarSat-1 and Gaofen-3. The experimental results show that the detection speed of our proposed method is faster than the existing other methods, such as faster-regions convolutional neural network (Faster R-CNN), single shot multi-box detector (SSD), and YOLO, under the same hardware environment with NVIDIA GTX1080 graphics processing unit (GPU) and the detection accuracy is kept within an acceptable range. Our proposed G-CNN ship detection system has great application values in real-time maritime disaster rescue and emergency military strategy formulation.

scholarly journals Detection of Rice Diseases by the Fusion of Optimization based K-means Clustering Algorithm and Faster Region based Convolutional Neural Network

Webology ◽  
2021 ◽  
Vol 18 (2) ◽  
pp. 693-708
Author(s):  
A. Pushpa Athisaya Sakila Rani ◽  
N. Suresh Singh
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Minimum Distance ◽  
Clustering Algorithm ◽  
Detection Method ◽  
Median Filter ◽  
Plant Diseases ◽  
Detection Accuracy ◽  
Leaf Lesion ◽  
Rice Disease

One of the most important food crops in the world is rice, which is highly affected by various plant diseases and pests. Even though there are so many methods to address the concern, detection accuracy is a hectic challenge, which needs to be boosted for an enjoyable farming environment. In the present study a rice disease detection technique was implemented by the fusion of Sailfish optimization – K-means (SCM-KM) and the Faster Region Based Convolutional Neural Network (Faster R-CNN) method. For the optimization of the KM clustering method, Sailfish Optimizer was coupled with the Maximum and Minimum distance algorithm, as well as Chaos theory. The 2D Filtering Mask and Weighted Multilevel Median Filter(2DFM-AMMF) were used to eliminate the sounds. With the aid of the Faster 2D-Otsu technique, the target leaf lesion was segmented from the image. The SCM-KM method is used for detection of rice disease. The Rice diseases were characterized and classified by Region Proposal Networks (RPN) and Faster R-CNN method. Comparative analysis of the SCM-KM+ Faster R-CNN method was performed using the metrics sensitivity, accuracy, and specificity. The proposed detection method produced elevated performance over similar bench marking frameworks.

scholarly journals Research on Online Defect Detection Method of Solar Cell Component Based on Lightweight Convolutional Neural Network

2021 ◽  
Vol 2021 ◽  
pp. 1-13
Author(s):  
Huaiguang Liu ◽  
Wancheng Ding ◽  
Qianwen Huang ◽  
Li Fang
Keyword(s):  
Neural Network ◽  
Solar Cell ◽  
Convolutional Neural Network ◽  
Silicon Wafer ◽  
Defect Detection ◽  
Detection Method ◽  
Detection Accuracy ◽  
Cell Component ◽  
Original Algorithm ◽  
Detection Speed

The defects of solar cell component (SCC) will affect the service life and power generation efficiency. In this paper, the defect images of SCC were taken by the photoluminescence (PL) method and processed by an advanced lightweight convolutional neural network (CNN). Firstly, in order to solve the high pixel SCC image detection, each silicon wafer image was segmented based on local difference extremum of edge projection (LDEEP). Secondly, in order to detect the defects with small size or weak edges in the silicon wafer, an improved lightweight CNN model with deep backbone feature extraction network structure was proposed, as the enhancing feature fusion layer and the three-scale feature prediction layer; the model provided more feature detail. The final experimental results showed that the improved model achieves a good balance between the detection accuracy and detection speed, with the mean average precision (mAP) reaching 87.55%, which was 6.78% higher than the original algorithm. Moreover, the detection speed reached 40 frames per second (fps), which meets requirements of precision and real-time detection. The detection method can better complete the defect detection task of SCC, which lays the foundation for automatic detection of SCC defects.

A novel real-time fall detection method based on head segmentation and convolutional neural network

2020 ◽  
Vol 17 (6) ◽  
pp. 1939-1949 ◽  
Author(s):  
Chenguang Yao ◽  
Jun Hu ◽  
Weidong Min ◽  
Zhifeng Deng ◽  
Song Zou ◽  
...  
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Real Time ◽  
Detection Method ◽  
Fall Detection ◽  
Head Segmentation ◽  
Time Fall

scholarly journals Identification of line status changes using phasor measurements in transient states through deep learning networks

2020 ◽  
Vol 216 ◽  
pp. 01035
Author(s):  
Natalja Gotman ◽  
Galina Shumilova
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Real Time ◽  
Detection Method ◽  
Electrical Network ◽  
Learning Networks ◽  
Transient States ◽  
Phasor Measurements ◽  
State Detection

The problem of detecting changes in a topology of an electrical network in real time is solved. This paper proposes a line state detection method based on a convolutional neural network (CNN) classifier using phasor measurements of bus voltages and currents in transient states.

Sign in / Sign up

Export Citation Format

Share Document