Motion Blur Removal for Uav-Based Wind Turbine Blade Images Using Synthetic Datasets

Unmanned air vehicle (UAV) based imaging has been an attractive technology to be used for wind turbine blades (WTBs) monitoring. In such applications, image motion blur is a challenging problem which means that motion deblurring is of great significance in the monitoring of running WTBs. However, an embarrassing fact for these applications is the lack of sufficient WTB images, which should include better pairs of sharp images and blurred images captured under the same conditions for network model training. To overcome the challenge of image pair acquisition, a training sample synthesis method is proposed. Sharp images of static WTBs were first captured, and then video sequences were prepared by running WTBs at different speeds. The blurred images were identified from the video sequences and matched to the sharp images using image difference. To expand the sample dataset, rotational motion blurs were simulated on different WTBs. Synthetic image pairs were then produced by fusing sharp images and images of simulated blurs. Finally, a total of 4000 image pairs were obtained. To conduct motion deblurring, a hybrid deblurring network integrated with DeblurGAN and DeblurGANv2 was deployed. The results show that the integration of DeblurGANv2 and Inception-ResNet-v2 provides better deblurred images, in terms of both metrics of signal-to-noise ratio (80.138) and structural similarity (0.950) than those obtained from the comparable networks of DeblurGAN and MobileNet-DeblurGANv2.

BLIND RESTORATION USING CONVOLUTION NEURAL NETWORK

Image restoration is a branch of image processing that involves a mathematical deterioration and restoration model to restore an original image from a degraded image. This research aims to restore blurred images that have been corrupted by a known or unknown degradation function. Image restoration approaches can be classified into 2 groups based on degradation feature knowledge: blind and non-blind techniques. In our research, we adopt the type of blind algorithm. A deep learning method (SR) has been proposed for single image super-resolution. This approach can directly learn an end-to-end mapping between low-resolution images and high-resolution images. The mapping is expressed by a deep convolutional neural network (CNN). The proposed restoration system must overcome and deal with the challenges that the degraded images have unknown kernel blur, to deblur degraded images as an estimation from original images with a minimum rate of error.

Pareidolia in Schizophrenia and Bipolar Disorder

While there are many studies on pareidolia in healthy individuals and patients with schizophrenia, to our knowledge, there are no prior studies on pareidolia in patients with bipolar disorder. Accordingly, in this study, we, for the first time, measured pareidolia in patients with bipolar disorder (N = 50), and compared that to patients with schizophrenia (N = 50) and healthy controls (N = 50). We have used (a) the scene test, which consists of 10 blurred images of natural scenes that was previously found to produce illusory face responses and (b) the noise test which had 32 black and white images consisting of visual noise and 8 images depicting human faces; participants indicated whether a face was present on these images and to point to the location where they saw the face. Illusory responses were defined as answers when observers falsely identified objects that were not on the images in the scene task (maximum illusory score: 10), and the number of noise images in which they reported the presence of a face (maximum illusory score: 32). Further, we also calculated the total pareidolia score for each task (the sum number of images with illusory responses in the scene and noise tests). The responses were scored by two independent raters with an excellent congruence (kappa > 0.9). Our results show that schizophrenia patients scored higher on pareidolia measures than both healthy controls and patients with bipolar disorder. Our findings are agreement with prior findings on more impaired cognitive processes in schizophrenia than in bipolar patients.

Research on Subway Pedestrian Detection Algorithm Based on Big Data Cleaning Technology

The pedestrian detection model has a high requirement on the quality of the dataset. Concerning this problem, this paper uses data cleaning technology to improve the quality of the dataset, so as to improve the performance of the pedestrian detection model. The dataset used in this paper is obtained from subway stations in Beijing and Nanjing. The data images’ quality is subject to motion blur, uneven illumination, and other noisy factors. Therefore, data cleaning is very important for this paper. The data cleaning process in this paper is divided into two parts: detection and correction. First, the whole dataset goes through blur detection, and the severely blurred images are filtered as the difficult samples. Then, the image is sent to DeblurGAN for deblur processing. 2D gamma function adaptive illumination correction algorithm is used to correct the subway pedestrian image. Then, the processed data is sent to the pedestrian detection model. Under different data cleaning datasets, through the analysis of the detection results, it is proved that the data cleaning process significantly improves the detection model’s performance.

Increasing the Image Sharpness of Light Microscope Images Using Deep Learning

Image-based qualitative and quantitative structural analyses using high-resolution light microscopy are integral parts of the materialographic work on materials and components. Vibrations or defocusing often result in blurred image areas, especially in large-scale micrographs and at high magnifications. As the robustness of the image-processing analysis methods is highly dependent on the image grade, the image quality directly affects the quantitative structural analysis. We present a deep learning model which, when using appropriate training data, is capable of increasing the image sharpness of light microscope images. We show that a sharpness correction for blurred images can successfully be performed using deep learning, taking the examples of steels with a bainitic microstructure, non-metallic inclusions in the context of steel purity degree analyses, aluminumsilicon cast alloys, sintered magnets, and lithium-ion batteries. We furthermore examine whether geometric accuracy is ensured in the artificially resharpened images.

Presentation in Self-Posted Facial Images Can Expose Sexual Orientation: Implications for Research and Privacy

Recent research has found that facial recognition algorithms can accurately classify people’s sexual orientations using naturalistic facial images, highlighting a severe risk to privacy. This article tests whether people of different sexual orientations present themselves distinctively in photographs, and whether these distinctions revealed their sexual orientation. I found significant differences in self-presentation. For example, gay individuals were on average more likely to wear glasses compared to heterosexual individuals in images uploaded to the dating website. Gay men also uploaded brighter images compared to heterosexual men. To test whether some of these differences drove classification of sexual orientation, I employed image augmentation or modification techniques. I progressively masked images until only a thin border of image background remained in each facial image. I found that even these pixels classified sexual orientations at rates significantly higher than random chance. I also blurred images, and found that merely three numbers representing the brightness of each color channel classified sexual orientations. These findings contribute to psychological research on sexual orientation by highlighting how people chose to present themselves differently on the dating website according to their sexual orientations. The findings also expose a privacy risk as they suggest that do-it-yourself data-protection strategies, such as masking and blurring, cannot effectively prevent leakage of sexual orientation information. As consumers are not equipped to protect themselves, the burden of privacy protection should be shifted to companies and governments.

High Inclusiveness and Accuracy Motion Blur Real-Time Gesture Recognition Based on YOLOv4 Model Combined Attention Mechanism and DeblurGanv2

The combination of gesture recognition and aerospace exploration robots can realize the efficient non-contact control of the robots. In the harsh aerospace environment, the captured gesture images are usually blurred and damaged inevitably. The motion blurred images not only cause part of the transmitted information to be lost, but also affect the effect of neural network training in the later stage. To improve the speed and accuracy of motion blurred gestures recognition, the algorithm of YOLOv4 (You Only Look Once, vision 4) is studied from the two aspects of motion blurred image processing and model optimization. The DeblurGanv2 is employed to remove the motion blur of the gestures in YOLOv4 network input pictures. In terms of model structure, the K-means++ algorithm is used to cluster the priori boxes for obtaining the more appropriate size parameters of the priori boxes. The CBAM attention mechanism and SPP (spatial pyramid pooling layer) structure are added to YOLOv4 model to improve the efficiency of network learning. The dataset for network training is designed for the human–computer interaction in the aerospace space. To reduce the redundant features of the captured images and enhance the effect of model training, the Wiener filter and bilateral filter are superimposed on the blurred images in the dataset to simply remove the motion blur. The augmentation of the model is executed by imitating different environments. A YOLOv4-gesture model is built, which collaborates with K-means++ algorithm, the CBAM and SPP mechanism. A DeblurGanv2 model is built to process the input images of the YOLOv4 target recognition. The YOLOv4-motion-blur-gesture model is composed of the YOLOv4-gesture and the DeblurGanv2. The augmented and enhanced gesture data set is used to simulate the model training. The experimental results demonstrate that the YOLOv4-motion-blur-gesture model has relatively better performance. The proposed model has the high inclusiveness and accuracy recognition effect in the real-time interaction of motion blur gestures, it improves the network training speed by 30%, the target detection accuracy by 10%, and the value of mAP by about 10%. The constructed YOLOv4-motion-blur-gesture model has a stable performance. It can not only meet the real-time human–computer interaction in aerospace space under real-time complex conditions, but also can be applied to other application environments under complex backgrounds requiring real-time detection.

An Adaptive Deblurring Vehicle Detection Method for High-Speed Moving Drones: Resistance to Shake

Vehicle detection is an essential part of an intelligent traffic system, which is an important research field in drone application. Because unmanned aerial vehicles (UAVs) are rarely configured with stable camera platforms, aerial images are easily blurred. There is a challenge for detectors to accurately locate vehicles in blurred images in the target detection process. To improve the detection performance of blurred images, an end-to-end adaptive vehicle detection algorithm (DCNet) for drones is proposed in this article. First, the clarity evaluation module is used to determine adaptively whether the input image is a blurred image using improved information entropy. An improved GAN called Drone-GAN is proposed to enhance the vehicle features of blurred images. Extensive experiments were performed, the results of which show that the proposed method can detect both blurred and clear images well in poor environments (complex illumination and occlusion). The detector proposed achieves larger gains compared with SOTA detectors. The proposed method can enhance the vehicle feature details in blurred images effectively and improve the detection accuracy of blurred aerial images, which shows good performance with regard to resistance to shake.