scholarly journals A Data-Driven Approach to Classifying Wave Breaking in Infrared Imagery

2019 ◽  
Vol 11 (7) ◽  
pp. 859 ◽  
Author(s):  
Daniel Buscombe ◽  
Roxanne J. Carini
Keyword(s):  
Wave Breaking ◽  
Surf Zone ◽  
Image Features ◽  
Image Feature ◽  
Front Face ◽  
Infrared Imagery ◽  
Deep Convolutional Neural Networks ◽  
Back Face ◽  
Data Driven Approach ◽  
Close Range

We apply deep convolutional neural networks (CNNs) to estimate wave breaking type (e.g., non-breaking, spilling, plunging) from close-range monochrome infrared imagery of the surf zone. Image features are extracted using six popular CNN architectures developed for generic image feature extraction. Logistic regression on these features is then used to classify breaker type. The six CNN-based models are compared without and with augmentation, a process that creates larger training datasets using random image transformations. The simplest model performs optimally, achieving average classification accuracies of 89% and 93%, without and with image augmentation respectively. Without augmentation, average classification accuracies vary substantially with CNN model. With augmentation, sensitivity to model choice is minimized. A class activation analysis reveals the relative importance of image features to a given classification. During its passage, the front face and crest of a spilling breaker are more important than the back face. For a plunging breaker, the crest and back face of the wave are most important, which suggests that CNN-based models utilize the distinctive ‘streak’ temperature patterns observed on the back face of plunging breakers for classification.

scholarly journals A Data-Driven Approach to Classifying Wave Breaking in Infrared Imagery

2019 ◽  
Author(s):  
Daniel Buscombe ◽  
Roxanne Carini
Keyword(s):  
Wave Breaking ◽  
Surf Zone ◽  
Image Features ◽  
Image Feature ◽  
Front Face ◽  
Infrared Imagery ◽  
Deep Convolutional Neural Networks ◽  
Back Face ◽  
Data Driven Approach ◽  
Close Range

We apply deep convolutional neural networks (CNNs) to estimate wave breaking type from close-range monochrome infrared imagery of the surf zone. Image features are extracted using six popular CNN architectures developed for generic image feature extraction. Logistic regression on these features is then used to classify breaker type. The six CNN-based models are compared without and with augmentation, a process that creates larger training datasets using random image transformations. The simplest model performs optimally, achieving average classification accuracies of 89% and 93%, without and with image augmentation respectively. Without augmentation, average classification accuracies vary substantially with CNN model. With augmentation, sensitivity to model choice is minimized. A class activation analysis reveals the relative importance of image features to a given classification. During its passage, the front face and crest of a spilling breaker are more important than the back face. Whereas for a plunging breaker, the crest and back face of the wave are most important. This suggests that CNN-based models utilize the distinctive `streak' temperature patterns observed on the back face of plunging breakers for classification.

scholarly journals Inferring Visual Perceptual Object by Adaptive Fusion of Image Salient Features

2015 ◽  
Vol 2015 ◽  
pp. 1-9 ◽  
Author(s):  
Xin Xu ◽  
Nan Mu ◽  
Hong Zhang
Keyword(s):  
Computational Model ◽  
Computational Models ◽  
Image Features ◽  
Image Feature ◽  
Selection Scheme ◽  
Perceptual Object ◽  
Low Level ◽  
Adaptive Weight ◽  
Adaptive Fusion ◽  
Data Driven Approach

Saliency computational model with active environment perception can be useful for many applications including image retrieval, object recognition, and image segmentation. Previous work on bottom-up saliency computation typically relies on hand-crafted low-level image features. However, the adaptation of saliency computational model towards different kinds of scenes remains a challenge. For a low-level image feature, it can contribute greatly on some images but may be detrimental for saliency computation on other images. In this work, a novel data driven approach is proposed to adaptively select proper features for different kinds of images. This method exploits low-level features containing the most distinguishable salient information per image. Then the image saliency can be calculated based on the adaptive weight selection scheme. A large number of experiments are conducted on the MSRA database to compare the performance of the proposed method with the state-of-the-art saliency computational models.

High-resolution electron microscopy of the atomic structure of some grain boundaries in Au

1986 ◽  
Vol 44 ◽  
pp. 414-415
Author(s):  
W. Krakow ◽  
D. A. Smith
Keyword(s):  
Atomic Structure ◽  
High Resolution Electron Microscopy ◽  
Image Features ◽  
Image Feature ◽  
Resolution Electron ◽  
Tilt Boundaries ◽  
Processing Techniques ◽  
Atom Position ◽  
Structure Configuration

The successful determination of the atomic structure of [110] tilt boundaries in Au stems from the investigation of microscope performance at intermediate accelerating voltages (200 and 400kV) as well as a detailed understanding of how grain boundary image features depend on dynamical diffraction processes variation with specimen and beam orientations. This success is also facilitated by improving image quality by digital image processing techniques to the point where a structure image is obtained and each atom position is represented by a resolved image feature. Figure 1 shows an example of a low angle (∼10°) Σ = 129/[110] tilt boundary in a ∼250Å Au film, taken under tilted beam brightfield imaging conditions, to illustrate the steps necessary to obtain the atomic structure configuration from the image. The original image of Fig. 1a shows the regular arrangement of strain-field images associated with the cores of ½ [10] primary dislocations which are separated by ∼15Å.

Structural displacement and strain monitoring based on the edge detection operator

2016 ◽  
Vol 20 (2) ◽  
pp. 191-201 ◽  
Author(s):  
Wei Lu ◽  
Yan Cui ◽  
Jun Teng
Keyword(s):  
Edge Detection ◽  
Image Features ◽  
Image Feature ◽  
Monitoring Method ◽  
Strain Monitoring ◽  
Morphological Operator ◽  
Filtering Effect ◽  
Circular Target ◽  
Plane Displacement ◽  
The Cost

To decrease the cost of instrumentation for the strain and displacement monitoring method that uses sensors as well as considers the structural health monitoring challenges in sensor installation, it is necessary to develop a machine vision-based monitoring method. For this method, the most important step is the accurate extraction of the image feature. In this article, the edge detection operator based on multi-scale structure elements and the compound mathematical morphological operator is proposed to provide improved image feature extraction. The proposed method can not only achieve an improved filtering effect and anti-noise ability but can also detect the edge more accurately. Furthermore, the required image features (vertex of a square calibration board and centroid of a circular target) can be accurately extracted using the extracted image edge information. For validation, the monitoring tests for the structural local mean strain and in-plane displacement were designed accordingly. Through analysis of the error between the measured and calculated values of the structural strain and displacement, the feasibility and effectiveness of the proposed edge detection operator are verified.

scholarly journals A Lightweight Fusion Distillation Network for Image Deblurring and Deraining

Sensors ◽  
2021 ◽  
Vol 21 (16) ◽  
pp. 5312
Author(s):  
Yanni Zhang ◽  
Yiming Liu ◽  
Qiang Li ◽  
Jianzhong Wang ◽  
Miao Qi ◽  
...  
Keyword(s):  
Deep Learning ◽  
Image Deblurring ◽  
Image Features ◽  
Image Feature ◽  
Model Complexity ◽  
Small Scale ◽  
Feature Maps ◽  
Learning Framework ◽  
Channel Information ◽  
Scale Spaces

Recently, deep learning-based image deblurring and deraining have been well developed. However, most of these methods fail to distill the useful features. What is more, exploiting the detailed image features in a deep learning framework always requires a mass of parameters, which inevitably makes the network suffer from a high computational burden. We propose a lightweight fusion distillation network (LFDN) for image deblurring and deraining to solve the above problems. The proposed LFDN is designed as an encoder–decoder architecture. In the encoding stage, the image feature is reduced to various small-scale spaces for multi-scale information extraction and fusion without much information loss. Then, a feature distillation normalization block is designed at the beginning of the decoding stage, which enables the network to distill and screen valuable channel information of feature maps continuously. Besides, an information fusion strategy between distillation modules and feature channels is also carried out by the attention mechanism. By fusing different information in the proposed approach, our network can achieve state-of-the-art image deblurring and deraining results with a smaller number of parameters and outperform the existing methods in model complexity.

Research on air pollution system based on neural network

2020 ◽  
pp. 1-11
Author(s):  
Zhiqi Jiang ◽  
Xidong Wang
Keyword(s):  
Neural Network ◽  
Air Pollution ◽  
Image Features ◽  
Air Pollutant ◽  
Pollution Monitoring ◽  
System Model ◽  
Process Data ◽  
Deep Convolutional Neural Networks ◽  
Air Pollution Monitoring ◽  
Neural Network Algorithm

This paper conducts in-depth research and analysis on the commonly used models in the simulation process of air pollutant diffusion. Combining with the actual needs of air pollution, this paper builds an air pollution system model based on neural network based on neural network algorithm, and proposes an image classification method based on deep learning and Gaussian aggregation coding. Moreover, this paper proposes a Gaussian aggregation coding layer to encode image features extracted by deep convolutional neural networks. Learn a fixed-size dictionary to represent the features of the image for final classification. In addition, this paper constructs an air pollution monitoring system based on the actual needs of the air system. Finally, this article designs a controlled experiment to verify the model proposed in this article, uses mathematical statistics to process data, and scientifically analyze the statistical results. The research results show that the model constructed in this paper has a certain effect.

scholarly journals 3D Affine: An Embedding of Local Image Features for Viewpoint Invariance Using RGB-D Sensor Data

Sensors ◽  
2019 ◽  
Vol 19 (2) ◽  
pp. 291 ◽  
Author(s):  
Hamdi Sahloul ◽  
Shouhei Shirafuji ◽  
Jun Ota
Keyword(s):  
Low Cost ◽  
Image Features ◽  
Image Feature ◽  
Sensor Data ◽  
Invariant Representation ◽  
Depth Sensors ◽  
Viewpoint Invariance ◽  
Surface Discontinuities ◽  
Local Image ◽  
Local Image Features

Local image features are invariant to in-plane rotations and robust to minor viewpoint changes. However, the current detectors and descriptors for local image features fail to accommodate out-of-plane rotations larger than 25°–30°. Invariance to such viewpoint changes is essential for numerous applications, including wide baseline matching, 6D pose estimation, and object reconstruction. In this study, we present a general embedding that wraps a detector/descriptor pair in order to increase viewpoint invariance by exploiting input depth maps. The proposed embedding locates smooth surfaces within the input RGB-D images and projects them into a viewpoint invariant representation, enabling the detection and description of more viewpoint invariant features. Our embedding can be utilized with different combinations of descriptor/detector pairs, according to the desired application. Using synthetic and real-world objects, we evaluated the viewpoint invariance of various detectors and descriptors, for both standalone and embedded approaches. While standalone local image features fail to accommodate average viewpoint changes beyond 33.3°, our proposed embedding boosted the viewpoint invariance to different levels, depending on the scene geometry. Objects with distinct surface discontinuities were on average invariant up to 52.8°, and the overall average for all evaluated datasets was 45.4°. Similarly, out of a total of 140 combinations involving 20 local image features and various objects with distinct surface discontinuities, only a single standalone local image feature exceeded the goal of 60° viewpoint difference in just two combinations, as compared with 19 different local image features succeeding in 73 combinations when wrapped in the proposed embedding. Furthermore, the proposed approach operates robustly in the presence of input depth noise, even that of low-cost commodity depth sensors, and well beyond.

scholarly journals Experimental Evaluation of PSO Based Transfer Learning Method for Meteorological Visibility Estimation

Atmosphere ◽  
2021 ◽  
Vol 12 (7) ◽  
pp. 828
Author(s):  
Wai Lun Lo ◽  
Henry Shu Hung Chung ◽  
Hong Fu
Keyword(s):  
Transfer Learning ◽  
Experimental Evaluation ◽  
Estimation Method ◽  
Image Features ◽  
Parameters Estimation ◽  
Image Feature ◽  
Support Vector ◽  
Learning Method ◽  
Feature Vectors ◽  
Visibility Estimation

Estimation of Meteorological visibility from image characteristics is a challenging problem in the research of meteorological parameters estimation. Meteorological visibility can be used to indicate the weather transparency and this indicator is important for transport safety. This paper summarizes the outcomes of the experimental evaluation of a Particle Swarm Optimization (PSO) based transfer learning method for meteorological visibility estimation method. This paper proposes a modified approach of the transfer learning method for visibility estimation by using PSO feature selection. Image data are collected at fixed location with fixed viewing angle. The database images were gone through a pre-processing step of gray-averaging so as to provide information of static landmark objects for automatic extraction of effective regions from images. Effective regions are then extracted from image database and the image features are then extracted from the Neural Network. Subset of Image features are selected based on the Particle Swarming Optimization (PSO) methods to obtain the image feature vectors for each effective sub-region. The image feature vectors are then used to estimate the visibilities of the images by using the Multiple Support Vector Regression (SVR) models. Experimental results show that the proposed method can give an accuracy more than 90% for visibility estimation and the proposed method is effective and robust.

DCNN-based Ship Classification using Enhanced Edge Information and Inception Module

2021 ◽  
Author(s):  
Bo Wang ◽  
Xiaoting Yu ◽  
Chengeng Huang ◽  
Qinghong Sheng ◽  
Yuanyuan Wang ◽  
...  
Keyword(s):  
Neural Networks ◽  
Classification Performance ◽  
Image Features ◽  
Deep Convolutional Neural Networks ◽  
Edge Information ◽  
Average Accuracy ◽  
Ship Classification ◽  
Edge Features ◽  
High Level ◽  
Better Than

The excellent feature extraction ability of deep convolutional neural networks (DCNNs) has been demonstrated in many image processing tasks, by which image classification can achieve high accuracy with only raw input images. However, the specific image features that influence the classification results are not readily determinable and what lies behind the predictions is unclear. This study proposes a method combining the Sobel and Canny operators and an Inception module for ship classification. The Sobel and Canny operators obtain enhanced edge features from the input images. A convolutional layer is replaced with the Inception module, which can automatically select the proper convolution kernel for ship objects in different image regions. The principle is that the high-level features abstracted by the DCNN, and the features obtained by multi-convolution concatenation of the Inception module must ultimately derive from the edge information of the preprocessing input images. This indicates that the classification results are based on the input edge features, which indirectly interpret the classification results to some extent. Experimental results show that the combination of the edge features and the Inception module improves DCNN ship classification performance. The original model with the raw dataset has an average accuracy of 88.72%, while when using enhanced edge features as input, it achieves the best performance of 90.54% among all models. The model that replaces the fifth convolutional layer with the Inception module has the best performance of 89.50%. It performs close to VGG-16 on the raw dataset and is significantly better than other deep neural networks. The results validate the functionality and feasibility of the idea posited.

Sign in / Sign up

Export Citation Format

Share Document