scholarly journals SmokeNet: Satellite Smoke Scene Detection Using Convolutional Neural Network with Spatial and Channel-Wise Attention

2019 ◽  
Vol 11 (14) ◽  
pp. 1702 ◽  
Author(s):  
Rui Ba ◽  
Chen Chen ◽  
Jing Yuan ◽  
Weiguo Song ◽  
Siuming Lo
Keyword(s):  
Neural Network ◽  
Satellite Imagery ◽  
Large Scale ◽  
State Of The Art ◽  
Kappa Coefficient ◽  
Feature Representation ◽  
Detection Methods ◽  
Smoke Detection ◽  
Training Images ◽  
Moderate Resolution Imaging Spectroradiometer

A variety of environmental analysis applications have been advanced by the use of satellite remote sensing. Smoke detection based on satellite imagery is imperative for wildfire detection and monitoring. However, the commonly used smoke detection methods mainly focus on smoke discrimination from a few specific classes, which reduces their applicability in different regions of various classes. To this end, in this paper, we present a new large-scale satellite imagery smoke detection benchmark based on Moderate Resolution Imaging Spectroradiometer (MODIS) data, namely USTC_SmokeRS, consisting of 6225 satellite images from six classes (i.e., cloud, dust, haze, land, seaside, and smoke) and covering various areas/regions over the world. To build a baseline for smoke detection in satellite imagery, we evaluate several state-of-the-art deep learning-based image classification models. Moreover, we propose a new convolution neural network (CNN) model, SmokeNet, which incorporates spatial and channel-wise attention in CNN to enhance feature representation for scene classification. The experimental results of our method using different proportions (16%, 32%, 48%, and 64%) of training images reveal that our model outperforms other approaches with higher accuracy and Kappa coefficient. Specifically, the proposed SmokeNet model trained with 64% training images achieves the best accuracy of 92.75% and Kappa coefficient of 0.9130. The model trained with 16% training images can also improve the classification accuracy and Kappa coefficient by at least 4.99% and 0.06, respectively, over the state-of-the-art models.

scholarly journals SketchGNN: Semantic Sketch Segmentation with Graph Neural Networks

2021 ◽  
Vol 40 (3) ◽  
pp. 1-13
Author(s):  
Lumin Yang ◽  
Jiajie Zhuang ◽  
Hongbo Fu ◽  
Xiangzhi Wei ◽  
Kun Zhou ◽  
...  
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Network Architecture ◽  
Large Scale ◽  
State Of The Art ◽  
Semantic Segmentation ◽  
Structure Information ◽  
Graph Neural Networks ◽  
Node Labels ◽  
Point Level

We introduce SketchGNN , a convolutional graph neural network for semantic segmentation and labeling of freehand vector sketches. We treat an input stroke-based sketch as a graph with nodes representing the sampled points along input strokes and edges encoding the stroke structure information. To predict the per-node labels, our SketchGNN uses graph convolution and a static-dynamic branching network architecture to extract the features at three levels, i.e., point-level, stroke-level, and sketch-level. SketchGNN significantly improves the accuracy of the state-of-the-art methods for semantic sketch segmentation (by 11.2% in the pixel-based metric and 18.2% in the component-based metric over a large-scale challenging SPG dataset) and has magnitudes fewer parameters than both image-based and sequence-based methods.

scholarly journals ShadingNet: Image Intrinsics by Fine-Grained Shading Decomposition

2021 ◽  
Author(s):  
Anil S. Baslamisli ◽  
Partha Das ◽  
Hoang-An Le ◽  
Sezer Karaoglu ◽  
Theo Gevers
Keyword(s):  
Neural Network ◽  
Large Scale ◽  
State Of The Art ◽  
Image Decomposition ◽  
Natural Environments ◽  
Decomposition Algorithms ◽  
Ambient Light ◽  
Fine Grained ◽  
Large Scale Dataset ◽  
Direct Illumination

AbstractIn general, intrinsic image decomposition algorithms interpret shading as one unified component including all photometric effects. As shading transitions are generally smoother than reflectance (albedo) changes, these methods may fail in distinguishing strong photometric effects from reflectance variations. Therefore, in this paper, we propose to decompose the shading component into direct (illumination) and indirect shading (ambient light and shadows) subcomponents. The aim is to distinguish strong photometric effects from reflectance variations. An end-to-end deep convolutional neural network (ShadingNet) is proposed that operates in a fine-to-coarse manner with a specialized fusion and refinement unit exploiting the fine-grained shading model. It is designed to learn specific reflectance cues separated from specific photometric effects to analyze the disentanglement capability. A large-scale dataset of scene-level synthetic images of outdoor natural environments is provided with fine-grained intrinsic image ground-truths. Large scale experiments show that our approach using fine-grained shading decompositions outperforms state-of-the-art algorithms utilizing unified shading on NED, MPI Sintel, GTA V, IIW, MIT Intrinsic Images, 3DRMS and SRD datasets.

SHEDR: An End-to-End Deep Neural Event Detection and Recommendation Framework for Hyperlocal News Using Social Media

2021 ◽  
Author(s):  
Yuheng Hu ◽  
Yili Hong
Keyword(s):  
Neural Network ◽  
Social Media ◽  
Deep Learning ◽  
Event Detection ◽  
Large Scale ◽  
Short Term Memory ◽  
State Of The Art ◽  
Neural Network Models ◽  
Neural Event ◽  
End To End

Residents often rely on newspapers and television to gather hyperlocal news for community awareness and engagement. More recently, social media have emerged as an increasingly important source of hyperlocal news. Thus far, the literature on using social media to create desirable societal benefits, such as civic awareness and engagement, is still in its infancy. One key challenge in this research stream is to timely and accurately distill information from noisy social media data streams to community members. In this work, we develop SHEDR (social media–based hyperlocal event detection and recommendation), an end-to-end neural event detection and recommendation framework with a particular use case for Twitter to facilitate residents’ information seeking of hyperlocal events. The key model innovation in SHEDR lies in the design of the hyperlocal event detector and the event recommender. First, we harness the power of two popular deep neural network models, the convolutional neural network (CNN) and long short-term memory (LSTM), in a novel joint CNN-LSTM model to characterize spatiotemporal dependencies for capturing unusualness in a region of interest, which is classified as a hyperlocal event. Next, we develop a neural pairwise ranking algorithm for recommending detected hyperlocal events to residents based on their interests. To alleviate the sparsity issue and improve personalization, our algorithm incorporates several types of contextual information covering topic, social, and geographical proximities. We perform comprehensive evaluations based on two large-scale data sets comprising geotagged tweets covering Seattle and Chicago. We demonstrate the effectiveness of our framework in comparison with several state-of-the-art approaches. We show that our hyperlocal event detection and recommendation models consistently and significantly outperform other approaches in terms of precision, recall, and F-1 scores. Summary of Contribution: In this paper, we focus on a novel and important, yet largely underexplored application of computing—how to improve civic engagement in local neighborhoods via local news sharing and consumption based on social media feeds. To address this question, we propose two new computational and data-driven methods: (1) a deep learning–based hyperlocal event detection algorithm that scans spatially and temporally to detect hyperlocal events from geotagged Twitter feeds; and (2) A personalized deep learning–based hyperlocal event recommender system that systematically integrates several contextual cues such as topical, geographical, and social proximity to recommend the detected hyperlocal events to potential users. We conduct a series of experiments to examine our proposed models. The outcomes demonstrate that our algorithms are significantly better than the state-of-the-art models and can provide users with more relevant information about the local neighborhoods that they live in, which in turn may boost their community engagement.

scholarly journals Development of Novel Multiplex PCR for Diagnosis of Co-infected Hemo-parasites in Cattle

2021 ◽  
Author(s):  
Pankaj Kumar ◽  
Abhay Kumar ◽  
Kamal Sarma ◽  
Paresh Sharma ◽  
Rashmi Rekha Kumari ◽  
...  
Keyword(s):  
Multiplex Pcr ◽  
Large Scale ◽  
Parasitic Infection ◽  
Epidemiological Studies ◽  
Kappa Coefficient ◽  
Detection Methods ◽  
Diagnostic Process ◽  
Specific Gene ◽  
Rrna Gene ◽  
Babesia Bigemina

Background: A novel, rapid and specific multiplex polymerase chain reaction was developed to diagnose hemo-parasitic infection in bovine blood co-infected with three of the most common hemo-parasites. Methods: The diagnostic process relied on the detection of the three different bovine hemoparasites isolated from red blood cells (RBCs) of cattle (N=30) by conventional Giemsa stained blood smear (GSBS) and confirmed by multiplex PCR. The multiplex PCR system was used to diagnose GSBS positive blood samples (N=12) found infected or co-infected with hemoparasites. The designed multiplex primer sets was attempted to amplify 205, 313 and 422 bp fragments of apocytochrome b, sporozoite and macroschizont 2 (spm2) and 16S rRNA gene for Babesia bigemina, Theileria annulata and Anaplasma marginale, respectively. Result: This multiplex PCR was sensitive with the ability to detect the presence of 150 ng of genomic DNA. The primers used in this multiplex PCR also showed highly specific amplification of specific gene fragments of each respective parasite. Comparing the two detection methods revealed that 58.33% of specimens showed concordant diagnoses with both techniques. The specificity, positive predictive value and kappa coefficient of the agreement was highest for diagnosis of B. bigemina and lowest for A. marginale. The overall Kappa coefficient for diagnosis based on GSBS for multiple pathogens compared to multiplex PCR was 0.56, slightly behind the threshold of 0.6 of agreement. Therefore, confirmation should always be based on PCR to rule out false positives due to differences in subjective observations, stain particles and false negatives due to low parasitemia. The simplicity and rapidity of this specific multiplex PCR method make it suitable for large-scale epidemiological studies and follow-up of drug treatments.

Precise No-Reference Image Quality Evaluation Based on Distortion Identification

2021 ◽  
Vol 17 (3s) ◽  
pp. 1-21
Author(s):  
Chenggang Yan ◽  
Tong Teng ◽  
Yutao Liu ◽  
Yongbing Zhang ◽  
Haoqian Wang ◽  
...  
Keyword(s):  
Neural Network ◽  
Image Quality ◽  
Quality Assessment ◽  
Large Scale ◽  
Quality Evaluation ◽  
Image Quality Assessment ◽  
State Of The Art ◽  
Gaussian White Noise ◽  
The State ◽  
Reference Image

The difficulty of no-reference image quality assessment (NR IQA) often lies in the lack of knowledge about the distortion in the image, which makes quality assessment blind and thus inefficient. To tackle such issue, in this article, we propose a novel scheme for precise NR IQA, which includes two successive steps, i.e., distortion identification and targeted quality evaluation. In the first step, we employ the well-known Inception-ResNet-v2 neural network to train a classifier that classifies the possible distortion in the image into the four most common distortion types, i.e., Gaussian white noise (WN), Gaussian blur (GB), jpeg compression (JPEG), and jpeg2000 compression (JP2K). Specifically, the deep neural network is trained on the large-scale Waterloo Exploration database, which ensures the robustness and high performance of distortion classification. In the second step, after determining the distortion type of the image, we then design a specific approach to quantify the image distortion level, which can estimate the image quality specially and more precisely. Extensive experiments performed on LIVE, TID2013, CSIQ, and Waterloo Exploration databases demonstrate that (1) the accuracy of our distortion classification is higher than that of the state-of-the-art distortion classification methods, and (2) the proposed NR IQA method outperforms the state-of-the-art NR IQA methods in quantifying the image quality.

scholarly journals A Hybrid Network for Large-Scale Action Recognition from RGB and Depth Modalities

Sensors ◽  
2020 ◽  
Vol 20 (11) ◽  
pp. 3305 ◽  
Author(s):  
Huogen Wang ◽  
Zhanjie Song ◽  
Wanqing Li ◽  
Pichao Wang
Keyword(s):  
Neural Network ◽  
Action Recognition ◽  
Canonical Correlation ◽  
Large Scale ◽  
State Of The Art ◽  
Hybrid Network ◽  
Support Vector ◽  
Multiple Modalities ◽  
Large Margin ◽  
Percentage Points

The paper presents a novel hybrid network for large-scale action recognition from multiple modalities. The network is built upon the proposed weighted dynamic images. It effectively leverages the strengths of the emerging Convolutional Neural Network (CNN) and Recurrent Neural Network (RNN) based approaches to specifically address the challenges that occur in large-scale action recognition and are not fully dealt with by the state-of-the-art methods. Specifically, the proposed hybrid network consists of a CNN based component and an RNN based component. Features extracted by the two components are fused through canonical correlation analysis and then fed to a linear Support Vector Machine (SVM) for classification. The proposed network achieved state-of-the-art results on the ChaLearn LAP IsoGD, NTU RGB+D and Multi-modal & Multi-view & Interactive ( M 2 I ) datasets and outperformed existing methods by a large margin (over 10 percentage points in some cases).

The Analysis of Faults Detection Software Based on Improved Neural Network Algorithm

2014 ◽  
Vol 602-605 ◽  
pp. 2044-2047
Author(s):  
Miao Yan ◽  
Zhi Bao Liu
Keyword(s):  
Neural Network ◽  
Large Scale ◽  
Detection Methods ◽  
Detection Accuracy ◽  
Improved Method ◽  
Software Faults ◽  
Component Software ◽  
The Neural Network ◽  
Neural Network Algorithm ◽  
Detection Software

The large-scale software is consisted of the components which are quite different. The detection accuracy of the traditional faults detection methods for the large-scale component software is not satisfactory. This paper proposes a large-scale software faults detection methods based on improved neural network combining the features of the large-scale software by computing the stable probability and building the neural network faults detection models. The proposed method can analyze the serial faults of the large-scale software to determine the positions of the faults. The experiment and simulation results show that the improved method for large-scale software fault detection can greatly improve the accuracy.

scholarly journals Link Prediction via Ranking Metric Dual-Level Attention Network Learning

2017 ◽  
Author(s):  
Zhou Zhao ◽  
Ben Gao ◽  
Vincent W. Zheng ◽  
Deng Cai ◽  
Xiaofei He ◽  
...  
Keyword(s):  
Link Prediction ◽  
Large Scale ◽  
State Of The Art ◽  
Feature Representation ◽  
Telecommunication Networks ◽  
Metric Embedding ◽  
Network Learning ◽  
Learning Framework ◽  
Discriminative Feature ◽  
Attentional Learning

Link prediction is a challenging problem for complex network analysis, arising in many disciplines such as social networks and telecommunication networks. Currently, many existing approaches estimate the proximity of the link endpoints for link prediction from their feature or the local neighborhood around them, which suffer from the localized view of network connections and insufficiency of discriminative feature representation. In this paper, we consider the problem of link prediction from the viewpoint of learning discriminative path-based proximity ranking metric embedding. We propose a novel ranking metric network learning framework by jointly exploiting both node-level and path-level attentional proximity of the endpoints for link prediction. We then develop the path-based dual-level reasoning attentional learning method with recurrent neural network for proximity ranking metric embedding. The extensive experiments on two large-scale datasets show that our method achieves better performance than other state-of-the-art solutions to the problem.

scholarly journals Development Of Novel Multiplex PCR For Rapid Diagnosis Of Coinfected Hemo-Parasites In Cattle

2021 ◽  
Author(s):  
Pankaj Kumar ◽  
Abhay Kumar ◽  
Kamal Sarma ◽  
Paresh Sharma ◽  
Rashmi Rekha Kumari ◽  
...  
Keyword(s):  
Multiplex Pcr ◽  
Large Scale ◽  
False Negative ◽  
Parasitic Infection ◽  
Epidemiological Studies ◽  
Kappa Coefficient ◽  
Detection Methods ◽  
Specific Gene ◽  
Rrna Gene ◽  
Babesia Bigemina

A novel, rapid and specific multiplex polymerase chain reaction has been developed for the diagnosis of hemo-parasitic infection in bovine blood by three of the most common hemo-parasites. The reported method relied on the detection of the three different bovine hemoparasites isolated from red blood cells (RBCs) of cattle by conventional Giemsa stained blood smear (GSBS) and confirmed by multiplex PCR. The designed multiplex primer sets can amplify 205, 313 and 422 bp fragments of apocytochrome b, sporozoite and macroschizont 2 (spm2) and 16S rRNA gene for Babesia bigemina, Theileria annulata and Anaplasma marginale, respectively. This multiplex PCR was sensitive with the ability to detect the presence of 150 ng of genomic DNA. The primers used in this multiplex PCR also showed highly specific amplification of specific gene fragments of each respective parasite DNA without the presence of non-specific and non-target PCR products. This multiplex PCR system was used to diagnose GSBS confirmed blood samples (N=12) found infected or co-infected with hemoparasites. A comparison of the two detection methods revealed that 58.33% of specimens showed concordant diagnoses with both techniques. The specificity, positive predictive value and kappa coefficient of agreement was highest for diagnosis of B. bigemina and lowest for A. marginale. The overall Kappa coefficient for diagnosis based on GSBS for multiple pathogen compared to multiplex PCR was 0.56 slightly behind the threshold of 0.6 of agreement. Therefore, confirmation should always be made based on PCR to rule out false positive due to differences in subjective observations, stain particles and false negative due to low level of parasitaemia. The simplicity and rapidity of this specific multiplex PCR method make it suitable for large-scale epidemiological studies and for follow-up of drug treatments.

scholarly journals A convNet based multi label microRNA sub cellular location predictor, by incorporating k-mer positional encoding

2020 ◽  
Author(s):  
Muhammad Nabeel Asim ◽  
Andreas Dengel ◽  
Sheraz Ahmed
Keyword(s):  
Neural Network ◽  
State Of The Art ◽  
Positional Information ◽  
Feature Representation ◽  
Location Prediction ◽  
Rna Sequences ◽  
Rna Molecules ◽  
Evaluation Measures ◽  
Cellular Location ◽  
Mammalian Transcriptome

ABSTRACTMicroRNAs are special RNA sequences containing 22 nucleotides and are capable of regulating almost 60% of highly complex mammalian transcriptome. Presently, there exists very limited approaches capable of visualizing miRNA locations inside cell to reveal the hidden pathways, and mechanisms behind miRNA functionality, transport, and biogenesis. State-of-the-art miRNA sub-cellular location prediction MIRLocatar approach makes use of sequence to sequence model along with pre-train k-mer embeddings. Existing pre-train k-mer embedding generation methodologies focus on the extraction of semantics of k-mers. In RNA sequences, rather than semantics, positional information of nucleotides is more important because distinct positions of four basic nucleotides actually define the functionality of RNA molecules. Considering the dynamicity and importance of nucleotides positions, instead of learning representation on the basis of k-mers semantics, we propose a novel kmerRP2vec feature representation approach that fuses positional information of k-mers to randomly initialized neural k-mer embeddings. Effectiveness of proposed feature representation approach is evaluated with two deep learning based convolutional neural network CNN and recurrent neural network RNN methodologies using 8 evaluation measures. Experimental results on a public benchmark miRNAsubloc dataset prove that proposed kmerRP2vec approach along with a simple CNN model outperforms state-of-the-art MirLocator approach with a significant margin of 18% and 19% in terms of precision and recall.

Sign in / Sign up

Export Citation Format

Share Document