scholarly journals Parallel Deep Learning Framework for Video Surveillance System

2021 ◽  
Author(s):  
Mayuri Karvande ◽  
Apoorv Katkar ◽  
Nikhil Koli ◽  
Amit Joshi ◽  
Suraj Sawant

In today’s world, the security of every individual has become an important aspect. There is a need for constant monitoring in public places. A Manual operating camera system is an unreliable and very basic and poor method for this purpose. Intelligent Video Surveillance is an approach where multiple CCTVs constantly record the scenes and proper algorithms are deployed in order to detect and monitor activities. Deep Learning frameworks and algorithms like Kera’s, YOLO, Convolutional Neural Networks or backbones for image detection like VGG16, Mobile net, Resnet101 have been used for human and weapon detection. The paper focuses on deep learning techniques and threading to collectively develop a Parallel Deep Learning Framework for Video Surveillance that aims at striking the right balance between accuracy and system performance or stability. Threading is used in terms of implementation of a uniquely proposed Dynamic Selection Algorithm that uses two backbones for object detection and switches between them based on the queue status for achieving system stability. A uniquely designed logistic regression filter is also implemented that boosts the system performance.

2021 ◽  
Vol 2021 ◽  
pp. 1-7
Author(s):  
Juncai Li ◽  
Xiaofei Jiang

Molecular property prediction is an essential task in drug discovery. Most computational approaches with deep learning techniques either focus on designing novel molecular representation or combining with some advanced models together. However, researchers pay fewer attention to the potential benefits in massive unlabeled molecular data (e.g., ZINC). This task becomes increasingly challenging owing to the limitation of the scale of labeled data. Motivated by the recent advancements of pretrained models in natural language processing, the drug molecule can be naturally viewed as language to some extent. In this paper, we investigate how to develop the pretrained model BERT to extract useful molecular substructure information for molecular property prediction. We present a novel end-to-end deep learning framework, named Mol-BERT, that combines an effective molecular representation with pretrained BERT model tailored for molecular property prediction. Specifically, a large-scale prediction BERT model is pretrained to generate the embedding of molecular substructures, by using four million unlabeled drug SMILES (i.e., ZINC 15 and ChEMBL 27). Then, the pretrained BERT model can be fine-tuned on various molecular property prediction tasks. To examine the performance of our proposed Mol-BERT, we conduct several experiments on 4 widely used molecular datasets. In comparison to the traditional and state-of-the-art baselines, the results illustrate that our proposed Mol-BERT can outperform the current sequence-based methods and achieve at least 2% improvement on ROC-AUC score on Tox21, SIDER, and ClinTox dataset.


2016 ◽  
Vol 43 (6Part3) ◽  
pp. 3334-3335 ◽  
Author(s):  
A Santhanam ◽  
Y Min ◽  
P Beron ◽  
N Agazaryan ◽  
P Kupelian ◽  
...  

2019 ◽  
Vol 9 (1) ◽  
Author(s):  
Gilad Liberman ◽  
Benedikt A. Poser

AbstractModern sequences for Magnetic Resonance Imaging (MRI) trade off scan time with computational challenges, resulting in ill-posed inverse problems and the requirement to account for more elaborated signal models. Various deep learning techniques have shown potential for image reconstruction from reduced data, outperforming compressed sensing, dictionary learning and other advanced techniques based on regularization, by characterization of the image manifold. In this work we suggest a framework for reducing a “neural” network to the bare minimum required by the MR physics, reducing the network depth and removing all non-linearities. The networks performed well both on benchmark simulated data and on arterial spin labeling perfusion imaging, showing clear images while preserving sensitivity to the minute signal changes. The results indicate that the deep learning framework plays a major role in MR image reconstruction, and suggest a concrete approach for probing into the contribution of additional elements.


2017 ◽  
Author(s):  
Vikash Gupta ◽  
Sophia I. Thomopoulos ◽  
Faisal M. Rashid ◽  
Paul M. Thompson

AbstractWhite matter tracts are commonly analyzed in studies of micro-structural integrity and anatomical connectivity in the brain. Over the last decade, it has been an open problem as to how best to cluster white matter fibers, extracted from whole-brain tractography, into anatomically meaningful groups. Some existing techniques use region of interest (ROI) based clustering, atlas-based labeling, or unsupervised spectral clustering. ROI-based clustering is popular for analyzing anatomical connectivity among a set of ROIs, but it does not always partition the brain into recognizable fiber bundles. Here we propose an approach using convolutional neural networks (CNNs) to learn shape features of the fiber bundles, which are then exploited to cluster white matter fibers. To achieve such clustering, we first need to re-parameterize the fibers in an intrinsic space. The clustering is performed in induced parameterized coordinates. To our knowledge, this is one of the first approaches for fiber clustering using deep learning techniques. The results show strong accuracy - on a par with or better than other state-of-the-art methods.


Businessesare constantly overhauling their existing infrastructure and processes to be more efficient, safe, and usable for employees, customers, and the community. With the ongoing pandemic, it's even more important to have advanced applications and services in place to mitigate risk. For public safety and health, authorities are recommending the use of face masks and coverings to control the spread of Coronovirus. The COVID-19 pandemic is devastation to themankind irrespective of caste, creed, gender, and religion. Using a face mask can undoubtedly help in managing the spread of the virus. COVID-19 face mask detector uses deep learning techniques to successfully test whether a person is wearing a face mask or not. Using a deep learning method called Convolutional Neural Network, got an accuracy of 98.6 %. It can work with still images and also works with a live video stream. Cases in which the mask is improperly worn are when the nose and mouth are partially covered is considered as the mask is not worn. Our face mask identifier is the least complex in structure and gives quick results and hence can be used in CCTV footage to detect whether a person is wearing a mask perfectly so that he does not pose any danger to others. Mass screening is possible and hence can be used in crowded places like railway stations, bus stops, markets, streets, mall entrances, schools, colleges, etc. By monitoring the placement of the face mask on the face, we can make sure that an individual wears it the right way and helps to curb the scope of the virus


Author(s):  
Rajitha B.

Abnormal behavior detection from on-line/off-line videos is an emerging field in the area of computer vision. This plays a vital role in video surveillance-based applications to provide safety for humans at public places such as traffic signals, shopping malls, railway stations, etc. Surveillance cameras are meant to act as digital eyes (i.e., watching over activities at public places) and provide security. There are a number of cameras deployed at various public places to provide video surveillance, but in reality, they are used only after some incident has happened. Moreover, a human watch is needed in order to detect the person/cause of the incident. This makes surveillance cameras passive. Thus, there is a huge demand to develop an intelligent video surveillance system that can detect the abnormality/incident dynamically and accordingly raise an alarm to the nearest police stations or hospitals as per requirement. If AI-supported CCTV systems are deployed at commercial and traffic areas, then we can easily detect the incidents/crimes, and they can be traced in minimal time.


2017 ◽  
Author(s):  
Sarah Taghavi Namin ◽  
Mohammad Esmaeilzadeh ◽  
Mohammad Najafi ◽  
Tim B. Brown ◽  
Justin O. Borevitz

AbstractHigh resolution and high throughput, genotype to phenotype studies in plants are underway to accelerate breeding of climate ready crops. Complex developmental phenotypes are observed by imaging a variety of accessions in different environment conditions, however extracting the genetically heritable traits is challenging. In the recent years, deep learning techniques and in particular Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs) and Long-Short Term Memories (LSTMs), have shown great success in visual data recognition, classification, and sequence learning tasks. In this paper, we proposed a CNN-LSTM framework for plant classification of various genotypes. Here, we exploit the power of deep CNNs for joint feature and classifier learning, within an automatic phenotyping scheme for genotype classification. Further, plant growth variation over time is also important in phenotyping their dynamic behavior. This was fed into the deep learning framework using LSTMs to model these temporal cues for different plant accessions. We generated a replicated dataset of four accessions of Arabidopsis and carried out automated phenotyping experiments. The results provide evidence of the benefits of our approach over using traditional hand-crafted image analysis features and other genotype classification frameworks. We also demonstrate that temporal information further improves the performance of the phenotype classification system.


2020 ◽  
Author(s):  
Tian Cai ◽  
Hansaim Lim ◽  
Kyra Alyssa Abbu ◽  
Yue Qiu ◽  
Ruth Nussinov ◽  
...  

AbstractMolecular interaction is the foundation of biological process. Elucidation of genome-wide binding partners of a biomolecule will address many questions in biomedicine. However, ligands of a vast number of proteins remain elusive. Existing methods mostly fail when the protein of interest is dissimilar from those with known functions or structures. We develop a new deep learning framework DISAE that incorporates biological knowledge into self-supervised learning techniques for predicting ligands of novel unannotated proteins on a genome-scale. In the rigorous benchmark studies, DISAE outperforms state-of-the-art methods by a significant margin. The interpretability analysis of DISAE suggests that it learns biologically meaningful information. We further use DISAE to assign ligands to human orphan G-Protein Coupled Receptors (GPCRs) and to cluster the human GPCRome by integrating their phylogenetic and ligand relationships. The promising results of DISAE open an avenue for exploring the chemical landscape of entire sequenced genomes.


Sensors ◽  
2021 ◽  
Vol 21 (21) ◽  
pp. 7010
Author(s):  
Xuefei Li ◽  
Liangtu Song ◽  
Liu Liu ◽  
Linli Zhou

Gas supply system risk assessment is a serious and important problem in cities. Existing methods tend to manually build mathematical models to predict risk value from single-modal information, i.e., pipeline parameters. In this paper, we attempt to consider this problem from a deep-learning perspective and define a novel task, Urban Gas Supply System Risk Assessment (GSS-RA). To drive deep-learning techniques into this task, we collect and build a domain-specific dataset GSS-20K containing multi-modal data. Accompanying the dataset, we design a new deep-learning framework named GSS-RiskAsser to learn risk prediction. In our method, we design a parallel-transformers Vision Embedding Transformer (VET) and Score Matrix Transformer (SMT) to process multi-modal information, and then propose a Multi-Modal Fusion (MMF) module to fuse the features with a cross-attention mechanism. Experiments show that GSS-RiskAsser could work well on GSS-RA task and facilitate practical applications. Our data and code will be made publicly available.


Sign in / Sign up

Export Citation Format

Share Document