scholarly journals Detection and Confirmation of Multiple Human Targets Using Pixel-Wise Code Aperture Measurements

2020 ◽  
Vol 6 (6) ◽  
pp. 40 ◽  
Author(s):  
Chiman Kwan ◽  
David Gribben ◽  
Akshay Rangamani ◽  
Trac Tran ◽  
Jack Zhang ◽  
...  
Keyword(s):  
Deep Learning ◽  
Data Storage ◽  
Target Detection ◽  
Vehicle Detection ◽  
Residual Network ◽  
Reconstruction Process ◽  
Recent Approach ◽  
Measurement Domain ◽  
Multiple Frames

Compressive video measurements can save bandwidth and data storage. However, conventional approaches to target detection require the compressive measurements to be reconstructed before any detectors are applied. This is not only time consuming but also may lose information in the reconstruction process. In this paper, we summarized the application of a recent approach to vehicle detection and classification directly in the compressive measurement domain to human targets. The raw videos were collected using a pixel-wise code exposure (PCE) camera, which condensed multiple frames into one frame. A combination of two deep learning-based algorithms (you only look once (YOLO) and residual network (ResNet)) was used for detection and confirmation. Optical and mid-wave infrared (MWIR) videos from a well-known database (SENSIAC) were used in our experiments. Extensive experiments demonstrated that the proposed framework was feasible for target detection up to 1500 m, but target confirmation needs more research.

scholarly journals Deep Learning-Based Target Tracking and Classification for Low Quality Videos Using Coded Aperture Cameras

Sensors ◽  
2019 ◽  
Vol 19 (17) ◽  
pp. 3702 ◽  
Author(s):  
Chiman Kwan ◽  
Bryan Chou ◽  
Jonathan Yang ◽  
Akshay Rangamani ◽  
Trac Tran ◽  
...  
Keyword(s):  
Deep Learning ◽  
Power Consumption ◽  
Compressive Sensing ◽  
Target Tracking ◽  
Low Power Consumption ◽  
Coded Aperture ◽  
Learning Approach ◽  
Residual Network ◽  
Practical Applications ◽  
Measurement Domain

Compressive sensing has seen many applications in recent years. One type of compressive sensing device is the Pixel-wise Code Exposure (PCE) camera, which has low power consumption and individual control of pixel exposure time. In order to use PCE cameras for practical applications, a time consuming and lossy process is needed to reconstruct the original frames. In this paper, we present a deep learning approach that directly performs target tracking and classification in the compressive measurement domain without any frame reconstruction. In particular, we propose to apply You Only Look Once (YOLO) to detect and track targets in the frames and we propose to apply Residual Network (ResNet) for classification. Extensive simulations using low quality optical and mid-wave infrared (MWIR) videos in the SENSIAC database demonstrated the efficacy of our proposed approach.

scholarly journals A Climate Downscaling Deep Learning Model considering the Multiscale Spatial Correlations and Chaos of Meteorological Events

2020 ◽  
Vol 2020 ◽  
pp. 1-17
Author(s):  
Bin Mu ◽  
Bo Qin ◽  
Shijin Yuan ◽  
Xiaoyun Qin
Keyword(s):  
Deep Learning ◽  
General Circulation ◽  
Dynamical Downscaling ◽  
General Circulation Models ◽  
Learning Model ◽  
Spatial Correlations ◽  
Reconstruction Process ◽  
Daily Precipitation Data ◽  
Climate Downscaling ◽  
Deep Learning Model

Climate downscaling is a way to provide finer resolution data at local scales, which has been widely used in meteorological research. The two main approaches for climate downscaling are dynamical and statistical. The traditional dynamical downscaling methods are quite time- and resource-consuming based on general circulation models (GCMs). Recently, more and more researchers construct a statistical deep learning model for climate downscaling motivated by the single-image superresolution (SISR) process in computer vision (CV). This is an approach that uses historical climate observations to learn a low-resolution to high-resolution mapping and produces great enhancements in terms of efficiency and effectiveness. Therefore, it has provided an appreciable new insight and successful downscaling solution to multiple climate phenomena. However, most existing models only make a simple analogy between climate downscaling and SISR and ignore the underlying dynamical mechanisms, which leads to the overaveraged downscaling results lacking crucial physical details. In this paper, we incorporate the a priori meteorological knowledge into a deep learning formalization for climate downscaling. More specifically, we consider the multiscale spatial correlations and the chaos in multiple climate events. Depending on two characteristics, we build up a two-stage deep learning model containing a stepwise reconstruction process and ensemble inference, which is named climate downscaling network (CDN). It can extract more local/remote spatial dependencies and provide more comprehensive captures of extreme conditions. We evaluate our model based on two datasets: climate science dataset (CSD) and benchmark image dataset (BID). The results demonstrate that our model shows the effectiveness and superiority in downscaling daily precipitation data from 2.5 degrees to 0.5 degrees over Asia and Europe. In addition, our model exhibits better performance than the other traditional approaches and state-of-the-art deep learning models.

Sign in / Sign up

Export Citation Format

Share Document