scholarly journals Video Compression for Surveillance Application using Deep Neural Network

Author(s):  
Prasanga Dhungel ◽  
Prashant Tandan ◽  
Sandesh Bhusal ◽  
Sobit Neupane ◽  
Subarna Shakya

We present a new approach to video compression for video surveillance by refining the shortcomings of conventional approach and substitute each traditional component with their neural network counterpart. Our proposed work consists of motion estimation, compression and compensation and residue compression, learned end-to-end to minimize the rate-distortion trade off. The whole model is jointly optimized using a single loss function. Our work is based on a standard method to exploit the spatio-temporal redundancy in video frames to reduce the bit rate along with the minimization of distortions in decoded frames. We implement a neural network version of conventional video compression approach and encode the redundant frames with lower number of bits. Although, our approach is more concerned toward surveillance, it can be extended easily to general purpose videos too. Experiments show that our technique is efficient and outperforms standard MPEG encoding at comparable bitrates while preserving the visual quality.

2012 ◽  
Vol 9 (11) ◽  
pp. 15329-15380 ◽  
Author(s):  
T. P. Sasse ◽  
B. I. McNeil ◽  
G. Abramowitz

Abstract. The ocean's role in modulating the observed 1–7 Pg C yr−1 inter-annual variability in atmospheric CO2 growth rate is an important, but poorly constrained process due to sparse spatio-temporal ocean carbon measurements. Here, we investigate and develop a non-linear empirical approach to predict inorganic CO2 concentrations (total carbon dioxide (CT) and total alkalinity (AT) in the global ocean mixed-layer from hydrographic properties (temperature, salinity, dissolved oxygen and nutrients). The benefit of this approach is that once the empirical relationship is established, it can be applied to hydrographic datasets that have better spatio-temporal coverage, and therefore provide an additional constraint to diagnose ocean carbon dynamics globally. Previous empirical approaches have employed multiple linear regressions (MLR), and relied on ad-hoc geographic and temporal partitioning of carbon data to constrain complex global carbon dynamics in the mixed-layer. Synthesising a new global CT/AT carbon bottle dataset consisting of ~33 000 measurements in the open ocean mixed-layer, we develop a neural network based approach to better constrain the non-linear carbon system. The approach classifies features in the global biogeochemical dataset based on their similarity and homogeneity in a self-organizing map (SOM; Kohonen, 1988). After the initial SOM analysis, which includes geographic constraints, we apply a local linear optimizer to the neural network which considerably enhances the predictive skill of the new approach. We call this new approach SOMLO, or self-organizing multiple linear output. Using independent bottle carbon data, we compare a traditional MLR analysis to our SOMLO approach to capture the spatial CT and AT distributions. We find the SOMLO approach improves predictive skill globally by 19% for CT, with a global capacity to predict CT to within 10.9 μmol kg−1 (9.2 μmol kg−1 for AT. The non-linear SOMLO approach is particularly powerful in complex, but important regions like the Southern Ocean, North Atlantic and equatorial Pacific where residual standard errors were reduced between 25–40% over traditional linear methods. We further test the SOMLO technique using the Bermuda Atlantic time-series (BATS) and Hawaiian ocean (HOT) datasets, where hydrographic data was capable of explaining 90% of the seasonal cycle and inter-annual variability at those multi-decadal time-series stations.


2013 ◽  
Vol 10 (6) ◽  
pp. 4319-4340 ◽  
Author(s):  
T. P. Sasse ◽  
B. I. McNeil ◽  
G. Abramowitz

Abstract. The ocean's role in modulating the observed 1–7 Pg C yr−1 inter-annual variability in atmospheric CO2 growth rate is an important, but poorly constrained process due to current spatio-temporal limitations in ocean carbon measurements. Here, we investigate and develop a non-linear empirical approach to predict inorganic CO2 concentrations (total carbon dioxide (CT) and total alkalinity (AT)) in the global ocean mixed layer from hydrographic properties (temperature, salinity, dissolved oxygen and nutrients). The benefit of this approach is that once the empirical relationship is established, it can be applied to hydrographic datasets that have better spatio-temporal coverage, and therefore provide an additional constraint to diagnose ocean carbon dynamics globally. Previous empirical approaches have employed multiple linear regressions (MLR) and relied on ad hoc geographic and temporal partitioning of carbon data to constrain complex global carbon dynamics in the mixed layer. Synthesizing a new global CT/AT carbon bottle dataset consisting of ~33 000 measurements in the open ocean mixed layer, we develop a neural network based approach to better constrain the non-linear carbon system. The approach classifies features in the global biogeochemical dataset based on their similarity and homogeneity in a self-organizing map (SOM; Kohonen, 1988). After the initial SOM analysis, which includes geographic constraints, we apply a local linear optimizer to the neural network, which considerably enhances the predictive skill of the new approach. We call this new approach SOMLO, or self-organizing multiple linear output. Using independent bottle carbon data, we compare a traditional MLR analysis to our SOMLO approach to capture the spatial CT and AT distributions. We find the SOMLO approach improves predictive skill globally by 19% for CT, with a global capacity to predict CT to within 10.9 μmol kg−1 (9.2 μmol kg−1 for AT). The non-linear SOMLO approach is particularly powerful in complex but important regions like the Southern Ocean, North Atlantic and equatorial Pacific, where residual standard errors were reduced between 25 and 40% over traditional linear methods. We further test the SOMLO technique using the Bermuda Atlantic time series (BATS) and Hawaiian ocean time series (HOT) datasets, where hydrographic data was capable of explaining 90% of the seasonal cycle and inter-annual variability at those multi-decadal time-series stations.


2016 ◽  
Vol 16 (03) ◽  
pp. 1650015
Author(s):  
S. Sowmyayani ◽  
P. Arockia Jansi Rani

The objective of this work is to propose a novel idea of transforming temporal redundancies present in videos. Initially, the frames are divided into sub-blocks. Then, the temporally redundant blocks are grouped together thus generating new frames with spatially redundant temporal data. The transformed frames are given to compression in the wavelet domain. This new approach greatly reduces the computational time. The reason is that the existing video codecs use block matching methods for motion estimation which is a time consuming process. The proposed method avoids the use of block matching method. The existing H.264/AVC takes approximately one hour to compress a video file where as the proposed method takes only one minute for the same task. The experimental results substantially proved that the proposed method performs better than the existing H.264/AVC standard in terms of time, compression ratio and PSNR.


2018 ◽  
Vol 10 (2) ◽  
pp. 84-94 ◽  
Author(s):  
M. Pershina ◽  
V.S. Bouksim ◽  
K. Arhid ◽  
F.R. Zakani ◽  
M. Aboulfatah ◽  
...  

Mathematics ◽  
2021 ◽  
Vol 9 (5) ◽  
pp. 458
Author(s):  
Leobardo Hernandez-Gonzalez ◽  
Jazmin Ramirez-Hernandez ◽  
Oswaldo Ulises Juarez-Sandoval ◽  
Miguel Angel Olivares-Robles ◽  
Ramon Blanco Sanchez ◽  
...  

The electric behavior in semiconductor devices is the result of the electric carriers’ injection and evacuation in the low doping region, N-. The carrier’s dynamic is determined by the ambipolar diffusion equation (ADE), which involves the main physical phenomena in the low doping region. The ADE does not have a direct analytic solution since it is a spatio-temporal second-order differential equation. The numerical solution is the most used, but is inadequate to be integrated into commercial electric circuit simulators. In this paper, an empiric approximation is proposed as the solution of the ADE. The proposed solution was validated using the final equations that were implemented in a simulator; the results were compared with the experimental results in each phase, obtaining a similarity in the current waveforms. Finally, an advantage of the proposed methodology is that the final expressions obtained can be easily implemented in commercial simulators.


2021 ◽  
Vol 13 (13) ◽  
pp. 2604
Author(s):  
Patrick Osei Darko ◽  
Margaret Kalacska ◽  
J. Pablo Arroyo-Mora ◽  
Matthew E. Fagan

Hyperspectral remote sensing across multiple spatio-temporal scales allows for mapping and monitoring mangrove habitats to support urgent conservation efforts. The use of hyperspectral imagery for assessing mangroves is less common than for terrestrial forest ecosystems. In this study, two well-known measures in statistical physics, Mean Information Gain (MIG) and Marginal Entropy (ME), have been adapted to high spatial resolution (2.5 m) full range (Visible-Shortwave-Infrared) airborne hyperspectral imagery. These two spectral complexity metrics describe the spatial heterogeneity and the aspatial heterogeneity of the reflectance. In this study, we compare MIG and ME with surface reflectance for mapping mangrove extent and species composition in the Sierpe mangroves in Costa Rica. The highest accuracy for separating mangroves from forest was achieved with visible-near infrared (VNIR) reflectance (98.8% overall accuracy), following by shortwave infrared (SWIR) MIG and ME (98%). Our results also show that MIG and ME can discriminate dominant mangrove species with higher accuracy than surface reflectance alone (e.g., MIG–VNIR = 93.6% vs. VNIR Reflectance = 89.7%).


2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Brett H. Hokr ◽  
Joel N. Bixler

AbstractDynamic, in vivo measurement of the optical properties of biological tissues is still an elusive and critically important problem. Here we develop a technique for inverting a Monte Carlo simulation to extract tissue optical properties from the statistical moments of the spatio-temporal response of the tissue by training a 5-layer fully connected neural network. We demonstrate the accuracy of the method across a very wide parameter space on a single homogeneous layer tissue model and demonstrate that the method is insensitive to parameter selection of the neural network model itself. Finally, we propose an experimental setup capable of measuring the required information in real time in an in vivo environment and demonstrate proof-of-concept level experimental results.


Sign in / Sign up

Export Citation Format

Share Document