scholarly journals Effectiveness of State-of-the-Art Super Resolution Algorithms in Surveillance Environment

2021 ◽  
pp. 79-88
Author(s):  
Muhammad Ali Farooq ◽  
Ammar Ali Khan ◽  
Ansar Ahmad ◽  
Rana Hammad Raza
Keyword(s):  
State Of The Art ◽  
Super Resolution

EDPANs: Enhanced Dual Path Attention Networks for Single Image Super-Resolution

2021 ◽  
pp. 2150300
Author(s):  
Guoan Cheng ◽  
Ai Matsune ◽  
Huaijuan Zang ◽  
Toru Kurihara ◽  
Shu Zhan
Keyword(s):  
State Of The Art ◽  
Super Resolution ◽  
Single Image ◽  
Residual Network ◽  
Dense Structure ◽  
Attention Networks ◽  
Residual Structure ◽  
Quantitative Results ◽  
Image Super Resolution ◽  
Single Image Super Resolution

In this paper, we propose an enhanced dual path attention network (EDPAN) for image super-resolution. ResNet is good at implicitly reusing extracted features, DenseNet is good at exploring new features. Dual Path Network (DPN) combines ResNets and DenseNet to create a more accurate architecture than the straightforward one. We experimentally show that the residual network performs best when each block consists of two convolutions, and the dense network performs best when each micro-block consists of one convolution. Following these ideas, our EDPAN exploits the advantages of the residual structure and the dense structure. Besides, to deploy the computations for features more effectively, we introduce the attention mechanism into our EDPAN. Moreover, to relieve the parameters burden, we also utilize recursive learning to propose a lightweight model. In the experiments, we demonstrate the effectiveness and robustness of our proposed EDPAN on different degradation situations. The quantitative results and visualization comparison can sufficiently indicate that our EDPAN achieves favorable performance over the state-of-the-art frameworks.

scholarly journals Mosaic Super-resolution via Sequential Feature Pyramid Networks

2019 ◽  
Author(s):  
Mehrdad Shoeiby ◽  
Mohammad Ali Armin ◽  
Sadegh Aliakbarian ◽  
Saeed Anwar ◽  
Lars petersson
Keyword(s):  
State Of The Art ◽  
Super Resolution ◽  
Autonomous Driving ◽  
Single Shot ◽  
Current State ◽  
Wide Range ◽  
Feature Pyramid ◽  
Novel Method ◽  
Convolutional Lstm ◽  
Mosaic Images

<div>Advances in the design of multi-spectral cameras have</div><div>led to great interests in a wide range of applications, from</div><div>astronomy to autonomous driving. However, such cameras</div><div>inherently suffer from a trade-off between the spatial and</div><div>spectral resolution. In this paper, we propose to address</div><div>this limitation by introducing a novel method to carry out</div><div>super-resolution on raw mosaic images, multi-spectral or</div><div>RGB Bayer, captured by modern real-time single-shot mo-</div><div>saic sensors. To this end, we design a deep super-resolution</div><div>architecture that benefits from a sequential feature pyramid</div><div>along the depth of the network. This, in fact, is achieved</div><div>by utilizing a convolutional LSTM (ConvLSTM) to learn the</div><div>inter-dependencies between features at different receptive</div><div>fields. Additionally, by investigating the effect of different</div><div>attention mechanisms in our framework, we show that a</div><div>ConvLSTM inspired module is able to provide superior at-</div><div>tention in our context. Our extensive experiments and anal-</div><div>yses evidence that our approach yields significant super-</div><div>resolution quality, outperforming current state-of-the-art</div><div>mosaic super-resolution methods on both Bayer and multi-</div><div>spectral images. Additionally, to the best of our knowledge,</div><div>our method is the first specialized method to super-resolve</div><div>mosaic images, whether it be multi-spectral or Bayer.</div><div><br></div>

scholarly journals Transferred Multi-Perception Attention Networks for Remote Sensing Image Super-Resolution

2019 ◽  
Vol 11 (23) ◽  
pp. 2857 ◽  
Author(s):  
Xiaoyu Dong ◽  
Zhihong Xi ◽  
Xu Sun ◽  
Lianru Gao
Keyword(s):  
Remote Sensing ◽  
Learning Strategy ◽  
State Of The Art ◽  
Spatial Scales ◽  
Super Resolution ◽  
Natural Image ◽  
Training Procedure ◽  
Remote Sensing Images ◽  
Objective Criterion ◽  
Image Super Resolution

Image super-resolution (SR) reconstruction plays a key role in coping with the increasing demand on remote sensing imaging applications with high spatial resolution requirements. Though many SR methods have been proposed over the last few years, further research is needed to improve SR processes with regard to the complex spatial distribution of the remote sensing images and the diverse spatial scales of ground objects. In this paper, a novel multi-perception attention network (MPSR) is developed with performance exceeding those of many existing state-of-the-art models. By incorporating the proposed enhanced residual block (ERB) and residual channel attention group (RCAG), MPSR can super-resolve low-resolution remote sensing images via multi-perception learning and multi-level information adaptive weighted fusion. Moreover, a pre-train and transfer learning strategy is introduced, which improved the SR performance and stabilized the training procedure. Experimental comparisons are conducted using 13 state-of-the-art methods over a remote sensing dataset and benchmark natural image sets. The proposed model proved its excellence in both objective criterion and subjective perspective.

scholarly journals Low Resolution Information Also Matters: Learning Multi-Resolution Representations for Person Re-Identification

2021 ◽  
Author(s):  
Guoqing Zhang ◽  
Yuhao Chen ◽  
Weisi Lin ◽  
Arun Chandran ◽  
Xuan Jing
Keyword(s):  
Feature Extraction ◽  
High Resolution ◽  
Feature Fusion ◽  
State Of The Art ◽  
Super Resolution ◽  
Input Image ◽  
Low Resolution ◽  
Joint Learning ◽  
Novel Method ◽  
Valid Information

As a prevailing task in video surveillance and forensics field, person re-identification (re-ID) aims to match person images captured from non-overlapped cameras. In unconstrained scenarios, person images often suffer from the resolution mismatch problem, i.e., Cross-Resolution Person Re-ID. To overcome this problem, most existing methods restore low resolution (LR) images to high resolution (HR) by super-resolution (SR). However, they only focus on the HR feature extraction and ignore the valid information from original LR images. In this work, we explore the influence of resolutions on feature extraction and develop a novel method for cross-resolution person re-ID called Multi-Resolution Representations Joint Learning (MRJL). Our method consists of a Resolution Reconstruction Network (RRN) and a Dual Feature Fusion Network (DFFN). The RRN uses an input image to construct a HR version and a LR version with an encoder and two decoders, while the DFFN adopts a dual-branch structure to generate person representations from multi-resolution images. Comprehensive experiments on five benchmarks verify the superiority of the proposed MRJL over the relevent state-of-the-art methods.

scholarly journals Research on Image Denoising and Super-Resolution Reconstruction Technology of Multiscale-Fusion Images

2021 ◽  
Vol 2021 ◽  
pp. 1-11
Author(s):  
Size Li ◽  
Pengjiang Qian ◽  
Xin Zhang ◽  
Aiguo Chen
Keyword(s):  
Image Processing ◽  
Receptive Field ◽  
Image Denoising ◽  
State Of The Art ◽  
Experimental Studies ◽  
Super Resolution ◽  
Image Resolution ◽  
Reconstruction Method ◽  
Model Learning ◽  
Image Super Resolution

Image denoising and image super-resolution reconstruction are two important techniques for image processing. Deep learning is used to solve the problem of image denoising and super-resolution reconstruction in recent years, and it usually has better results than traditional methods. However, image denoising and super-resolution reconstruction are studied separately by state-of-the-art work. To optimally improve the image resolution, it is necessary to investigate how to integrate these two techniques. In this paper, based on Generative Adversarial Network (GAN), we propose a novel image denoising and super-resolution reconstruction method, i.e., multiscale-fusion GAN (MFGAN), to restore the images interfered by noises. Our contributions reflect in the following three aspects: (1) the combination of image denoising and image super-resolution reconstruction simplifies the process of upsampling and downsampling images during the model learning, avoiding repeated input and output images operations, and improves the efficiency of image processing. (2) Motivated by the Inception structure and introducing a multiscale-fusion strategy, our method is capable of using the multiple convolution kernels with different sizes to expand the receptive field in parallel. (3) The ablation experiments verify the effectiveness of each employed loss measurement in our devised loss function. And our experimental studies demonstrate that the proposed model can effectively expand the receptive field and thus reconstruct images with high resolution and accuracy and that the proposed MFGAN method performs better than a few state-of-the-art methods.

scholarly journals Single Image Reconstruction using Novel Super Resolution Technique for Large Scaled Images

2021 ◽  
Author(s):  
Ramanath Datta ◽  
Sekhar Mandal ◽  
Saiyed Umer ◽  
Ahmad Ali AlZubi ◽  
Abdullah Alharbi ◽  
...  
Keyword(s):  
Image Reconstruction ◽  
Architectural Design ◽  
State Of The Art ◽  
Super Resolution ◽  
Electrical Machine ◽  
Single Image ◽  
Resolution Image ◽  
Working Principle ◽  
Novel Method ◽  
Homogeneous Regions

Abstract A fast and novel method for single-image reconstruction using super resolution (SR) technique has been proposed in this paper. The working principle of proposed technique has been divided into three components. In the first component, a low resolution image is divided into several homogeneous or non-homogeneous regions. This partition is based on the analysis of texture pattern within that region. Only the non-homogeneous regions undergo to the sparse representation for super resolution image reconstruction in the second component. The obtained reconstructed region from the second component undergoes to a statistical based prediction model to generate its more enhanced version in the third component. The remaining homogeneous regions are bicubic interpolated and reflected to the required high resolution image. The proposed technique is applied on some Large scaled Electrical, Machine and Civil architectural design images. The purpose of using these images is that these images are huge in size and processing such large images for any applications, is time consuming. The proposed SR technique results the better reconstructed SR image from its very lower version with low time complexity. The performance of the proposed system on the Electrical, Machine and Civil architectural design images is compared with the state-of-the-art methods and it is shown that the proposed system outperforms the other competing methods.

scholarly journals A Survey of Machine Learning-Based Physics Event Generation

2021 ◽  
Author(s):  
Yasir Alanazi ◽  
Nobuo Sato ◽  
Pawel Ambrozewicz ◽  
Astrid Hiller-Blin ◽  
Wally Melnitchouk ◽  
...  
Keyword(s):  
Machine Learning ◽  
Particle Physics ◽  
State Of The Art ◽  
Super Resolution ◽  
High Energy ◽  
Generative Models ◽  
The State ◽  
Open Questions ◽  
Event Generation ◽  
Building Physics

Event generators in high-energy nuclear and particle physics play an important role in facilitating studies of particle reactions. We survey the state of the art of machine learning (ML) efforts at building physics event generators. We review ML generative models used in ML-based event generators and their specific challenges, and discuss various approaches of incorporating physics into the ML model designs to overcome these challenges. Finally, we explore some open questions related to super-resolution, fidelity, and extrapolation for physics event generation based on ML technology.

scholarly journals Super resolution DOA estimation based on deep neural network

2020 ◽  
Vol 10 (1) ◽  
Author(s):  
Wanli Liu
Keyword(s):  
Neural Network ◽  
Potential Application ◽  
Deep Neural Network ◽  
State Of The Art ◽  
Signal To Noise Ratio ◽  
Super Resolution ◽  
Doa Estimation ◽  
Angular Distance ◽  
Signal To Noise ◽  
Simulation Results

AbstractRecently, deep neural network (DNN) studies on direction-of-arrival (DOA) estimations have attracted more and more attention. This new method gives an alternative way to deal with DOA problem and has successfully shown its potential application. However, these works are often restricted to previously known signal number, same signal-to-noise ratio (SNR) or large intersignal angular distance, which will hinder their generalization in real application. In this paper, we present a novel DNN framework that realizes higher resolution and better generalization to random signal number and SNR. Simulation results outperform that of previous works and reach the state of the art.

scholarly journals Frame and Feature-Context Video Super-Resolution

2019 ◽  
Vol 33 ◽  
pp. 5597-5604
Author(s):  
Bo Yan ◽  
Chuming Lin ◽  
Weimin Tan
Keyword(s):  
Information Flow ◽  
State Of The Art ◽  
Super Resolution ◽  
Sliding Window ◽  
Visual Quality ◽  
Local Network ◽  
Context Information ◽  
High Quality ◽  
Current State ◽  
Inter Frame

For video super-resolution, current state-of-the-art approaches either process multiple low-resolution (LR) frames to produce each output high-resolution (HR) frame separately in a sliding window fashion or recurrently exploit the previously estimated HR frames to super-resolve the following frame. The main weaknesses of these approaches are: 1) separately generating each output frame may obtain high-quality HR estimates while resulting in unsatisfactory flickering artifacts, and 2) combining previously generated HR frames can produce temporally consistent results in the case of short information flow, but it will cause significant jitter and jagged artifacts because the previous super-resolving errors are constantly accumulated to the subsequent frames.In this paper, we propose a fully end-to-end trainable frame and feature-context video super-resolution (FFCVSR) network that consists of two key sub-networks: local network and context network, where the first one explicitly utilizes a sequence of consecutive LR frames to generate local feature and local SR frame, and the other combines the outputs of local network and the previously estimated HR frames and features to super-resolve the subsequent frame. Our approach takes full advantage of the inter-frame information from multiple LR frames and the context information from previously predicted HR frames, producing temporally consistent highquality results while maintaining real-time speed by directly reusing previous features and frames. Extensive evaluations and comparisons demonstrate that our approach produces state-of-the-art results on a standard benchmark dataset, with advantages in terms of accuracy, efficiency, and visual quality over the existing approaches.

Sign in / Sign up

Export Citation Format

Share Document