Input Image-Based Dictionary Formation in Super-Resolution for Online Image Streaming

2020 ◽  
pp. 1189-1196
Author(s):  
Garima Pandey ◽  
Umesh Ghanekar
Keyword(s):  
Super Resolution ◽  
Input Image ◽  
Image Streaming

scholarly journals Region Filling with Super Resolution Algorithm

2021 ◽  
Vol 9 (VI) ◽  
pp. 3557-3564
Author(s):  
Darakhshan R. Khan
Keyword(s):  
Patch Size ◽  
Research Work ◽  
Super Resolution ◽  
Input Image ◽  
Computational Time ◽  
Low Resolution ◽  
Resolution Image ◽  
Resolution Algorithm ◽  
Region Filling

Region filling which has another name inpainting, is an approach to find the values of missing pixels from data available in the remaining portion of the image. The missing information must be recalculated in a distinctly convincing manner, such that, image look seamless. This research work has built a methodology for completely automating patch priority based region filling process. To reduce the computational time, low resolution image is constructed from input image. Based on texel of an image, patch size is determined. Several low resolution image with missing region filled is generated using region filling algorithm. Pixel information from these low resolution images is consolidated to produce single low resolution region filled image. Finally, super resolution algorithm is applied to enhance the quality of image and regain all specifics of image. This methodology of identifying patch size based on input fed has an advantage over filling algorithms which in true sense automate the process of region filling, to deal with sensitivity in region filling, algorithm different parameter settings are used and functioning with coarse version of image will notably reduce the computational time.

scholarly journals Low Resolution Information Also Matters: Learning Multi-Resolution Representations for Person Re-Identification

2021 ◽  
Author(s):  
Guoqing Zhang ◽  
Yuhao Chen ◽  
Weisi Lin ◽  
Arun Chandran ◽  
Xuan Jing
Keyword(s):  
Feature Extraction ◽  
High Resolution ◽  
Feature Fusion ◽  
State Of The Art ◽  
Super Resolution ◽  
Input Image ◽  
Low Resolution ◽  
Joint Learning ◽  
Novel Method ◽  
Valid Information

As a prevailing task in video surveillance and forensics field, person re-identification (re-ID) aims to match person images captured from non-overlapped cameras. In unconstrained scenarios, person images often suffer from the resolution mismatch problem, i.e., Cross-Resolution Person Re-ID. To overcome this problem, most existing methods restore low resolution (LR) images to high resolution (HR) by super-resolution (SR). However, they only focus on the HR feature extraction and ignore the valid information from original LR images. In this work, we explore the influence of resolutions on feature extraction and develop a novel method for cross-resolution person re-ID called Multi-Resolution Representations Joint Learning (MRJL). Our method consists of a Resolution Reconstruction Network (RRN) and a Dual Feature Fusion Network (DFFN). The RRN uses an input image to construct a HR version and a LR version with an encoder and two decoders, while the DFFN adopts a dual-branch structure to generate person representations from multi-resolution images. Comprehensive experiments on five benchmarks verify the superiority of the proposed MRJL over the relevent state-of-the-art methods.

scholarly journals Super-resolution Ultrasound Imaging Scheme Based on a Symmetric Series Convolutional Neural Network

2021 ◽  
Author(s):  
Lakpa Dorje Tamang
Keyword(s):  
Neural Network ◽  
Feature Extraction ◽  
Convolutional Neural Network ◽  
Ultrasound Image ◽  
Similarity Index ◽  
Super Resolution ◽  
Input Image ◽  
Feature Maps ◽  
Proposed Model ◽  
Reconstruction Performance

In this paper, we propose a symmetric series convolutional neural network (SS-CNN), which is a novel deep convolutional neural network (DCNN)-based super-resolution (SR) technique for ultrasound medical imaging. The proposed model comprises two parts: a feature extraction network (FEN) and an up-sampling layer. In the FEN, the low-resolution (LR) counterpart of the ultrasound image passes through a symmetric series of two different DCNNs. The low-level feature maps obtained from the subsequent layers of both DCNNs are concatenated in a feed forward manner, aiding in robust feature extraction to ensure high reconstruction quality. Subsequently, the final concatenated features serve as an input map to the latter 2D convolutional layers, where the textural information of the input image is connected via skip connections. The second part of the proposed model is a sub-pixel convolutional (SPC) layer, which up-samples the output of the FEN by multiplying it with a multi-dimensional kernel followed by a periodic shuffling operation to reconstruct a high-quality SR ultrasound image. We validate the performance of the SS-CNN with publicly available ultrasound image datasets. Experimental results show that the proposed model achieves an exquisite reconstruction performance of ultrasound image over the conventional methods in terms of peak signal-to-noise ratio (PSNR), and structural similarity index (SSIM), while providing compelling SR reconstruction time.

scholarly journals Adversarial example defense based on image reconstruction

2021 ◽  
Vol 7 ◽  
pp. e811
Author(s):  
Yu(AUST) Zhang ◽  
Huan Xu ◽  
Chengfei Pei ◽  
Gaoming Yang
Keyword(s):  
Image Reconstruction ◽  
Language Processing ◽  
Rapid Development ◽  
Super Resolution ◽  
Autonomous Driving ◽  
Input Image ◽  
Widespread Application ◽  
Input Sample ◽  
Adversarial Example ◽  
Depth Compression

The rapid development of deep neural networks (DNN) has promoted the widespread application of image recognition, natural language processing, and autonomous driving. However, DNN is vulnerable to adversarial examples, such as an input sample with imperceptible perturbation which can easily invalidate the DNN and even deliberately modify the classification results. Therefore, this article proposes a preprocessing defense framework based on image compression reconstruction to achieve adversarial example defense. Firstly, the defense framework performs pixel depth compression on the input image based on the sensitivity of the adversarial example to eliminate adversarial perturbations. Secondly, we use the super-resolution image reconstruction network to restore the image quality and then map the adversarial example to the clean image. Therefore, there is no need to modify the network structure of the classifier model, and it can be easily combined with other defense methods. Finally, we evaluate the algorithm with MNIST, Fashion-MNIST, and CIFAR-10 datasets; the experimental results show that our approach outperforms current techniques in the task of defending against adversarial example attacks.

scholarly journals Super-Resolution Enhancement Method Based on Generative Adversarial Network for Integral Imaging Microscopy

Sensors ◽  
2021 ◽  
Vol 21 (6) ◽  
pp. 2164
Author(s):  
Md. Shahinur Alam ◽  
Ki-Chul Kwon ◽  
Munkh-Uchral Erdenebat ◽  
Mohammed Y. Abbass ◽  
Md. Ashraful Alam ◽  
...  
Keyword(s):  
High Resolution ◽  
Resolution Enhancement ◽  
Three Dimensional ◽  
Super Resolution ◽  
Input Image ◽  
Low Resolution ◽  
Generative Adversarial Network ◽  
Microscopic Object ◽  
Integral Imaging ◽  
Adversarial Network

The integral imaging microscopy system provides a three-dimensional visualization of a microscopic object. However, it has a low-resolution problem due to the fundamental limitation of the F-number (the aperture stops) by using micro lens array (MLA) and a poor illumination environment. In this paper, a generative adversarial network (GAN)-based super-resolution algorithm is proposed to enhance the resolution where the directional view image is directly fed as input. In a GAN network, the generator regresses the high-resolution output from the low-resolution input image, whereas the discriminator distinguishes between the original and generated image. In the generator part, we use consecutive residual blocks with the content loss to retrieve the photo-realistic original image. It can restore the edges and enhance the resolution by ×2, ×4, and even ×8 times without seriously hampering the image quality. The model is tested with a variety of low-resolution microscopic sample images and successfully generates high-resolution directional view images with better illumination. The quantitative analysis shows that the proposed model performs better for microscopic images than the existing algorithms.

scholarly journals Restoration and Enhancement of Historical Stereo Photos

2021 ◽  
Vol 7 (7) ◽  
pp. 103
Author(s):  
Marco Fanfani ◽  
Carlo Colombo ◽  
Fabio Bellavia
Keyword(s):  
Super Resolution ◽  
Input Image ◽  
Visual Media ◽  
Consistency Checking ◽  
Single Image ◽  
Original Algorithm ◽  
Digital Restoration ◽  
Fully Automatic ◽  
Comparative Results ◽  
Detail Enhancement

Restoration of digital visual media acquired from repositories of historical photographic and cinematographic material is of key importance for the preservation, study and transmission of the legacy of past cultures to the coming generations. In this paper, a fully automatic approach to the digital restoration of historical stereo photographs is proposed, referred to as Stacked Median Restoration plus (SMR+). The approach exploits the content redundancy in stereo pairs for detecting and fixing scratches, dust, dirt spots and many other defects in the original images, as well as improving contrast and illumination. This is done by estimating the optical flow between the images, and using it to register one view onto the other both geometrically and photometrically. Restoration is then accomplished in three steps: (1) image fusion according to the stacked median operator, (2) low-resolution detail enhancement by guided supersampling, and (3) iterative visual consistency checking and refinement. Each step implements an original algorithm specifically designed for this work. The restored image is fully consistent with the original content, thus improving over the methods based on image hallucination. Comparative results on three different datasets of historical stereograms show the effectiveness of the proposed approach, and its superiority over single-image denoising and super-resolution methods. Results also show that the performance of the state-of-the-art single-image deep restoration network Bringing Old Photo Back to Life (BOPBtL) can be strongly improved when the input image is pre-processed by SMR+.

scholarly journals Combination of single image super resolution and digital Inpainting algorithms based on GANS for robust image completion

2017 ◽  
Vol 14 (3) ◽  
pp. 379-386 ◽  
Author(s):  
Sparik Hayrapetyan ◽  
Gevorg Karapetyan ◽  
Viacheslav Voronin ◽  
Hakob Sarukhanyan
Keyword(s):  
Image Inpainting ◽  
Super Resolution ◽  
Input Image ◽  
Image Completion ◽  
Single Image ◽  
Powerful Approach ◽  
Image Super Resolution ◽  
Robust Image ◽  
Digital Inpainting ◽  
Single Image Super Resolution

Image inpainting, a technique of completing missing or corrupted image regions in undetected form, is an open problem in digital image processing. Inpainting of large regions using Deep Convolutional Generative Adversarial Nets (DCGAN) is a new and powerful approach. In described approaches the size of generated image and size of input image should be the same. In this paper we propose a new method where the size of input image with corrupted region can be up to 4 times larger than generated image.

SinGAN-Based Asteroid Surface Image Generation

2021 ◽  
Vol 32 (4) ◽  
pp. 28-47
Author(s):  
Yundong Guo ◽  
Jeng-Shyang Pan ◽  
Chengbo Qiu ◽  
Fang Xie ◽  
Hao Luo ◽  
...  
Keyword(s):  
Super Resolution ◽  
Landing Site ◽  
Input Image ◽  
Shape Variation ◽  
Surface Sampling ◽  
Test Environment ◽  
Illumination Direction ◽  
Asteroid Exploration ◽  
Set Up ◽  
Asteroid Surface

While it is risky considering spacecraft constraints and unknown environment on asteroid, surface sampling is an important technique for asteroid exploration. One of the sample return missions is to seek an optimal landing site, which may be in hazardous terrain. Since autonomous landing is particularly challenging, it is necessary to simulate the effectiveness of this process and prove the onboard optical hazard avoidance is robust to various uncertainties. This paper aims to generate realistic surface images of asteroids for simulations of asteroid exploration. A SinGAN-based method is proposed, which only needs a single input image for training a pyramid of multi-scale patch generators. Various images with high fidelity can be generated, and manipulations such as shape variation, illumination direction variation, super resolution generation are well achieved. The method's applicability is validated by extensive experimental results and evaluations. At last, the proposed method has been used to help set up a test environment for landing site selection simulation.

Sign in / Sign up

Export Citation Format

Share Document