scholarly journals Unsupervised natural image patch learning

2019 ◽  
Vol 5 (3) ◽  
pp. 229-237 ◽  
Author(s):  
Dov Danon ◽  
Hadar Averbuch-Elor ◽  
Ohad Fried ◽  
Daniel Cohen-Or
Keyword(s):  
Natural Image ◽  
Image Patch

scholarly journals Autoencoder-based patch learning for real-world image denoising

2019 ◽  
Vol 13 ◽  
pp. 174830261988139
Author(s):  
Fei Chen ◽  
Haiqing Chen ◽  
Xunxun Zeng ◽  
Meiqing Wang
Keyword(s):  
Image Denoising ◽  
Real World ◽  
State Of The Art ◽  
Compact Representation ◽  
Natural Image ◽  
Great Success ◽  
Image Patch ◽  
Self Similarity ◽  
Coding Scheme ◽  
World Image

Internal patch prior (e.g. self-similarity) has achieved a great success in image denoising. However, it is a challenging task to utilize clean external natural patches for denoising. Natural image patch comes from very complex distributions which are hard to learn without supervision. In this paper, we use an autoencoder to discover and utilize these underlying distributions to learn a compact representation that is more robust to realistic noises. By exploiting learned external prior and internal self-similarity jointly, we develop an efficient patch sparse coding scheme for real-world image denoising. Numerical experiments demonstrate that the proposed method outperforms many state-of-the-art denoising methods, especially on removing realistic noise.

scholarly journals Improved SinGAN Integrated with an Attentional Mechanism for Remote Sensing Image Classification

2021 ◽  
Vol 13 (9) ◽  
pp. 1713
Author(s):  
Songwei Gu ◽  
Rui Zhang ◽  
Hongxia Luo ◽  
Mengyao Li ◽  
Huamei Feng ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Real Life ◽  
Attention Mechanism ◽  
Training Data ◽  
Generative Adversarial Networks ◽  
Natural Image ◽  
Remote Sensing Images ◽  
Training Time ◽  
Adversarial Networks ◽  
Remote Sensing Image Classification

Deep learning is an important research method in the remote sensing field. However, samples of remote sensing images are relatively few in real life, and those with markers are scarce. Many neural networks represented by Generative Adversarial Networks (GANs) can learn from real samples to generate pseudosamples, rather than traditional methods that often require more time and man-power to obtain samples. However, the generated pseudosamples often have poor realism and cannot be reliably used as the basis for various analyses and applications in the field of remote sensing. To address the abovementioned problems, a pseudolabeled sample generation method is proposed in this work and applied to scene classification of remote sensing images. The improved unconditional generative model that can be learned from a single natural image (Improved SinGAN) with an attention mechanism can effectively generate enough pseudolabeled samples from a single remote sensing scene image sample. Pseudosamples generated by the improved SinGAN model have stronger realism and relatively less training time, and the extracted features are easily recognized in the classification network. The improved SinGAN can better identify sub-jects from images with complex ground scenes compared with the original network. This mechanism solves the problem of geographic errors of generated pseudosamples. This study incorporated the generated pseudosamples into training data for the classification experiment. The result showed that the SinGAN model with the integration of the attention mechanism can better guarantee feature extraction of the training data. Thus, the quality of the generated samples is improved and the classification accuracy and stability of the classification network are also enhanced.

scholarly journals Pansharpening of WorldView-2 Data via Graph Regularized Sparse Coding and Adaptive Coupled Dictionary

Sensors ◽  
2021 ◽  
Vol 21 (11) ◽  
pp. 3586
Author(s):  
Wenqing Wang ◽  
Han Liu ◽  
Guo Xie
Keyword(s):  
High Resolution ◽  
Sparse Representation ◽  
Sparse Coding ◽  
Spectral Response ◽  
Objective Evaluation ◽  
Coefficient Matrix ◽  
Image Patch ◽  
Subjective Analysis ◽  
High Resolution Image ◽  
Sparse Coefficient

The spectral mismatch between a multispectral (MS) image and its corresponding panchromatic (PAN) image affects the pansharpening quality, especially for WorldView-2 data. To handle this problem, a pansharpening method based on graph regularized sparse coding (GRSC) and adaptive coupled dictionary is proposed in this paper. Firstly, the pansharpening process is divided into three tasks according to the degree of correlation among the MS and PAN channels and the relative spectral response of WorldView-2 sensor. Then, for each task, the image patch set from the MS channels is clustered into several subsets, and the sparse representation of each subset is estimated through the GRSC algorithm. Besides, an adaptive coupled dictionary pair for each task is constructed to effectively represent the subsets. Finally, the high-resolution image subsets for each task are obtained by multiplying the estimated sparse coefficient matrix by the corresponding dictionary. A variety of experiments are conducted on the WorldView-2 data, and the experimental results demonstrate that the proposed method achieves better performance than the existing pansharpening algorithms in both subjective analysis and objective evaluation.

scholarly journals An Underwater Image Enhancement Algorithm Based on Generative Adversarial Network and Natural Image Quality Evaluation Index

2021 ◽  
Vol 9 (7) ◽  
pp. 691
Author(s):  
Kai Hu ◽  
Yanwen Zhang ◽  
Chenghang Weng ◽  
Pengsheng Wang ◽  
Zhiliang Deng ◽  
...  
Keyword(s):  
Image Quality ◽  
Image Enhancement ◽  
Quality Evaluation ◽  
High Efficiency ◽  
Natural Image ◽  
High Quality ◽  
Generative Adversarial Network ◽  
Image Quality Evaluation ◽  
Adversarial Network ◽  
Underwater Image

When underwater vehicles work, underwater images are often absorbed by light and scattered and diffused by floating objects, which leads to the degradation of underwater images. The generative adversarial network (GAN) is widely used in underwater image enhancement tasks because it can complete image-style conversions with high efficiency and high quality. Although the GAN converts low-quality underwater images into high-quality underwater images (truth images), the dataset of truth images also affects high-quality underwater images. However, an underwater truth image lacks underwater image enhancement, which leads to a poor effect of the generated image. Thus, this paper proposes to add the natural image quality evaluation (NIQE) index to the GAN to provide generated images with higher contrast and make them more in line with the perception of the human eye, and at the same time, grant generated images a better effect than the truth images set by the existing dataset. In this paper, several groups of experiments are compared, and through the subjective evaluation and objective evaluation indicators, it is verified that the enhanced image of this algorithm is better than the truth image set by the existing dataset.

scholarly journals Application of Fast Non-Local Means Algorithm for Noise Reduction Using Separable Color Channels in Light Microscopy Images

2021 ◽  
Vol 18 (6) ◽  
pp. 2903
Author(s):  
Seong-Hyeon Kang ◽  
Ji-Youn Kim
Keyword(s):  
Light Microscopy ◽  
Noise Reduction ◽  
Natural Image ◽  
Search Window ◽  
Local Means ◽  
Image Characteristics ◽  
Non Local ◽  
Spatial Quality ◽  
Evaluation Parameters ◽  
Color Channels

The purpose of this study is to evaluate the various control parameters of a modeled fast non-local means (FNLM) noise reduction algorithm which can separate color channels in light microscopy (LM) images. To achieve this objective, the tendency of image characteristics with changes in parameters, such as smoothing factors and kernel and search window sizes for the FNLM algorithm, was analyzed. To quantitatively assess image characteristics, the coefficient of variation (COV), blind/referenceless image spatial quality evaluator (BRISQUE), and natural image quality evaluator (NIQE) were employed. When high smoothing factors and large search window sizes were applied, excellent COV and unsatisfactory BRISQUE and NIQE results were obtained. In addition, all three evaluation parameters improved as the kernel size increased. However, the kernel and search window sizes of the FNLM algorithm were shown to be dependent on the image processing time (time resolution). In conclusion, this work has demonstrated that the FNLM algorithm can effectively reduce noise in LM images, and parameter optimization is important to achieve the algorithm’s appropriate application.

scholarly journals View-tuned and view-invariant face encoding in IT cortex is explained by selected natural image fragments

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Yunjun Nam ◽  
Takayuki Sato ◽  
Go Uchida ◽  
Ekaterina Malakhova ◽  
Shimon Ullman ◽  
...  
Keyword(s):  
Face Recognition ◽  
Visual Pathway ◽  
Visual Features ◽  
Natural Image ◽  
Face Representation ◽  
Low Level ◽  
Ventral Visual Pathway ◽  
Neural Substrate ◽  
The Face

AbstractHumans recognize individual faces regardless of variation in the facial view. The view-tuned face neurons in the inferior temporal (IT) cortex are regarded as the neural substrate for view-invariant face recognition. This study approximated visual features encoded by these neurons as combinations of local orientations and colors, originated from natural image fragments. The resultant features reproduced the preference of these neurons to particular facial views. We also found that faces of one identity were separable from the faces of other identities in a space where each axis represented one of these features. These results suggested that view-invariant face representation was established by combining view sensitive visual features. The face representation with these features suggested that, with respect to view-invariant face representation, the seemingly complex and deeply layered ventral visual pathway can be approximated via a shallow network, comprised of layers of low-level processing for local orientations and colors (V1/V2-level) and the layers which detect particular sets of low-level elements derived from natural image fragments (IT-level).

Sign in / Sign up

Export Citation Format

Share Document