scholarly journals Image Shadow Removal Using End-to-End Deep Convolutional Neural Networks

2019 ◽  
Vol 9 (5) ◽  
pp. 1009 ◽  
Author(s):  
Hui Fan ◽  
Meng Han ◽  
Jinjiang Li
Keyword(s):  
Signal To Noise Ratio ◽  
Network Models ◽  
Structural Similarity ◽  
Shadow Removal ◽  
Deep Convolutional Neural Networks ◽  
Edge Information ◽  
Qualitative And Quantitative ◽  
Automatic Methods ◽  
End To End ◽  
High Level

Image degradation caused by shadows is likely to cause technological issues in image segmentation and target recognition. In view of the existing shadow removal methods, there are problems such as small and trivial shadow processing, the scarcity of end-to-end automatic methods, the neglecting of light, and high-level semantic information such as materials. An end-to-end deep convolutional neural network is proposed to further improve the image shadow removal effect. The network mainly consists of two network models, an encoder–decoder network and a small refinement network. The former predicts the alpha shadow scale factor, and the latter refines to obtain sharper edge information. In addition, a new image database (remove shadow database, RSDB) is constructed; and qualitative and quantitative evaluations are made on databases such as UIUC, UCF and newly-created databases (RSDB) with various real images. Using the peak signal-to-noise ratio (PSNR) and the structural similarity (SSIM) for quantitative analysis, the algorithm has a big improvement on the PSNR and the SSIM as opposed to other methods. In terms of qualitative comparisons, the network shadow has a clearer and shadow-free image that is consistent with the original image color and texture, and the detail processing effect is much better. The experimental results show that the proposed algorithm is superior to other algorithms, and it is more robust in subjective vision and objective quantization.

DCNN-based Ship Classification using Enhanced Edge Information and Inception Module

2021 ◽  
Author(s):  
Bo Wang ◽  
Xiaoting Yu ◽  
Chengeng Huang ◽  
Qinghong Sheng ◽  
Yuanyuan Wang ◽  
...  
Keyword(s):  
Neural Networks ◽  
Classification Performance ◽  
Image Features ◽  
Deep Convolutional Neural Networks ◽  
Edge Information ◽  
Average Accuracy ◽  
Ship Classification ◽  
Edge Features ◽  
High Level ◽  
Better Than

The excellent feature extraction ability of deep convolutional neural networks (DCNNs) has been demonstrated in many image processing tasks, by which image classification can achieve high accuracy with only raw input images. However, the specific image features that influence the classification results are not readily determinable and what lies behind the predictions is unclear. This study proposes a method combining the Sobel and Canny operators and an Inception module for ship classification. The Sobel and Canny operators obtain enhanced edge features from the input images. A convolutional layer is replaced with the Inception module, which can automatically select the proper convolution kernel for ship objects in different image regions. The principle is that the high-level features abstracted by the DCNN, and the features obtained by multi-convolution concatenation of the Inception module must ultimately derive from the edge information of the preprocessing input images. This indicates that the classification results are based on the input edge features, which indirectly interpret the classification results to some extent. Experimental results show that the combination of the edge features and the Inception module improves DCNN ship classification performance. The original model with the raw dataset has an average accuracy of 88.72%, while when using enhanced edge features as input, it achieves the best performance of 90.54% among all models. The model that replaces the fifth convolutional layer with the Inception module has the best performance of 89.50%. It performs close to VGG-16 on the raw dataset and is significantly better than other deep neural networks. The results validate the functionality and feasibility of the idea posited.

scholarly journals HLS Based Approach to Develop an Implementable HDR Algorithm

Electronics ◽  
2018 ◽  
Vol 7 (11) ◽  
pp. 332 ◽  
Author(s):  
Rappy Saha ◽  
Partha Banik ◽  
Ki-Doo Kim
Keyword(s):  
Dynamic Range ◽  
Signal To Noise Ratio ◽  
Simple Algorithm ◽  
Structural Similarity ◽  
High Dynamic Range ◽  
Field Programmable ◽  
Hardware Description ◽  
On Chip ◽  
High Level ◽  
Removal Technique

Hardware suitability of an algorithm can only be verified when the algorithm is actually implemented in the hardware. By hardware, we indicate system on chip (SoC) where both processor and field-programmable gate array (FPGA) are available. Our goal is to develop a simple algorithm that can be implemented on hardware where high-level synthesis (HLS) will reduce the tiresome work of manual hardware description language (HDL) optimization. We propose an algorithm to achieve high dynamic range (HDR) image from a single low dynamic range (LDR) image. We use highlight removal technique for this purpose. Our target is to develop parameter free simple algorithm that can be easily implemented on hardware. For this purpose, we use statistical information of the image. While software development is verified with state of the art, the HLS approach confirms that the proposed algorithm is implementable to hardware. The performance of the algorithm is measured using four no-reference metrics. According to the measurement of the structural similarity (SSIM) index metric and peak signal-to-noise ratio (PSNR), hardware simulated output is at least 98.87 percent and 39.90 dB similar to the software simulated output. Our approach is novel and effective in the development of hardware implementable HDR algorithm from a single LDR image using the HLS tool.

scholarly journals Optimized Hybrid Model for Gaussian Noise Reduction images

2021 ◽  
Vol 19 (1) ◽  
pp. 9-17
Author(s):  
Lubna Farhi ◽  
Agha Yasir ◽  
Farhan Ur Rehman ◽  
Baqar A. Zardari ◽  
Ramsha Shakeel
Keyword(s):  
Noise Reduction ◽  
Hybrid Model ◽  
Gaussian Noise ◽  
Impulsive Noise ◽  
Signal To Noise Ratio ◽  
Wiener Filter ◽  
Structural Similarity ◽  
Mean Value ◽  
The Matrix ◽  
High Level

In this paper, image noise is removed by using a hybrid model of wiener and fuzzy filters. It is a challenging task to remove Gaussian noise (GN) from an image and to protect the image’s edges. The Fuzzy-Wiener filter (FWF) hybrid model is used for optimizing the image smoothness and efficiency at a high level of GN. The efficiency is measured by using Structural Similarity (SSIM), Mean Square Error (MSE), and Peak Signal to Noise Ratio (PSNR). The proposed algorithm substitutes a mean value of the matrix for a non-overlapping block and replaces the total pixel number with each direction. In the proposed model, overall results proved that the optimized hybrid model FWF has an enormous computational speed and impulsive noise reduction, which enables efficient filtering as compared to the existing techniques.

scholarly journals Hybrid FWF Model For Gaussian Noise Reduction From Images

10.31645/11 ◽  
2020 ◽  
Author(s):  
Lubna Farhi ◽  
◽  
Farhan Ur Rehman ◽  
Keyword(s):  
Noise Reduction ◽  
Hybrid Model ◽  
Gaussian Noise ◽  
Impulsive Noise ◽  
Signal To Noise Ratio ◽  
Wiener Filter ◽  
Structural Similarity ◽  
Mean Value ◽  
The Matrix ◽  
High Level

In this paper, the image efficiency is improved by using hybrid model of wiener’s filter and fuzzy filter. It’s a challenging task to remove Gaussian noise (GN) from an image and to protect the picture edges. The Fuzzy - Wiener filter (FWF) hybrid model is used for optimizing the image smoothness and efficiency at a high level of GN. The efficiency is measured by using Structural Similarity (SSIM), Mean Square Error (MSE), and Peak Signal to Noise Ratio (PSNR). The proposed algorithm substitutes a mean value of the matrix for a non-overlapping block and replaces the total pixel number with each direction. In the proposed model, overall results presented that the optimized hybrid model FWF has an enormous computational speed and impulsive noise reduction, which enables efficient filtering as compared to the existing techniques

Pollen morphology of some Tamarix (Tamaricaceae) species of Iran

2020 ◽  
Vol 62 (1-2) ◽  
pp. 151-161
Author(s):  
T. Shagholi ◽  
M. Keshavarzi ◽  
M. Sheidai
Keyword(s):  
North Africa ◽  
Pollen Grains ◽  
Ecological Niches ◽  
Multivariate Statistical Methods ◽  
Multivariate Statistical ◽  
Qualitative And Quantitative ◽  
Petal Length ◽  
Electron Microscopes ◽  
High Level ◽  
Scanning Electron Microscopes

Tamarix L. (Tamaricaceae) is a halophytic shrub in different parts of Asia and North Africa. Taxonomy and species limitation of Tamarix is very complex. This genus has three sections as Tamarix, Oligadenia, and Polyadenia, which are mainly separated by petal length, the number of stamens, the shape of androecial disk and attachment of filament on the androecial disk. As there was no palynological data on pollen features of Tamarix species of Iran, in the present study 12 qualitative and quantitative pollen features were evaluated to find diagnostic ones. Pollen grains of 8 Tamarix species were collected from nature. Pollen grains were studied without any treatment. Measurements were based on at least 50 pollen grains per specimen. Light and scanning electron microscopes were used. Multivariate statistical methods were applied to clarify the species relationships based on pollen data. All species studied showed monad and tricolpate (except some individuals of T. androssowii). Some Tamarix species show a high level of variability, in response to ecological niches and phenotypic plasticity, which make Tamarix species separation much more difficult. Based on the results of the present study, pollen grains features are not in agreement with previous morphological and molecular genetics about the sectional distinction.

ANALISIS SENSITIVITAS VIDEO MPEG-4 BERDASARKAN STRUKTUR FRAME PADA TRANSMISI DVB-T

2020 ◽  
Vol 25 (2) ◽  
pp. 86-97
Author(s):  
Sandy Suryo Prayogo ◽  
Tubagus Maulana Kusuma
Keyword(s):  
Deep Learning ◽  
Bit Error Rate ◽  
Error Rate ◽  
Signal To Noise Ratio ◽  
Similarity Index ◽  
Structural Similarity ◽  
Signal To Noise ◽  
Structural Similarity Index ◽  
Noise Ratio

DVB merupakan standar transmisi televisi digital yang paling banyak digunakan saat ini. Unsur terpenting dari suatu proses transmisi adalah kualitas gambar dari video yang diterima setelah melalui proses transimisi tersebut. Banyak faktor yang dapat mempengaruhi kualitas dari suatu gambar, salah satunya adalah struktur frame dari video. Pada tulisan ini dilakukan pengujian sensitifitas video MPEG-4 berdasarkan struktur frame pada transmisi DVB-T. Pengujian dilakukan menggunakan simulasi matlab dan simulink. Digunakan juga ffmpeg untuk menyediakan format dan pengaturan video akan disimulasikan. Variabel yang diubah dari video adalah bitrate dan juga group-of-pictures (GOP), sedangkan variabel yang diubah dari transmisi DVB-T adalah signal-to-noise-ratio (SNR) pada kanal AWGN di antara pengirim (Tx) dan penerima (Rx). Hasil yang diperoleh dari percobaan berupa kualitas rata-rata gambar pada video yang diukur menggunakan metode pengukuran structural-similarity-index (SSIM). Dilakukan juga pengukuran terhadap jumlah bit-error-rate BER pada bitstream DVB-T. Percobaan yang dilakukan dapat menunjukkan seberapa besar sensitifitas bitrate dan GOP dari video pada transmisi DVB-T dengan kesimpulan semakin besar bitrate maka akan semakin buruk nilai kualitas gambarnya, dan semakin kecil nilai GOP maka akan semakin baik nilai kualitasnya. Penilitian diharapkan dapat dikembangkan menggunakan deep learning untuk memperoleh frame struktur yang tepat di kondisi-kondisi tertentu dalam proses transmisi televisi digital.

scholarly journals Efficient End-to-End Sentence-Level Lipreading with Temporal Convolutional Networks

2021 ◽  
Vol 11 (15) ◽  
pp. 6975
Author(s):  
Tao Zhang ◽  
Lun He ◽  
Xudong Li ◽  
Guoqing Feng
Keyword(s):  
Performance Improvement ◽  
State Of The Art ◽  
Error Rates ◽  
Convolutional Network ◽  
Convolutional Networks ◽  
Sentence Level ◽  
End To End ◽  
High Level ◽  
Improved Accuracy ◽  
Talking Face

Lipreading aims to recognize sentences being spoken by a talking face. In recent years, the lipreading method has achieved a high level of accuracy on large datasets and made breakthrough progress. However, lipreading is still far from being solved, and existing methods tend to have high error rates on the wild data and have the defects of disappearing training gradient and slow convergence. To overcome these problems, we proposed an efficient end-to-end sentence-level lipreading model, using an encoder based on a 3D convolutional network, ResNet50, Temporal Convolutional Network (TCN), and a CTC objective function as the decoder. More importantly, the proposed architecture incorporates TCN as a feature learner to decode feature. It can partly eliminate the defects of RNN (LSTM, GRU) gradient disappearance and insufficient performance, and this yields notable performance improvement as well as faster convergence. Experiments show that the training and convergence speed are 50% faster than the state-of-the-art method, and improved accuracy by 2.4% on the GRID dataset.

scholarly journals Computing 3D Phase-Type Holograms Based on Deep Learning Method

Photonics ◽  
2021 ◽  
Vol 8 (7) ◽  
pp. 280
Author(s):  
Huadong Zheng ◽  
Jianbin Hu ◽  
Chaojun Zhou ◽  
Xiaoxi Wang
Keyword(s):  
Deep Learning ◽  
Signal To Noise Ratio ◽  
Contrast Ratio ◽  
Angular Spectrum ◽  
Structural Similarity ◽  
Computational Time ◽  
Experimental Investigations ◽  
Training Strategy ◽  
Holographic Display ◽  
Phase Type

Computer holography is a technology that use a mathematical model of optical holography to generate digital holograms. It has wide and promising applications in various areas, especially holographic display. However, traditional computational algorithms for generation of phase-type holograms based on iterative optimization have a built-in tradeoff between the calculating speed and accuracy, which severely limits the performance of computational holograms in advanced applications. Recently, several deep learning based computational methods for generating holograms have gained more and more attention. In this paper, a convolutional neural network for generation of multi-plane holograms and its training strategy is proposed using a multi-plane iterative angular spectrum algorithm (ASM). The well-trained network indicates an excellent ability to generate phase-only holograms for multi-plane input images and to reconstruct correct images in the corresponding depth plane. Numerical simulations and optical reconstructions show that the accuracy of this method is almost the same with traditional iterative methods but the computational time decreases dramatically. The result images show a high quality through analysis of the image performance indicators, e.g., peak signal-to-noise ratio (PSNR), structural similarity (SSIM) and contrast ratio. Finally, the effectiveness of the proposed method is verified through experimental investigations.

Joint Encryption and Compression-Based Watermarking Technique for Security of Digital Documents

2021 ◽  
Vol 21 (1) ◽  
pp. 1-20
Author(s):  
A. K. Singh ◽  
S. Thakur ◽  
Alireza Jolfaei ◽  
Gautam Srivastava ◽  
MD. Elhoseny ◽  
...  
Keyword(s):  
Signal To Noise Ratio ◽  
Similarity Index ◽  
Structural Similarity ◽  
Digital Data ◽  
The Internet ◽  
Discrete Wavelet ◽  
Compression Performance ◽  
Strong Compression ◽  
Multiple Watermarks ◽  
Value Decomposition

Recently, due to the increase in popularity of the Internet, the problem of digital data security over the Internet is increasing at a phenomenal rate. Watermarking is used for various notable applications to secure digital data from unauthorized individuals. To achieve this, in this article, we propose a joint encryption then-compression based watermarking technique for digital document security. This technique offers a tool for confidentiality, copyright protection, and strong compression performance of the system. The proposed method involves three major steps as follows: (1) embedding of multiple watermarks through non-sub-sampled contourlet transform, redundant discrete wavelet transform, and singular value decomposition; (2) encryption and compression via SHA-256 and Lempel Ziv Welch (LZW), respectively; and (3) extraction/recovery of multiple watermarks from the possibly distorted cover image. The performance estimations are carried out on various images at different attacks, and the efficiency of the system is determined in terms of peak signal-to-noise ratio (PSNR) and normalized correlation (NC), structural similarity index measure (SSIM), number of changing pixel rate (NPCR), unified averaged changed intensity (UACI), and compression ratio (CR). Furthermore, the comparative analysis of the proposed system with similar schemes indicates its superiority to them.

Dual-Hop Amplify-and-Forward Variable Gain Relaying over Mixture Gamma Fading Channels

2015 ◽  
Vol 719-720 ◽  
pp. 767-772
Author(s):  
Wei Jun Cheng
Keyword(s):  
Fading Channels ◽  
Signal To Noise Ratio ◽  
Symbol Error Rate ◽  
Amplify And Forward ◽  
Variable Gain ◽  
Average Symbol Error Rate ◽  
Simulation Results ◽  
End To End ◽  
The Moment ◽  
Relaying System

In this paper, we present the end-to-end performance of a dual-hop amplify-and-forward variablegain relaying system over Mixture Gamma distribution. Novel closed-form expressions for the probability density function and the moment-generation function of the end-to-end Signal-to-noise ratio (SNR) are derived. Moreover, the average symbol error rate, the average SNR and the average capacity are found based on the above new expressions, respectively. These expressions are more simple and accuracy than the previous ones obtained by using generalized-K (KG) distribution. Finally, numerical and simulation results are shown to verify the accuracy of the analytical results.

Sign in / Sign up

Export Citation Format

Share Document