scholarly journals Demosaicing of Bayer and CFA 2.0 Patterns for Low Lighting Images

Electronics ◽  
2019 ◽  
Vol 8 (12) ◽  
pp. 1444 ◽  
Author(s):  
Chiman Kwan ◽  
Jude Larkin
Keyword(s):  
Deep Learning ◽  
Comparative Study ◽  
Performance Metrics ◽  
Signal To Noise Ratio ◽  
Color Filter ◽  
Signal To Noise ◽  
Lighting Conditions ◽  
Bayer Pattern ◽  
Filter Array ◽  
Better Than

It is commonly believed that having more white pixels in a color filter array (CFA) will help the demosaicing performance for images collected in low lighting conditions. However, to the best of our knowledge, a systematic study to demonstrate the above statement does not exist. We present a comparative study to systematically and thoroughly evaluate the performance of demosaicing for low lighting images using two CFAs: the standard Bayer pattern (aka CFA 1.0) and the Kodak CFA 2.0 (RGBW pattern with 50% white pixels). Using the clean Kodak dataset containing 12 images, we first emulated low lighting images by injecting Poisson noise at two signal-to-noise (SNR) levels: 10 dBs and 20 dBs. We then created CFA 1.0 and CFA 2.0 images for the noisy images. After that, we applied more than 15 conventional and deep learning based demosaicing algorithms to demosaic the CFA patterns. Using both objectives with five performance metrics and subjective visualization, we observe that having more white pixels indeed helps the demosaicing performance in low lighting conditions. This thorough comparative study is our first contribution. With denoising, we observed that the demosaicing performance of both CFAs has been improved by several dBs. This can be considered as our second contribution. Moreover, we noticed that denoising before demosaicing is more effective than denoising after demosaicing. Answering the question of where denoising should be applied is our third contribution. We also noticed that denoising plays a slightly more important role in 10 dBs signal-to-noise ratio (SNR) as compared to 20 dBs SNR. Some discussions on the following phenomena are also included: (1) why CFA 2.0 performed better than CFA 1.0; (2) why denoising was more effective before demosaicing than after demosaicing; and (3) why denoising helped more at low SNRs than at high SNRs.

scholarly journals Demosaicing of CFA 3.0 with Applications to Low Lighting Images

Sensors ◽  
2020 ◽  
Vol 20 (12) ◽  
pp. 3423 ◽  
Author(s):  
Chiman Kwan ◽  
Jude Larkin ◽  
Bulent Ayhan
Keyword(s):  
Comparative Study ◽  
Poisson Noise ◽  
Color Filter ◽  
Signal To Noise ◽  
Color Filter Array ◽  
Lighting Conditions ◽  
Bayer Pattern ◽  
Filter Array ◽  
Better Than

Low lighting images usually contain Poisson noise, which is pixel amplitude-dependent. More panchromatic or white pixels in a color filter array (CFA) are believed to help the demosaicing performance in dark environments. In this paper, we first introduce a CFA pattern known as CFA 3.0 that has 75% white pixels, 12.5% green pixels, and 6.25% of red and blue pixels. We then present algorithms to demosaic this CFA, and demonstrate its performance for normal and low lighting images. In addition, a comparative study was performed to evaluate the demosaicing performance of three CFAs, namely the Bayer pattern (CFA 1.0), the Kodak CFA 2.0, and the proposed CFA 3.0. Using a clean Kodak dataset with 12 images, we emulated low lighting conditions by introducing Poisson noise into the clean images. In our experiments, normal and low lighting images were used. For the low lighting conditions, images with signal-to-noise (SNR) of 10 dBs and 20 dBs were studied. We observed that the demosaicing performance in low lighting conditions was improved when there are more white pixels. Moreover, denoising can further enhance the demosaicing performance for all CFAs. The most important finding is that CFA 3.0 performs better than CFA 1.0, but is slightly inferior to CFA 2.0, in low lighting images.

scholarly journals Comparison of Denoising Algorithms for Demosacing Low Lighting Images Using CFA 2.0

2020 ◽  
Vol 11 (5) ◽  
pp. 37-60
Author(s):  
Chiman Kwan ◽  
Jude Larkin
Keyword(s):  
Deep Learning ◽  
Image Quality ◽  
Poisson Noise ◽  
Color Filter ◽  
Digital Cameras ◽  
Critical Step ◽  
Lighting Conditions ◽  
Bayer Pattern ◽  
Filter Array ◽  
The Impact

In modern digital cameras, the Bayer color filter array (CFA) has been widely used. It is also widely known as CFA 1.0. However, Bayer pattern is inferior to the red-green-blue-white (RGBW) pattern, which is also known as CFA 2.0, in low lighting conditions in which Poisson noise is present. It is well known that demosaicing algorithms cannot effectively deal with Poisson noise and additional denoising is needed in order to improve the image quality. In this paper, we propose to evaluate various conventional and deep learning based denoising algorithms for CFA 2.0 in low lighting conditions. We will also investigate the impact of the location of denoising, which refers to whether the denoising is done before or after a critical step of demosaicing. Extensive experiments show that some denoising algorithms can indeed improve the image quality in low lighting conditions. We also noticed that the location of denoising plays an important role in the overall demosaicing performance.

scholarly journals Weights-Based Image Demosaicking Using Posteriori Gradients and the Correlation of R–B Channels in High Frequency

Symmetry ◽  
2019 ◽  
Vol 11 (5) ◽  
pp. 600
Author(s):  
Meidong Xia ◽  
Chengyou Wang ◽  
Wenhan Ge
Keyword(s):  
High Frequency ◽  
Signal To Noise Ratio ◽  
Experimental Results ◽  
Color Filter ◽  
Signal To Noise ◽  
Visual Effect ◽  
B Values ◽  
Bayer Pattern ◽  
Filter Array ◽  
Composite Peak

In this paper, we propose a weights-based image demosaicking algorithm which is based on the Bayer pattern color filter array (CFA). When reconstructing the missing G components, the proposed algorithm uses weights based on posteriori gradients to mitigate color artifacts and distortions. Furthermore, the proposed algorithm makes full use of the correlation of R–B channels in high frequency when interpolating R/B values at B/R positions. Experimental results show that the proposed algorithm is superior to previous similar algorithms in composite peak signal-to-noise ratio (CPSNR) and subjective visual effect. The biggest advantage of the proposed algorithm is the use of posteriori gradients and the correlation of R–B channels in high frequency.

ANALISIS SENSITIVITAS VIDEO MPEG-4 BERDASARKAN STRUKTUR FRAME PADA TRANSMISI DVB-T

2020 ◽  
Vol 25 (2) ◽  
pp. 86-97
Author(s):  
Sandy Suryo Prayogo ◽  
Tubagus Maulana Kusuma
Keyword(s):  
Deep Learning ◽  
Bit Error Rate ◽  
Error Rate ◽  
Signal To Noise Ratio ◽  
Similarity Index ◽  
Structural Similarity ◽  
Signal To Noise ◽  
Structural Similarity Index ◽  
Noise Ratio

DVB merupakan standar transmisi televisi digital yang paling banyak digunakan saat ini. Unsur terpenting dari suatu proses transmisi adalah kualitas gambar dari video yang diterima setelah melalui proses transimisi tersebut. Banyak faktor yang dapat mempengaruhi kualitas dari suatu gambar, salah satunya adalah struktur frame dari video. Pada tulisan ini dilakukan pengujian sensitifitas video MPEG-4 berdasarkan struktur frame pada transmisi DVB-T. Pengujian dilakukan menggunakan simulasi matlab dan simulink. Digunakan juga ffmpeg untuk menyediakan format dan pengaturan video akan disimulasikan. Variabel yang diubah dari video adalah bitrate dan juga group-of-pictures (GOP), sedangkan variabel yang diubah dari transmisi DVB-T adalah signal-to-noise-ratio (SNR) pada kanal AWGN di antara pengirim (Tx) dan penerima (Rx). Hasil yang diperoleh dari percobaan berupa kualitas rata-rata gambar pada video yang diukur menggunakan metode pengukuran structural-similarity-index (SSIM). Dilakukan juga pengukuran terhadap jumlah bit-error-rate BER pada bitstream DVB-T. Percobaan yang dilakukan dapat menunjukkan seberapa besar sensitifitas bitrate dan GOP dari video pada transmisi DVB-T dengan kesimpulan semakin besar bitrate maka akan semakin buruk nilai kualitas gambarnya, dan semakin kecil nilai GOP maka akan semakin baik nilai kualitasnya. Penilitian diharapkan dapat dikembangkan menggunakan deep learning untuk memperoleh frame struktur yang tepat di kondisi-kondisi tertentu dalam proses transmisi televisi digital.

Frame-Level Signal-to-Noise Ratio Estimation Using Deep Learning

2020 ◽  
Author(s):  
Hao Li ◽  
DeLiang Wang ◽  
Xueliang Zhang ◽  
Guanglai Gao
Keyword(s):  
Deep Learning ◽  
Signal To Noise Ratio ◽  
Ratio Estimation ◽  
Signal To Noise ◽  
Noise Ratio

MIMO Detectors: A Comprehensive Performance Analysis

2021 ◽  
Vol 16 (3) ◽  
pp. 24-27
Author(s):  
E. Obi ◽  
B.O. Sadiq ◽  
O.S . Zakariyya ◽  
A. Theresa
Keyword(s):  
Error Rate ◽  
Mimo Systems ◽  
Signal To Noise Ratio ◽  
Minimum Mean Square Error ◽  
Multiple Input Multiple Output ◽  
Symbol Error Rate ◽  
Signal To Noise ◽  
High Data ◽  
Noise Ratio ◽  
Better Than

Multiple-input multiple-output (MIMO) systems are increasingly becoming popular due to their ability to multiply data rates without any expansion in the bandwidth. This is critical in this era of high-data rate applications but limited bandwidth. MIMO detectors play an important role in ensuring effective communication in such systems and as such the performance of the following are compared in this paper with respect to symbol error rate (SER) versus signal-to-noise ratio (SNR): maximum likelihood (ML), zero forcing (ZF), minimum mean square error (MMSE) and vertical Bell laboratories layered space time (VBLAST). Results showed that the ML has the best performance as it has the least Symbol Error Rate (SER) for all values of Signal to Noise Ratio (SNR) as it was 91.9% better than MMSE, 99.6% better than VBLAST and 99.8% better than ZF at 20db for a 2x2 antenna configuration., it can also be deduced that the performance increased with increase in number of antenna for all detectors except the V-BLAST detector.

scholarly journals An SNR Estimation Technique Based on Deep Learning

Electronics ◽  
2019 ◽  
Vol 8 (10) ◽  
pp. 1139 ◽  
Author(s):  
Kai Yang ◽  
Zhitao Huang ◽  
Xiang Wang ◽  
Fenghua Wang
Keyword(s):  
Deep Learning ◽  
Signal To Noise Ratio ◽  
A Priori ◽  
Intermediate Frequency ◽  
Estimation Technique ◽  
Signal To Noise ◽  
Snr Estimation ◽  
Application Range ◽  
Noise Ratio ◽  
Priori Information

Signal-to-noise ratio (SNR) is a priori information necessary for many signal processing algorithms or techniques. However, there are many problems exsisting in conventional SNR estimation techniques, such as limited application range of modulation types, narrow effective estimation range of signal-to-noise ratio, and poor ability to accommodate non-zero timing offsets and frequency offsets. In this paper, an SNR estimation technique based on deep learning (DL) is proposed, which is a non-data-aid (NDA) technique. Second and forth moment (M2M4) estimator is used as a benchmark, and experimental results show that the performance and robustness of the proposed method are better, and the applied ranges of modulation types is wider. At the same time, the proposed method is not only applicable to the baseband signal and the incoherent signal, but can also estimate the SNR of the intermediate frequency signal.

Sign in / Sign up

Export Citation Format

Share Document