Transfer Learning for Spectral Image Reconstruction from RGB Images

Author(s):  
Emmanuel Martínez ◽  
Santiago Castro ◽  
Jorge Bacca ◽  
Henry Arguello
2010 ◽  
Vol 3 (3) ◽  
pp. 619-645 ◽  
Author(s):  
Kalyani Krishnamurthy ◽  
Maxim Raginsky ◽  
Rebecca Willett

2021 ◽  
Author(s):  
Juan Florez Ospina ◽  
Abdullah Alrushud ◽  
Daniel Lau ◽  
Gonzalo Arce

2020 ◽  
Vol 12 (19) ◽  
pp. 3258
Author(s):  
Jiangsan Zhao ◽  
Dmitry Kechasov ◽  
Boris Rewald ◽  
Gernot Bodner ◽  
Michel Verheul ◽  
...  

Hyperspectral imaging has many applications. However, the high device costs and low hyperspectral image resolution are major obstacles limiting its wider application in agriculture and other fields. Hyperspectral image reconstruction from a single RGB image fully addresses these two problems. The robust HSCNN-R model with mean relative absolute error loss function and evaluated by the Mean Relative Absolute Error metric was selected through permutation tests from models with combinations of loss functions and evaluation metrics, using tomato as a case study. Hyperspectral images were subsequently reconstructed from single tomato RGB images taken by a smartphone camera. The reconstructed images were used to predict tomato quality properties such as the ratio of soluble solid content to total titratable acidity and normalized anthocyanin index. Both predicted parameters showed very good agreement with corresponding “ground truth” values and high significance in an F test. This study showed the suitability of hyperspectral image reconstruction from single RGB images for fruit quality control purposes, underpinning the potential of the technology—recovering hyperspectral properties in high resolution—for real-world, real time monitoring applications in agriculture any beyond.


2017 ◽  
Vol 56 (30) ◽  
pp. 8461 ◽  
Author(s):  
Peng Xu ◽  
Haisong Xu ◽  
Changyu Diao ◽  
Zhengnan Ye

2020 ◽  
pp. 1-15
Author(s):  
Rui Zhu ◽  
Mario V. Wüthrich

Abstract It has become of key interest in the insurance industry to understand and extract information from telematics car driving data. Telematics car driving data of individual car drivers can be summarised in so-called speed–acceleration heatmaps. The aim of this study is to cluster such speed–acceleration heatmaps to different categories by analysing similarities and differences in these heatmaps. Making use of local smoothness properties, we propose to process these heatmaps as RGB images. Clustering can then be achieved by involving supervised information via a transfer learning approach using the pre-trained AlexNet to extract discriminative features. The K-means algorithm is then applied on these extracted discriminative features for clustering. The experiment results in an improvement of heatmap clustering compared to classical approaches.


2019 ◽  
Vol 9 (1) ◽  
Author(s):  
Amirhossein Mostajabi ◽  
Hamidreza Karami ◽  
Mohammad Azadifar ◽  
Alireza Ghasemi ◽  
Marcos Rubinstein ◽  
...  

AbstractElectromagnetic Time Reversal (EMTR) has been used to locate different types of electromagnetic sources. We propose a novel technique based on the combination of EMTR and Machine Learning (ML) for source localization. We show for the first time that ML techniques can be used in conjunction with EMTR to reduce the required number of sensors to only one for the localization of electromagnetic sources in the presence of scatterers. In the EMTR part, we use 2D-FDTD method to generate 2D profiles of the vertical electric field as RGB images. Next, in the ML part, we take advantage of transfer learning techniques by using the pretrained VGG-19 Convolutional Neural Network (CNN) as the feature extractor tool. To the best of our knowledge, this is the first time that the knowledge of pretrained CNNs is applied to simulation-generated images. We demonstrate the skill of the developed methodology in localizing two kinds of electromagnetic sources, namely RF sources with a bandwidth of 0.1–10 MHz and lightning impulses. For the localization of lightning, based on the experimental recordings in the Säntis region, the new approach enables accurate 2D lightning localization using only one sensor, as opposed to current lightning location systems that need at least two sensors to operate.


Sign in / Sign up

Export Citation Format

Share Document