scholarly journals Multimodal plant recognition through hybrid feature fusion technique using imaging and non-imaging hyper-spectral data

Author(s):  
Pradip Salve ◽  
Pravin Yannawar ◽  
Milind Sardesai
2013 ◽  
Vol 19 (S2) ◽  
pp. 828-829 ◽  
Author(s):  
R. Wuhrer ◽  
K. Moran

Extended abstract of a paper presented at Microscopy and Microanalysis 2013 in Indianapolis, Indiana, USA, August 4 – August 8, 2013.


2010 ◽  
Vol 04 (02) ◽  
pp. 155-179 ◽  
Author(s):  
DHAVAL SHAH ◽  
KYU J. HAN ◽  
SHRIKANTH S. NARAYANAN

In this paper, we first show the importance of face-voice correlation for audio-visual person recognition. We propose a simple multimodal fusion technique which preserves the correlation between audio-visual features during speech and evaluate the performance of such a system against audio-only, video-only, and audio-visual systems which use audio and visual features neglecting the interdependency of a person's spoken utterance and the associated facial movements. Experiments performed on the VidTIMIT dataset show that the proposed multimodal fusion scheme has a lower error rate than all other comparison conditions and is more robust against replay attacks. The simplicity of the fusion technique allows for low-complexity designs for a simple low-cost real-time DSP implementation. We then discuss some problems associated with the previously proposed design and, as a solution to those problems, propose two novel classifier designs which provide more flexibility and a convenient way to represent multimodal data where each modality has different characteristics. We also show that these novel classifier designs offer superior performance in terms of both accuracy and robustness.


2019 ◽  
Vol 2019 ◽  
pp. 1-11 ◽  
Author(s):  
Junping Hu ◽  
Shitu Abubakar ◽  
Shengjun Liu ◽  
Xiaobiao Dai ◽  
Gen Yang ◽  
...  

Pedestrians, motorist, and cyclist remain the victims of poor vision and negligence of human drivers, especially in the night. Millions of people die or sustain physical injury yearly as a result of traffic accidents. Detection and recognition of road markings play a vital role in many applications such as traffic surveillance and autonomous driving. In this study, we have trained a nighttime road-marking detection model using NIR camera images. We have modified the VGG-16 base network of the state-of-the-art faster R-CNN algorithm by using a multilayer feature fusion technique. We have demonstrated another promising feature fusion technique of concatenating all the convolutional layers within a stage to extract image features. The modification boosts the overall detection performance of the model by utilizing the advantages of the shallow layers and the deep layers of the VGG-16 network. The training samples were augmented using random rotation and translation to enhance the heterogeneity of the detection algorithm. We have achieved a mean average precision (mAP) of 89.48% and 92.83% for the baseline faster R-CNN and our modified method, respectively.


2021 ◽  
Author(s):  
Matteo Roncoroni ◽  
Davide Mancini ◽  
Tyler Joe Kohler ◽  
Floreana Marie Miesen ◽  
Mattia Gianini ◽  
...  

<p>Biofilms have received great attention in the last few decades including their potential contribution to carbon fluxes and ecosystem engineering in aquatic ecosystems. Quantifying the spatial distribution of biofilms and their dynamics through time is a critical challenge. Satellite imagery is one solution, and can provide multi- and hyper-spectral data but not necessarily the spatial resolution that such studies need. Multi- and hyper-spectral data sets may be of particular value for not simply detecting the presense/absence of biofilms but also indicators of primary productivity such as chlorophyll-a concentrations. Spatial resolution is sensor quality dependent, but also controlled by sensor elevation above the ground. Hence, higher resolutions can be achieved either by using a very expensive sensor or by decreasing the distance between the target area and the sensor itself. To date, sensor technology has advanced to a point where multi- or even hyper-spectral cameras can be easily transported by UAVs, potentially yielding wide-range spectral information at unprecedented spatial resolutions. That said, such set ups have often exorbitant costs (several 1000s of US$) that few research institutions can afford or, due to the high probability of sensor lost, are risky to use. This is particularly true for glacier forefields where low air temperatures, dust and sudden wind gusts can easily damage both UAV and sensor components.</p><p>In this paper we test the performance of visible band ratios for mapping both biofilms and chlorophyll-a concentrations in an alpine glacier forefield characterized by a well-developed and heterogeneous (kryal, krenal and rhithral) stream system. The paper shows that low-cost and consumer grade UAVs can be easily deployed in such extreme environments, delivering high temporal resolution datasets and with sufficient quality RGB images for photogrammetric (SfM-MVS) processing and post-processing image analysis (i.e., band ratios). This paper shows also that visible band ratios correlates with chlorophyll-a concentrations yielding reliable chlorophyll-a information of the forefield and at the centimetric scale. This in turn allows for precise identification of the environmental conditions that lead to both biofilm development and removal through perturbation.</p>


2018 ◽  
Vol 34 (6) ◽  
pp. 664-687 ◽  
Author(s):  
Chander Shekhar ◽  
Sunita Srivastava ◽  
Harendra Singh Negi ◽  
Manish Dwivedi
Keyword(s):  

2014 ◽  
Vol 1073-1076 ◽  
pp. 1960-1964
Author(s):  
Jie Zhang ◽  
Hao Yan Zhao ◽  
Min Xia Zhang

By using hyper-spectral remote sensing data of desert vegetation, the original spectral data was simply pretreated firstly, then first order differential transform and smoothing was the hyper-spectral data. The spectral characteristics of different grassland types were extracted. The results showed that: desert vegetation has some unique spectral features of common green vegetation. However, affected by the underlying surface of spared leaves, low coverage, the spectrum of desert vegetation does not have obvious green peak, and the red edge characteristics decreased with the decline of vegetation coverage.


Sign in / Sign up

Export Citation Format

Share Document