scholarly journals Development of an Image Registration Technique for Fluvial Hyperspectral Imagery Using an Optical Flow Algorithm

Sensors ◽  
2021 ◽  
Vol 21 (7) ◽  
pp. 2407
Author(s):  
Hojun You ◽  
Dongsu Kim

Fluvial remote sensing has been used to monitor diverse riverine properties through processes such as river bathymetry and visual detection of suspended sediment, algal blooms, and bed materials more efficiently than laborious and expensive in-situ measurements. Red–green–blue (RGB) optical sensors have been widely used in traditional fluvial remote sensing. However, owing to their three confined bands, they rely on visual inspection for qualitative assessments and are limited to performing quantitative and accurate monitoring. Recent advances in hyperspectral imaging in the fluvial domain have enabled hyperspectral images to be geared with more than 150 spectral bands. Thus, various riverine properties can be quantitatively characterized using sensors in low-altitude unmanned aerial vehicles (UAVs) with a high spatial resolution. Many efforts are ongoing to take full advantage of hyperspectral band information in fluvial research. Although geo-referenced hyperspectral images can be acquired for satellites and manned airplanes, few attempts have been made using UAVs. This is mainly because the synthesis of line-scanned images on top of image registration using UAVs is more difficult owing to the highly sensitive and heavy image driven by dense spatial resolution. Therefore, in this study, we propose a practical technique for achieving high spatial accuracy in UAV-based fluvial hyperspectral imaging through efficient image registration using an optical flow algorithm. Template matching algorithms are the most common image registration technique in RGB-based remote sensing; however, they require many calculations and can be error-prone depending on the user, as decisions regarding various parameters are required. Furthermore, the spatial accuracy of this technique needs to be verified, as it has not been widely applied to hyperspectral imagery. The proposed technique resulted in an average reduction of spatial errors by 91.9%, compared to the case where the image registration technique was not applied, and by 78.7% compared to template matching.

Author(s):  
S. Jay ◽  
R. Bendoula ◽  
X. Hadoux ◽  
N. Gorretta

Most methods for retrieving foliar content from hyperspectral data are well adapted either to remote-sensing scale, for which each spectral measurement has a spatial resolution ranging from a few dozen centimeters to a few hundred meters, or to leaf scale, for which an integrating sphere is required to collect the spectral data. In this study, we present a method for estimating leaf optical properties from hyperspectral images having a spatial resolution of a few millimeters or centimeters. In presence of a single light source assumed to be directional, it is shown that leaf hyperspectral measurements can be related to the directional hemispherical reflectance simulated by the PROSPECT radiative transfer model using two other parameters. The first one is a multiplicative term that is related to local leaf angle and illumination zenith angle. The second parameter is an additive specular-related term that models BRDF effects. <br><br> Our model was tested on visible and near infrared hyperspectral images of leaves of various species, that were acquired under laboratory conditions. Introducing these two additional parameters into the inversion scheme leads to improved estimation results of PROSPECT parameters when compared to original PROSPECT. In particular, the RMSE for local chlorophyll content estimation was reduced by 21% (resp. 32%) when tested on leaves placed in horizontal (resp. sloping) position. Furthermore, inverting this model provides interesting information on local leaf angle, which is a crucial parameter in classical remote-sensing.


Author(s):  
Raj Bridgelall ◽  
James B. Rafert ◽  
Denver D. Tolliver

The ongoing proliferation and diversification of remote sensing platforms offer greater flexibility to select from a range of hyperspectral imagers as payloads. The emergence of low-cost unmanned aircraft systems (drones) and their launch flexibility present an opportunity to maximize spectral resolution while scaling both daily spatial coverage and spatial resolution simultaneously by operating synchronized swarms. This article presents a model to compare the performance of hyperspectral-imaging platforms in their spatial coverage and spatial resolution envelope. The authors develop a data acquisition framework and use the model to compare the achievable performance among existing airborne and spaceborne hyperspectral imaging vehicles and drone swarms. The results show that, subject to cost and operational limitations, a platform implemented with drone swarms has the potential to provide greater spatial resolution for the same daily ground coverage compared with existing airborne platforms.


2019 ◽  
Vol 85 (10) ◽  
pp. 725-736 ◽  
Author(s):  
Ming Hao ◽  
Jian Jin ◽  
Mengchao Zhou ◽  
Yi Tian ◽  
Wenzhong Shi

Image registration is an indispensable component of remote sensing applications, such as disaster monitoring, change detection, and classification. Grayscale differences and geometric distortions often occur among multisource images due to their different imaging mechanisms, thus making it difficult to acquire feature points and match corresponding points. This article proposes a scene shape similarity feature (SSSF) descriptor based on scene shape features and shape context algorithms. A new similarity measure called SSSFncc is then defined by computing the normalized correlation coefficient of the SSSF descriptors between multisource remote sensing images. Furthermore, the tie points between the reference and the sensed image are extracted via a template matching strategy. A global consistency check method is then used to remove the mismatched tie points. Finally, a piecewise linear transform model is selected to rectify the remote sensing image. The proposed SSSFncc aims to extract the scene shape similarity between multisource images. The accuracy of the proposed SSSFncc is evaluated using five pairs of experimental images from optical, synthetic aperture radar, and map data. Registration results demonstrate that the SSSFncc similarity measure is robust enough for complex nonlinear grayscale differences among multisource remote sensing images. The proposed method achieves more reliable registration outcomes compared with other popular methods.


Author(s):  
Jamir Jyoti ◽  
Henry Medeiros ◽  
Spencer Sebo ◽  
Walter Mcdonald

Sensors ◽  
2018 ◽  
Vol 18 (11) ◽  
pp. 3598 ◽  
Author(s):  
Chiman Kwan

Hyperspectral images with hundreds of spectral bands have been proven to yield high performance in material classification. However, despite intensive advancement in hardware, the spatial resolution is still somewhat low, as compared to that of color and multispectral (MS) imagers. In this paper, we aim at presenting some ideas that may further enhance the performance of some remote sensing applications such as border monitoring and Mars exploration using hyperspectral images. One popular approach to enhancing the spatial resolution of hyperspectral images is pansharpening. We present a brief review of recent image resolution enhancement algorithms, including single super-resolution and multi-image fusion algorithms, for hyperspectral images. Advantages and limitations of the enhancement algorithms are highlighted. Some limitations in the pansharpening process include the availability of high resolution (HR) panchromatic (pan) and/or MS images, the registration of images from multiple sources, the availability of point spread function (PSF), and reliable and consistent image quality assessment. We suggest some proactive ideas to alleviate the above issues in practice. In the event where hyperspectral images are not available, we suggest the use of band synthesis techniques to generate HR hyperspectral images from low resolution (LR) MS images. Several recent interesting applications in border monitoring and Mars exploration using hyperspectral images are presented. Finally, some future directions in this research area are highlighted.


2021 ◽  
Vol 13 (13) ◽  
pp. 2520
Author(s):  
Dongdong Ma ◽  
Tanzeel U. Rehman ◽  
Libo Zhang ◽  
Hideki Maki ◽  
Mitchell R. Tuinstra ◽  
...  

Aerial imaging technologies have been widely applied in agricultural plant remote sensing. However, an as yet unexplored challenge with field imaging is that the environmental conditions, such as sun angle, cloud coverage, temperature, and so on, can significantly alter plant appearance and thus affect the imaging sensor’s accuracy toward extracting plant feature measurements. These image alterations result from the complicated interaction between the real-time environments and plants. Analysis of these impacts requires continuous monitoring of the changes through various environmental conditions, which has been difficult with current aerial remote sensing systems. This paper aimed to propose a modeling method to comprehensively understand and model the environmental influences on hyperspectral imaging data. In 2019, a fixed hyperspectral imaging gantry was constructed in Purdue University’s research farm, and over 8000 repetitive images of the same corn field were taken with a 2.5 min interval for 31 days. Time-tagged local environment data, including solar zenith angle, solar irradiation, temperature, wind speed, and so on, were also recorded during the imaging time. The images were processed for phenotyping data, and the time series decomposition method was applied to extract the phenotyping data variation caused by the changing environments. An artificial neural network (ANN) was then built to model the relationship between the phenotyping data variation and environmental changes. The ANN model was able to accurately predict the environmental effects in remote sensing results, and thus could be used to effectively eliminate the environment-induced variation in the phenotyping features. The test of the normalized difference vegetation index (NDVI) calculated from the hyperspectral images showed that variance in NDVI was reduced by 79%. A similar performance was confirmed with the relative water content (RWC) predictions. Therefore, this modeling method shows great potential for application in aerial remote sensing applications in agriculture, to significantly improve the imaging quality by effectively eliminating the effects from the changing environmental conditions.


Author(s):  
Dimitris Manolakis ◽  
Ronald Lockwood ◽  
Thomas Cooley

Sign in / Sign up

Export Citation Format

Share Document