scholarly journals SAT-Hadoop-Processor: A Distributed Remote Sensing Big Data Processing Software for Earth Observation Applications

2021 ◽  
Vol 11 (22) ◽  
pp. 10610
Author(s):  
Badr-Eddine Boudriki Semlali ◽  
Felix Freitag

Nowadays, several environmental applications take advantage of remote sensing techniques. A considerable volume of this remote sensing data occurs in near real-time. Such data are diverse and are provided with high velocity and variety, their pre-processing requires large computing capacities, and a fast execution time is critical. This paper proposes a new distributed software for remote sensing data pre-processing and ingestion using cloud computing technology, specifically OpenStack. The developed software discarded 86% of the unneeded daily files and removed around 20% of the erroneous and inaccurate datasets. The parallel processing optimized the total execution time by 90%. Finally, the software efficiently processed and integrated data into the Hadoop storage system, notably the HDFS, HBase, and Hive.

2021 ◽  
Vol 13 (9) ◽  
pp. 1815
Author(s):  
Xiaohua Zhou ◽  
Xuezhi Wang ◽  
Yuanchun Zhou ◽  
Qinghui Lin ◽  
Jianghua Zhao ◽  
...  

With the remarkable development and progress of earth-observation techniques, remote sensing data keep growing rapidly and their volume has reached exabyte scale. However, it's still a big challenge to manage and process such huge amounts of remote sensing data with complex and diverse structures. This paper designs and realizes a distributed storage system for large-scale remote sensing data storage, access, and retrieval, called RSIMS (remote sensing images management system), which is composed of three sub-modules: RSIAPI, RSIMeta, RSIData. Structured text metadata of different remote sensing images are all stored in RSIMeta based on a set of uniform models, and then indexed by the distributed multi-level Hilbert grids for high spatiotemporal retrieval performance. Unstructured binary image files are stored in RSIData, which provides large scalable storage capacity and efficient GDAL (Geospatial Data Abstraction Library) compatible I/O interfaces. Popular GIS software and tools (e.g., QGIS, ArcGIS, rasterio) can access data stored in RSIData directly. RSIAPI provides users a set of uniform interfaces for data access and retrieval, hiding the complex inner structures of RSIMS. The test results show that RSIMS can store and manage large amounts of remote sensing images from various sources with high and stable performance, and is easy to deploy and use.


Proceedings ◽  
2020 ◽  
Vol 30 (1) ◽  
pp. 78
Author(s):  
Anna Brook

Fires were once a natural phenomenon that helped to shape species distribution, contributed to the persistence of fire-dependent species, and assisted the natural evolution of ecosystems. However, nowadays, most of the forest fires worldwide are not of natural causes. Therefore, wildfires have received significant attention over the past few decades. Major ecological and policy changes were stimulated by historical frequency, extent, and severity of fires in the dry forests. These fires are important at both local to regional scales, as it might change the maintenance of landscape structure, composition, and function. Moreover, it affects pollutants, impacts air quality and raises human health risks. Many studies suggested using remote sensing data and techniques to assess fire characteristics and post-fire effects. Due to its ability to quantify patterns of variation in space and time, the remote sensing data are especially important to detect active fire extents at local and regional scales, mapping fuel loading and identify areas with long or problematic natural recovery. In the past few decades, the advantages of multi-temporal remote sensing techniques to monitor landscape change in a rapid and cost-effective manner, are reported in the scientific literature. Many studies focused on the development of techniques to evaluate and quantify fire behavior and fuel combustion. Yet the main contribution is recorded for spectral indices, e.g. the Normalized Burn Ratio (NBR), the difference in the Normalized Burn Ratio between pre- and post-fire images (dNBR), and the Normalized Difference Vegetation Index (NDVI), which are calculated by a simple combinations of different sensor bands, rely on spectral changes of the burning or burned surfaces. Numerous papers are focused on more advanced and very detailed spectral models of fuel and post-fire ash residues, mainly using laboratory spectrometers, e.g., Fourier Transform Infrared (FTIR). However, many of the developed models are not applicable in the real world. In the current talk, we will present the most recent studies and scientific activities in the field of (1) active fire detection and characterization, using mainly hyperspectral ground and airborne technologies; (2) future space-borne applications on board of nano- and micro-satellites; (3) discuss the contribution of detailed and precise spectral models for post-fire ecological effects studies; (4) describe field assessment; (5) discuss management applications and future directions of fire-related remote sensing research.


2002 ◽  
Vol 8 (1) ◽  
pp. 15-22
Author(s):  
V.N. Astapenko ◽  
◽  
Ye.I. Bushuev ◽  
V.P. Zubko ◽  
V.I. Ivanov ◽  
...  

2011 ◽  
Vol 17 (6) ◽  
pp. 30-44
Author(s):  
Yu.V. Kostyuchenko ◽  
◽  
M.V. Yushchenko ◽  
I.M. Kopachevskyi ◽  
S. Levynsky ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document