scholarly journals Crop Monitoring Using Satellite/UAV Data Fusion and Machine Learning

2020 ◽  
Vol 12 (9) ◽  
pp. 1357 ◽  
Author(s):  
Maitiniyazi Maimaitijiang ◽  
Vasit Sagan ◽  
Paheding Sidike ◽  
Ahmad M. Daloye ◽  
Hasanjan Erkbol ◽  
...  
Keyword(s):  
Machine Learning ◽  
High Resolution ◽  
Data Fusion ◽  
Unmanned Aerial Vehicle ◽  
Canopy Structure ◽  
Canopy Height ◽  
Spectral Information ◽  
Structure Information ◽  
Crop Monitoring ◽  
Aerial Vehicle

Non-destructive crop monitoring over large areas with high efficiency is of great significance in precision agriculture and plant phenotyping, as well as decision making with regards to grain policy and food security. The goal of this research was to assess the potential of combining canopy spectral information with canopy structure features for crop monitoring using satellite/unmanned aerial vehicle (UAV) data fusion and machine learning. Worldview-2/3 satellite data were tasked synchronized with high-resolution RGB image collection using an inexpensive unmanned aerial vehicle (UAV) at a heterogeneous soybean (Glycine max (L.) Merr.) field. Canopy spectral information (i.e., vegetation indices) was extracted from Worldview-2/3 data, and canopy structure information (i.e., canopy height and canopy cover) was derived from UAV RGB imagery. Canopy spectral and structure information and their combination were used to predict soybean leaf area index (LAI), aboveground biomass (AGB), and leaf nitrogen concentration (N) using partial least squares regression (PLSR), random forest regression (RFR), support vector regression (SVR), and extreme learning regression (ELR) with a newly proposed activation function. The results revealed that: (1) UAV imagery-derived high-resolution and detailed canopy structure features, canopy height, and canopy coverage were significant indicators for crop growth monitoring, (2) integration of satellite imagery-based rich canopy spectral information with UAV-derived canopy structural features using machine learning improved soybean AGB, LAI, and leaf N estimation on using satellite or UAV data alone, (3) adding canopy structure information to spectral features reduced background soil effect and asymptotic saturation issue to some extent and led to better model performance, (4) the ELR model with the newly proposed activated function slightly outperformed PLSR, RFR, and SVR in the prediction of AGB and LAI, while RFR provided the best result for N estimation. This study introduced opportunities and limitations of satellite/UAV data fusion using machine learning in the context of crop monitoring.

scholarly journals Wheat Leaf Area Index Prediction Using Data Fusion Based on High-Resolution Unmanned Aerial Vehicle Imagery

2021 ◽  
Author(s):  
Shuang Wu ◽  
Lei Deng ◽  
Lijie Guo ◽  
Yanjie Wu
Keyword(s):  
High Resolution ◽  
Data Fusion ◽  
Leaf Area Index ◽  
Leaf Area ◽  
Unmanned Aerial Vehicle ◽  
Prediction Accuracy ◽  
Sensor Data ◽  
Support Vector ◽  
Area Index ◽  
Aerial Vehicle

Abstract Background: Leaf Area Index (LAI) is half of the amount of leaf area per unit horizontal ground surface area. Consequently, accurate vegetation extraction in remote sensing imagery is critical for LAI estimation. However, most studies do not fully exploit the advantages of Unmanned Aerial Vehicle (UAV) imagery with high spatial resolution, such as not removing the background (soil and shadow, etc.). Furthermore, the advancement of multi-sensor synchronous observation and integration technology allows for the simultaneous collection of canopy spectral, structural, and thermal data, making it possible for data fusion.Methods: To investigate the potential of high-resolution UAV imagery combined with multi-sensor data fusion in LAI estimation. High-resolution UAV imagery was obtained with a multi-sensor integrated MicaSense Altum camera to extract the wheat canopy's spectral, structural, and thermal features. After removing the soil background, all features were fused, and LAI was estimated using Random Forest and Support Vector Machine Regression.Result: The results show that: (1) the soil background reduced the accuracy of the LAI prediction, and soil background could be effectively removed by taking advantage of high-resolution UAV imagery. After removing the soil background, the LAI prediction accuracy improved significantly, R2 raised by about 0.27, and RMSE fell by about 0.476. (2) The fusion of multi-sensor synchronous observation data improved LAI prediction accuracy and achieved the best accuracy (R2 = 0.815 and RMSE = 1.023). (3) When compared to other variables, 23 CHM, NRCT, NDRE, and BLUE are crucial for LAI estimation. Even the simple Multiple Linear Regression model could achieve high prediction accuracy (R2 = 0.679 and RMSE = 1.231), providing inspiration for rapid and efficient LAI prediction.Conclusions: The method of this study can be transferred to other sites with more extensive areas or similar agriculture structures, which will facilitate agricultural production and management.

scholarly journals A High-Resolution Spatial and Time-Series Labeled Unmanned Aerial Vehicle Image Dataset for Middle-Season Rice

2020 ◽  
Vol 9 (12) ◽  
pp. 728
Author(s):  
Dongbo Zhou ◽  
Shuangjian Liu ◽  
Jie Yu ◽  
Hao Li
Keyword(s):  
Machine Learning ◽  
Time Series ◽  
Deep Learning ◽  
High Resolution ◽  
Unmanned Aerial Vehicle ◽  
Temporal Information ◽  
Learning Networks ◽  
Image Dataset ◽  
Aerial Vehicle ◽  
Uav Image

The existing remote sensing image datasets target the identification of objects, features, or man-made targets but lack the ability to provide the date and spatial information for the same feature in the time-series images. The spatial and temporal information is important for machine learning methods so that networks can be trained to support precision classification, particularly for agricultural applications of specific crops with distinct phenological growth stages. In this paper, we built a high-resolution unmanned aerial vehicle (UAV) image dataset for middle-season rice. We scheduled the UAV data acquisition in five villages of Hubei Province for three years, including 11 or 13 growing stages in each year that were accompanied by the annual agricultural surveying business. We investigated the accuracy of the vector maps for each field block and the precise information regarding the crops in the field by surveying each village and periodically arranging the UAV flight tasks on a weekly basis during the phenological stages. Subsequently, we developed a method to generate the samples automatically. Finally, we built a high-resolution UAV image dataset, including over 500,000 samples with the location and phenological growth stage information, and employed the imagery dataset in several machine learning algorithms for classification. We performed two exams to test our dataset. First, we used four classical deep learning networks for the fine classification of spatial and temporal information. Second, we used typical models to test the land cover on our dataset and compared this with the UCMerced Land Use Dataset and RSSCN7 Dataset. The results showed that the proposed image dataset supported typical deep learning networks in the classification task to identify the location and time of middle-season rice and achieved high accuracy with the public image dataset.

New method for tree stands parameters determination using high resolution images done by unmanned aerial vehicle

2016 ◽  
Author(s):  
А.С. Алексеев ◽  
А.А. Никифоров ◽  
А.А. Михайлова ◽  
М.Р. Вагизов
Keyword(s):  
High Resolution ◽  
Unmanned Aerial Vehicle ◽  
New Method ◽  
Growth And Yield ◽  
Special Treatment ◽  
Resolution Image ◽  
Growing Stock ◽  
High Resolution Image ◽  
Aerial Vehicle ◽  
Area Unit

В связи со старением информационных материалов о состоянии лесов существует потребность в разработке новых методов таксации древостоев, основанных на применении последних научно-технических достижений в области теории структуры и продуктивности древостоев, дистанционных методов изучения лесов, информационных и ГИС технологий. В статье приведены результаты разработки и проверки нового метода определения таксационных характеристик сомкнутых насаждений на основе правила 3/2 и подобных ему правил Хильми и Рейнеке, с одной стороны, и определения числа деревьев на единице площади по снимку сверх высокого разрешения, полученного с помощью БПЛА, с другой. С теоретической точки зрения эта зависимости величин запаса, средней высоты и среднего диаметра от числа стволов на единице площади относятся к классу аллометрических связей, очень часто встречающихся при количественном описании соотношений частей биологических систем разных уровней иерархии, от организмов до экосистем. Параметры аллометрических зависимостей запаса, средних высоты и диаметра от числа стволов на единице площади были определены для основных лесообразующих пород по данным таблиц хода роста нормальных (полных) древостоев с теоретическим показателем степени и затем использованы для расчетов. Число деревьев на единице площади определялось по снимку с разрешением 7,13 см/пиксель, полученному с помощью 4-роторной платформы. Обработка материалов аэрофотосъемки была выполнена в специализированной фотограмметрической системе Agisoft Photoscan. В результате были получены ортофотоплан и цифровая модель поверхности крон деревьев на изучаемую территорию с определением их высот. Для автоматизированной обработки полученных изображений с целью получения значений числа деревьев на единицу площади был создан специализированный скрипт на языке Java. Погрешности определения таксационных характеристик древостоев предлагаемым методом не выше установленных действующими нормативными материалами. Every time there is a demand for new innovative methods of forest resources estimation based on last achievements in theoretical science, remote sensing methods, information and GIS-technologies. In the paper are presented a new method and the results of its application to forest stands growing stock, mean height and diameter determination. The method is based on rule 3/2 and similar Reineke and Hilmy rules, on one hand and high resolution image made by unmanned aerial vehicle, which used for determination of number of trees per area unit, on other. The above rules are well known in quantitative biology as an allometric and widely used for description of different kind of relations in biological systems of various scale: from organisms to ecosystems. Parameters of above allometric relationships between growing stock, mean height and diameter and stems density per area unit was determine on the base of full stock growth and yield tables for main tree species and after used for experimental calculations. The number of trees per area unit was determined after special treatment of high resolution image made by unmanned flying machine. The growing stock, mean height and diameter determined by suggested method was compared with the data of regular forest inventory. Comparison gives positive result and method may be recommended for further development.

High-resolution monitoring of beach topography and its change using unmanned aerial vehicle imagery

2018 ◽  
Vol 160 ◽  
pp. 103-116 ◽  
Author(s):  
Benqing Chen ◽  
Yanming Yang ◽  
Hongtao Wen ◽  
Hailin Ruan ◽  
Zaiming Zhou ◽  
...  
Keyword(s):  
High Resolution ◽  
Unmanned Aerial Vehicle ◽  
Aerial Vehicle

Spatial Dynamic Analysis of a Mangeove Patch Based on Unmanned Aerial Vehicle: A Case Study in Pear Bay in Guangxi, China

2021 ◽  
Author(s):  
Xin Lin ◽  
Chungan Li ◽  
Mei Zhou ◽  
Wenhai Liang ◽  
Biao Li
Keyword(s):  
Unmanned Aerial Vehicle ◽  
Spatial Dynamics ◽  
Absolute Error ◽  
Maximum Error ◽  
Canopy Height ◽  
Accurate Information ◽  
Maximum Absolute Error ◽  
Patch Area ◽  
Maximum Increase ◽  
Aerial Vehicle

Abstract This study investigated the short-term spatial variability of an mangrove patch, located in the Pearl Bay in Guangxi, China. Unmanned aerial vehicle (UAV) imagery covering the period from March 2015 to October 2017 were used and the following models were developed: two annual ultra-high resolution spatial resolution digital orthophoto maps (DOMs), two digital elevation models (DEMs), two digital surface models (DSMs), two canopy height models (CHMs), and a canopy height difference model (d-CHM). Using these models, the spatial dynamics of the extent and canopy height of the patch were analyzed. The resolution of the DOMs was 0.1 m, with an average geometrical error of 0.17 m and a maximum error of 0.44 m. The resolutions of DEMs, DSMs, CHMs, d-CHM were all 1 m. The average elevation errors of CHM in 2015 and 2017 were 0.002 m and -0.001 m, respectively, with maximum absolute errors of 0.034 m and 0.030 m, respectively. The average elevation error of d-CHM was -0.003 m and the maximum absolute error was 0.036 m, and the data quality were rated as good. From 2015 to 2017, the area of the mangrove patch increased from 8.16 ha to 8.79 ha, with an average annual increase of 3.7%. Specifically, the areas of expansion, shrinkage, and maximum seaward expansion were 6356 m2, 19 m2, and 24 m, respectively. The driving factor for the variability was natural processes. Stand canopy height exhibited a particular trend of decrease from northwest to southeast (horizontal; parallel to the seawall) and from the land to the sea (vertically; perpendicular to the seawall). From 2015 to 2017, 88.2% of the patch area showed increased canopy height, with an average increase of 0.78 m and a maximum increase of 3.2 m. In contrast, 11.8% of the patch area showed decreased canopy height with a maximum decrease of 3.1 m. The main reason for the decrease in canopy height was the death of trees caused by serious insect plagues. On the other hand, the reason for the increase in height could be attributed to the natural growth of mangrove trees, but further studies are required to verify the cause. UAV remote sensing has an incomparable advantage over traditional methods in that it provides extremely detailed and highly accurate information for in-depth study of the spatial evolution of mangrove patches, which would significantly contribute towards the protection and management of mangroves.

scholarly journals AGB Estimation in a Tropical Mountain Forest (TMF) by Means of RGB and Multispectral Images Using an Unmanned Aerial Vehicle (UAV)

2019 ◽  
Vol 11 (12) ◽  
pp. 1413 ◽  
Author(s):  
Víctor González-Jaramillo ◽  
Andreas Fries ◽  
Jörg Bendix
Keyword(s):  
High Resolution ◽  
Unmanned Aerial Vehicle ◽  
Tree Level ◽  
Mountain Forest ◽  
Multispectral Images ◽  
Individual Tree ◽  
Tropical Mountain ◽  
Aerial Vehicle ◽  
Rgb Images ◽  
Very High

The present investigation evaluates the accuracy of estimating above-ground biomass (AGB) by means of two different sensors installed onboard an unmanned aerial vehicle (UAV) platform (DJI Inspire I) because the high costs of very high-resolution imagery provided by satellites or light detection and ranging (LiDAR) sensors often impede AGB estimation and the determination of other vegetation parameters. The sensors utilized included an RGB camera (ZENMUSE X3) and a multispectral camera (Parrot Sequoia), whose images were used for AGB estimation in a natural tropical mountain forest (TMF) in Southern Ecuador. The total area covered by the sensors included 80 ha at lower elevations characterized by a fast-changing topography and different vegetation covers. From the total area, a core study site of 24 ha was selected for AGB calculation, applying two different methods. The first method used the RGB images and applied the structure for motion (SfM) process to generate point clouds for a subsequent individual tree classification. Per the classification at tree level, tree height (H) and diameter at breast height (DBH) could be determined, which are necessary input parameters to calculate AGB (Mg ha−1) by means of a specific allometric equation for wet forests. The second method used the multispectral images to calculate the normalized difference vegetation index (NDVI), which is the basis for AGB estimation applying an equation for tropical evergreen forests. The obtained results were validated against a previous AGB estimation for the same area using LiDAR data. The study found two major results: (i) The NDVI-based AGB estimates obtained by multispectral drone imagery were less accurate due to the saturation effect in dense tropical forests, (ii) the photogrammetric approach using RGB images provided reliable AGB estimates comparable to expensive LiDAR surveys (R2: 0.85). However, the latter is only possible if an auxiliary digital terrain model (DTM) in very high resolution is available because in dense natural forests the terrain surface (DTM) is hardly detectable by passive sensors due to the canopy layer, which impedes ground detection.

Sign in / Sign up

Export Citation Format

Share Document