scholarly journals A data science challenge for converting airborne remote sensing data into ecological information

2018 ◽  
Author(s):  
Sergio Marconi ◽  
Sarah J. Graves ◽  
Dihong Gong ◽  
Morteza Shahriari Nia ◽  
Marion Le Bras ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Quantitative Methods ◽  
Data Science ◽  
Remote Sensing Data ◽  
Remotely Sensed ◽  
Species Classification ◽  
Ecological Information ◽  
The Difference ◽  
Segmentation Task ◽  
Individual Trees

Ecology has reached the point where data science competitions, in which multiple groups solve the same problem using the same data by different methods, will be productive for advancing quantitative methods for tasks such as species identification from remote sensing images. We ran a competition to help improve three tasks that are central to converting images into information on individual trees: 1) crown segmentation, for identifying the location and size of individual trees; 2) alignment, to match ground truthed trees with remote sensing; and 3) species classification of individual trees. Six teams (composed of 16 individual participants) submitted predictions for one or more tasks. The crown segmentation task proved to be the most challenging, with the highest-performing algorithm yielding only 34% overlap between remotely sensed crowns and the ground truthed trees. However, most algorithms performed better on larger trees. For the alignment task, an algorithm based on minimizing the difference, in terms of both position and tree size, between ground truthed and remotely sensed crowns yielded a perfect alignment. In hindsight, this task was over simplified by only including targeted trees instead of all possible remotely sensed crowns. Several algorithms performed well for species classification, with the highest-performing algorithm correctly classifying 92% of individuals and performing well on both common and rare species. Comparisons of results across algorithms provided a number of insights for improving the overall accuracy in extracting ecological information from remote sensing. Our experience suggests that this kind of competition can benefit methods development in ecology and biology more broadly.

scholarly journals A data science challenge for converting airborne remote sensing data into ecological information

2018 ◽  
Author(s):  
Sergio Marconi ◽  
Sarah J. Graves ◽  
Dihong Gong ◽  
Morteza Shahriari Nia ◽  
Marion Le Bras ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Quantitative Methods ◽  
Data Science ◽  
Remote Sensing Data ◽  
Remotely Sensed ◽  
Species Classification ◽  
Ecological Information ◽  
The Difference ◽  
Segmentation Task ◽  
Individual Trees

Ecology has reached the point where data science competitions, in which multiple groups solve the same problem using the same data by different methods, will be productive for advancing quantitative methods for tasks such as species identification from remote sensing images. We ran a competition to help improve three tasks that are central to converting images into information on individual trees: 1) crown segmentation, for identifying the location and size of individual trees; 2) alignment, to match ground truthed trees with remote sensing; and 3) species classification of individual trees. Six teams (composed of 16 individual participants) submitted predictions for one or more tasks. The crown segmentation task proved to be the most challenging, with the highest-performing algorithm yielding only 34% overlap between remotely sensed crowns and the ground truthed trees. However, most algorithms performed better on larger trees. For the alignment task, an algorithm based on minimizing the difference, in terms of both position and tree size, between ground truthed and remotely sensed crowns yielded a perfect alignment. In hindsight, this task was over simplified by only including targeted trees instead of all possible remotely sensed crowns. Several algorithms performed well for species classification, with the highest-performing algorithm correctly classifying 92% of individuals and performing well on both common and rare species. Comparisons of results across algorithms provided a number of insights for improving the overall accuracy in extracting ecological information from remote sensing. Our experience suggests that this kind of competition can benefit methods development in ecology and biology more broadly.

scholarly journals A data science challenge for converting airborne remote sensing data into ecological information

PeerJ ◽  
2019 ◽  
Vol 6 ◽  
pp. e5843 ◽  
Author(s):  
Sergio Marconi ◽  
Sarah J. Graves ◽  
Dihong Gong ◽  
Morteza Shahriari Nia ◽  
Marion Le Bras ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Quantitative Methods ◽  
Data Science ◽  
Remote Sensing Data ◽  
Remotely Sensed ◽  
Species Classification ◽  
Ecological Information ◽  
Large Trees ◽  
Segmentation Task ◽  
Individual Trees

Ecology has reached the point where data science competitions, in which multiple groups solve the same problem using the same data by different methods, will be productive for advancing quantitative methods for tasks such as species identification from remote sensing images. We ran a competition to help improve three tasks that are central to converting images into information on individual trees: (1) crown segmentation, for identifying the location and size of individual trees; (2) alignment, to match ground truthed trees with remote sensing; and (3) species classification of individual trees. Six teams (composed of 16 individual participants) submitted predictions for one or more tasks. The crown segmentation task proved to be the most challenging, with the highest-performing algorithm yielding only 34% overlap between remotely sensed crowns and the ground truthed trees. However, most algorithms performed better on large trees. For the alignment task, an algorithm based on minimizing the difference, in terms of both position and tree size, between ground truthed and remotely sensed crowns yielded a perfect alignment. In hindsight, this task was over simplified by only including targeted trees instead of all possible remotely sensed crowns. Several algorithms performed well for species classification, with the highest-performing algorithm correctly classifying 92% of individuals and performing well on both common and rare species. Comparisons of results across algorithms provided a number of insights for improving the overall accuracy in extracting ecological information from remote sensing. Our experience suggests that this kind of competition can benefit methods development in ecology and biology more broadly.

scholarly journals Individual tree crown delineation and tree species classification with hyperspectral and LiDAR data

PeerJ ◽  
2019 ◽  
Vol 6 ◽  
pp. e6227 ◽  
Author(s):  
Michele Dalponte ◽  
Lorenzo Frizzera ◽  
Damiano Gianelle
Keyword(s):  
Remote Sensing ◽  
Tree Species ◽  
Data Science ◽  
Remote Sensing Data ◽  
Tree Crown ◽  
Species Classification ◽  
Individual Tree ◽  
Sensing Data ◽  
Tree Species Classification ◽  
Selection Of

An international data science challenge, called National Ecological Observatory Network—National Institute of Standards and Technology data science evaluation, was set up in autumn 2017 with the goal to improve the use of remote sensing data in ecological applications. The competition was divided into three tasks: (1) individual tree crown (ITC) delineation, for identifying the location and size of individual trees; (2) alignment between field surveyed trees and ITCs delineated on remote sensing data; and (3) tree species classification. In this paper, the methods and results of team Fondazione Edmund Mach (FEM) are presented. The ITC delineation (Task 1 of the challenge) was done using a region growing method applied to a near-infrared band of the hyperspectral images. The optimization of the parameters of the delineation algorithm was done in a supervised way on the basis of the Jaccard score using the training set provided by the organizers. The alignment (Task 2) between the delineated ITCs and the field surveyed trees was done using the Euclidean distance among the position, the height, and the crown radius of the ITCs and the field surveyed trees. The classification (Task 3) was performed using a support vector machine classifier applied to a selection of the hyperspectral bands and the canopy height model. The selection of the bands was done using the sequential forward floating selection method and the Jeffries Matusita distance. The results of the three tasks were very promising: team FEM ranked first in the data science competition in Task 1 and 2, and second in Task 3. The Jaccard score of the delineated crowns was 0.3402, and the results showed that the proposed approach delineated both small and large crowns. The alignment was correctly done for all the test samples. The classification results were good (overall accuracy of 88.1%, kappa accuracy of 75.7%, and mean class accuracy of 61.5%), although the accuracy was biased toward the most represented species.

scholarly journals Data science competition for cross-site delineation and classification of individual trees from airborne remote sensing data

2021 ◽  
Author(s):  
Sarah J Graves ◽  
Sergio Marconi ◽  
Dylan Stewart ◽  
Ira Harmon ◽  
Ben G Weinstein ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Data Science ◽  
Remote Sensing Data ◽  
Common Species ◽  
Gradient Boosting ◽  
Individual Species ◽  
Site Classification ◽  
Similar Species ◽  
Sensing Data ◽  
Individual Trees

Delineating and classifying individual trees in remote sensing data is challenging. Many tree crown delineation methods have difficulty in closed-canopy forests and do not leverage multiple datasets. Methods to classify individual species are often accurate for common species, but perform poorly for less common species and when applied to new sites. We ran a data science competition to help identify effective methods for delineation of individual crowns and classification to determine species identity. This competition included data from multiple sites to assess the methods' ability to generalize learning across multiple sites simultaneously, and transfer learning to novel sites where the methods were not trained. Six teams, representing 4 countries and 9 individual participants, submitted predictions. Methods from a previous competition were also applied and used as the baseline to understand whether the methods are changing and improving over time. The best delineation method was based on an instance segmentation pipeline, closely followed by a Faster R-CNN pipeline, both of which outperformed the baseline method. However, the baseline (based on a growing region algorithm) still performed well as did the Faster R-CNN. All delineation methods generalized well and transferred to novel forests effectively. The best species classification method was based on a two-stage fully connected neural network, which significantly outperformed the baseline (a random forest and Gradient boosting ensemble). The classification methods generalized well, with all teams training their models using multiple sites simultaneously, but the predictions from these trained models generally failed to transfer effectively to a novel site. Classification performance was strongly influenced by the number of field-based species IDs available for training the models, with most methods predicting common species well at the training sites. Classification errors (i.e., species misidentification) were most common between similar species in the same genus and different species that occur in the same habitat. The best methods handled class imbalance well and learned unique spectral features even with limited data. Most methods performed better than baseline in detecting new (untrained) species, especially in the site with no training data. Our experience further shows that data science competitions are useful for comparing different methods through the use of a standardized dataset and set of evaluation criteria, which highlights promising approaches and common challenges, and therefore advances the ecological and remote sensing field as a whole.

scholarly journals Remote sensing pipeline for tree segmentation and classification in a mixed softwood and hardwood system

PeerJ ◽  
2019 ◽  
Vol 6 ◽  
pp. e5837 ◽  
Author(s):  
Conor A. McMahon
Keyword(s):  
Remote Sensing ◽  
Data Science ◽  
Vegetation Index ◽  
Remote Sensing Data ◽  
Watershed Segmentation ◽  
Stem Height ◽  
Plant Identification ◽  
Species Classification ◽  
Individual Tree ◽  
Height Model

The National Institute of Standards and Technology data science evaluation plant identification challenge is a new periodic competition focused on improving and generalizing remote sensing processing methods for forest landscapes. I created a pipeline to perform three remote sensing tasks. First, a marker-controlled watershed segmentation thresholded by vegetation index and height was performed to identify individual tree crowns within the canopy height model. Second, remote sensing data for segmented crowns was aligned with ground measurements by choosing the set of pairings which minimized error in position and in crown area as predicted by stem height. Third, species classification was performed by reducing the dataset’s dimensionality through principle component analysis and then constructing a set of maximum likelihood classifiers to estimate species likelihoods for each tree. Of the three algorithms, the classification routine exhibited the strongest relative performance, with the segmentation algorithm performing the least well.

scholarly journals NEON NIST data science evaluation challenge: methods and results of team Conor

2018 ◽  
Author(s):  
Conor A McMahon
Keyword(s):  
Remote Sensing ◽  
Data Science ◽  
Remote Sensing Data ◽  
Watershed Segmentation ◽  
Stem Height ◽  
Plant Identification ◽  
Species Classification ◽  
Individual Tree ◽  
Crown Area ◽  
Tree Crowns

The NIST DSE Plant Identification challenge is a new periodic competition focused on improving and generalizing remote sensing processing methods for forest landscapes. To compete in the competition, I created a pipeline to perform three remote sensing tasks. First, a NDVI- and height-thresholded watershed segmentation was performed to identify individual tree crowns using LIDAR height measurements. Second, remote sensing data for segmented crowns was aligned with ground measurements by choosing the set of pairings which minimized error in position and in crown area as predicted by stem height. Third, species classification was performed by reducing the dataset's dimensionality through PCA and then constructing a set of maximum likelihood classifiers to estimate species likelihoods for each tree. Of the three algorithms, the classification routine exhibited the strongest relative performance, with the segmentation algorithm performing the least well.

scholarly journals NEON NIST data science evaluation challenge: methods and results of team Conor

2018 ◽  
Author(s):  
Conor A McMahon
Keyword(s):  
Remote Sensing ◽  
Data Science ◽  
Remote Sensing Data ◽  
Watershed Segmentation ◽  
Stem Height ◽  
Plant Identification ◽  
Species Classification ◽  
Individual Tree ◽  
Crown Area ◽  
Tree Crowns

The NIST DSE Plant Identification challenge is a new periodic competition focused on improving and generalizing remote sensing processing methods for forest landscapes. To compete in the competition, I created a pipeline to perform three remote sensing tasks. First, a NDVI- and height-thresholded watershed segmentation was performed to identify individual tree crowns using LIDAR height measurements. Second, remote sensing data for segmented crowns was aligned with ground measurements by choosing the set of pairings which minimized error in position and in crown area as predicted by stem height. Third, species classification was performed by reducing the dataset's dimensionality through PCA and then constructing a set of maximum likelihood classifiers to estimate species likelihoods for each tree. Of the three algorithms, the classification routine exhibited the strongest relative performance, with the segmentation algorithm performing the least well.

THE ROLE OF REMOTE SENSING DATA FOR COASTAL ZONE MONITIORING AND MANAGEMENT (CASE STUDY FOR THE EAST PART OF GULF OF FINLAND)

2017 ◽  
Author(s):  
Nikifor Ostanin ◽  
Nikifor Ostanin
Keyword(s):  
Remote Sensing ◽  
Coastal Zone ◽  
Environmental Changes ◽  
Rapid Development ◽  
Water Environment ◽  
Remote Sensing Data ◽  
Remotely Sensed ◽  
Gulf Of Finland ◽  
Coastal Protection ◽  
Remotely Sensed Data

Coastal zone of the Eastern Gulf of Finland is subjected to essential natural and anthropogenic impact. The processes of abrasion and accumulation are predominant. While some coastal protection structures are old and ruined the problem of monitoring and coastal management is actual. Remotely sensed data is important component of geospatial information for coastal environment research. Rapid development of modern satellite remote sensing techniques and data processing algorithms made this data essential for monitoring and management. Multispectral imagers of modern high resolution satellites make it possible to produce advanced image processing, such as relative water depths estimation, sea-bottom classification and detection of changes in shallow water environment. In the framework of the project of development of new coast protection plan for the Kurortny District of St.-Petersburg a series of archival and modern satellite images were collected and analyzed. As a result several schemes of underwater parts of coastal zone and schemes of relative bathymetry for the key areas were produced. The comparative analysis of multi-temporal images allow us to reveal trends of environmental changes in the study areas. This information, compared with field observations, shows that remotely sensed data is useful and efficient for geospatial planning and development of new coast protection scheme.

Sign in / Sign up

Export Citation Format

Share Document