Discovering Potential Illegal Construction Within Building Roofs from UAV Images Using Semantic Segmentation and Object-Based Change Detection

2021 ◽  
Vol 87 (4) ◽  
pp. 263-271
Author(s):  
Yang Liu ◽  
Yujie Sun ◽  
Shikang Tao ◽  
Min Wang ◽  
Qian Shen ◽  
...  
Keyword(s):  
Change Detection ◽  
Semantic Segmentation ◽  
Small Object ◽  
Detection Scheme ◽  
Building Roof ◽  
Object Based ◽  
Detection Stage ◽  
Aerial Vehicle ◽  
Uav Images ◽  
Uav Image

A novel potential illegal construction (PIC) detection method by bitemporal unmanned aerial vehicle (UAV ) image comparison (change detection) within building roof areas is proposed. In this method, roofs are first extracted from UAV images using a depth-channel improved UNet model. A two-step change detection scheme is then implemented for PIC detection. In the change detection stage, roofs with appearance, disappearance, and shape changes are first extracted by morphological analysis. Subroof primitives are then obtained by roof-constrained image segmentation within the remaining roof areas, and object-based iteratively reweighted multivariate alteration detection (IR-MAD ) is implemented to extract the small PICs from the subroof primitives. The proposed method organically combines deep learning and object-based image analysis, which can identify entire roof changes and locate small object changes within the roofs. Experiments show that the proposed method has better accuracy compared with the other counterparts, including the original IR-MAD, change vector analysis, and principal components analysis-K-means.

scholarly journals Identifying the Branch of Kiwifruit Based on Unmanned Aerial Vehicle (UAV) Images Using Deep Learning Method

Sensors ◽  
2021 ◽  
Vol 21 (13) ◽  
pp. 4442
Author(s):  
Zijie Niu ◽  
Juntao Deng ◽  
Xu Zhang ◽  
Jun Zhang ◽  
Shijia Pan ◽  
...  
Keyword(s):  
Deep Learning ◽  
Unmanned Aerial Vehicle ◽  
Semantic Segmentation ◽  
Dynamic Monitoring ◽  
Support Vector ◽  
Distribution Maps ◽  
Time Operation ◽  
Aerial Vehicle ◽  
Uav Images ◽  
Segmentation Image

It is important to obtain accurate information about kiwifruit vines to monitoring their physiological states and undertake precise orchard operations. However, because vines are small and cling to trellises, and have branches laying on the ground, numerous challenges exist in the acquisition of accurate data for kiwifruit vines. In this paper, a kiwifruit canopy distribution prediction model is proposed on the basis of low-altitude unmanned aerial vehicle (UAV) images and deep learning techniques. First, the location of the kiwifruit plants and vine distribution are extracted from high-precision images collected by UAV. The canopy gradient distribution maps with different noise reduction and distribution effects are generated by modifying the threshold and sampling size using the resampling normalization method. The results showed that the accuracies of the vine segmentation using PSPnet, support vector machine, and random forest classification were 71.2%, 85.8%, and 75.26%, respectively. However, the segmentation image obtained using depth semantic segmentation had a higher signal-to-noise ratio and was closer to the real situation. The average intersection over union of the deep semantic segmentation was more than or equal to 80% in distribution maps, whereas, in traditional machine learning, the average intersection was between 20% and 60%. This indicates the proposed model can quickly extract the vine distribution and plant position, and is thus able to perform dynamic monitoring of orchards to provide real-time operation guidance.

scholarly journals A Deep Learning Approach on Building Detection from Unmanned Aerial Vehicle-Based Images in Riverbank Monitoring

Sensors ◽  
2018 ◽  
Vol 18 (11) ◽  
pp. 3921 ◽  
Author(s):  
Wuttichai Boonpook ◽  
Yumin Tan ◽  
Yinghua Ye ◽  
Peerapong Torteeka ◽  
Kritanai Torsri ◽  
...  
Keyword(s):  
Deep Learning ◽  
Network Architecture ◽  
Semantic Segmentation ◽  
Water Levels ◽  
Building Detection ◽  
Network Training ◽  
Building Information ◽  
Open Standard ◽  
Uav Images ◽  
Uav Image

Buildings along riverbanks are likely to be affected by rising water levels, therefore the acquisition of accurate building information has great importance not only for riverbank environmental protection but also for dealing with emergency cases like flooding. UAV-based photographs are flexible and cloud-free compared to satellite images and can provide very high-resolution images up to centimeter level, while there exist great challenges in quickly and accurately detecting and extracting building from UAV images because there are usually too many details and distortions on UAV images. In this paper, a deep learning (DL)-based approach is proposed for more accurately extracting building information, in which the network architecture, SegNet, is used in the semantic segmentation after the network training on a completely labeled UAV image dataset covering multi-dimension urban settlement appearances along a riverbank area in Chongqing. The experiment results show that an excellent performance has been obtained in the detection of buildings from untrained locations with an average overall accuracy more than 90%. To verify the generality and advantage of the proposed method, the procedure is further evaluated by training and testing with another two open standard datasets which have a variety of building patterns and styles, and the final overall accuracies of building extraction are more than 93% and 95%, respectively.

scholarly journals Fast Anchor Point Matching for Emergency UAV Image Stitching Using Position and Pose Information

Sensors ◽  
2020 ◽  
Vol 20 (7) ◽  
pp. 2007
Author(s):  
Ruizhe Shao ◽  
Chun Du ◽  
Hao Chen ◽  
Jun Li
Keyword(s):  
Image Stitching ◽  
Feature Points ◽  
Point Matching ◽  
Novel Approach ◽  
Aerial Vehicle ◽  
Speed Up ◽  
Anchor Points ◽  
Uav Images ◽  
Uav Image ◽  
Traditional Approaches

With the development of unmanned aerial vehicle (UAV) techniques, UAV images are becoming more widely used. However, as an essential step of UAV image application, the computation of stitching remains time intensive, especially for emergency applications. Addressing this issue, we propose a novel approach to use the position and pose information of UAV images to speed up the process of image stitching, called FUIS (fast UAV image stitching). This stitches images by feature points. However, unlike traditional approaches, our approach rapidly finds several anchor-matches instead of a lot of feature matches to stitch the image. Firstly, from a large number of feature points, we design a method to select a small number of them that are more helpful for stitching as anchor points. Then, a method is proposed to more quickly and accurately match these anchor points, using position and pose information. Experiments show that our method significantly reduces the time consumption compared with the-state-of-art approaches with accuracy guaranteed.

Mapping Cynodon dactylon in vineyards using UAV images for site-specific weed control

2017 ◽  
Vol 8 (2) ◽  
pp. 267-271 ◽  
Author(s):  
A. I. de Castro ◽  
J. M. Peña ◽  
J. Torres-Sánchez ◽  
F. Jiménez-Brenes ◽  
F. López-Granados
Keyword(s):  
Cover Crops ◽  
Weed Management ◽  
Cynodon Dactylon ◽  
Management Practice ◽  
Bare Soil ◽  
Economic Losses ◽  
Site Specific ◽  
Object Based ◽  
Aerial Vehicle ◽  
Uav Images

In Spain, the use of annual cover crops is a crop management practice for irrigated vineyards that allows controlling vineyard vigor and yield, which also leads to improve the crop quality. Recently, Cynodon dactylon (bermudagrass) has been reported to infest those cover crops and colonize the grapevine rows, resulting in significant yield and economic losses due to the competition for water and nutrients. From timely unmanned aerial vehicle (UAV) imagery, the objective of this research was to map C. dactylon patches in order to provide an optimized site-specific weed management. A quadrocopter UAV equipped with a point-and-shoot camera was used to collect a set of aerial red-green-blue (RGB) images over a commercial vineyard plot, coinciding with the dormant period of C. dactylon (February 2016). Object-based image analysis (OBIA) techniques were used to develop an innovative algorithm for early discrimination and mapping of C. dactylon, which had the ability to solve the limitation of spectral similarity of this weed with cover crops or bare soil. As a general result, the classified maps of the studied vineyard showed four main classes, i.e. vine, cover crop, C. dactylon and bare soil, with 85% overall accuracy. These weed maps allow developing new strategies for site-specific control of C. dactylon populations in the context of precision viticulture.

scholarly journals A Deep-Learning-Based Approach for Wheat Yellow Rust Disease Recognition from Unmanned Aerial Vehicle Images

Sensors ◽  
2021 ◽  
Vol 21 (19) ◽  
pp. 6540
Author(s):  
Qian Pan ◽  
Maofang Gao ◽  
Pingbo Wu ◽  
Jingwen Yan ◽  
Shilei Li
Keyword(s):  
Deep Learning ◽  
Unmanned Aerial Vehicle ◽  
Recognition Accuracy ◽  
Yellow Rust ◽  
Semantic Segmentation ◽  
High Accuracy ◽  
Economic Losses ◽  
Support Vector ◽  
Aerial Vehicle ◽  
Uav Images

Yellow rust is a disease with a wide range that causes great damage to wheat. The traditional method of manually identifying wheat yellow rust is very inefficient. To improve this situation, this study proposed a deep-learning-based method for identifying wheat yellow rust from unmanned aerial vehicle (UAV) images. The method was based on the pyramid scene parsing network (PSPNet) semantic segmentation model to classify healthy wheat, yellow rust wheat, and bare soil in small-scale UAV images, and to investigate the spatial generalization of the model. In addition, it was proposed to use the high-accuracy classification results of traditional algorithms as weak samples for wheat yellow rust identification. The recognition accuracy of the PSPNet model in this study reached 98%. On this basis, this study used the trained semantic segmentation model to recognize another wheat field. The results showed that the method had certain generalization ability, and its accuracy reached 98%. In addition, the high-accuracy classification result of a support vector machine was used as a weak label by weak supervision, which better solved the labeling problem of large-size images, and the final recognition accuracy reached 94%. Therefore, the present study method facilitated timely control measures to reduce economic losses.

scholarly journals Object Segmentation on UAV Photo Data to Support the Provision of Rural Area Spatial Information

2015 ◽  
Vol 29 (1) ◽  
Author(s):  
Nurwita Mustika Sari ◽  
Dony Kushardono
Keyword(s):  
Rural Area ◽  
Rural Areas ◽  
Spatial Information ◽  
Remote Sensing Data ◽  
Image Data ◽  
Aerial Photographs ◽  
Segmentation Method ◽  
Object Based ◽  
Aerial Vehicle ◽  
Uav Image

The use of Unmanned Aerial Vehicle (UAV) to take aerial photographs is increasing in recent years. Photo data taken by UAV become one of reliable detailed-scale  remote sensing data sources. The capability to obtain cloud-free images and the flexibility of time are some of the advantages of UAV photo data compared to satellite images with optical sensor. Displayed area at the data shows the objects clearly. Rural area has certain characteristics in its land cover namely ricefield. To delineate the area correctly there is an object-based image analysis methods (OBIA) that could be applied. In this  study, proposed a novel method to  execute the separation of objects that exist in the data with segmentation method. The result shows an effective segmentation method to separate different objects in rural areas recorded on UAV image data. The accuracy obtained is 90.47% after optimization process. This segmentation can be a valid basis to support the provision of spatial information in rural area.

scholarly journals Automatic Seam-Line Detection in UAV Remote Sensing Image Mosaicking by Use of Graph Cuts

2018 ◽  
Vol 7 (9) ◽  
pp. 361 ◽  
Author(s):  
Ming Li ◽  
Deren Li ◽  
Bingxuan Guo ◽  
Lin Li ◽  
Teng Wu ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Energy Function ◽  
Graph Cuts ◽  
Remote Sensing Image ◽  
Existing Problems ◽  
Image Mosaicking ◽  
Target Energy ◽  
Aerial Vehicle ◽  
Uav Images ◽  
Uav Image

Image mosaicking is one of the key technologies in data processing in the field of computer vision and digital photogrammetry. For the existing problems of seam, pixel aliasing, and ghosting in mosaic images, this paper proposes and implements an optimal seam-line search method based on graph cuts for unmanned aerial vehicle (UAV) remote sensing image mosaicking. This paper first uses a mature and accurate image matching method to register the pre-mosaicked UAV images, and then it marks the source of each pixel in the overlapped area of adjacent images and calculates the energy value contributed by the marker by using the target energy function of graph cuts constructed in this paper. Finally, the optimal seam-line can be obtained by solving the minimum value of target energy function based on graph cuts. The experimental results show that our method can realize seamless UAV image mosaicking, and the image mosaic area transitions naturally.

scholarly journals ICENET: A Semantic Segmentation Deep Network for River Ice by Fusing Positional and Channel-Wise Attentive Features

2020 ◽  
Vol 12 (2) ◽  
pp. 221 ◽  
Author(s):  
Xiuwei Zhang ◽  
Jiaojiao Jin ◽  
Zeze Lan ◽  
Chunjiang Li ◽  
Minhao Fan ◽  
...  
Keyword(s):  
State Of The Art ◽  
Yellow River ◽  
Semantic Segmentation ◽  
Ice Cover ◽  
River Ice ◽  
Superior Result ◽  
Aerial Vehicle ◽  
Deep Convolution Neural Network ◽  
Uav Image ◽  
Cover Density

River ice monitoring is of great significance for river management, ship navigation and ice hazard forecasting in cold-regions. Accurate ice segmentation is one most important pieces of technology in ice monitoring research. It can provide the prerequisite information for the calculation of ice cover density, drift ice speed, ice cover distribution, change detection and so on. Unmanned aerial vehicle (UAV) aerial photography has the advantages of higher spatial and temporal resolution. As UAV technology has become more popular and cheaper, it has been widely used in ice monitoring. So, we focused on river ice segmentation based on UAV remote sensing images. In this study, the NWPU_YRCC dataset was built for river ice segmentation, in which all images were captured by different UAVs in the region of the Yellow River, the most difficult river to manage in the world. To the best of our knowledge, this is the first public UAV image dataset for river ice segmentation. Meanwhile, a semantic segmentation deep convolution neural network by fusing positional and channel-wise attentive features is proposed for river ice semantic segmentation, named ICENET. Experiments demonstrated that the proposed ICENET outperforms the state-of-the-art methods, achieving a superior result on the NWPU_YRCC dataset.

Sign in / Sign up

Export Citation Format

Share Document