scholarly journals Affiliated Fusion Conditional Random Field for Urban UAV Image Semantic Segmentation

Sensors ◽  
2020 ◽  
Vol 20 (4) ◽  
pp. 993
Author(s):  
Yingying Kong ◽  
Bowen Zhang ◽  
Biyuan Yan ◽  
Yanjuan Liu ◽  
Henry Leung ◽  
...  
Keyword(s):  
Random Field ◽  
Conditional Random Field ◽  
Region Of Interest ◽  
Semantic Segmentation ◽  
Geographical Information ◽  
Aerial Image ◽  
Surface Model ◽  
Uav Images ◽  
Uav Image ◽  
Multiple Metrics

Unmanned aerial vehicles (UAV) have had significant progress in the last decade, which is applied to many relevant fields because of the progress of aerial image processing and the convenience to explore areas that men cannot reach. Still, as the basis of further applications such as object tracking and terrain classification, semantic image segmentation is one of the most difficult challenges in the field of computer vision. In this paper, we propose a method for urban UAV images semantic segmentation, which utilizes the geographical information of the region of interest in the form of a digital surface model (DSM). We introduce an Affiliated Fusion Conditional Random Field (AF-CRF), which combines the information of visual pictures and DSM, and a multi-scale strategy with attention to improve the segmenting results. The experiments show that the proposed structure performs better than state-of-the-art networks in multiple metrics.

scholarly journals A Deep Learning Approach on Building Detection from Unmanned Aerial Vehicle-Based Images in Riverbank Monitoring

Sensors ◽  
2018 ◽  
Vol 18 (11) ◽  
pp. 3921 ◽  
Author(s):  
Wuttichai Boonpook ◽  
Yumin Tan ◽  
Yinghua Ye ◽  
Peerapong Torteeka ◽  
Kritanai Torsri ◽  
...  
Keyword(s):  
Deep Learning ◽  
Network Architecture ◽  
Semantic Segmentation ◽  
Water Levels ◽  
Building Detection ◽  
Network Training ◽  
Building Information ◽  
Open Standard ◽  
Uav Images ◽  
Uav Image

Buildings along riverbanks are likely to be affected by rising water levels, therefore the acquisition of accurate building information has great importance not only for riverbank environmental protection but also for dealing with emergency cases like flooding. UAV-based photographs are flexible and cloud-free compared to satellite images and can provide very high-resolution images up to centimeter level, while there exist great challenges in quickly and accurately detecting and extracting building from UAV images because there are usually too many details and distortions on UAV images. In this paper, a deep learning (DL)-based approach is proposed for more accurately extracting building information, in which the network architecture, SegNet, is used in the semantic segmentation after the network training on a completely labeled UAV image dataset covering multi-dimension urban settlement appearances along a riverbank area in Chongqing. The experiment results show that an excellent performance has been obtained in the detection of buildings from untrained locations with an average overall accuracy more than 90%. To verify the generality and advantage of the proposed method, the procedure is further evaluated by training and testing with another two open standard datasets which have a variety of building patterns and styles, and the final overall accuracies of building extraction are more than 93% and 95%, respectively.

scholarly journals EFFICIENT SEMANTIC SEGMENTATION OF MAN-MADE SCENES USING FULLY-CONNECTED CONDITIONAL RANDOM FIELD

2016 ◽  
Vol XLI-B3 ◽  
pp. 633-640
Author(s):  
Weihao Li ◽  
Michael Ying Yang
Keyword(s):  
Random Field ◽  
State Of The Art ◽  
Conditional Random Field ◽  
Contextual Information ◽  
Mean Field ◽  
Semantic Segmentation ◽  
Gaussian Kernels ◽  
Previous State ◽  
Fully Connected ◽  
Better Than

In this paper we explore semantic segmentation of man-made scenes using fully connected conditional random field (CRF). Images of man-made scenes display strong contextual dependencies in the spatial structures. Fully connected CRFs can model long-range connections within the image of man-made scenes and make use of contextual information of scene structures. The pairwise edge potentials of fully connected CRF models are defined by a linear combination of Gaussian kernels. Using filter-based mean field algorithm, the inference is very efficient. Our experimental results demonstrate that fully connected CRF performs better than previous state-of-the-art approaches on both eTRIMS dataset and LabelMeFacade dataset.

scholarly journals Assessment of DSM Based on Radiometric Transformation of UAV Data

Sensors ◽  
2021 ◽  
Vol 21 (5) ◽  
pp. 1649
Author(s):  
Muhammad Hamid Chaudhry ◽  
Anuar Ahmad ◽  
Qudsia Gulzar ◽  
Muhammad Shahid Farid ◽  
Himan Shahabi ◽  
...  
Keyword(s):  
Point Cloud ◽  
Accuracy Assessment ◽  
Low Cost ◽  
Image Data ◽  
Flying Height ◽  
Surface Model ◽  
Lidar Data ◽  
Local Accuracy ◽  
Uav Images ◽  
Uav Image

Unmanned Aerial Vehicle (UAV) is one of the latest technologies for high spatial resolution 3D modeling of the Earth. The objectives of this study are to assess low-cost UAV data using image radiometric transformation techniques and investigate its effects on global and local accuracy of the Digital Surface Model (DSM). This research uses UAV Light Detection and Ranging (LIDAR) data from 80 meters and UAV Drone data from 300 and 500 meters flying height. RAW UAV images acquired from 500 meters flying height are radiometrically transformed in Matrix Laboratory (MATLAB). UAV images from 300 meters flying height are processed for the generation of 3D point cloud and DSM in Pix4D Mapper. UAV LIDAR data are used for the acquisition of Ground Control Points (GCP) and accuracy assessment of UAV Image data products. Accuracy of enhanced DSM with DSM generated from 300 meters flight height were analyzed for point cloud number, density and distribution. Root Mean Square Error (RMSE) value of Z is enhanced from ±2.15 meters to 0.11 meters. For local accuracy assessment of DSM, four different types of land covers are statistically compared with UAV LIDAR resulting in compatibility of enhancement technique with UAV LIDAR accuracy.

Multilabel Conditional Random Field Classification for UAV Images

2018 ◽  
Vol 15 (3) ◽  
pp. 399-403 ◽  
Author(s):  
Abdallah Zeggada ◽  
Souad Benbraika ◽  
Farid Melgani ◽  
Zouhir Mokhtari
Keyword(s):  
Random Field ◽  
Conditional Random Field ◽  
Uav Images

scholarly journals Boundary Perception Guidance: A Scribble-Supervised Semantic Segmentation Approach

2019 ◽  
Author(s):  
Bin Wang ◽  
Guojun Qi ◽  
Sheng Tang ◽  
Tianzhu Zhang ◽  
Yunchao Wei ◽  
...  
Keyword(s):  
Random Field ◽  
State Of The Art ◽  
Conditional Random Field ◽  
Semantic Segmentation ◽  
Semantic Feature ◽  
Feature Maps ◽  
Feature Enhancement ◽  
Pascal Voc ◽  
Segmentation Approach ◽  
Fully Connected

Semantic segmentation suffers from the fact that densely annotated masks are expensive to obtain. To tackle this problem, we aim at learning to segment by only leveraging scribbles that are much easier to collect for supervision. To fully explore the limited pixel-level annotations from scribbles, we present a novel Boundary Perception Guidance (BPG) approach, which consists of two basic components, i.e., prediction refinement and boundary regression. Specifically, the prediction refinement progressively makes a better segmentation by adopting an iterative upsampling and a semantic feature  enhancement strategy. In the boundary regression, we employ class-agnostic edge maps for supervision to effectively guide the segmentation network in localizing the boundaries between different semantic regions, leading to producing finer-grained representation of feature maps for semantic segmentation. The experiment results on the PASCAL VOC 2012 demonstrate the proposed BPG achieves mIoU of 73.2% without fully connected Conditional Random Field (CRF) and 76.0% with CRF, setting up the new state-of-the-art in literature.

scholarly journals MULTI-TEMPORAL CLASSIFICATION AND CHANGE DETECTION USING UAV IMAGES

2018 ◽  
Vol XLII-2 ◽  
pp. 651-658 ◽  
Author(s):  
S. Makuti ◽  
F. Nex ◽  
M. Y. Yang
Keyword(s):  
Change Detection ◽  
Conditional Random Field ◽  
Building Construction ◽  
Detection Techniques ◽  
Multi Temporal ◽  
Uav Images ◽  
Uav Image ◽  
Data Collections ◽  
Fully Connected ◽  
Unary Potential

In this paper different methodologies for the classification and change detection of UAV image blocks are explored. UAV is not only the cheapest platform for image acquisition but it is also the easiest platform to operate in repeated data collections over a changing area like a building construction site. Two change detection techniques have been evaluated in this study: the pre-classification and the post-classification algorithms. These methods are based on three main steps: feature extraction, classification and change detection. A set of state of the art features have been used in the tests: colour features (HSV), textural features (GLCM) and 3D geometric features. For classification purposes Conditional Random Field (CRF) has been used: the unary potential was determined using the Random Forest algorithm while the pairwise potential was defined by the fully connected CRF. In the performed tests, different feature configurations and settings have been considered to assess the performance of these methods in such challenging task. Experimental results showed that the post-classification approach outperforms the pre-classification change detection method. This was analysed using the overall accuracy, where by post classification have an accuracy of up to 62.6 % and the pre classification change detection have an accuracy of 46.5 %. These results represent a first useful indication for future works and developments.

Sign in / Sign up

Export Citation Format

Share Document