scholarly journals DETECTION OF UNDOCUMENTED BUILDINGS USING CONVOLUTIONAL NEURAL NETWORK AND OFFICIAL GEODATA

2020 ◽  
Vol V-2-2020 ◽  
pp. 517-524
Author(s):  
Q. Li ◽  
Y. Shi ◽  
S. Auer ◽  
R. Roschlaub ◽  
K. Möst ◽  
...  
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Large Scale ◽  
The State ◽  
Detection Methods ◽  
Optical Data ◽  
Surface Model ◽  
Building Detection ◽  
Robust Detection ◽  
Analysis Experiment

Abstract. Undocumented buildings are buildings which were built years ago, but were never recorded in official digital cadastral maps. Detection of undocumented buildings is of great importance for urban planning and monitoring. The state of Bavaria, Germany, pursues this task based on high resolution optical data and digital surface models, using semi-automatic detection methods, which suffer from a high false alarm rate. In order to study the influence of sampling strategies on the performance of building detection, we have firstly designed a transferability analysis experiment, which has not been adequately addressed in the current literature. In this experiment, we test whether the trained model from a district contains valuable information for building detection in a different district. It was found that the large-scale building detection results can be considerably improved when training samples are collected from different districts. Based on the building detection results, we propose a novel framework for the detection of undocumented buildings using Convolutional Neural Network (CNN) and official geodata. More specifically, buildings are identified as undocumented, when their pixels in the output of the CNN are predicted as “building”, whereas they belong to the “non-building” in the Digital Cadastral Map (DFK). The detected undocumented building pixels are subsequently divided into the class of old or new undocumented building with the aid of a Temporal Digital Surface Model (tDSM) in the stage of decision fusion. By doing so, a seamless map of undocumented buildings is generated for 1/4th of the state of Bavaria, Germany at a spatial resolution of 0.4 m, which has demonstrated the use of CNN for the robust detection of undocumented buildings at large-scale.

scholarly journals Detection of Undocumented Building Constructions from Official Geodata Using a Convolutional Neural Network

2020 ◽  
Vol 12 (21) ◽  
pp. 3537
Author(s):  
Qingyu Li ◽  
Yilei Shi ◽  
Stefan Auer ◽  
Robert Roschlaub ◽  
Karin Möst ◽  
...  
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Large Scale ◽  
The State ◽  
Optical Data ◽  
Surface Model ◽  
Building Detection ◽  
Digital Surface Model ◽  
Training Samples ◽  
Analysis Experiment

Undocumented building constructions are buildings or stories that were built years ago, but are missing in the official digital cadastral maps (DFK). The detection of undocumented building constructions is essential to urban planning and monitoring. The state of Bavaria, Germany, uses two semi-automatic detection methods for this task that suffer from a high false alarm rate. To solve this problem, we propose a novel framework to detect undocumented building constructions using a Convolutional Neural Network (CNN) and official geodata, including high resolution optical data and the Normalized Digital Surface Model (nDSM). More specifically, an undocumented building pixel is labeled as “building” by the CNN but does not overlap with a building polygon of the DFK. The class of old or new undocumented building can be further separated when a Temporal Digital Surface Model (tDSM) is introduced in the stage of decision fusion. In a further step, undocumented story construction is detected as the pixels that are “building” in both DFK and predicted results from CNN, but shows a height deviation from the tDSM. By doing so, we have produced a seamless map of undocumented building constructions for one-quarter of the state of Bavaria, Germany at a spatial resolution of 0.4 m, which has proved that our framework is robust to detect undocumented building constructions at large-scale. Considering that the official geodata exploited in this research is advantageous because of its high quality and large coverage, a transferability analysis experiment is also designed in our research to investigate the sampling strategies for building detection at large-scale. Our results indicate that building detection results in unseen areas at large-scale can be improved when training samples are collected from different districts. In an area where training samples are available, local training sampless collection and training can save much time and effort.

scholarly journals Broad Area Target Search System for Ship Detection via Deep Convolutional Neural Network

2019 ◽  
Vol 11 (17) ◽  
pp. 1965 ◽  
Author(s):  
Yanan You ◽  
Zezhong Li ◽  
Bohao Ran ◽  
Jingyi Cao ◽  
Sudi Lv ◽  
...  
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Large Scale ◽  
Processing System ◽  
Deep Convolutional Neural Network ◽  
Detection Methods ◽  
Optical Remote Sensing ◽  
Broad Area ◽  
Target Search ◽  
Ship Detection

High-resolution optical remote sensing data can be utilized to investigate the human behavior and the activities of artificial targets, for example ship detection on the sea. Recently, the deep convolutional neural network (DCNN) in the field of deep learning is widely used in image processing, especially in target detection tasks. Therefore, a complete processing system called the broad area target search (BATS) is proposed based on DCNN in this paper, which contains data import, processing and storage steps. In this system, aiming at the problem of onshore false alarms, a method named as Mask-Faster R-CNN is proposed to differentiate the target and non-target areas by introducing a semantic segmentation sub network into the Faster R-CNN. In addition, we propose a DCNN framework named as Saliency-Faster R-CNN to deal with the problem of multi-scale ships detection, which solves the problem of missing detection caused by the inconsistency between large-scale targets and training samples. Based on these DCNN-based methods, the BATS system is tested to verify that our system can integrate different ship detection methods to effectively solve the problems that existed in the ship detection task. Furthermore, our system provides an interface for users, as a data-driven learning, to optimize the DCNN-based methods.

Non-Blind Image Deconvolution Based on “Ringing” Removal Using Convolutional Neural Network

2020 ◽  
Vol 2020 (10) ◽  
pp. 181-1-181-7
Author(s):  
Takahiro Kudo ◽  
Takanori Fujisawa ◽  
Takuro Yamaguchi ◽  
Masaaki Ikehara
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Network Architecture ◽  
Large Scale ◽  
Blind Deconvolution ◽  
Training Dataset ◽  
Image Deconvolution ◽  
Classic Problem ◽  
Key Points ◽  
Blind Image

Image deconvolution has been an important issue recently. It has two kinds of approaches: non-blind and blind. Non-blind deconvolution is a classic problem of image deblurring, which assumes that the PSF is known and does not change universally in space. Recently, Convolutional Neural Network (CNN) has been used for non-blind deconvolution. Though CNNs can deal with complex changes for unknown images, some CNN-based conventional methods can only handle small PSFs and does not consider the use of large PSFs in the real world. In this paper we propose a non-blind deconvolution framework based on a CNN that can remove large scale ringing in a deblurred image. Our method has three key points. The first is that our network architecture is able to preserve both large and small features in the image. The second is that the training dataset is created to preserve the details. The third is that we extend the images to minimize the effects of large ringing on the image borders. In our experiments, we used three kinds of large PSFs and were able to observe high-precision results from our method both quantitatively and qualitatively.

scholarly journals Classification of Skin Disease Using Deep Learning Neural Networks with MobileNet V2 and LSTM

Sensors ◽  
2021 ◽  
Vol 21 (8) ◽  
pp. 2852
Author(s):  
Parvathaneni Naga Srinivasu ◽  
Jalluri Gnana SivaSai ◽  
Muhammad Fazal Ijaz ◽  
Akash Kumar Bhoi ◽  
Wonjoon Kim ◽  
...  
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Skin Disease ◽  
Network Architecture ◽  
Large Scale ◽  
Short Term Memory ◽  
Convolutional Networks ◽  
Occurrence Matrix

Deep learning models are efficient in learning the features that assist in understanding complex patterns precisely. This study proposed a computerized process of classifying skin disease through deep learning based MobileNet V2 and Long Short Term Memory (LSTM). The MobileNet V2 model proved to be efficient with a better accuracy that can work on lightweight computational devices. The proposed model is efficient in maintaining stateful information for precise predictions. A grey-level co-occurrence matrix is used for assessing the progress of diseased growth. The performance has been compared against other state-of-the-art models such as Fine-Tuned Neural Networks (FTNN), Convolutional Neural Network (CNN), Very Deep Convolutional Networks for Large-Scale Image Recognition developed by Visual Geometry Group (VGG), and convolutional neural network architecture that expanded with few changes. The HAM10000 dataset is used and the proposed method has outperformed other methods with more than 85% accuracy. Its robustness in recognizing the affected region much faster with almost 2× lesser computations than the conventional MobileNet model results in minimal computational efforts. Furthermore, a mobile application is designed for instant and proper action. It helps the patient and dermatologists identify the type of disease from the affected region’s image at the initial stage of the skin disease. These findings suggest that the proposed system can help general practitioners efficiently and effectively diagnose skin conditions, thereby reducing further complications and morbidity.

scholarly journals Programmable phase-change metasurfaces on waveguides for multimode photonic convolutional neural network

2021 ◽  
Vol 12 (1) ◽  
Author(s):  
Changming Wu ◽  
Heshan Yu ◽  
Seokhyeong Lee ◽  
Ruoming Peng ◽  
Ichiro Takeuchi ◽  
...  
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Phase Change ◽  
Convolutional Neural Network ◽  
Large Scale ◽  
Phase Change Materials ◽  
Refractive Index Change ◽  
Optical Computing ◽  
Machine Learning Algorithms ◽  
Matrix Vector Multiplication

AbstractNeuromorphic photonics has recently emerged as a promising hardware accelerator, with significant potential speed and energy advantages over digital electronics for machine learning algorithms, such as neural networks of various types. Integrated photonic networks are particularly powerful in performing analog computing of matrix-vector multiplication (MVM) as they afford unparalleled speed and bandwidth density for data transmission. Incorporating nonvolatile phase-change materials in integrated photonic devices enables indispensable programming and in-memory computing capabilities for on-chip optical computing. Here, we demonstrate a multimode photonic computing core consisting of an array of programable mode converters based on on-waveguide metasurfaces made of phase-change materials. The programmable converters utilize the refractive index change of the phase-change material Ge2Sb2Te5 during phase transition to control the waveguide spatial modes with a very high precision of up to 64 levels in modal contrast. This contrast is used to represent the matrix elements, with 6-bit resolution and both positive and negative values, to perform MVM computation in neural network algorithms. We demonstrate a prototypical optical convolutional neural network that can perform image processing and recognition tasks with high accuracy. With a broad operation bandwidth and a compact device footprint, the demonstrated multimode photonic core is promising toward large-scale photonic neural networks with ultrahigh computation throughputs.

scholarly journals Automatic Handgun Detection with Deep Learning in Video Surveillance Images

2021 ◽  
Vol 11 (13) ◽  
pp. 6085
Author(s):  
Jesus Salido ◽  
Vanesa Lomas ◽  
Jesus Ruiz-Santaquiteria ◽  
Oscar Deniz
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Video Surveillance ◽  
Automatic Detection ◽  
Public Spaces ◽  
Detection Methods ◽  
Training Dataset ◽  
Average Precision ◽  
Terrorist Acts

There is a great need to implement preventive mechanisms against shootings and terrorist acts in public spaces with a large influx of people. While surveillance cameras have become common, the need for monitoring 24/7 and real-time response requires automatic detection methods. This paper presents a study based on three convolutional neural network (CNN) models applied to the automatic detection of handguns in video surveillance images. It aims to investigate the reduction of false positives by including pose information associated with the way the handguns are held in the images belonging to the training dataset. The results highlighted the best average precision (96.36%) and recall (97.23%) obtained by RetinaNet fine-tuned with the unfrozen ResNet-50 backbone and the best precision (96.23%) and F1 score values (93.36%) obtained by YOLOv3 when it was trained on the dataset including pose information. This last architecture was the only one that showed a consistent improvement—around 2%—when pose information was expressly considered during training.

PHENYLKETONURIA, AND GUTHRIE INHIBITION ASSAY SCREENING PROCEDURE

PEDIATRICS ◽  
1963 ◽  
Vol 32 (3) ◽  
pp. 344-346
Keyword(s):  
Public Health ◽  
Large Scale ◽  
Human Genetics ◽  
Screening Program ◽  
Genetic Diseases ◽  
State Department ◽  
The State ◽  
Detection Methods ◽  
Inhibition Assay ◽  
Pilot Studies

Recommendations were made in view of the following facts: (1) the need for further information on the mechanisms involved in the phenotypic expressions of phenylketonuria; (2) the present lack of adequate data on the effectiveness of the Guthrie Inhibition Assay, in terms of number of cases which may be missed, factors making for positive determinations and providing other information on which to evaluate the appropriateness of the large-scale screening program proposed; (3) the undesirability of deploying inordinate resources in the evaluation of the Guthrie Inhibition Assay to the detriment of the needs of other areas of child health including phenylketonuria; (4) the indications that a multi-faceted approach to phenylketonuria would be productive, not only in resolving the problems involving this disorder but also as a model for the investigation of and application to the treatment of other genetic diseases; (5) the possibility that the Guthrie Inhibition Assay could be a useful tool in the early detection, treatment and investigation of phenylketonuria; and (6) the fact that other state health departments are participating in the Guthrie Field Trials, indicating that the California State Department of Public Health should apply its resources to a more intensive study of PKU and detection methods. The consultants made the following recommendations, through resolution, to the California State Department of Public Health. It was resolved that: 1. The State of California not be responsible at this time for initiating or recommending that the Guthrie procedure be accomplished on a state-wide basis in all newborn nurseries (one dissent). 2. The State of California initiate and coordinate the development of pilot studies in selected hospitals and medical centers throughout the State in the investigation of phenylketonuria, utilizing the Guthrie Inhibition Assay or other tests. 3. A scientific committee be appointed immediately as an advisory committee to the State Department of Public Health to develop recommendations for carrying out the suggested investigations. 4. A registry for phenylketonuria and other diseases (as listed in the recommendations by the Subcommittee on Human Genetics) be established within the framework of the State organization.

A fully automated method of human identification based on dental panoramic radiographs using a convolutional neural network

2021 ◽  
Author(s):  
Young Hyun Kim ◽  
Eun-Gyu Ha ◽  
Kug Jin Jeon ◽  
Chena Lee ◽  
Sang-Sun Han
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
High Speed ◽  
Large Scale ◽  
Oral Surgery ◽  
Human Identification ◽  
Running Time ◽  
Automated Method ◽  
Image Characteristics ◽  
Proposed Model

Objectives: This study aimed to develop a fully automated human identification method based on a convolutional neural network (CNN) with a large-scale dental panoramic radiograph (DPR) dataset. Methods: In total, 2,760 DPRs from 746 subjects who had 2 to 17 DPRs with various changes in image characteristics due to various dental treatments (tooth extraction, oral surgery, prosthetics, orthodontics, or tooth development) were collected. The test dataset included the latest DPR of each subject (746 images) and the other DPRs (2,014 images) were used for model training. A modified VGG16 model with two fully connected layers was applied for human identification. The proposed model was evaluated with rank-1, –3, and −5 accuracies, running time, and gradient-weighted class activation mapping (Grad-CAM)–applied images. Results: This model had rank-1,–3, and −5 accuracies of 82.84%, 89.14%, and 92.23%, respectively. All rank-1 accuracy values of the proposed model were above 80% regardless of changes in image characteristics. The average running time to train the proposed model was 60.9 sec per epoch, and the prediction time for 746 test DPRs was short (3.2 sec/image). The Grad-CAM technique verified that the model automatically identified humans by focusing on identifiable dental information. Conclusion: The proposed model showed good performance in fully automatic human identification despite differing image characteristics of DPRs acquired from the same patients. Our model is expected to assist in the fast and accurate identification by experts by comparing large amounts of images and proposing identification candidates at high speed.

Study on Rapid Archival Technology of Bullets Based on Graph Convolutional Neural Network

2021 ◽  
Author(s):  
Shi-bo Pan ◽  
Di-lin Pan ◽  
Nan Pan ◽  
Xiao Ye ◽  
Miaohan Zhang
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Neural Network Model ◽  
Dynamic Time Warping ◽  
Large Scale ◽  
Line Graph ◽  
High Accuracy ◽  
Time Warping ◽  
Large Numbers ◽  
Dynamic Time

Traditional gun archiving methods are mostly carried out through bullets’ physics or photography, which are inefficient and difficult to trace, and cannot meet the needs of large-scale archiving. Aiming at such problems, a rapid archival technology of bullets based on graph convolutional neural network has been studied and developed. First, the spot laser is used to take the circle points of the bullet rifling traces. The obtained data is filtered and noise-reduced to make the corresponding line graph, and then the dynamic time warping (DTW) algorithm convolutional neural network model is used to perform the processing on the processed data. Not only is similarity matched, the rapid matching of the rifling of the bullet is also accomplished. Comparison of experimental results shows that this technology has the advantages of rapid archiving and high accuracy. Furthermore, it can be carried out in large numbers at the same time, and is more suitable for practical promotion and application.

Sign in / Sign up

Export Citation Format

Share Document