scholarly journals DeepDualMapper: A Gated Fusion Network for Automatic Map Extraction Using Aerial Images and Trajectories

2020 ◽  
Vol 34 (01) ◽  
pp. 1037-1045 ◽  
Author(s):  
Hao Wu ◽  
Hanyuan Zhang ◽  
Xinyu Zhang ◽  
Weiwei Sun ◽  
Baihua Zheng ◽  
...  

Automatic map extraction is of great importance to urban computing and location-based services. Aerial image and GPS trajectory data refer to two different data sources that could be leveraged to generate the map, although they carry different types of information. Most previous works on data fusion between aerial images and data from auxiliary sensors do not fully utilize the information of both modalities and hence suffer from the issue of information loss. We propose a deep convolutional neural network called DeepDualMapper which fuses the aerial image and trajectory data in a more seamless manner to extract the digital map. We design a gated fusion module to explicitly control the information flows from both modalities in a complementary-aware manner. Moreover, we propose a novel densely supervised refinement decoder to generate the prediction in a coarse-to-fine way. Our comprehensive experiments demonstrate that DeepDualMapper can fuse the information of images and trajectories much more effectively than existing approaches, and is able to generate maps with higher accuracy.

2020 ◽  
Vol 9 (3) ◽  
pp. 181
Author(s):  
Banqiao Chen ◽  
Chibiao Ding ◽  
Wenjuan Ren ◽  
Guangluan Xu

The requirements of location-based services have generated an increasing need for up-to-date digital road maps. However, traditional methods are expensive and time-consuming, requiring many skilled operators. The feasibility of using massive GPS trajectory data provides a cheap and quick means for generating and updating road maps. The detection of road intersections, being the critical component of a road map, is a key problem in map generation. Unfortunately, low sampling rates and high disparities are ubiquitous among floating car data (FCD), making road intersection detection from such GPS trajectories very challenging. In this paper, we extend a point clustering-based road intersection detection framework to include a post-classification course, which utilizes the geometric features of road intersections. First, we propose a novel turn-point position compensation algorithm, in order to improve the concentration of selected turn-points under low sampling rates. The initial detection results given by the clustering algorithm are recall-focused. Then, we rule out false detections in an extended classification course based on an image thinning algorithm. The detection results of the proposed method are quantitatively evaluated by matching with intersections from OpenStreetMap using a variety of distance thresholds. Compared with other methods, our approach can achieve a much higher recall rate and better overall performance, thereby better supporting map generation and other similar applications.


Author(s):  
DONGJIANG XU ◽  
TAKIS KASPARIS

This paper proposes a hybrid approach to image registration for inferring the affine transformation that best matches a pair of partially overlapping aerial images. The image registration is formulated as a two-stage hybrid approach combining both phase correlation method (PCME) and optical flow equation (OFE) based estimation algorithm in a coarse-to-fine manner. With PCME applied at the highest level of decomposition, the initial affine parameter model could be first estimated. Subsequently, the OFE-based estimation algorithm is incorporated into the proposed hybrid approach using a multi-resolution mechanism. PCME is characterized by its insensitivity to large geometric transform between images, which can effectively guide the OFE-based registration. For image pairs under salient brightness variations, we propose a nonlinear image representation that emphasizes common intensity information, suppresses the non-common information between an image pair, and is suitable for the proposed coarse-to-fine hierarchical iterative processing. Experimental results demonstrate the accuracy and efficiency of our proposed approach using different types of aerial images.


2006 ◽  
Vol 33 (10) ◽  
pp. 1320-1331 ◽  
Author(s):  
Jin Gon Kim ◽  
Dong Yeob Han ◽  
Ki Yun Yu ◽  
Yong Il Kim ◽  
Sung Mo Rhee

The efficient extraction of road information is increasingly important with the rapid growth of road-related services, such as car navigation systems, telematics, and location-based services. Conventional methods of creating and updating road information are expensive and time consuming. Therefore, a set of processes is required that collects the same information more efficiently. We propose a new method for collecting road information in complex urban areas from road pavement markings located on aerial images. This information includes lane and symbol markings that guide direction; the geometric properties of the pavement markings and their spatial relationships are analyzed. Road construction manuals and a series of cutting-edge techniques, including template matching, are used in our analysis. To validate our approach, the accuracy of our results was evaluated by comparing the data with manually extracted ground truth data. Our approach demonstrates that road information can be extracted efficiently to an extent in a complex urban area.Key words: aerial image, automatic extraction, pavement marking, road information, CNS.


Author(s):  
Chenyi Zhuang ◽  
Nicholas Jing Yuan ◽  
Ruihua Song ◽  
Xing Xie ◽  
Qiang Ma

Technologies are increasingly taking advantage of the explosion in the amount of data generated by social multimedia (e.g., web searches, ad targeting, and urban computing). In this paper, we propose a multi-view learning framework for presenting the construction of a new urban movement knowledge graph, which could greatly facilitate the research domains mentioned above. In particular, by viewing GPS trajectory data from temporal, spatial, and spatiotemporal points of view, we construct a knowledge graph of which nodes and edges are their locations and relations, respectively. On the knowledge graph, both nodes and edges are represented in latent semantic space. We verify its utility by subsequently applying the knowledge graph to predict the extent of user attention (high or low) paid to different locations in a city. Experimental evaluations and analysis of a real-world dataset show significant improvements in comparison to state-of-the-art methods.


Sensors ◽  
2020 ◽  
Vol 20 (6) ◽  
pp. 1580
Author(s):  
Liantao Ma ◽  
Chaohe Zhang ◽  
Yasha Wang ◽  
Guangju Peng ◽  
Chao Chen ◽  
...  

GPS is taken as the most prevalent positioning system in practice. However, in urban areas, as the GPS satellite signal could be blocked by buildings, the GPS positioning is not accurate due to multi-path errors. Estimating the negative impact of urban environments on GPS accuracy, that is the GPS environment friendliness (GEF) in this paper, will help to predict the GPS errors in different road segments. It enhances user experiences of location-based services and helps to determine where to deploy auxiliary assistant positioning devices. In this paper, we propose a method of processing and analysing massive historical bus GPS trajectory data to estimate the urban road GEF integrated with the contextual information of roads. First, our approach takes full advantage of the particular feature that bus routes are fixed to improve the performance of map matching. In order to estimate the GEF of all roads fairly and reasonably, the method estimates the GPS positioning error of each bus on the roads that are not covered by its route, by taking POIinformation, tag information of roads, and building layout information into account. Finally, we utilize a weighted estimation strategy to calculate the GEF of each road based on the GPS positioning performance of all buses. Based on one month of GPS trajectory data of 4835 buses within the second ring road in Chengdu, China, we estimate the GEF of 8831 different road segments and verify the rationality of the results by satellite maps, street views, and field tests.


2020 ◽  
Vol 34 (10) ◽  
pp. 2050092
Author(s):  
Zhiren Huang ◽  
Pu Wang ◽  
Yang Liu

Entering big data era, individual GPS trajectory data have created great opportunities for human mobility and collective behavior studies. Individual GPS trajectories can be collected by location-based services on mobile phones. However, GPS data often do not record transportation modes (e.g., walking, riding a bus, or driving a car). In this study, we analyzed the statistical characteristics of individual trajectories and present a collaborative isolation forest (Co-IF) model to identify the transportation modes of mobile phone GPS trajectories. Unlike previous models that identify multiple transportation modes simultaneously, the proposed Co-IF model builds a single-class classifier for each transportation mode and then combines their results. Compared to the existing models, the Co-IF model offers competitive performance and shows improved reliability with noisy trajectories.


2021 ◽  
Vol 10 (3) ◽  
pp. 122
Author(s):  
Banqiao Chen ◽  
Chibiao Ding ◽  
Wenjuan Ren ◽  
Guangluan Xu

High-quality digital road maps are essential prerequisites of location-based services and smart city applications. The massive and accessible GPS trajectory data generated by mobile GPS devices provide a new means through which to generate maps. However, due to the low sampling rate and multi-level disparity problems, automatically generating road maps is challenging and the generated maps cannot yet meet commercial requirements. In this paper, we present a GPS trajectory data-based road tracking algorithm, including an active contour-based road centerline refinement algorithm as the necessary post-processing. First, the low-frequency trajectory data were transferred into a density estimation map representing the roads through a kernel density estimator, for a seeding algorithm to automatically generate the initial points of the road-tracking algorithm. Then, we present a template-matching-based road-direction extraction algorithm for the road trackers to conduct simple correction, based on local density information. Last, we present an active contour-based road centerline refinement algorithm, considering both the geometric information of roads and density information. The generated road map was quantitatively evaluated using maps offered by the OpenStreetMap. Compared to other methods, our approach could produce a higher quality map with fewer zig-zag roads, and therefore more accurately represents reality.


Informatica ◽  
2019 ◽  
Vol 30 (1) ◽  
pp. 33-52 ◽  
Author(s):  
Pengfei HAO ◽  
Chunlong YAO ◽  
Qingbin MENG ◽  
Xiaoqiang YU ◽  
Xu LI

2020 ◽  
Author(s):  
John J Shaw ◽  
Zhisen Urgolites ◽  
Padraic Monaghan

Visual long-term memory has a large and detailed storage capacity for individual scenes, objects, and actions. However, memory for combinations of actions and scenes is poorer, suggesting difficulty in binding this information together. Sleep can enhance declarative memory of information, but whether sleep can also boost memory for binding information and whether the effect is general across different types of information is not yet known. Experiments 1 to 3 tested effects of sleep on binding actions and scenes, and Experiments 4 and 5 tested binding of objects and scenes. Participants viewed composites and were tested 12-hours later after a delay consisting of sleep (9pm-9am) or wake (9am-9pm), on an alternative forced choice recognition task. For action-scene composites, memory was relatively poor with no significant effect of sleep. For object-scene composites sleep did improve memory. Sleep can promote binding in memory, depending on the type of information to be combined.


2019 ◽  
Vol 11 (10) ◽  
pp. 1157 ◽  
Author(s):  
Jorge Fuentes-Pacheco ◽  
Juan Torres-Olivares ◽  
Edgar Roman-Rangel ◽  
Salvador Cervantes ◽  
Porfirio Juarez-Lopez ◽  
...  

Crop segmentation is an important task in Precision Agriculture, where the use of aerial robots with an on-board camera has contributed to the development of new solution alternatives. We address the problem of fig plant segmentation in top-view RGB (Red-Green-Blue) images of a crop grown under open-field difficult circumstances of complex lighting conditions and non-ideal crop maintenance practices defined by local farmers. We present a Convolutional Neural Network (CNN) with an encoder-decoder architecture that classifies each pixel as crop or non-crop using only raw colour images as input. Our approach achieves a mean accuracy of 93.85% despite the complexity of the background and a highly variable visual appearance of the leaves. We make available our CNN code to the research community, as well as the aerial image data set and a hand-made ground truth segmentation with pixel precision to facilitate the comparison among different algorithms.


Sign in / Sign up

Export Citation Format

Share Document