Strark-H: A Strategy for Spatial Data Storage to Improve Query Efficiency Based on Spark

Many studies in air, soil, and water research involve observations and sampling of a specific location. Knowing where studies have been previously undertaken can be a valuable addition to future research, including understanding the geographical context of previously published literature and selecting future study sites. Here, we introduce Literature Mapper, a Python QGIS plugin that provides a method for creating a spatial bibliography manager as well as a specification for storing spatial data in a bibliography manager. Literature Mapper uses QGIS’ spatial capabilities to allow users to digitize and add location information to a Zotero library, a free and open-source bibliography manager on basemaps or other geographic data of the user’s choice. Literature Mapper enhances the citations in a user’s online Zotero database with geo-locations by storing spatial coordinates as part of traditional citation entries. Literature Mapper receives data from and sends data to the user’s online database via Zotero’s web API. Using Zotero as the backend data storage, Literature Mapper benefits from all of its features including shared citation Collections, public sharing, and an open web API usable by additional applications, such as web mapping libraries. To evaluate Literature Mapper’s ability to provide insights into the spatial distribution of published literature, we provide a case study using the tool to map the study sites described in academic publications related to the biogeomorphology of California’s coastal strand vegetation, a line of research in which air movement, soil, and water are all driving factors. The results of this exercise are presented in static and web map form. The source code for Literature Mapper is available in the corresponding author’s GitHub repository: https://github.com/MicheleTobias/LiteratureMapper

Download Full-text

Spatial Data Repositories

Geographic Information Systems in Business ◽

10.4018/978-1-59140-399-9.ch005 ◽

2011 ◽

pp. 80-112

Author(s):

Julian Ray

Keyword(s):

Data Storage ◽

Spatial Data ◽

Storage Systems ◽

Systems Design ◽

Successful Implementation ◽

Security Risks ◽

Data Repositories ◽

Emerging Trends ◽

Storage Technologies ◽

Systems Architectures

This chapter identifies and discusses issues associated with integrating technologies for storing spatial data into business information technology frameworks. A new taxonomy of spatial data storage systems is developed differentiating storage systems by the systems architectures used to enable interaction between client applications and physical spatial data stores, and by the methods used by client applications to query and return spatial data. Five distinct storage models are identified and discussed along with current examples of vendor implementations. Building on this initial discussion, the chapter identifies a variety of issues pertaining to spatial data storage systems affecting three distinct aspects of technology adoption: systems design, systems implementation and management of completed systems. Current issues associated with each of these three aspects are described and illustrated along with a discussion of emerging trends in spatial data storage technologies. As spatial data and the technologies designed to store and manipulate it become more prevalent, understanding potential impacts these technologies may have on other technology decisions within an organization becomes increasingly important. Furthermore, understanding how these technologies can introduce security risks and other vulnerabilities into a computing framework is critical to successful implementation.

Download Full-text

CitySAC: A Query-Able CityGML Compression System

Smart Cities ◽

10.3390/smartcities2010008 ◽

2019 ◽

Vol 2 (1) ◽

pp. 106-117

Author(s):

Chengxi Siew ◽

Pankaj Kumar

Keyword(s):

Data Storage ◽

Spatial Data ◽

City Planning ◽

Data Transfer ◽

Original Data ◽

File Size ◽

Compression Technique ◽

3D Data ◽

Data Infrastructures ◽

Data Efficiency

Spatial Data Infrastructures (SDIs) are frequently used to exchange 2D & 3D data, in areas such as city planning, disaster management, urban navigation and many more. City Geography Mark-up Language (CityGML), an Open Geospatial Consortium (OGC) standard has been developed for the storage and exchange of 3D city models. Due to its encoding in XML based format, the data transfer efficiency is reduced which leads to data storage issues. The use of CityGML for analysis purposes is limited due to its inefficiency in terms of file size and bandwidth consumption. This paper introduces XML based compression technique and elaborates how data efficiency can be achieved with the use of schema-aware encoder. We particularly present CityGML Schema Aware Compressor (CitySAC), which is a compression approach for CityGML data transaction within SDI framework. Our test results show that the encoding system produces smaller file size in comparison with existing state-of-the-art compression methods. The encoding process significantly reduces the file size up to 7–10% of the original data.

Download Full-text

Analysis and Research on Spatial Data Storage Model Based on Cloud Computing Platform

IOP Conference Series Earth and Environmental Science ◽

10.1088/1755-1315/100/1/012112 ◽

2017 ◽

Vol 100 ◽

pp. 012112 ◽

Cited By ~ 1

Author(s):

Yong Hu

Keyword(s):

Cloud Computing ◽

Data Storage ◽

Spatial Data ◽

Storage Model ◽

Computing Platform ◽

Model Based ◽

Cloud Computing Platform

Download Full-text

Optimization Mode Research of Weighted Undirected Graph

Advanced Engineering Forum ◽

10.4028/www.scientific.net/aef.2-3.211 ◽

2011 ◽

Vol 2-3 ◽

pp. 211-216

Author(s):

Wei Fan ◽

Hong Wang ◽

Feng Liu ◽

Qian Xing

Keyword(s):

Information System ◽

Data Storage ◽

Optimization Model ◽

Directed Acyclic Graph ◽

Undirected Graph ◽

Graph Structure ◽

Acyclic Graph ◽

Efficiency Theory ◽

Query Efficiency

An algorithm is described for constructing a weighted undirected graph structure, based on the principle of directed acyclic graph, used the improved Floyd algorithm to improve the multi-node version of the evolution of information in order to release as an indicator of difference, to improve the reliability of multiple versions of data storage and multi-version storage and query efficiency. Theory and examples show that efficiency is improved using the optimization model in multi-node information system.

Download Full-text

AN EFFECTIVE DATABASE MANAGEMENT OF THE URBAN UNDERGROUND FACILITIES AND TOPOGRAPHIC INFORMATION

Geodesy and Cartography ◽

10.3846/20296991.2015.1120388 ◽

2015 ◽

Vol 41 (4) ◽

pp. 156-161 ◽

Cited By ~ 1

Author(s):

Žilvinas Stankevičius ◽

Dominykas Šlikas ◽

Darius Popovas

Keyword(s):

Information System ◽

Data Storage ◽

Spatial Data ◽

Construction Projects ◽

Developed Countries ◽

The Other ◽

Topographic Maps ◽

Spatial Objects ◽

Topographic Information ◽

Data Provision

In developed countries the most accurate and reliable spatial data (M 1:500–1:1000) are extensively used. The same spatial object could be inscribed into separate systems: utilities companies have some systems, municipality collected catalogues of CAD data, separately developed real estate map. The same spatial objects are repeated and reiterated, unreasonable costs are incurred for their storage, the customers find it complicated to determine and select the best and appropriate spatial data required just for their own needs. This article suggests the solution of the problem. Authors have introduced the idea to compose and develop information system specialized for topography and infrastructure subsequently to be merged and coordinated. The model for data storage, data provision to the customers and service activities is defined. The available electronic services for the spatial data are described as advantageous for implementation on topographic maps, for inspection and monitoring of construction projects, for the issue of permits of excavation works and for the other activities.

Download Full-text

Research on Construction of Visual Platform of Beijing Power Grid Based on Multi-Technology Fusion

Applied Mechanics and Materials ◽

10.4028/www.scientific.net/amm.608-609.928 ◽

2014 ◽

Vol 608-609 ◽

pp. 928-932

Author(s):

Dong Ya Jin

Keyword(s):

Data Storage ◽

Spatial Data ◽

Power Distribution ◽

Spatial Information ◽

Power Transmission ◽

Power Grid ◽

Three Dimensional ◽

Visual Display ◽

Decision Makers ◽

Control Measures

The platform uses three-dimensional data modeling, visual simulation and spatial data storage to make the business of regulation center, operation and maintenance center and marketing and management center of Beijing Power grid implement visualized operation, and load the spatial information data, equipment data and operation data of Beijing power grid into the system platform, and the data is displayed with the form of graphic or image, which not only realizes managing space resource data in real three-dimensional scene, but also make the system operator to know the operation state of the system directly, and makes the control measures more effective. And the paper uses virtual reality technology to establish visual scene of ground to realize integrated visual display of power transformation, power transmission and power distribution, which not only makes the producers, managers and decision makers directly master the situation of production line in power station, but also realizes that producers and managers affiliate decision makers to formulate production plan.

Download Full-text