scholarly journals HiBuffer: Buffer Analysis of 10-Million-Scale Spatial Data in Real Time

2018 ◽  
Vol 7 (12) ◽  
pp. 467 ◽  
Author(s):  
Mengyu Ma ◽  
Ye Wu ◽  
Wenze Luo ◽  
Luo Chen ◽  
Jun Li ◽  
...  
Keyword(s):  
Real Time ◽  
Spatial Data ◽  
High Performance ◽  
Large Scale ◽  
Computation Time ◽  
Buffer Analysis ◽  
Data Volume ◽  
Time Buffer ◽  
Real World Datasets ◽  
Spatial Indexes

Buffer analysis, a fundamental function in a geographic information system (GIS), identifies areas by the surrounding geographic features within a given distance. Real-time buffer analysis for large-scale spatial data remains a challenging problem since the computational scales of conventional data-oriented methods expand rapidly with increasing data volume. In this paper, we introduce HiBuffer, a visualization-oriented model for real-time buffer analysis. An efficient buffer generation method is proposed which introduces spatial indexes and a corresponding query strategy. Buffer results are organized into a tile-pyramid structure to enable stepless zooming. Moreover, a fully optimized hybrid parallel processing architecture is proposed for the real-time buffer analysis of large-scale spatial data. Experiments using real-world datasets show that our approach can reduce computation time by up to several orders of magnitude while preserving superior visualization effects. Additional experiments were conducted to analyze the influence of spatial data density, buffer radius, and request rate on HiBuffer performance, and the results demonstrate the adaptability and stability of HiBuffer. The parallel scalability of HiBuffer was also tested, showing that HiBuffer achieves high performance of parallel acceleration. Experimental results verify that HiBuffer is capable of handling 10-million-scale data.

scholarly journals Interactive and Online Buffer-Overlay Analytics of Large-Scale Spatial Data

2019 ◽  
Vol 8 (1) ◽  
pp. 21 ◽  
Author(s):  
Mengyu Ma ◽  
Ye Wu ◽  
Luo Chen ◽  
Jun Li ◽  
Ning Jing
Keyword(s):  
Real Time ◽  
Spatial Data ◽  
Large Scale ◽  
Optimization Method ◽  
Spatial Index ◽  
Overlay Analysis ◽  
Analysis Model ◽  
Time Buffer ◽  
Real World Datasets ◽  
Processing Architecture

Buffer and overlay analysis are fundamental operations which are widely used in Geographic Information Systems (GIS) for resource allocation, land planning, and other relevant fields. Real-time buffer and overlay analysis for large-scale spatial data remains a challenging problem because the computational scales of conventional data-oriented methods expand rapidly with data volumes. In this paper, we present HiBO, a visualization-oriented buffer-overlay analysis model which is less sensitive to data volumes. In HiBO, the core task is to determine the value of pixels for display. Therefore, we introduce an efficient spatial-index-based buffer generation method and an effective set-transformation-based overlay optimization method. Moreover, we propose a fully optimized hybrid-parallel processing architecture to ensure the real-time capability of HiBO. Experiments on real-world datasets show that our approach is capable of handling ten-million-scale spatial data in real time. An online demonstration of HiBO is provided (http://www.higis.org.cn: 8080/hibo).

Towards A Multi-FPGA Infrared Simulator

2007 ◽  
Vol 4 (4) ◽  
pp. 343-355 ◽  
Author(s):  
Vinay Sriram ◽  
David Kearney
Keyword(s):  
Homeland Security ◽  
Reconfigurable Computing ◽  
High Speed ◽  
High Performance ◽  
Large Scale ◽  
Computation Time ◽  
Ccd Camera ◽  
Hardware Acceleration ◽  
Limiting Factor ◽  
Scene Simulation

High speed infrared (IR) scene simulation is used extensively in defense and homeland security to test sensitivity of IR cameras and accuracy of IR threat detection and tracking algorithms used commonly in IR missile approach warning systems (MAWS). A typical MAWS requires an input scene rate of over 100 scenes/second. Infrared scene simulations typically take 32 minutes to simulate a single IR scene that accounts for effects of atmospheric turbulence, refraction, optical blurring and charge-coupled device (CCD) camera electronic noise on a Pentium 4 (2.8GHz) dual core processor [7]. Thus, in IR scene simulation, the processing power of modern computers is a limiting factor. In this paper we report our research to accelerate IR scene simulation using high performance reconfigurable computing. We constructed a multi Field Programmable Gate Array (FPGA) hardware acceleration platform and accelerated a key computationally intensive IR algorithm over the hardware acceleration platform. We were successful in reducing the computation time of IR scene simulation by over 36%. This research acts as a unique case study for accelerating large scale defense simulations using a high performance multi-FPGA reconfigurable computer.

scholarly journals Space-time clustering-based method to optimize shareability in real-time ride-sharing

PLoS ONE ◽  
2022 ◽  
Vol 17 (1) ◽  
pp. e0262499
Author(s):  
Negin Alisoltani ◽  
Mostafa Ameli ◽  
Mahdi Zargayouna ◽  
Ludovic Leclercq
Keyword(s):  
Real Time ◽  
Large Scale ◽  
Computation Time ◽  
Clustering Method ◽  
Matching Problem ◽  
Solution Quality ◽  
Mobility Service ◽  
Ride Sharing ◽  
Large Scale Problems ◽  
Spatio Temporal

Real-time ride-sharing has become popular in recent years. However, the underlying optimization problem for this service is highly complex. One of the most critical challenges when solving the problem is solution quality and computation time, especially in large-scale problems where the number of received requests is huge. In this paper, we rely on an exact solving method to ensure the quality of the solution, while using AI-based techniques to limit the number of requests that we feed to the solver. More precisely, we propose a clustering method based on a new shareability function to put the most shareable trips inside separate clusters. Previous studies only consider Spatio-temporal dependencies to do clustering on the mobility service requests, which is not efficient in finding the shareable trips. Here, we define the shareability function to consider all the different sharing states for each pair of trips. Each cluster is then managed with a proposed heuristic framework in order to solve the matching problem inside each cluster. As the method favors sharing, we present the number of sharing constraints to allow the service to choose the number of shared trips. To validate our proposal, we employ the proposed method on the network of Lyon city in France, with half-million requests in the morning peak from 6 to 10 AM. The results demonstrate that the algorithm can provide high-quality solutions in a short time for large-scale problems. The proposed clustering method can also be used for different mobility service problems such as car-sharing, bike-sharing, etc.

scholarly journals Digital matter as interdisciplinary commodity

2017 ◽  
Vol 2 (3) ◽  
pp. 103
Author(s):  
Uwe Rieger
Keyword(s):  
Real Time ◽  
Spatial Data ◽  
Architectural Design ◽  
Large Scale ◽  
Mixed Reality ◽  
Digital Fabrication ◽  
Digital Information ◽  
Design Environment ◽  
Digital World ◽  
Starting Point

<p>With the current exponential growth in the sector of Spatial Data Technology and Mixed Reality display devises we experience an increasing overlap of the physical and digital world. Next to making data spatially visible the attempt is to connect digital information with physical properties. Over the past years a number of research institutions have been laying the ground for these developments. In contemporary architecture architectural design the dominant application of data technology is connected to graphical presentation, form finding and digital fabrication.<br />The <em>arc/sec Lab for Digital Spatial Operations </em>at the University of Auckland takes a further step. The Lab explores concepts for a new condition of buildings and urban patterns in which digital information is connected with spatial appearance and linked to material properties. The approach focuses on the step beyond digital re-presentation and digital fabrication, where data is re-connected to the multi-sensory human perceptions and physical skills. The work at the Lab is conducted in a cross disciplinary design environment and based on experiential investigations. The arc/sec Lab utilizes large-scale interactive installations as the driving vehicle for the exploration and communication of new dimensions in architectural space. The experiments are aiming to make data “touchable” and to demonstrate real time responsive environments. In parallel they are the starting point for both the development of practice oriented applications and speculation on how our cities and buildings might change in the future.<br />The article gives an overview of the current experiments being undertaken at the arc/sec Lab. It discusses how digital technologies allow for innovation between the disciplines by introducing real time adaptive behaviours to our build environment and it speculates on the type of spaces we can construct when <em>digital matter </em>is used as a new dynamic building material.</p>

scholarly journals AstroCatR: a mechanism and tool for efficient time series reconstruction of large-scale astronomical catalogues

2020 ◽  
Vol 496 (1) ◽  
pp. 629-637
Author(s):  
Ce Yu ◽  
Kun Li ◽  
Shanjiang Tang ◽  
Chao Sun ◽  
Bin Ma ◽  
...  
Keyword(s):  
Time Series ◽  
High Performance ◽  
Large Scale ◽  
Extrasolar Planets ◽  
Time Series Data ◽  
Series Data ◽  
Data Sets ◽  
Observation Data ◽  
Data Volume ◽  
And Performance

ABSTRACT Time series data of celestial objects are commonly used to study valuable and unexpected objects such as extrasolar planets and supernova in time domain astronomy. Due to the rapid growth of data volume, traditional manual methods are becoming extremely hard and infeasible for continuously analysing accumulated observation data. To meet such demands, we designed and implemented a special tool named AstroCatR that can efficiently and flexibly reconstruct time series data from large-scale astronomical catalogues. AstroCatR can load original catalogue data from Flexible Image Transport System (FITS) files or data bases, match each item to determine which object it belongs to, and finally produce time series data sets. To support the high-performance parallel processing of large-scale data sets, AstroCatR uses the extract-transform-load (ETL) pre-processing module to create sky zone files and balance the workload. The matching module uses the overlapped indexing method and an in-memory reference table to improve accuracy and performance. The output of AstroCatR can be stored in CSV files or be transformed other into formats as needed. Simultaneously, the module-based software architecture ensures the flexibility and scalability of AstroCatR. We evaluated AstroCatR with actual observation data from The three Antarctic Survey Telescopes (AST3). The experiments demonstrate that AstroCatR can efficiently and flexibly reconstruct all time series data by setting relevant parameters and configuration files. Furthermore, the tool is approximately 3× faster than methods using relational data base management systems at matching massive catalogues.

Visualising large-scale geodynamic simulations: How to Dive into Earth's Mantle with Virtual Reality

2020 ◽  
Author(s):  
Markus Wiedemann ◽  
Bernhard S.A. Schuberth ◽  
Lorenzo Colli ◽  
Hans-Peter Bunge ◽  
Dieter Kranzlmüller
Keyword(s):  
Virtual Reality ◽  
Real Time ◽  
High Performance ◽  
Large Scale ◽  
Large Data ◽  
Optimization Techniques ◽  
Physical Parameters ◽  
Mantle Flow ◽  
Data Set ◽  
Precise Knowledge

&lt;p&gt;Precise knowledge of the forces acting at the base of tectonic plates is of fundamental importance, but models of mantle dynamics are still often qualitative in nature to date. One particular problem is that we cannot access the deep interior of our planet and can therefore not make direct in situ measurements of the relevant physical parameters. Fortunately, modern software and powerful high-performance computing infrastructures allow us to generate complex three-dimensional models of the time evolution of mantle flow through large-scale numerical simulations.&lt;/p&gt;&lt;p&gt;In this project, we aim at visualizing the resulting convective patterns that occur thousands of kilometres below our feet and to make them &quot;accessible&quot; using high-end virtual reality techniques.&lt;/p&gt;&lt;p&gt;Models with several hundred million grid cells are nowadays possible using the modern supercomputing facilities, such as those available at the Leibniz Supercomputing Centre. These models provide quantitative estimates on the inaccessible parameters, such as buoyancy and temperature, as well as predictions of the associated gravity field and seismic wavefield that can be tested against Earth observations.&lt;/p&gt;&lt;p&gt;3-D visualizations of the computed physical parameters allow us to inspect the models such as if one were actually travelling down into the Earth. This way, convective processes that occur thousands of kilometres below our feet are virtually accessible by combining the simulations with high-end VR techniques.&lt;/p&gt;&lt;p&gt;The large data set used here poses severe challenges for real time visualization, because it cannot fit into graphics memory, while requiring rendering with strict deadlines. This raises the necessity to balance the amount of displayed data versus the time needed for rendering it.&lt;/p&gt;&lt;p&gt;As a solution, we introduce a rendering framework and describe our workflow that allows us to visualize this geoscientific dataset. Our example exceeds 16 TByte in size, which is beyond the capabilities of most visualization tools. To display this dataset in real-time, we reduce and declutter the dataset through isosurfacing and mesh optimization techniques.&lt;/p&gt;&lt;p&gt;Our rendering framework relies on multithreading and data decoupling mechanisms that allow to upload data to graphics memory while maintaining high frame rates. The final visualization application can be executed in a CAVE installation as well as on head mounted displays such as the HTC Vive or Oculus Rift. The latter devices will allow for viewing our example on-site at the EGU conference.&lt;/p&gt;

scholarly journals Review on Real Time Background Extraction: Models, Applications, Environments, Challenges and Evaluation Approaches

2021 ◽  
Vol 17 (02) ◽  
pp. 37
Author(s):  
Maryam A. Yasir ◽  
Yossra Hussain Ali
Keyword(s):  
Real Time ◽  
High Performance ◽  
Performance Metrics ◽  
Computation Time ◽  
Background Extraction ◽  
Accurate Performance ◽  
Real Time Applications ◽  
Conventional Models ◽  
Evaluation Approaches ◽  
Extraction Model

<p>In the computer vision, background extraction is a promising technique. It is characterized by being applied in many different real time applications in diverse environments and with variety of challenges. Background extraction is the most popular technique employed in the domain of detecting moving foreground objects taken by stationary surveillance cameras. Achieving high performance is required with many perspectives and demands. Choosing the suitable background extraction model plays the major role in affecting the performance matrices of time, memory, and accuracy.</p><p>In this article we present an extensive review on background extraction in which we attempt to cover all the related topics. We list the four process stages of background extraction and we consider several well-known models starting with the conventional models and ending up with the state-of-the art models. This review also focuses on the model environments whether it is human activities, Nature or sport environments and illuminates on some of the real time applications where background extraction method is adopted. Many challenges are addressed in respect to environment, camera, foreground objects, background, and computation time. </p><p>In addition, this article provides handy tables containing different common datasets and libraries used in the field of background extraction experiments. Eventually, we illustrate the performance evaluation with a table of the set performance metrics to measure the robustness of the background extraction model against other models in terms of time, accurate performance and required memory.</p>

scholarly journals Real-time Analysis of City Scale Transportation Networks in New Orleans Metropolitan Area using an Agent Based Model Approach

2019 ◽  
Vol 271 ◽  
pp. 06007
Author(s):  
Millard McElwee ◽  
Bingyu Zhao ◽  
Kenichi Soga
Keyword(s):  
New Orleans ◽  
Real Time ◽  
High Performance ◽  
Large Scale ◽  
Transportation Networks ◽  
Transportation Network ◽  
Regional Scale ◽  
Agent Based Model ◽  
Agent Based ◽  
Real Time Analysis

The primary focus of this research is to develop and implement an agent-based model (ABM) to analyze the New Orleans Metropolitan transportation network near real-time. ABMs have grown in popularity because of their ability to analyze multifaceted community scale resilience with hundreds of thousands of links and millions of agents. Road closures and reduction in capacities are examples of influences on the weights or removal of edges which can affect the travel time, speed, and route of agents in the transportation model. Recent advances in high-performance computing (HPC) have made modeling networks on the city scale much less computationally intensive. We introduce an open-source ABM which utilizes parallel distributed computing to enable faster convergence to large scale problems. We simulate 50,000 agents on the entire southeastern Louisiana road network and part of Mississippi as well. This demonstrates the capability to simulate both city and regional scale transportation networks near real time.

scholarly journals Real-time interactive simulations of large-scale systems on personal computers and cell phones: Toward patient-specific heart modeling and other applications

2019 ◽  
Vol 5 (3) ◽  
pp. eaav6019 ◽  
Author(s):  
Abouzar Kaboudian ◽  
Elizabeth M. Cherry ◽  
Flavio H. Fenton
Keyword(s):  
Real Time ◽  
High Performance ◽  
Large Scale ◽  
Personal Computers ◽  
Patient Specific ◽  
Dynamics Modeling ◽  
Large Scale Systems ◽  
Simulation Tools ◽  
Cardiac Dynamics ◽  
Research And Education

Cardiac dynamics modeling has been useful for studying and treating arrhythmias. However, it is a multiscale problem requiring the solution of billions of differential equations describing the complex electrophysiology of interconnected cells. Therefore, large-scale cardiac modeling has been limited to groups with access to supercomputers and clusters. Many areas of computational science face similar problems where computational costs are too high for personal computers so that supercomputers or clusters currently are necessary. Here, we introduce a new approach that makes high-performance simulation of cardiac dynamics and other large-scale systems like fluid flow and crystal growth accessible to virtually anyone with a modest computer. For cardiac dynamics, this approach will allow not only scientists and students but also physicians to use physiologically accurate modeling and simulation tools that are interactive in real time, thereby making diagnostics, research, and education available to a broader audience and pushing the boundaries of cardiac science.

scholarly journals Vertical MEMS Resonators for Real-Time Clock Applications

2010 ◽  
Vol 2010 ◽  
pp. 1-5 ◽  
Author(s):  
A. Pomarico ◽  
A. Morea ◽  
P. Flora ◽  
G. Roselli ◽  
E. Lasalandra
Keyword(s):  
Real Time ◽  
High Performance ◽  
Large Scale ◽  
Low Cost ◽  
Frequency Stability ◽  
Equivalent Resistance ◽  
Real Time Clock ◽  
Mems Resonator ◽  
Mems Resonators ◽  
Frequency Tunable

MEMS resonators are today widely investigated as a desirable alternative to quartz resonators in real-time clock applications, because of their low-cost, integration capability properties. Nevertheless, MEMS resonators performances are still not competitive, especially in terms of frequency stability and device equivalent resistance (and, then, power consumption). We propose a new structure for a MEMS resonator, with a vertical-like transduction mechanism, which exhibits promising features. The vertical resonator can be fabricated with the low-cost, high performance THELMA technology, and it is designed to be efficiently frequency tunable. With respect to the commonly investigated lateral resonators, it is expected to have lower equivalent resistances and improved large-scale repeatability characteristics.

Sign in / Sign up

Export Citation Format

Share Document