scholarly journals Managing large multidimensional hydrologic datasets: A case study comparing NetCDF and SciDB

2018 ◽  
Vol 20 (5) ◽  
pp. 1058-1070
Author(s):  
Haicheng Liu ◽  
Peter van Oosterom ◽  
Theo Tijssen ◽  
Tom Commandeur ◽  
Wen Wang

Abstract Management of large hydrologic datasets including storage, structuring, clustering, indexing, and query is one of the crucial challenges in the era of big data. This research originates from a specific problem: time series extraction at specific locations takes a long time when a large multidimensional (MD) dataset is stored in the NetCDF classic or the 64-bit offset format. The essence of this issue lies in the contiguous storage structure adopted by NetCDF. In this research, NetCDF file-based solutions and a MD array database management system applying a chunked storage structure are benchmarked to determine the best solution for storing and querying large MD hydrologic datasets. Expert consultancy was conducted to establish benchmark sets, with the HydroNET-4 system being utilized to provide the benchmark environment. In the final benchmark tests, the effect of data storage configurations, elaborating chunk size, dimension order (spatio-temporal clustering) and compression on the query performance, is explored. Results indicate that for big hydrologic MD data management, the properly chunked NetCDF-4 solution without compression is, in general, more efficient than the SciDB DBMS. However, benefits of a DBMS should not be neglected, for example, the integration with other data types, smart caching strategies, transaction support, scalability, and out-of-the-box support for parallelization.

1987 ◽  
Vol 26 (02) ◽  
pp. 73-76 ◽  
Author(s):  
Kathryn Rowan ◽  
P. Byass ◽  
R. W. Snow

SummaryThis paper reports on a computerised approach to the management of an epidemiological field trial, which aimed at determining the effects of insecticide-impregnated bed nets on the incidence of malaria in children. The development of a data system satisfying the requirements of the project and its implementation using a database management system are discussed. The advantages of this method of management in terms of rapid processing of and access to data from the study are described, together with the completion rates and error rates observed in data collection.


2019 ◽  
Vol 28 (7) ◽  
pp. 1863-1883 ◽  
Author(s):  
Agustín Molina Sánchez ◽  
Patricia Delgado ◽  
Antonio González-Rodríguez ◽  
Clementina González ◽  
A. Francisco Gómez-Tagle Rojas ◽  
...  

Author(s):  
Álvaro Briz-Redón ◽  
Adina Iftimi ◽  
Juan Francisco Correcher ◽  
Jose De Andrés ◽  
Manuel Lozano ◽  
...  

GeoJournal ◽  
2021 ◽  
Author(s):  
R. Nasiri ◽  
S. Akbarpour ◽  
AR. Zali ◽  
N. Khodakarami ◽  
MH. Boochani ◽  
...  

2021 ◽  
Vol 12 (1) ◽  
pp. 18
Author(s):  
Lennart Adenaw ◽  
Markus Lienkamp

In order to electrify the transport sector, scores of charging stations are needed to incentivize people to buy electric vehicles. In urban areas with a high charging demand and little space, decision-makers are in need of planning tools that enable them to efficiently allocate financial and organizational resources to the promotion of electromobility. As with many other city planning tasks, simulations foster successful decision-making. This article presents a novel agent-based simulation framework for urban electromobility aimed at the analysis of charging station utilization and user behavior. The approach presented here employs a novel co-evolutionary learning model for adaptive charging behavior. The simulation framework is tested and verified by means of a case study conducted in the city of Munich. The case study shows that the presented approach realistically reproduces charging behavior and spatio-temporal charger utilization.


2021 ◽  
pp. 1-16
Author(s):  
CAN ZHOU ◽  
NIGEL BROTHERS

Summary The incidental mortality of seabirds in fisheries remains a serious global concern. Obtaining unbiased and accurate estimates of bycatch rates is a priority for seabird bycatch mitigation and demographic research. For measuring the capture risk of seabird interactions in fisheries, the rate of carcass retrieval from hauled gear is commonly used. However, reliability can be limited by a lack of direct capture observations and the substantial pre-haul bycatch losses known to occur, meaning incidence of seabird bycatch is underestimated. To solve this problem, a new measure (bycatch vulnerability) that links an observed interaction directly to the underlying capture event is proposed to represent the capture risk of fishery interactions by seabirds. The new measure is not affected by subsequent bycatch loss. To illustrate how to estimate and analyse bycatch vulnerability, a case study based on a long-term dataset of seabird interactions and capture confirmation is provided. Bayesian modelling and hypothesis testing were conducted to identify important bycatch risk factors. Competition was found to play a central role in determining seabird bycatch vulnerability. More competitive environments were riskier for seabirds, and larger and thus more competitive species were more at risk than smaller sized and less competitive species. Species foraging behaviour also played a role. On the other hand, no additional effect of physical oceanic condition and spatio-temporal factors on bycatch vulnerability was detected. Bycatch vulnerability is recommended as a replacement for the commonly used bycatch rate or carcass retrieval rate to measure the capture risk of an interaction. Combined with a normalized contact rate, bycatch vulnerability offers an unbiased estimate of seabird bycatch rate in pelagic longline fisheries.


SATS ◽  
2021 ◽  
Vol 0 (0) ◽  
Author(s):  
Nivedita Gangopadhyay ◽  
Alois Pichler

Abstract Our linguistic communication often takes the form of creating texts. In this paper, we propose that creating texts or ‘texting’ is a form of joint action. We examine the nature and evolution of this joint action. We argue that creating texts ushers in a special type of joint action, which, while lacking some central features of normal, everyday joint actions such as spatio-temporal collocation of agency and embodiment, nonetheless results in an authentic, strong, and unique type of joint action agency. This special type of agency is already present in creating texts in general and is further augmented in creating texts through digital media. We propose that such a unique type of joint action agency has a transformative effect on the experience of our sense of agency and subjectivity. We conclude with the implications of the proposal for social cognition and social agency. The paper combines research in philosophy of mind with the emerging fields of digital humanities and text technology.


2021 ◽  
Vol 9 (4) ◽  
pp. 422
Author(s):  
Alessio Innocenti ◽  
Miguel Onorato ◽  
Carlo Brandini

Extreme sea waves, although rare, can be notably dangerous when associated with energetic sea states and can generate risks for the navigation. In the last few years, they have been the object of extensive research from the scientific community that helped with understanding the main physical aspects; however, the estimate of extreme waves probability in operational forecasts is still debated. In this study, we analyzed a number of sea-states that occurred in a precise area of the Mediterranean sea, near the location of a reported accident, with the objective of relating the probability of extreme events with different sea state conditions. For this purpose, we performed phase-resolving simulations of wave spectra obtained from a WaveWatch III hindcast, using a Higher Order Spectral Method. We produced statistics of the sea-surface elevation field, calculating crest distributions and the probability of extreme events from the analysis of a long time-series of the surface elevation. We found a good matching between the distributions of the numerically simulated field and theory, namely Tayfun second- and third- order ones, in contrast with a significant underestimate given by the Rayleigh distribution. We then related spectral quantities like angular spreading and wave steepness to the probability of occurrence of extreme events finding an enhanced probability for high mean steepness seas and narrow spectra, in accordance with literature results, finding also that the case study of the reported accident was not amongst the most dangerous. Finally, we related the skewness and kurtosis of the surface elevation to the wave steepness to explain the discrepancy between theoretical and numerical distributions.


Sign in / Sign up

Export Citation Format

Share Document