scholarly journals An Efficient Group-Based Replica Placement Policy for Large-Scale Geospatial 3D Raster Data on Hadoop

Sensors ◽  
2021 ◽  
Vol 21 (23) ◽  
pp. 8132
Author(s):  
Zhipeng Liu ◽  
Weihua Hua ◽  
Xiuguo Liu ◽  
Dong Liang ◽  
Yabo Zhao ◽  
...  
Keyword(s):  
Data Exchange ◽  
Large Scale ◽  
Three Dimensional ◽  
Group Scheme ◽  
Replica Placement ◽  
Climate Data ◽  
Raster Data ◽  
Placement Policy ◽  
Spatio Temporal ◽  
Network Overhead

Geospatial three-dimensional (3D) raster data have been widely used for simple representations and analysis, such as geological models, spatio-temporal satellite data, hyperspectral images, and climate data. With the increasing requirements of resolution and accuracy, the amount of geospatial 3D raster data has grown exponentially. In recent years, the processing of large raster data using Hadoop has gained popularity. However, data uploaded to Hadoop are randomly distributed onto datanodes without consideration of the spatial characteristics. As a result, the direct processing of geospatial 3D raster data produces a massive network data exchange among the datanodes and degrades the performance of the cluster. To address this problem, we propose an efficient group-based replica placement policy for large-scale geospatial 3D raster data, aiming to optimize the locations of the replicas in the cluster to reduce the network overhead. An overlapped group scheme was designed for three replicas of each file. The data in each group were placed in the same datanode, and different colocation patterns for three replicas were implemented to further reduce the communication between groups. The experimental results show that our approach significantly reduces the network overhead during data acquisition for 3D raster data in the Hadoop cluster, and maintains the Hadoop replica placement requirements.

scholarly journals A TENSOR BASED FRAMEWORK FOR LARGE SCALE SPATIO-TEMPORAL RASTER DATA PROCESSING

2019 ◽  
Vol XLII-4/W14 ◽  
pp. 3-9
Author(s):  
S. Bhattacharya ◽  
C. Braun ◽  
U. Leopold
Keyword(s):  
Large Scale ◽  
Solar Irradiation ◽  
Raster Data ◽  
Fine Grained ◽  
Multiple Dimensions ◽  
Proposed Model ◽  
Spatio Temporal ◽  
Using Data ◽  
Tensor Data ◽  
Flow Graphs

Abstract. In this paper, we address the curse of dimensionality and scalability issues while managing vast volumes of multidimensional raster data in the renewable energy modeling process in an appropriate spatial and temporal context. Tensor representation provides a convenient way to capture inter-dependencies along multiple dimensions. In this direction, we propose a sophisticated way of handling large-scale multi-layered spatio-temporal data, adopted for raster-based geographic information systems (GIS). We chose Tensorflow, an open source software library developed by Google using data flow graphs, and the tensor data structure. We provide a comprehensive performance evaluation of the proposed model against r.sun in GRASS GIS. Benchmarking shows that the tensor-based approach outperforms by up to 60%, concerning overall execution time for high-resolution datasets and fine-grained time intervals for daily sums of solar irradiation [Wh.m-2.day-1].

scholarly journals Documentary data and the study of past droughts: a global state of the art

2018 ◽  
Vol 14 (12) ◽  
pp. 1915-1960 ◽  
Author(s):  
Rudolf Brázdil ◽  
Andrea Kiss ◽  
Jürg Luterbacher ◽  
David J. Nash ◽  
Ladislava Řezníčková
Keyword(s):  
Large Scale ◽  
State Of The Art ◽  
Drought Indices ◽  
Documentary Evidence ◽  
Climatic Trends ◽  
Instrumental Observations ◽  
Spatio Temporal ◽  
Epigraphic Evidence ◽  
Administrative Evidence

Abstract. The use of documentary evidence to investigate past climatic trends and events has become a recognised approach in recent decades. This contribution presents the state of the art in its application to droughts. The range of documentary evidence is very wide, including general annals, chronicles, memoirs and diaries kept by missionaries, travellers and those specifically interested in the weather; records kept by administrators tasked with keeping accounts and other financial and economic records; legal-administrative evidence; religious sources; letters; songs; newspapers and journals; pictographic evidence; chronograms; epigraphic evidence; early instrumental observations; society commentaries; and compilations and books. These are available from many parts of the world. This variety of documentary information is evaluated with respect to the reconstruction of hydroclimatic conditions (precipitation, drought frequency and drought indices). Documentary-based drought reconstructions are then addressed in terms of long-term spatio-temporal fluctuations, major drought events, relationships with external forcing and large-scale climate drivers, socio-economic impacts and human responses. Documentary-based drought series are also considered from the viewpoint of spatio-temporal variability for certain continents, and their employment together with hydroclimate reconstructions from other proxies (in particular tree rings) is discussed. Finally, conclusions are drawn, and challenges for the future use of documentary evidence in the study of droughts are presented.

scholarly journals Climate drivers of plague epidemiology in British India, 1898–1949

2020 ◽  
Vol 287 (1928) ◽  
pp. 20200538
Author(s):  
Warren S. D. Tennant ◽  
Mike J. Tildesley ◽  
Simon E. F. Spencer ◽  
Matt J. Keeling
Keyword(s):  
Predictive Models ◽  
Control Measures ◽  
Climate Data ◽  
British India ◽  
Middle Income ◽  
Middle Income Countries ◽  
Complex Interactions ◽  
The World ◽  
Spatio Temporal

Plague, caused by Yersinia pestis infection, continues to threaten low- and middle-income countries throughout the world. The complex interactions between rodents and fleas with their respective environments challenge our understanding of human plague epidemiology. Historical long-term datasets of reported plague cases offer a unique opportunity to elucidate the effects of climate on plague outbreaks in detail. Here, we analyse monthly plague deaths and climate data from 25 provinces in British India from 1898 to 1949 to generate insights into the influence of temperature, rainfall and humidity on the occurrence, severity and timing of plague outbreaks. We find that moderate relative humidity levels of between 60% and 80% were strongly associated with outbreaks. Using wavelet analysis, we determine that the nationwide spread of plague was driven by changes in humidity, where, on average, a one-month delay in the onset of rising humidity translated into a one-month delay in the timing of plague outbreaks. This work can inform modern spatio-temporal predictive models for the disease and aid in the development of early-warning strategies for the deployment of prophylactic treatments and other control measures.

scholarly journals A Review on Additive Manufacturing Possibilities for Electrical Machines

Energies ◽  
2021 ◽  
Vol 14 (7) ◽  
pp. 1940
Author(s):  
Muhammad Usman Naseer ◽  
Ants Kallaste ◽  
Bilal Asad ◽  
Toomas Vaimann ◽  
Anton Rassõlkin
Keyword(s):  
Additive Manufacturing ◽  
Large Scale ◽  
Three Dimensional ◽  
Electrical Machines ◽  
Electromagnetic Properties ◽  
Scale Production ◽  
Performance Parameters ◽  
Large Scale Production ◽  
One Step ◽  
Manufacturing Techniques

This paper presents current research trends and prospects of utilizing additive manufacturing (AM) techniques to manufacture electrical machines. Modern-day machine applications require extraordinary performance parameters such as high power-density, integrated functionalities, improved thermal, mechanical & electromagnetic properties. AM offers a higher degree of design flexibility to achieve these performance parameters, which is impossible to realize through conventional manufacturing techniques. AM has a lot to offer in every aspect of machine fabrication, such that from size/weight reduction to the realization of complex geometric designs. However, some practical limitations of existing AM techniques restrict their utilization in large scale production industry. The introduction of three-dimensional asymmetry in machine design is an aspect that can be exploited most with the prevalent level of research in AM. In order to take one step further towards the enablement of large-scale production of AM-built electrical machines, this paper also discusses some machine types which can best utilize existing developments in the field of AM.

scholarly journals Vibration characteristics of triple-gear-rotor system in compressed air energy storage under variable torque load

2021 ◽  
Vol 104 (1) ◽  
pp. 003685042098705
Author(s):  
Xinran Wang ◽  
Yangli Zhu ◽  
Wen Li ◽  
Dongxu Hu ◽  
Xuehui Zhang ◽  
...  
Keyword(s):  
Large Scale ◽  
Three Dimensional ◽  
Element Model ◽  
Rotor System ◽  
Dynamic Responses ◽  
System Response ◽  
Rotating Speed ◽  
Torque Load ◽  
Set Up ◽  
Two Stages

This paper focuses on the effects of the off-design operation of CAES on the dynamic characteristics of the triple-gear-rotor system. A finite element model of the system is set up with unbalanced excitations, torque load excitations, and backlash which lead to variations of tooth contact status. An experiment is carried out to verify the accuracy of the mathematical model. The results show that when the system is subjected to large-scale torque load lifting at a high rotating speed, it has two stages of relatively strong periodicity when the torque load is light, and of chaotic when the torque load is heavy, with the transition between the two states being relatively quick and violent. The analysis of the three-dimensional acceleration spectrum and the meshing force shows that the variation in the meshing state and the fluctuation of the meshing force is the basic reasons for the variation in the system response with the torque load. In addition, the three rotors in the triple-gear-rotor system studied show a strong similarity in the meshing states and meshing force fluctuations, which result in the similarity in the dynamic responses of the three rotors.

scholarly journals Shell-crossing in a ΛCDM Universe

2020 ◽  
Vol 501 (1) ◽  
pp. L71-L75
Author(s):  
Cornelius Rampf ◽  
Oliver Hahn
Keyword(s):  
Dark Matter ◽  
Perturbation Theory ◽  
Large Scale ◽  
Cold Dark Matter ◽  
Three Dimensional ◽  
Random Initial Data ◽  
Recursion Relations ◽  
Indispensable Tool ◽  
First Time ◽  
Very High

ABSTRACT Perturbation theory is an indispensable tool for studying the cosmic large-scale structure, and establishing its limits is therefore of utmost importance. One crucial limitation of perturbation theory is shell-crossing, which is the instance when cold-dark-matter trajectories intersect for the first time. We investigate Lagrangian perturbation theory (LPT) at very high orders in the vicinity of the first shell-crossing for random initial data in a realistic three-dimensional Universe. For this, we have numerically implemented the all-order recursion relations for the matter trajectories, from which the convergence of the LPT series at shell-crossing is established. Convergence studies performed at large orders reveal the nature of the convergence-limiting singularities. These singularities are not the well-known density singularities at shell-crossing but occur at later times when LPT already ceased to provide physically meaningful results.

Sign in / Sign up

Export Citation Format

Share Document