scholarly journals Department of Energy Project ER25739 Final Report QoS-Enabled, High-performance Storage Systems for Data-Intensive Scientific Computing

2009 ◽  
Author(s):  
Raju Rangaswami
Keyword(s):  
High Performance ◽  
Scientific Computing ◽  
Storage Systems ◽  
Department Of Energy ◽  
Final Report ◽  
Data Intensive

Overview of Big Data-Intensive Storage and its Technologies for Cloud and Fog Computing

2021 ◽  
pp. 112-153
Author(s):  
Richard S. Segall ◽  
Jeffrey S Cook ◽  
Gao Niu
Keyword(s):  
Big Data ◽  
Data Storage ◽  
High Performance ◽  
Storage Systems ◽  
Fog Computing ◽  
Storage Management ◽  
Data Intensive Computing ◽  
Computing Systems ◽  
Application Performance ◽  
Data Intensive

Computing systems are becoming increasingly data-intensive because of the explosion of data and the needs for processing the data, and subsequently storage management is critical to application performance in such data-intensive computing systems. However, if existing resource management frameworks in these systems lack the support for storage management, this would cause unpredictable performance degradation when applications are under input/output (I/O) contention. Storage management of data-intensive systems is a challenge. Big Data plays a most major role in storage systems for data-intensive computing. This article deals with these difficulties along with discussion of High Performance Computing (HPC) systems, background for storage systems for data-intensive applications, storage patterns and storage mechanisms for Big Data, the Top 10 Cloud Storage Systems for data-intensive computing in today's world, and the interface between Big Data Intensive Storage and Cloud/Fog Computing. Big Data storage and its server statistics and usage distributions for the Top 500 Supercomputers in the world are also presented graphically and discussed as data-intensive storage components that can be interfaced with Fog-to-cloud interactions and enabling protocols.

Overview of Big Data-Intensive Storage and its Technologies for Cloud and Fog Computing

2019 ◽  
Vol 2 (1) ◽  
pp. 74-113 ◽  
Author(s):  
Richard S. Segall ◽  
Jeffrey S Cook ◽  
Gao Niu
Keyword(s):  
Big Data ◽  
Data Storage ◽  
High Performance ◽  
Storage Systems ◽  
Fog Computing ◽  
Storage Management ◽  
Data Intensive Computing ◽  
Computing Systems ◽  
Application Performance ◽  
Data Intensive

Computing systems are becoming increasingly data-intensive because of the explosion of data and the needs for processing the data, and subsequently storage management is critical to application performance in such data-intensive computing systems. However, if existing resource management frameworks in these systems lack the support for storage management, this would cause unpredictable performance degradation when applications are under input/output (I/O) contention. Storage management of data-intensive systems is a challenge. Big Data plays a most major role in storage systems for data-intensive computing. This article deals with these difficulties along with discussion of High Performance Computing (HPC) systems, background for storage systems for data-intensive applications, storage patterns and storage mechanisms for Big Data, the Top 10 Cloud Storage Systems for data-intensive computing in today's world, and the interface between Big Data Intensive Storage and Cloud/Fog Computing. Big Data storage and its server statistics and usage distributions for the Top 500 Supercomputers in the world are also presented graphically and discussed as data-intensive storage components that can be interfaced with Fog-to-cloud interactions and enabling protocols.

scholarly journals Key Performance Indicators for an Energy Community Based on Sustainable Technologies

2021 ◽  
Vol 13 (16) ◽  
pp. 8789
Author(s):  
Giovanni Bianco ◽  
Barbara Bonvini ◽  
Stefano Bracco ◽  
Federico Delfino ◽  
Paola Laiolo ◽  
...  
Keyword(s):  
Performance Indicators ◽  
Urban Areas ◽  
High Performance ◽  
Power Plants ◽  
New Technologies ◽  
Storage Systems ◽  
Clean Energy ◽  
Key Performance Indicators ◽  
Energy Performance ◽  
Green Energy

As reported in the “Clean energy for all Europeans package” set by the EU, a sustainable transition from fossil fuels towards cleaner energy is necessary to improve the quality of life of citizens and the livability in cities. The exploitation of renewable sources, the improvement of energy performance in buildings and the need for cutting-edge national energy and climate plans represent important and urgent topics to be faced in order to implement the sustainability concept in urban areas. In addition, the spread of polygeneration microgrids and the recent development of energy communities enable a massive installation of renewable power plants, high-performance small-size cogeneration units, and electrical storage systems; moreover, properly designed local energy production systems make it possible to optimize the exploitation of green energy sources and reduce both energy supply costs and emissions. In the present paper, a set of key performance indicators is introduced in order to evaluate and compare different energy communities both from a technical and environmental point of view. The proposed methodology was used in order to assess and compare two sites characterized by the presence of sustainable energy infrastructures: the Savona Campus of the University of Genoa in Italy, where a polygeneration microgrid has been in operation since 2014 and new technologies will be installed in the near future, and the SPEED2030 District, an urban area near the Campus where renewable energy power plants (solar and wind), cogeneration units fed by hydrogen and storage systems are planned to be installed.

Beyond MPI

2021 ◽  
Vol 49 (4) ◽  
pp. 12-17
Author(s):  
Feilong Liu ◽  
Claude Barthels ◽  
Spyros Blanas ◽  
Hideaki Kimura ◽  
Garret Swart
Keyword(s):  
High Performance ◽  
Processing System ◽  
Complex Interaction ◽  
Remote Memory ◽  
Interaction Patterns ◽  
Round Trip ◽  
Data Processing System ◽  
Data Intensive ◽  
Multiple Round ◽  
Programming Interface

Networkswith Remote DirectMemoryAccess (RDMA) support are becoming increasingly common. RDMA, however, offers a limited programming interface to remote memory that consists of read, write and atomic operations. With RDMA alone, completing the most basic operations on remote data structures often requires multiple round-trips over the network. Data-intensive systems strongly desire higher-level communication abstractions that supportmore complex interaction patterns. A natural candidate to consider is MPI, the de facto standard for developing high-performance applications in the HPC community. This paper critically evaluates the communication primitives of MPI and shows that using MPI in the context of a data processing system comes with its own set of insurmountable challenges. Based on this analysis, we propose a new communication abstraction named RDMO, or Remote DirectMemory Operation, that dispatches a short sequence of reads, writes and atomic operations to remote memory and executes them in a single round-trip.

Ultrahigh energy storage and ultrafast ion diffusion in borophene-based anodes for rechargeable metal ion batteries

2017 ◽  
Vol 5 (5) ◽  
pp. 2328-2338 ◽  
Author(s):  
Dewei Rao ◽  
Lingyan Zhang ◽  
Zhaoshun Meng ◽  
Xirui Zhang ◽  
Yunhui Wang ◽  
...  
Keyword(s):  
Energy Storage ◽  
Metal Ion ◽  
High Performance ◽  
Storage Systems ◽  
Ultrahigh Energy ◽  
Ion Diffusion ◽  
Energy Storage Systems ◽  
Increasing Demand

Since the turn of the new century, the increasing demand for high-performance energy storage systems has generated considerable interest in rechargeable ion batteries.

scholarly journals Compiler-directed scratchpad memory data transfer optimization for multithreaded applications on a heterogeneous many-core architecture

2021 ◽  
Author(s):  
Xiaohan Tao ◽  
Jianmin Pang ◽  
Jinlong Xu ◽  
Yu Zhu
Keyword(s):  
Energy Consumption ◽  
High Performance ◽  
Scientific Computing ◽  
Data Transfer ◽  
Performance Model ◽  
Experimental Result ◽  
Transfer Model ◽  
Scratchpad Memory ◽  
On Chip ◽  
Many Core

AbstractThe heterogeneous many-core architecture plays an important role in the fields of high-performance computing and scientific computing. It uses accelerator cores with on-chip memories to improve performance and reduce energy consumption. Scratchpad memory (SPM) is a kind of fast on-chip memory with lower energy consumption compared with a hardware cache. However, data transfer between SPM and off-chip memory can be managed only by a programmer or compiler. In this paper, we propose a compiler-directed multithreaded SPM data transfer model (MSDTM) to optimize the process of data transfer in a heterogeneous many-core architecture. We use compile-time analysis to classify data accesses, check dependences and determine the allocation of data transfer operations. We further present the data transfer performance model to derive the optimal granularity of data transfer and select the most profitable data transfer strategy. We implement the proposed MSDTM on the GCC complier and evaluate it on Sunway TaihuLight with selected test cases from benchmarks and scientific computing applications. The experimental result shows that the proposed MSDTM improves the application execution time by 5.49$$\times$$ × and achieves an energy saving of 5.16$$\times$$ × on average.

Sign in / Sign up

Export Citation Format

Share Document