storage optimization
Recently Published Documents


TOTAL DOCUMENTS

175
(FIVE YEARS 67)

H-INDEX

14
(FIVE YEARS 3)

2021 ◽  
Vol 2021 ◽  
pp. 1-14
Author(s):  
Yajun Wang ◽  
Shengming Cheng ◽  
Xinchen Zhang ◽  
Junyu Leng ◽  
Jun Liu

The traditional distributed database storage architecture has the problems of low efficiency and storage capacity in managing data resources of seafood products. We reviewed various storage and retrieval technologies for the big data resources. A block storage layout optimization method based on the Hadoop platform and a parallel data processing and analysis method based on the MapReduce model are proposed. A multireplica consistent hashing algorithm based on data correlation and spatial and temporal properties is used in the parallel data processing and analysis method. The data distribution strategy and block size adjustment are studied based on the Hadoop platform. A multidata source parallel join query algorithm and a multi-channel data fusion feature extraction algorithm based on data-optimized storage are designed for the big data resources of seafood products according to the MapReduce parallel frame work. Practical verification shows that the storage optimization and data-retrieval methods provide supports for constructing a big data resource-management platform for seafood products and realize efficient organization and management of the big data resources of seafood products. The execution time of multidata source parallel retrieval is only 32% of the time of the standard Hadoop scheme, and the execution time of the multichannel data fusion feature extraction algorithm is only 35% of the time of the standard Hadoop scheme.


Author(s):  
Nicolas Curin ◽  
Michael Kettler ◽  
Xi Kleisinger-Yu ◽  
Vlatka Komaric ◽  
Thomas Krabichler ◽  
...  

AbstractTo the best of our knowledge, the application of deep learning in the field of quantitative risk management is still a relatively recent phenomenon. In this article, we utilize techniques inspired by reinforcement learning in order to optimize the operation plans of underground natural gas storage facilities. We provide a theoretical framework and assess the performance of the proposed method numerically in comparison to a state-of-the-art least-squares Monte-Carlo approach. Due to the inherent intricacy originating from the high-dimensional forward market as well as the numerous constraints and frictions, the optimization exercise can hardly be tackled by means of traditional techniques.


2021 ◽  
Author(s):  
Simón Marín Giraldo ◽  
Julian David Ramirez Lopera ◽  
Mauricio Toro ◽  
Andres Salazar Galeano

This work introduces some of the most widely usedcompression algorithms, and their relevance to the field oflivestock farming, which has been historically characterizedfor requiring menial and inefficient labor, introducingenvironmental. And also for lacking the scale andautomation that cutting edge technologies can provide. Bydoing this we will explain how this opens the door tolocations untouched by technology, and the generaladvantages, and possibilities that integrating patternrecognition models bring to the table. In addition, we willexplain the ins and outs of these compression algorithms,and our reasoning behind our decision to choose analgorithm to implement in our pattern recognition model.To solve this problem, Seam Carving, Image Scaling andRun-Length encoding were used. With them we compressedthe images an average of 17.5% of their original size in atime complexity of O(L*N*M). This research shows howyou can create an efficient compression algorithm for usagein PLF.


2021 ◽  
Vol 110 ◽  
pp. 103385
Author(s):  
Fangning Zheng ◽  
Atefeh Jahandideh ◽  
Birendra Jha ◽  
Behnam Jafarpour

2021 ◽  
Author(s):  
Ricardo Macedo ◽  
Claudia Correia ◽  
Marco Dantas ◽  
Claudia Brito ◽  
Weijia Xu ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document