VPCH: A Consistent Hashing Algorithm for Better Load Balancing in a Hadoop Environment

The NOSQL database to support data and high concurrent read and write,scalability and high availability features in a distributed storage system which has been applied widely. In this paper, through the research of load balancing in distributed storage system,and it proposes the consistent hashing algorithm and the virtual node strategy, in order to improve the load balancing of the system and increase the cache hit ratio. For the load balancing principle of NOSQL and SQL Server, analysis and comparison of the experimental data.The result shows that, with the increase of the number of virtual nodes, the cache hit ratio of NOSQL is higher than the cache hit ratio of SQL Server.

Download Full-text

Research of Cloud Storage and Improved Distributed Strategy of Data Storage

Applied Mechanics and Materials ◽

10.4028/www.scientific.net/amm.496-500.1812 ◽

2014 ◽

Vol 496-500 ◽

pp. 1812-1816 ◽

Cited By ~ 1

Author(s):

Hong Xia Mao

Keyword(s):

Load Balancing ◽

Data Storage ◽

Cloud Storage ◽

Storage System ◽

Utilization Rate ◽

Consistent Hashing ◽

Storage Node ◽

Load Rate ◽

Hashing Algorithm ◽

System Prototype

In this paper, an extensible system prototype of cloud storage is designed. Considering the load balance of cloud storage system, an improved data storage strategy based on consistent hashing algorithm is proposed in this paper. The strategy adopts virtual nodes to storage data and real–time monitoring of load rate of each storage node to adjust load balancing of the whole storage system. In the improved strategy, the priority is introduced into the storage system to rapidly improve the utilization rate of the new storage nodes. The strategy can effectively optimize the performance of the whole storage system, and improve the overall effect of the load balancing.

Download Full-text

Load-Balancing using HA Proxy on Multipath System with Flow Slice

INTERNATIONAL JOURNAL OF COMPUTERS & TECHNOLOGY ◽

10.24297/ijct.v11i1.1189 ◽

2013 ◽

Vol 11 (1) ◽

pp. 2182-2188

Author(s):

Pallavali Radha ◽

C Surekha ◽

U Sesadri

Keyword(s):

Load Balancing ◽

Web Sites ◽

Load Balance ◽

Hardware Complexity ◽

Heavy Load ◽

Through Flow ◽

Multiple Paths ◽

Heavy Tailed ◽

Reliable Solution ◽

Hashing Algorithm

To provide switching capacity in terabit or petabit uses core routers in multipath switching systems (MPS). Without disturbing the order of intra flow packets, the load balance across multiple paths is the main issue of MPS design phase. The performance is not good through heavy tailed flow size distribution in flow based hashing algorithm. Our proposed novel scheme consist the HA Proxy very fast and reliable solution offering high availability, load balancing, and proxying for TCP and HTTP-based applications. To process Layer7 of web site or to provide persistence to the website this scheme is very well suited for heavy load web sites crawling and flow slices are generated through Flow Slice (FS) that halt each flow at every intra flow spell larger than a slicing threshold and balances the load. The study analysis on traces of Internet, our scheme is optimal in load balancing performance through FS and the slicing threshold we set to 1 to 4 ms. We neglected out of order packets limits of probability 1/106 on three prominent MPSs with little hardware complexity and twice of the internal speedup. The theoretical analysis proved that this and trace driven prototype simulations are validated.Â

Download Full-text