Load Balancing Algorithm of Stream Data Based on Correlation Analysis

2014 ◽  
Vol 543-547 ◽  
pp. 2594-2599
Author(s):  
Yong Gui Zou ◽  
Yuan Lei Tang ◽  
Ying Xia

With the development of stream processing technology, achieving load balance of resource accessing becomes one of key problems. However, the existing technologies are difficult to balance the system and maintain the data integrity requirements when large data stream arrive. In this paper, combined with the dynamic load balancing algorithm, we propose a load balancing algorithm of stream data based on correlation analysis (SDCA-LBA). The algorithm analyses correlation of stream data through the window feature statistics. On the basis of ensuring the load balancing of the stream data system, we consider the data correlation. The experiment results show that this method can effectively solve the problem of stream data load balancing, maintain the data integrity, and improve the system data processing capabilities.

2013 ◽  
Vol 684 ◽  
pp. 559-562
Author(s):  
Zhuang Liu ◽  
Guang Dong ◽  
Hong Wei Yang ◽  
Guan Nan Qu ◽  
Hong Bin Wang ◽  
...  

The core technology of load balancing is the task scheduling. Different tasks have different resource occupation rate on the server node and influence the current server load also different. This paper presents a dynamic load balancing algorithm and we design some experimental environment. We do some simulation experiments based on some reasonable assumptions and actual state of network, to evaluate our dynamic load balancing algorithm. The experimental data shows that compared with the least weighted connection scheduling algorithm, the algorithm of this paper can make full use of machine resources. The system data retrieval efficiency is also improved.


2020 ◽  
Vol 8 (5) ◽  
pp. 4812-4816

The basic idea of building Distributed Systems (DS) is to replenish systematic way to access disseminated resources in a decisive way. As It ensures remote access to the resources, the vital part in distributed systems is to allow proper allocation of the resources. Efficient allocation of resources amongst the various Computing Nodes (CN) can happen with the help of various scheduling policies. The various scheduling policies that are being used for efficient load balancing are Round Robin, Throttled, equally spread Load Balancing Algorithms. These are the traditional algorithms which help in performing load balance amongst CN. In this research paper an Improved and Efficient Dynamic Load Balancing Algorithm is proposed which fairs comparatively well compared with the traditional existing approaches which come along with the Cloud Simulator. The simulation of the same is made using Cloud Simulator whose efficiency in terms of response time and cost is proved to be more than 5% when compared to the traditional approaches.


2013 ◽  
Vol 303-306 ◽  
pp. 2241-2244
Author(s):  
Lin Chen ◽  
Zhi Yi Fang ◽  
Hong Bin Wang ◽  
Rui Yang

Load balancing problems play a special role in the operation of parallel and distribution systems. The core technology of load balancing is the task scheduling. In order to achieve equally distribute the load on processors and maximize their utilities while minimizing the total task execution time, this article analyses a large number of data retrieval requests content. It shows different tasks have different resource occupation rate on the server node and the current server load is also different. The demand of different task types on CPU and I/O resources are not same. So, this paper presents a dynamic load balancing algorithm which is based on task classification, and applies it to the cluster system data retrieval.


2012 ◽  
Vol 182-183 ◽  
pp. 1978-1981 ◽  
Author(s):  
Li Lan ◽  
Chu Huan Qi

The utilization efficiency of system resources is a key issue for cluster system while load balance is an important tool to realize the efficient use of resources. Based on server cluster system, this paper puts forwards an improved self-adaptive algorithm for network load balancing. Simulation results show that the algorithm can improve the utilization efficiency of system resource and reduce the server’s response time so as to achieve the request of real time when dealing with tasks and high availability of system.


Sign in / Sign up

Export Citation Format

Share Document