Dynamic Load Balancing in Parallel Processing on Heterogeneous System

Abstract

This paper presents the parallel computing and dynamic load balancing on heterogeneous system architecture, simultaneously analyzing the theoretical parallel Speedup as well as the Speedup experimentally obtained. Load balancing techniques play a very important role in developing high performance system. However, the parallel computing algorithm use that one slave computer calculates one problem. If the problem is small and the processor speed is high, the performance of the system is increased. If the problem is very large but the processor speed is slow, the performance of the system is decreased. Hence, dynamic load balancing system is developed to evaluate performance of load balancing algorithm and to calculate on the slave nodes. The proposed dynamic load balancing scheme can minimize the average slow down of all parallel jobs running on a system and reduces the average response time of jobs.