Phase Level Scheduler for MapReduce using Grained Resource
Published: 2021
Author(s) Name: Bandla Manjula |
Author(s) Affiliation: Seshachala Degree and P.G. College, Puttur, Andhra Pradesh, India.
Locked
Subscribed
Available for All
Abstract
MapReduce is one of the important concepts of Hadoop that is used for data handling used by big companies today such as Google and Facebook. Here we divide each job into the map and reduce phases and try to complete the execution of the assigned task in a parallel form. In this paper, we suggest that it would be more efficient if we make the scheduler to work at the phase-level instead of the task-level. The reason is that the task demands a lot of requirements during its lifetime. For this very purpose, we introduce the concept called PRISM, which is a phase and information-aware scheduler for MapReduce and in this concept, we divide the tasks into unequal parts called as phases and apply phase-level scheduling to these phases and achieve efficient resource usage.
Keywords: Job progress monitor, MapReduce, Phase-based scheduler.
View PDF