Reference : Measuring data locality ratio in virtual MapReduce cluster using WorkflowSim
Scientific congresses, symposiums and conference proceedings : Paper published in a book
Engineering, computing & technology : Computer science
http://hdl.handle.net/10993/34042
Measuring data locality ratio in virtual MapReduce cluster using WorkflowSim
English
Wangsom, Peerasak [> >]
Lavangnananda, Kittichai [> >]
Bouvry, Pascal mailto [University of Luxembourg > Faculty of Science, Technology and Communication (FSTC) > Computer Science and Communications Research Unit (CSC) >]
Jul-2017
Proceedings of the 14th International Joint Conference on Computer Science and Software Engineering (JCSSE), 2017 14th
IEEE
Yes
International
14th International Joint Conference on Computer Science and Software Engineering (JCSSE), 2017
12-14 July, 2017
[en] Computational modeling, Scheduling algorithms, Data models, Engines, Virtual environments, Prefetching, Tools
[en] The data locality is significant factor which has a direct impact on the performance of MapReduce framework. Several previous works have proposed alternative scheduling algorithms for improving the performance by increasing data locality. Nevertheless, their studies had focused the data locality on physical MapReduce cluster. As more and more deployment of MapReduce cluster have been on virtual environment, a more suitable evaluation of MapReduce cluster may be necessary. This study adopts a simulation based approach. Five scheduling algorithms were used for the simulation. WorkflowSim is extended by inclusion of three implemented modules to assess the new performance measure called `data locality ratio'. Comparison of their results reveals interesting findings. The proposed implementation can be used to assess `data locality ratio' and allows users prior to efficiently select and tune scheduler and system configurations suitable for an environment prior to its actual physical MapReduce deployment.
University of Luxembourg: High Performance Computing - ULHPC
http://hdl.handle.net/10993/34042
10.1109/JCSSE.2017.8025944
http://ieeexplore.ieee.org/document/8025944/

File(s) associated to this reference

Fulltext file(s):

FileCommentaryVersionSizeAccess
Limited access
08025944.pdfPublisher postprint352.08 kBRequest a copy

Bookmark and Share SFX Query

All documents in ORBilu are protected by a user license.