Discrete element method; High Performance Computing; Cloud Computing; OpenStack; XEN; KVM
Résumé :
[en] As Cloud Computing services become ever more prominent, it appears necessary to assess the efficiency of these solutions. This paper presents a performance evaluation of the OpenStack Cloud Computing middleware using our XDEM application simulating the pyrolysis of biomass as a benchmark.
We propose a systematic study based on a fully automated benchmarking framework to evaluate 3 different configurations: Native (i.e. no virtualization), OpenStack with KVM and XEN hypervisors. Our approach features the following advantages:
real user application, the fair comparison using the same hardware, the large scale distributed execution, while fully automated and reproducible.
Experiments has been run on two different clusters, using up to 432 cores. Results show a moderate overhead for sequential execution and a significant penalty for distributed execution under the Cloud middleware. The overhead on multiple nodes is between 10% and 30% for OpenStack/KVM and 30% and 60% for OpenStack/XEN.
Centre de recherche :
ULHPC - University of Luxembourg: High Performance Computing LuXDEM - University of Luxembourg: Luxembourg XDEM Research Centre
Disciplines :
Sciences informatiques
Auteur, co-auteur :
BESSERON, Xavier ; University of Luxembourg > Faculty of Science, Technology and Communication (FSTC) > Engineering Research Unit
PLUGARU, Valentin ; University of Luxembourg > Faculty of Science, Technology and Communication (FSTC) > Computer Science and Communications Research Unit (CSC)
MAHMOUDI, Amir Houshang ; University of Luxembourg > Faculty of Science, Technology and Communication (FSTC) > Engineering Research Unit
VARRETTE, Sébastien ; University of Luxembourg > Faculty of Science, Technology and Communication (FSTC) > Computer Science and Communications Research Unit (CSC)
PETERS, Bernhard ; University of Luxembourg > Faculty of Science, Technology and Communication (FSTC) > Engineering Research Unit
BOUVRY, Pascal ; University of Luxembourg > Faculty of Science, Technology and Communication (FSTC) > Computer Science and Communications Research Unit (CSC)
Co-auteurs externes :
no
Langue du document :
Anglais
Titre :
Performance Evaluation of the XDEM framework on the OpenStack Cloud Computing Middleware
Date de publication/diffusion :
février 2015
Nom de la manifestation :
The Fourth International Conference on Parallel, Distributed, Grid and Cloud Computing for Engineering
Lieu de la manifestation :
Dubrovnik, Croatie
Date de la manifestation :
March 2015
Manifestation à portée :
International
Titre de l'ouvrage principal :
Proceedings of the Fourth International Conference on Parallel, Distributed, Grid and Cloud Computing for Engineering
J. Duran, Sands, powders, and grains: An introduction to the physics of granular material, Springer, 1999.
P.W. Cleary, "Large scale industrial DEM modelling", in Engineering Computations, pages 169-204, 2004.
B. Peters, "The extended discrete element method (XDEM) for multi-physics applications", Scholarly Journal of Engineering Research, 2(1): 1-20, 2013.
B. Peters, X. Besseron, A. Estupinan, F. Hoffmann, M. Michael, M. A., "Enhanced Thermal Process Engineering by the Extended Discrete Element Method (XDEM)", Universal Journal of Engineering Science, 1(4): 139-145, 2013.
B. Peters, X. Besseron, A. Estupinan, F. Hoffmann, M. Michael, M. A., "The Extended Discrete Element Method (XDEM) Applied to Drying of a Packed Bed", IFRF Journal, 2013.
I. Foster, Y. Zhao, I. Raicu, S. Lu, "Cloud Computing and Grid Computing 360- Degree Compared", in Grid Computing Environments Workshop, 2008. GCE '08, pages 1-10, Nov 2008.
A. Marathe, R. Harris, D.K. Lowenthal, B.R. de Supinski, B. Rountree, M. Schulz, X. Yuan, "A comparative study of high-performance computing on the cloud", in Proceedings of the 22nd international symposium on Highperformance parallel and distributed computing, pages 239-250. ACM, 2013.
S. Varrette, V. Plugaru, M. Guzek, X. Besseron, P. Bouvry, "HPC Performance and Energy-Efficiency of the OpenStack Cloud Middleware", in Proc. of the 43rd Intl. Conf. on Parallel Processing (ICPP-2014), Heterogeneous and Uncon- ventional Cluster Architectures and Applications Workshop (HUCAA'14). IEEE, Minneapolis, MN, US, Sept. 2014.
V. Plugaru, S. Varrette, P. Bouvry, "Performance Analysis of Cloud Environments on Top of Energy-Efficient Platforms Featuring Low Power Processors", in 6th IEEE Intl. Conf. on Cloud Computing Technology and Science (Cloud- Com'14). IEEE Computer Society, 2014.
K. Samiei, B. Peters, "The discrete particle method (DPM): An advanced numerical simulation tool for particulate applications", in Proceedings of the IV European Conference on Computational Mechanics: Solids, Structures and Coupled Problems in Engineering, May 2010.
K. Samiei, G. Berhe, B. Peters, "Simulation of Moving Particles on a Backward Acting Grate using Implicit Integration and Domain Decomposition", in Proceedings Of The Second International Conference On Parallel, Distributed, Grid And Cloud Computing For Engineering, 2011 Apr.
X. Besseron, F. Hoffmann, M. Michael, B. Peters, "Unified Design for Parallel Execution of Coupled Simulations using the Discrete Particle Method", in Proceedings of the Third International Conference on Parallel, Distributed, Grid and Cloud Computing for Engineering (PARENG'2013). Civil-Comp Press, 2013.
A. Estupinan, F. Hoffmann, B. Peters, "eXtended Discrete Element Method used for Convective Heat Transfer Predictions", International Review of Mechanical Engineering (I.R.E.M.E), 7(2): (in press), 2013.
B. Peters, "Classification of combustion regimes in a packed bed based on the relevant time and length scales", Combustion and Flame, 116: 297-301, 1999.
A.H. Mahmoudi, F. Hoffmann, B. Peters, "Application of XDEM as a novel approach to predict drying of a packed bed", International Journal of Thermal Sciences, 75(0): 65 - 75, 2014.
B. Peters, "Validation of a numerical approach to model pyrolysis of biomass and assessment of kinetic data", Fuel, 90(6): 2301 - 2314, 2011.
B. Peters, "Application of a detailed reaction mechanism to pyrolysis of Miscanthus giganteus", Journal of Analytical and Applied Pyrolysis, 91(2), 2011.
B. Peters, "Prediction of pyrolysis of pistachio shells based on its components hemicellulose, cellulose and lignin", Fuel Processing Technology, 92(10), 2011.
F. Hoffmann, B. Peters, "An Integrated Approach to Model Blast Furnaces", in Proceedings of METEC InSteelCon 2011, 4th International Conference on Modelling and Simulation of Metallurgical Processes in Steelmaking, 2011.
K. Samiei, Assessment of Implicit and Explicit Algorithms in Numerical Simulation of Granular Matter, PhD thesis, University of Luxembourg, 2012.
M. Michael, B. Peters, F. Vogel, "Resolution of Different Length Scales by an Efficient Combination of the Finite Element Method and the Discrete Element Method", in Proceedings of the Eleventh International Conference on Compu- tational Structures Technology. Civil-Comp Press, 2012.
MPI: A Message-Passing Interface Standard, May 1994.
M.J. Berger, S.H. Bokhari, "A Partitioning Strategy for Non-uniform Problems on Multiprocessors", IEEE Trans. Comput., 36(5): 570-580, 1987.
G. Berhe, B. Peters, S. Varrette, P. Bouvry, "Parallel Implementation of a Domain Decomposition Algorithm for Molecular Dynamics", in Proceedings Of The First International Conference On Parallel, Distributed And Grid Computing For Engineering, Apr. 2009.
V.K. Naik, S.K. Setia, M.S. Squillante, "Processor allocation in multiprogrammed distributed-memory parallel computer systems", Parallel Distributed Computing, 1997.
X. Besseron, T. Gautier, "Impact of over-decomposition on coordinated checkpoint/ rollback protocol", in Workshop on Resiliency in High Performance Computing in Clusters, Clouds, and Grids (Resilience'11), held in conjunction with EuroPar'11. Bordeaux, France, Aug. 2011.
L.A. Bongo, B. Vinter, O.J. Anshus, T. Larsen, J.M. Bjorndalen, "Using Overdecomposition to Overlap Communication Latencies with Computation and Take Advantage of SMT Processors", in ICPP Workshops, 2006.
R. Buyya, C.S. Yeo, S. Venugopal, J. Broberg, I. Brandic, "Cloud computing and emerging IT platforms: Vision, hype, and reality for delivering computing as the 5th utility", Future Generation Computer Systems, 25(6): 599-616, 2009.
M. Armbrust, al., "Above the Clouds: A Berkeley View of Cloud Computing", Technical Report UCB/EECS-2009-28, EECS Department, University of California, Berkeley, Feb 2009.
P. Mell, T. Grance, "The NIST definition of cloud computing", NIST special publication, 800(145): 7, 2011.
P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, A. Warfield, "Xen and the art of virtualization", in Proceedings of the nineteenth ACM symposium on Operating systems principles, SOSP '03, pages 164-177. ACM, New York, NY, USA, 2003.
A. Kivity, al., "KVM: The Linux virtual machine monitor", in Ottawa Linux Symposium, pages 225-230, July 2007.
Q. Ali, V. Kiriansky, J. Simons, P. Zaroo, "Performance evaluation of HPC benchmarks on VMware's ESXi server", in Proceedings of the 2011 international conference on Parallel Processing, Euro-Par'11, pages 213-222. Springer-Verlag, Berlin, Heidelberg, 2012.
A. Velte, T. Velte, Microsoft virtualization with Hyper-V, McGraw-Hill, Inc., 2009.
"OpenStack", http://www.openstack.org/.
A. Gavrilovska et al., "High-Performance Hypervisor Architectures: Virtualization in HPC Systems", in Proc. of HPCVirt 2007. Portugal, Mar. 2007.
P. Luszczek, E. Meek, S. Moore, D. Terpstra, V.M.Weaver, J. Dongarra, "Evaluation of the HPC Challenge Benchmarks in Virtualized Environments", in VHPC 2011, 6th Workshop on Virtualization in High-Performance Cloud Computing. Bordeaux, France, 08/2011 2011.
K. Ibrahim, S. Hofmeyr, C. Iancu, "Characterizing the Performance of Parallel Applications on Multi-socket Virtual Machines", in Cluster, Cloud and Grid Computing (CCGrid), 2011 11th IEEE/ACM International Symposium on, pages 1-12, May 2011.
M. Guzek, S. Varrette, V. Plugaru, J.E. Pecero, P. Bouvry, "A holistic model of the performance and the energy efficiency of hypervisors in a high-performance computing environment", Concurrency and Computation: Practice and Experience, 26(15): 2569-2590, 2014.
S. Varrette, M. Guzek, V. Plugaru, X. Besseron, P. Bouvry, "HPC Performance and Energy-Efficiency of Xen, KVM and VMware Hypervisors", in Proc. of the 25th Symposium on Computer Architecture and High Performance Computing (SBAC-PAD 2013). IEEE Computer Society, Porto de Galinhas, Brazil, Oct. 2013.
R.R. Expósito, G.L. Taboada, S. Ramos, J. TouriñO, R. Doallo, "Performance analysis of HPC applications in the cloud", Future Generation Computer Systems, 29(1): 218-229, 2013.
P. Zaspel, M. Griebel, "Massively Parallel Fluid Simulations on Amazon's HPC Cloud", in Network Cloud Computing and Applications (NCCA), 2011 First International Symposium on, pages 73-78, Nov 2011.
M. Hajdukovic, D. Milainovic, D. Goles, M. Nikolic, P. Maric, Z. Zivanov, P. Rakic, "Cloud Computing based MPI/OpenMP Parallelization of the Harmonic Coupled Finite Strip Method applied to Large Displacement Stability Analysis of Prismatic Shell Structures", in Proceedings of the Third International Conference on Parallel, Distributed, Grid and Cloud Computing for Engineering (PARENG'2013). Civil-Comp Press, 2013.
T. McDonald, R. Fisher, G. Rigden, R. Perala, "Parallel FDTD electromagnetic effects simulation using on-demand cloud HPC resources", in Electromagnetic Compatibility (EMC), 2013 IEEE International Symposium on, pages 499-502, Aug 2013.
P. Mehrotra, J. Djomehri, S. Heistand, R. Hood, H. Jin, A. Lazanoff, S. Saini, R. Biswas, "Performance Evaluation of Amazon EC2 for NASA HPC Applications", in Proceedings of the 3rd Workshop on Scientific Cloud Computing Date, ScienceCloud '12, pages 41-50. ACM, New York, NY, USA, 2012.
R. Bolze, F. Cappello, E. Caron, M. Daydé, F. Desprez, E. Jeannot, Y. Jégou, S. Lanteri, J. Leduc, N. Melab, G. Mornet, R. Namyst, P. Primet, B. Quetier, O. Richard, E.G. Talbi, I. Touche, "Grid'5000: A Large Scale And Highly Reconfigurable Experimental Grid Testbed", Int. J. High Perform. Comput. Appl., 20(4): 481-494, Nov. 2006.
E. Jeanvoine, L. Sarzyniec, L. Nussbaum, "Kadeploy3: Efficient and Scalable Operating System Provisioning", USENIX, 38(1): 38-44, Feb. 2013.
M. Gronli, A theoretical and experimental study of the thermal degradation of biomass, PhD thesis, The Norwegian University of Science and Technology Trondheim, 1996.
B. Peters, Thermal Conversion of Solid Fuels, WIT Press, Southampton, 2003.
A.H. Mahmoudi, F. Hoffmann, B. Peters, "Detailed numerical modeling of pyrolysis in a heterogeneous packed bed using XDEM", Journal of Analytical and Applied Pyrolysis, 106: 9 - 20, 2014.
J. Liu, B. Chandrasekaran, W. Yu, J. Wu, D. Buntinas, S. Kini, D. Panda, P. Wyckoff, "Microbenchmark performance comparison of high-speed cluster interconnects", Micro, IEEE, 24(1): 42-51, Jan 2004.
G.K. Lockwood, M. Tatineni, R. Wagner, "SR-IOV: Performance Benefits for Virtualized Interconnects", in Proceedings of the 2014 Annual Conference on Extreme Science and Engineering Discovery Environment, XSEDE '14. ACM, 2014.
