[en] Cloud service providers (CSPs) offer different Ser- vice Level Agreements (SLAs) to the cloud users. Cloud Service Brokers (CSBs) provide multiple sets of alternatives to the cloud users according to users requirements. Generally, a CSB considers the service commitments of CSPs rather than the actual quality of CSPs services. To overcome this issue, the broker should verify the service performances while recommending cloud services to the cloud users, using all available data. In this paper, we compare our two approaches to do so: a min-max-min decomposition based on Intuitionistic Fuzzy Logic (IFL) and a Performance Heat Map technique, to evaluate the performance of commercially available cloud providers. While the IFL technique provides simple, total order of the evaluated CSPs, Performance Heat Map provides transparent and explanatory, yet consistent evaluation of service performance of commercially available CSPs. The identified drawbacks of the IFL technique are: 1) It does not return the accurate performance evaluation over multiple decision alternatives due to highly influenced by critical feedback of the evaluators; 2) Overall ranking of the CSPs is not as expected according to the performance measurement. As a result, we recommend to use performance Heat Map for this problem.
Disciplines :
Sciences informatiques
Auteur, co-auteur :
WAGLE, Shyam Sharan ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT)
GUZEK, Mateusz ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT)
BOUVRY, Pascal ; University of Luxembourg > Faculty of Science, Technology and Communication (FSTC) > Computer Science and Communications Research Unit (CSC)
BISDORFF, Raymond ; University of Luxembourg > Faculty of Science, Technology and Communication (FSTC) > Computer Science and Communications Research Unit (CSC)
Co-auteurs externes :
no
Langue du document :
Anglais
Titre :
Comparisons of Heat Map and IFL Technique to Evaluate the Performance of Commercially Available Cloud Providers
Date de publication/diffusion :
2016
Nom de la manifestation :
Cloud2016
Organisateur de la manifestation :
IEEE
Lieu de la manifestation :
Sanfrancisco, Etats-Unis
Date de la manifestation :
27-06-2016 to 02-07-2016
Sur invitation :
Oui
Manifestation à portée :
International
Titre de l'ouvrage principal :
2016 IEEE 9th International Conference on Cloud Computing
"Qos modeling for green scheduling in clouds," 2015, "http://homepages.laas.fr/tguerout/data/PUBLIS/REVUES/SUSCOM EARMS QoS Modeling for Green Scheduling in Clouds.pdf".
M. Guzek, A. Gniewek, P. Bouvry, J. Musial, and J. Blazewicz, "Cloud brokering: Current practices and upcoming challenges," Cloud Computing, IEEE, vol. 2, no. 2, pp. 40-47, Mar 2015.
S. S. Wagle, M. Guzek, P. Bouvry, and R. Bisdorff, "An evaluation model for selecting cloud services from commercially available cloud providers," in IEEE 7th International Conference on Cloud Computing, Vancouver, Canada, Nov. 2015, pp. 107-114.
S. S. Wagle, "Sla assured brokering (sab) and csp certification in cloud computing," in Utility and Cloud Computing (UCC), 2014 IEEE/ACM 7th International Conference on, Dec 2014, pp. 1016-1017.
S. S. Wagle, M. Guzek, and P. Bouvry, "Cloud service providers ranking based on service delivery and consumer experience," in IEEE 4th International Conference on Cloud Networking (CloudNet), Niagara Falls, Canada, Oct. 2015, pp. 202-205.
P. Wang, "Qos-aware web services selection with intuitionistic fuzzy set under consumers vague perception," Expert Systems with Applications, vol. 36, no. 3, Part 1, pp. 4460-4466, 2009.
S. Wang, L. Huang, C.-H. Hsu, and F. Yang, "Collaboration reputation for trustworthy web service selection in social networks," Journal of Computer and System Sciences, vol. 82, no. 1, Part B, pp. 130-143, 2016, mobile Social Networking and computing in Proximity (MSNP): A Multi-disciplinary Inspired Approach. [Online]. Available: http://www.sciencedirect.com/science/article/pii/S0022000015000719
K. Garg, S. Versteeg, and R. Buyya, "Smicloud: A framework for comparing and ranking cloud services," in IEEE 4th International Conference on UCC, Dec 2011, pp. 210-218.
"C. S. M. I. C. (csmic), smi framework," 2014, "http://betawww.cloudcommons.com/servicemeasure mentindex".
S. Thomas, "Theory and applications of analytic network process." Pittsburgh, PA: RWS Publications, 2005.
A. Li, X. Yang, S. Kandula, and M. Zhang, "Cloudcmp: Comparing public cloud providers," in Proceedings of the 10th ACM SIGCOMM Conference on Internet Measurement, ser. IMC '10, 2010, pp. 1-14.
M. Guzek, S. Varrette, V. Plugaru, J. E. Pecero, and P. Bouvry, "A holistic model of the performance and the energy efficiency of hypervisors in a hpc environment," Concurrency and Computation: Practice and Experience, vol. 26, no. 15, pp. 2569-2590, 2014.
L. Qu, Y. Wang, M. A. Orgun, L. Liu, and A. Bouguettaya, "Cloud service selection based on contextual subjective assessment and objective assessment," in Proceedings of the 2014 International Conference on Autonomous Agents and Multi-agent Systems, ser. AAMAS '14, 2014, pp. 1483-1484.
P. Choudhury, M. Sharma, K. Vikas, T. Pranshu, and V. Satyanarayana, "Service ranking systems for cloud vendors," January 2012, pp. 433-440.
K. Atanassov and G. Gargov, "Interval valued intuitionistic fuzzy sets," Fuzzy Sets Syst., vol. 31, no. 3, pp. 343-349, Jul. 1989.
K. T. Atanassov, "Intuitionistic fuzzy sets," Fuzzy Sets Syst., vol. 20, no. 1, pp. 87-96, Aug. 1986. [Online]. Available: http://dx.doi.org/10.1016/S0165-0114(86)80034-3
R. Biswas, "Intuitionistic fuzzy relations," Bulletin for Studies and Exchange of Fuzziness and its Applications BUSEFAL, vol. 70, p. 2229, july 1997.
"An application of intuitionistic fuzzy sets in medical diagnosis," Fuzzy Sets and Systems, vol. 117, no. 2, pp. 209-213, 2001.
R. Bisdorff, "On polarizing outranking relations with large performance differences," Journal of Multi Criteria Decision Analysis, vol. 20, no. 1-2.
- Evaluation and Decision Models with Multiple Criteria: Case Studies. Berlin, Heidelberg: Springer Berlin Heidelberg, 2015, ch. The EURO 2004 Best Poster Award: Choosing the Best Poster in a Scientific Conference, pp. 117-165.
- "On measuring and testing the ordinal correlation between bipolar outranking relations," in From Multiple Criteria Decision Aid to Preference Learning, NOV 2012, pp. 91-100.
- "Ranking big performance tableaux with multiple incommensurable criteria and missing data," in 30th Annual Conference of the Belgian Operational Research Society UCL-CORE, Belgium, JAN 2016.
