Hardware and Architecture; Information Systems; Software; Cloud computing; Edge computing; Scheduling; Container Orchestration; Resource allocation; 5G; Kubernetes
Résumé :
[en] The edge to data center computing continuum is the aggregation of computing resources located anywhere between the network edge (e.g., close to 5G antennas), and servers in traditional data centers. Kubernetes is the de facto standard for the orchestration of services in data center environments, where it is very efficient. It, however, fails to give the same performance when including edge resources. At the edge, resources are more limited, and networking conditions are changing over time. In this paper, we present a methodology that lowers the costs of running applications in the edge-to-cloud computing continuum. This methodology can adapt to changing environments, e.g., moving end-users. We are also monitoring some Key Performance Indicators of the applications to ensure that cost optimizations do not negatively impact their Quality of Service. In addition, to ensure that performances are optimal even when users are moving, we introduce a background process that periodically checks if a better location is available for the service and, if so, moves the service. To demonstrate the performance of our scheduling approach, we evaluate it using a vehicle cooperative perception use case, a representative 5G application. With this use case, we can demonstrate that our scheduling approach can robustly lower the cost in different scenarios, while other approaches that are already available fail in either being adaptive to changing environments or will have poor cost-effectiveness in some scenarios.
Centre de recherche :
Interdisciplinary Centre for Security, Reliability and Trust (SnT) > SEDAN - Service and Data Management in Distributed Systems
Disciplines :
Sciences informatiques
Auteur, co-auteur :
RAC, Samuel ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > SEDAN
BRORSSON, Mats Håkan ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > SEDAN
Co-auteurs externes :
no
Langue du document :
Anglais
Titre :
Cost-aware service placement and scheduling in the Edge-Cloud Continuum
Date de publication/diffusion :
16 janvier 2024
Titre du périodique :
Transactions on Architecture and Code Optimization
Bloomberg. 2023. Retrieved 31 January 2024 from https://github.com/bloomberg/goldpinger
Docker. 2023. Retrieved 31 January 2024 from https://www.docker.com
Yucong Duan, Guohua Fu, Nianjun Zhou, Xiaobing Sun, Nanjangud C. Narendra, and Bo Hu. 2015. Everything as a service (xaas) on the cloud: Origins, current and future trends. In Proceedings of the 2015 IEEE 8th International Conference on Cloud Computing. 621–628. ISSN: 2159-6190. DOI:https://doi.org/10.1109/CLOUD.2015.88
ETCD. 2023. Retrieved 31 January 2024 from https://etcd.io
Linux Fondation. 2023. Retrieved 31 January 2024 from https://opencontainers.org
Kaihua Fu, Wei Zhang, Quan Chen, Deze Zeng, and Minyi Guo. 2022. Adaptive resource efficient microservice deployment in cloud-edge continuum. IEEE Transactions on Parallel and Distributed Systems 33, 8 (2022), 1825–1840. DOI:https://doi.org/10.1109/TPDS.2021.3128037. Conference Name: IEEE Transactions on Parallel and Distributed Systems.
Kiranpreet Kaur, Fabrice Guillemin, Veronica Quintuna Rodriguez, and Francoise Sailhan. 2022. Latency and network aware placement for cloud-native 5G/6G services. In Proceedings of the 2022 IEEE 19th Annual Consumer Communications and Networking Conference. 114–119. ISSN: 2331-9860. DOI:https://doi.org/10.1109/CCNC49033.2022.9700582
Colin Ian King. 2023. Retrieved 31 January 2024 from https://github.com/ColinIanKing/stress-ng
Kubernetes. 2023. Retrieved 31 January 2024 from https://kubernetes.io/docs/concepts/scheduling-eviction/scheduling-framework/
Kubernetes. 2023. Retrieved 31 January 2024 from https://kubernetes.io/docs/reference/scheduling/config/ #scheduling-plugins
Phu Lai, Qiang He, John Grundy, Feifei Chen, Mohamed Abdelrazek, John G. Hosking, and Yun Yang. 2020. Cost-effective app user allocation in an edge computing environment. IEEE Transactions on Cloud Computing 10, 3 (2020), 1701–1713. DOI:https://doi.org/10.1109/TCC.2020.3001570. Conference Name: IEEE Transactions on Cloud Computing.
Hongjian Li, Jie Shen, Lei Zheng, Yuzheng Cui, and Zhi Mao. 2023. Cost-efficient scheduling algorithms based on beetle antennae search for containerized applications in kubernetes clouds. The Journal of Supercomputing 79, 9 (2023), 10300–10334. DOI:https://doi.org/10.1007/s11227-023-05077-7
Angelo Marchese and Orazio Tomarchio. 2022. Extending the kubernetes platform with network-aware scheduling capabilities. In Proceedings of the Service-Oriented Computing. Javier Troya, Brahim Medjahed, Mario Piattini, Lina Yao, Pablo Fernández, and Antonio Ruiz-Cortés (Eds.), Lecture Notes in Computer Science, Springer Nature Switzerland, Cham, 465–480. DOI:https://doi.org/10.1007/978-3-031-20984-0_33
Angelo Marchese and Orazio Tomarchio. 2022. Network-aware container placement in cloud-edge kubernetes clusters. In Proceedings of the 2022 22nd IEEE International Symposium on Cluster, Cloud and Internet Computing. 859–865. DOI:https://doi.org/10.1109/CCGrid54584.2022.00102
Gabriele Proietti Mattia and Roberto Beraldi. 2021. Leveraging reinforcement learning for online scheduling of real-time tasks in the edge/fog-to-cloud computing continuum. In Proceedings of the 2021 IEEE 20th International Symposium on Network Computing and Applications. 1–9. ISSN: 2643-7929. DOI:https://doi.org/10.1109/NCA53618.2021. 9685413
Adrián Orive, Aitor Agirre, Hong-Linh Truong, Isabel Sarachaga, and Marga Marcos. 2022. Quality of service aware orchestration for cloud-edge continuum applications. Sensors 22, 5 (2022), 1755. DOI:https://doi.org/10.3390/ s22051755. Number: 5 Publisher: Multidisciplinary Digital Publishing Institute.
Prometheus. 2023. Retrieved 31 January 2024 from https://prometheus.io/
Prometheus. 2023. Retrieved 31 January 2024 from https://github.com/prometheus/pushgateway/
Thomas Pusztai, Stefan Nastic, Andrea Morichetta, Víctor Casamayor Pujol, Philipp Raith, Schahram Dustdar, Deepak Vij, Ying Xiong, and Zhaobo Zhang. 2022. Polaris scheduler: SLO- and topology-aware microservices scheduling at the edge. In Proceedings of the 2022 IEEE/ACM 15th International Conference on Utility and Cloud Computing. 61–70. DOI:https://doi.org/10.1109/UCC56403.2022.00017
Samuel Rac and Mats Brorsson. 2021. At the Edge of a Seamless Cloud Experience. arXiv:2111.06157.
Samuel Rac and Mats Brorsson. 2023. Cost-effective scheduling for kubernetes in the edge-to-cloud continuum. In Proceedings of the 2023 IEEE International Conference on Cloud Engineering. IEEE, 153–160.
Samuel Rac, Rajarshi Sanyal, and Mats Brorsson. 2023. A Cloud-Edge Continuum Experimental Methodology Applied to a 5G Core Study.
László Toka. 2021. Ultra-reliable and low-latency computing in the edge with kubernetes. Journal of Grid Computing 19, 3 (2021), 31. DOI:https://doi.org/10.1007/s10723-021-09573-z
Lukasz Wojciechowski, Krzysztof Opasiak, Jakub Latusek, Maciej Wereski, Victor Morales, Taewan Kim, and Moonki Hong. 2021. NetMARKS: Network metrics-aware kubernetes scheduler powered by service mesh. In Proceedings of the IEEE INFOCOM 2021 - IEEE Conference on Computer Communications. 1–9. ISSN: 2641–9874. DOI:https://doi.org/ 10.1109/INFOCOM42981.2021.9488670
Zhiheng Zhong and Rajkumar Buyya. 2020. A cost-efficient container orchestration strategy in kubernetes-based cloud computing infrastructures with heterogeneous resources. ACM Transactions on Internet Technology 20, 2 (2020), 15:1–15:24. DOI:https://doi.org/10.1145/3378447