Article (Scientific journals)
MARL based resource allocation scheme leveraging vehicular cloudlet in automotive-industry 5.0
Ahmed, Manzoor; Liu, Jinshi; Mirza, Muhammad Ayzed et al.
2022In Journal of King Saud University - Computer and Information Sciences
Peer Reviewed verified by ORBi
 

Files


Full Text
1-s2.0-S1319157822003627-main.pdf
Publisher postprint (1.95 MB)
Request a copy

All documents in ORBilu are protected by a user license.

Send to



Details



Keywords :
Multi-agent reinforcement learning; Vehicular cloudlet; Industry 5.0
Abstract :
[en] Automotive-Industry 5.0 will use Beyond Fifth-Generation (B5G) communications to provide robust, abundant computation resources and energy-efficient data sharing among various Intelligent Transportation System (ITS) entities. Based on the vehicle communication network, the Internet of Vehicles (IoV) is created, where vehicles’ resources, including processing, storage, sensing, and communication units, can be leveraged to construct Vehicular Cloudlet (VC) to realize resource sharing. As Connected and Autonomous Vehicles (CAV) onboard computing is becoming more potent, VC resources (comprising stationary and moving vehicles’ idle resources) seems a promising solution to tackle the incessant computing requirements of vehicles. Furthermore, such spare computing resources can significantly reduce task requests’ delay and transmission costs. In order to maximize the utility of task requests in the system under the maximum time constraint, this paper proposes a Secondary Resource Allocation (SRA) mechanism based on a dual time scale. The request service process is regarded as M/M/1 queuing model and considers each task request in the same time slot as an agent. A Partially Observable Markov Decision Process (POMDP) is constructed and combined with the Multi-Agent Reinforcement Learning (MARL) algorithm known as QMix, which exploits the overall vehicle state and queue state to reach effective computing resource allocation decisions. There are two main performance metrics: the system’s total utility and task completion rate. Simulation results reveal that the task completion rate is increased by 13%. Furthermore, compared with the deep deterministic policy optimization method, our proposed algorithm can improve the overall utility value by 70% and the task completion rate by 6%.
Disciplines :
Electrical & electronics engineering
Author, co-author :
Ahmed, Manzoor
Liu, Jinshi
Mirza, Muhammad Ayzed
Khan, Wali Ullah ;  University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > SigCom
Al-wesabi, Fahd N.
External co-authors :
yes
Language :
English
Title :
MARL based resource allocation scheme leveraging vehicular cloudlet in automotive-industry 5.0
Alternative titles :
[en] MARL based resource allocation scheme leveraging vehicular cloudlet in automotive-industry 5.0
Publication date :
19 October 2022
Journal title :
Journal of King Saud University - Computer and Information Sciences
ISSN :
2213-1248
Publisher :
Elsevier
Peer reviewed :
Peer Reviewed verified by ORBi
Focus Area :
Security, Reliability and Trust
Available on ORBilu :
since 25 January 2023

Statistics


Number of views
21 (0 by Unilu)
Number of downloads
0 (0 by Unilu)

Scopus citations®
 
2
Scopus citations®
without self-citations
1
OpenCitations
 
0

Bibliography


Similar publications



Contact ORBilu