Communications systems; Communicationtechnology; Future internet; Next generation Internet; Non-orthogonal; Radiofrequency signals; Reinforcement learning techniques; Reinforcement learnings; Sustainable solution; Transmit data; Software; Computer Networks and Communications; Computer Science Applications; Hardware and Architecture; Information Systems
Abstract :
[en] Backscatter communication (BC) technology offers sustainable solutions for next-generation Internet-of-Things (IoT) networks, where devices can transmit data by reflecting and adjusting incident radio frequency signals. In parallel to BC, deep reinforcement learning (DRL) has recently emerged as a promising tool to augment intelligence and optimize low-powered IoT devices. This article commences by elucidating the foundational principles underpinning BC systems, subsequently delving into the diverse array of DRL techniques and their respective practical implementations. Subsequently, it investigates potential domains and presents recent advancements in the realm of RL-BC systems. A use case of RIS-aided non-orthogonal multiple access BC systems leveraging DRL is meticulously examined to highlight its potential. Lastly, this study identifies and investigates salient challenges and proffers prospective avenues for future research endeavors.
Disciplines :
Computer science
Author, co-author :
KHAN, Wali Ullah ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > SigCom
LAGUNAS, Eva ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > SigCom
Ali, Zain; University of California, United States
MAHMOOD, Asad ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > SigCom
SHEEMAR, Chandan Kumar ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > SigCom
Ahmed, Manzoor; Hubei Engineering University, China
Dev, Kapal; Munster Technological University, Ireland ; University of Johannesburg, South Africa
CHATZINOTAS, Symeon ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > SigCom
Ottersten, Bjorn; University of Luxembourg, Luxembourg
External co-authors :
yes
Language :
English
Title :
Deep Reinforcement Learning for Backscatter Communications: Augmenting Intelligence in Future Internet of Things
Publication date :
23 August 2024
Journal title :
IEEE Internet of Things Magazine
ISSN :
2576-3180
eISSN :
2576-3199
Publisher :
Institute of Electrical and Electronics Engineers Inc.
M. R. Mahmood et al., "A Comprehensive Review on Artificial Intelligence/Machine Learning Algorithms for Empowering the Future IoT Toward 6G Era," IEEE Access, vol. 10, 2022, pp. 87,535-62.
M. Ahmed et al., "Backscatter Sensors Communication for 6G Low-Powered NOMA-Enabled IoT Networks Under Imperfect SIC," IEEE Systems J., vol. 16, no. 4, 2022, pp. 5,883-93.
F. Rezaei et al., "Coding Techniques for Backscatter Communications-A Contemporary Survey," IEEE Commun. Surveys & Tutorials, vol. 25, no. 2, 2023, pp. 1020-58.
R. Torres et al., "Backscatter Communications," IEEE J. Microwaves, vol. 1, no. 4, 2021, pp. 864-78.
W. Wu et al., "A Survey on Ambient Backscatter Communications: Principles, Systems, Applications, and Challenges," Computer Networks, 2022, p. 109235.
J. Liu et al., "RL/DRL Meets Vehicular Task Offloading Using Edge and vehicular Cloudlet: A Survey," IEEE IoT J., vol. 9, no. 11, 2022, pp. 8315-38.
X. Jia and X. Zhou, "IRS-Assisted Ambient Backscatter Communications Utilizing Deep Reinforcement Learning," IEEE Wireless Commun. Lett., vol. 10, no. 11, 2021, pp. 2374-78.
Y. Nie et al., "Energy-Efficient UAV Trajectory Design for Backscatter Communication: A Deep Reinforcement Learning Approach," China Commun., vol. 17, no. 10, 2020, pp. 129-41.
Y. Zhang et al., "Hierarchical Deep Reinforcement Learning for Backscattering Data Collection with Multiple UAVs," IEEE IoT J., vol. 8, no. 5, 2021, pp. 3786-3800.
T. T. Anh et al., "Deep Reinforcement Learning for Time Scheduling in Rf-Powered Backscatter Cognitive Radio Networks," Proc. 2019 IEEE WCNC, 2019, pp. 1-7.
Y. Xie et al., "Backscatter-Assisted Computation Offloading for Energy Harvesting IoT Devices Via Policy-Based Deep Reinforcement Learning," Proc. 2019 IEEE/CIC ICCC Wksps., 2019, pp. 65-70.
G. M. Salama et al., "Deep Reinforcement Learning Based Algorithm for Symbiotic Radio IoT Throughput Optimization in 6G Network," IEEE Access, vol. 11, 2023, pp. 42,331-42.
Q. Zhang, Y.-C. Liang, and H. V. Poor, "Intelligent User Association for Symbiotic Radio Networks Using Deep Reinforcement Learning," IEEE Trans. Wireless Commun., vol. 19, no. 7, 2020, pp. 4535-48.
T. T. Anh, N. C. Luong, and D. Niyato, "A Deep Reinforcement Learning Approach for Backscatter-Assisted Relay Communications," IEEE Wireless Commun. Lett., vol. 10, no. 1, 2021, pp. 166-69.
W. U. Khan et al., "Opportunities for Physical Layer Security in UAV Communication Enhanced with Intelligent Reflective Surfaces," IEEE Wireless Commun., vol. 29, no. 6, 2022, pp. 22-28.
