Deep reinforcement learning (DRL); Physical layer security (PLS); Simultaneous transmitting and reflecting RIS (STAR-RIS); Computer Science (all); Simultaneous transmitting and reflecting RIS; (STAR-RIS)
Abstract :
[en] The rapid development of next-generation wireless networks has intensified the need for robust security measures, particularly in environments susceptible to eavesdropping. Simultaneous transmitting and reflecting reconfigurable intelligent surfaces (STAR-RIS) have emerged as a transformative technology, offering full-space coverage by manipulating electromagnetic wave propagation. However, the inherent flexibility of STAR-RIS introduces new vulnerabilities, making secure communication a significant challenge. To overcome these challenges, we propose a deep reinforcement learning (DRL) based secure and efficient beamforming optimization strategy, leveraging the deep deterministic policy gradient (DDPG) algorithm. By framing the problem as a Markov decision process (MDP), our approach enables the DDPG algorithm to learn optimal strategies for beamforming and transmission and reflection coefficients (TARCs) configurations. This method is specifically designed to optimize phase-shift coefficients within the STAR-RIS environment, effectively managing the coupled phase shifts and complex interactions that are critical for enhancing physical layer security (PLS). Through extensive simulations, we demonstrate that our DRL-based strategy not only outperforms traditional optimization techniques but also achieves real-time adaptive optimization, significantly improving both confidentiality and network efficiency. This research addresses key gaps in secure wireless communication and sets a new standard for future advancements in intelligent, adaptable network technologies.
Disciplines :
Computer science
Author, co-author :
Wahid, Abdul ; The College of Computer Science and Technology, Qingdao University, Qingdao, China
Abideen, Syed Zain Ul; The College of Computer Science and Technology, Qingdao University, Qingdao, China
Ahmed, Manzoor ; School of Computer and Information Science and also with Institute for AI Industrial Technology Research, Hubei Engineering University, Xiaogan, China
KHAN, Wali Ullah ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > SigCom
Sheraz, Muhammad; The Centre for Wireless Technology, Faculty of Engineering, Multimedia University, Cyberjaya, Malaysia
Chuah, Teong Chee ; The Centre for Wireless Technology, Faculty of Engineering, Multimedia University, Cyberjaya, Malaysia
Lee, Ying Loong ; Faculty of Engineering and Science, Universiti Tunku Abdul Rahman, Kajang, Malaysia
External co-authors :
yes
Language :
English
Title :
Advanced security measures in coupled phase-shift STAR-RIS networks: A DRL approach
Original title :
[en] Advanced security measures in coupled phase-shift STAR-RIS networks: A DRL approach
Publication date :
November 2024
Journal title :
Journal of King Saud University - Computer and Information Sciences
Abeywickrama, S., Zhang, R., Wu, Q., Yuen, C., Intelligent reflecting surface: Practical phase shift model and beamforming optimization. IEEE Trans. Commun. 68:9 (2020), 5849–5863, 10.1109/TCOMM.2020.3001125.
Ahmed, M., Ali, Z., Khan, W.U., Waqar, O., Asif, M., Javed, M.A., Al-Wesabi, F.N., et al. Cooperative backscatter NOMA with imperfect SIC: Towards energy efficient sum rate maximization in sustainable 6G networks. J. King Saud Univ., Comput. Inf. Sci. 34:10 (2022), 7940–7947.
Ahmed, M., Alshahrani, H.M., Alruwais, N., Asiri, M.M., Al Duhayyim, M., Khan, W.U., Nauman, A., et al. Joint optimization of UAV-IRS placement and resource allocation for wireless powered mobile edge computing networks. J. King Saud Univ., Comput. Inf. Sci., 35(8), 2023, 101646.
Ahmed, M., Liu, J., Mirza, M.A., Khan, W.U., Al-Wesabi, F.N., MARL based resource allocation scheme leveraging vehicular cloudlet in automotive-industry 5.0. J. King Saud Univ., Comput. Inf. Sci., 35(6), 2023, 101420.
Ahmed, M., Shi, H., Chen, X., Li, Y., Waqas, M., Jin, D., Socially aware secrecy-ensured resource allocation in D2D underlay communication: An overlapping coalitional game scheme. IEEE Trans. Wireless Commun. 17:6 (2018), 4118–4133, 10.1109/TWC.2018.2820693.
Ahmed, M., Wahid, A., Laique, S.S., Khan, W.U., Ihsan, A., Xu, F., Chatzinotas, S., Han, Z., A survey on STAR-RIS: Use cases, recent advances, and future research challenges. IEEE Internet Things J., 2023, 1, 10.1109/JIOT.2023.3279357.
Basar, E., Di Renzo, M., De Rosny, J., Debbah, M., Alouini, M.-S., Zhang, R., Wireless communications through reconfigurable intelligent surfaces. IEEE Access 7 (2019), 116753–116773, 10.1109/ACCESS.2019.2935192.
Bisheh-Niasar, M., Azarderakhsh, R., Mozaffari-Kermani, M., High-speed NTT-based polynomial multiplication accelerator for post-quantum cryptography. 2021 IEEE 28th Symposium on Computer Arithmetic, ARITH, 2021, IEEE, Lyngby, Denmark, 94–101.
Cui, M., Zhang, G., Zhang, R., Secure wireless communication via intelligent reflecting surface. IEEE Wirel. Commun. Lett. 8:5 (2019), 1410–1414, 10.1109/LWC.2019.2919685.
Dhanda, S.S., Singh, B., Jindal, P., Lightweight cryptography: A solution to secure IoT. Wirel. Pers. Commun. 112:3 (2020), 1947–1980.
Fang, S., Chen, G., Abdullah, Z., Li, Y., Intelligent omni surface-assisted secure MIMO communication networks with artificial noise. IEEE Commun. Lett. 26:6 (2022), 1231–1235, 10.1109/LCOMM.2022.3159575.
Fang, S., Chen, G., Xiao, P., Wong, K.-K., Tafazolli, R., Intelligent omni surface-assisted self-interference cancellation for full-duplex MISO system. IEEE Trans. Wireless Commun., 2023, 1, 10.1109/TWC.2023.3297071.
Gao, S., Dong, P., Pan, Z., Li, G.Y., Deep multi-stage CSI acquisition for reconfigurable intelligent surface aided MIMO systems. IEEE Commun. Lett. 25:6 (2021), 2024–2028, 10.1109/LCOMM.2021.3063464.
Guan, X., Wu, Q., Zhang, R., Intelligent reflecting surface assisted secrecy communication: Is artificial noise helpful or not?. IEEE Wirel. Commun. Lett. 9:6 (2020), 778–782, 10.1109/LWC.2020.2969629.
Hong, S., Pan, C., Ren, H., Wang, K., Chai, K.K., Nallanathan, A., Robust transmission design for intelligent reflecting surface-aided secure communication systems with imperfect cascaded CSI. IEEE Trans. Wireless Commun. 20:4 (2021), 2487–2501, 10.1109/TWC.2020.3042828.
Hou, T., Wang, J., Liu, Y., Sun, X., Li, A., Ai, B., A joint design for STAR-RIS enhanced NOMA-CoMP networks: A simultaneous-signal-enhancement-and-cancellation-based (SSECB) design. IEEE Trans. Veh. Technol. 71:1 (2022), 1043–1048, 10.1109/TVT.2021.3129178.
Huang, C., Mo, R., Yuen, C., Reconfigurable intelligent surface assisted multiuser MISO systems exploiting deep reinforcement learning. IEEE J. Sel. Areas Commun. 38:8 (2020), 1839–1850, 10.1109/JSAC.2020.3000835.
Kermani, M.M., Zhang, M., Raghunathan, A., Jha, N.K., Emerging frontiers in embedded security. 2013 26th International Conference on VLSI Design and 2013 12th International Conference on Embedded Systems, 2013, IEEE, 203–208.
Koziel, B., Azarderakhsh, R., Kermani, M.M., Jao, D., Post-quantum cryptography on FPGA based on isogenies on elliptic curves. IEEE Trans. Circuits Syst. I. Regul. Pap. 64:1 (2016), 86–99.
Lillicrap, T.P., Hunt, J.J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., Wierstra, D., Continuous control with deep reinforcement learning. 2015 arXiv preprint arXiv:1509.02971.
Liu, Y., Mu, X., Schober, R., Poor, H.V., 2022. Simultaneously Transmitting and Reflecting (STAR)-RISs: A Coupled Phase-Shift Model. In: ICC 2022 - IEEE International Conference on Communications. Seoul, Korea, Republic of.
Liu, Y., Mu, X., Xu, J., Schober, R., Hao, Y., Poor, H.V., Hanzo, L., STAR: Simultaneous transmission and reflection for 360°coverage by intelligent surfaces. IEEE Wirel. Commun. 28:6 (2021), 102–109, 10.1109/MWC.001.2100191.
Mao, Y., Pranolo, A., Hernandez, L., Wibawa, A.P., Nuryana, Z., Artificial intelligence in mobile communication: A survey. IOP Conf. Ser. Mater. Sci. Eng., 1212(1), 2022, 012046, 10.1088/1757-899x/1212/1/012046.
Mirza, M.A., Yu, J., Raza, S., Krichen, M., Ahmed, M., Khan, W.U., Rabie, K., Shongwe, T., DRL-assisted delay optimized task offloading in automotive-industry 5.0 based VECNs. J. King Saud Univ., Comput. Inf. Sci., 35(6), 2023, 101512.
Mozaffari-Kermani, M., Sur-Kolay, S., Raghunathan, A., Jha, N.K., Systematic poisoning attacks on and defenses for machine learning in healthcare. IEEE J. Biomed. Health Inform. 19:6 (2014), 1893–1905.
Mukherjee, A., Swindlehurst, A.L., Detecting passive eavesdroppers in the MIMO wiretap channel. 2012 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP, 2012, 2809–2812, 10.1109/ICASSP.2012.6288501.
Ni, W., Liu, Y., Eldar, Y.C., Yang, Z., Tian, H., STAR-RIS enabled heterogeneous networks: Ubiquitous NOMA communication and pervasive federated learning. 2021 ArXiv. org.
Nia, A.M., Mozaffari-Kermani, M., Sur-Kolay, S., Raghunathan, A., Jha, N.K., Energy-efficient long-term continuous personal health monitoring. IEEE Trans. Multi-Scale Comput. Syst. 1:2 (2015), 85–98.
Qiu, C., Hu, Y., Chen, Y., Zeng, B., Deep deterministic policy gradient (DDPG)-based energy harvesting wireless communications. IEEE Internet Things J. 6:5 (2019), 8577–8588, 10.1109/JIOT.2019.2921159.
Rashid, L., Rubab, S., Alhaisoni, M., Alqahtani, A., Alsubai, S., Binbusayyis, A., Bukhari, S.A.C., Analysis of dimensionality reduction techniques on Internet of Things data using machine learning. Sustain. Energy Technol. Assess., 52, 2022, 102304.
Song, H., Zhang, M., Gao, J., Zhong, C., Unsupervised learning-based joint active and passive beamforming design for reconfigurable intelligent surfaces aided wireless networks. IEEE Commun. Lett. 25:3 (2021), 892–896, 10.1109/LCOMM.2020.3041510.
Sun, Y., An, K., Luo, J., Zhu, Y., Zheng, G., Chatzinotas, S., Outage constrained robust beamforming optimization for multiuser IRS-assisted anti-jamming communications with incomplete information. IEEE Internet Things J. 9:15 (2022), 13298–13314, 10.1109/JIOT.2022.3140752.
Sun, Y., An, K., Zhu, Y., Zheng, G., Wong, K.-K., Chatzinotas, S., Ng, D.W.K., Guan, D., Energy-efficient hybrid beamforming for multilayer RIS-assisted secure integrated terrestrial-aerial networks. IEEE Trans. Commun. 70:6 (2022), 4189–4210, 10.1109/TCOMM.2022.3170632.
Sun, Y., An, K., Zhu, Y., Zheng, G., Wong, K.-K., Chatzinotas, S., Yin, H., Liu, P., RIS-assisted robust hybrid beamforming against simultaneous jamming and eavesdropping attacks. IEEE Trans. Wireless Commun. 21:11 (2022), 9212–9231, 10.1109/TWC.2022.3174629.
Tang, X., Wang, D., Zhang, R., Chu, Z., Han, Z., Jamming mitigation via aerial reconfigurable intelligent surface: Passive beamforming and deployment optimization. IEEE Trans. Veh. Technol. 70:6 (2021), 6232–6237, 10.1109/TVT.2021.3077662.
Wang, C.-X., Di Renzo, M., Stańczak, S., Wang, S., Larsson, E.G., Artificial intelligence enabled wireless networking for 5G and beyond: Recent advances and future challenges. 2020 arXiv (Cornell University), 10.48550/arxiv.2001.08159.
Wang, W., Ni, W., Tian, H., Yang, Z., Huang, C., Wong, K.-K., 2022b. Robust Design for STAR-RIS Secured Internet of Medical Things. In: 2022 IEEE International Conference on Communications Workshops, ICC Workshops. Seoul, Korea, Republic of.
Wang, W., Ni, W., Tian, H., Yang, Z., Huang, C., Wong, K.-K., Safeguarding NOMA networks via reconfigurable dual-functional surface under imperfect CSI. IEEE J. Sel. Top. Sign. Proces. 16:5 (2022), 950–966, 10.1109/JSTSP.2022.3175013.
Wei, L., Huang, C., Guo, Q., Yang, Z., Zhang, Z., Alexandropoulos, G.C., Debbah, M., Yuen, C., Joint channel estimation and signal recovery for RIS-empowered multiuser communications. IEEE Trans. Commun. 70:7 (2022), 4640–4655, 10.1109/TCOMM.2022.3179771.
Wu, C., Liu, Y., Mu, X., Gu, X., Dobre, O.A., Coverage characterization of STAR-RIS networks: NOMA and OMA. IEEE Commun. Lett. 25:9 (2021), 3036–3040, 10.1109/LCOMM.2021.3091807.
Wu, Q., Zhang, R., Intelligent reflecting surface enhanced wireless network via joint active and passive beamforming. IEEE Trans. Wireless Commun. 18:11 (2019), 5394–5409, 10.1109/TWC.2019.2936025.
Xu, F., Ahmad, S., Ahmed, M., Raza, S., Khan, F., Ma, Y., Khan, W.U., et al. Beyond encryption: Exploring the potential of physical layer security in UAV networks. J. King Saud Univ., Comput. Inf. Sci., 2023, 101717.
Yang, H., Xiong, Z., Zhao, J., Niyato, D., Wu, Q., Poor, H.V., Tornatore, M., Intelligent reflecting surface assisted anti-jamming communications: A fast reinforcement learning approach. IEEE Trans. Wireless Commun. 20:3 (2021), 1963–1974, 10.1109/TWC.2020.3037767.
Yang, H., Xiong, Z., Zhao, J., Niyato, D., Xiao, L., Wu, Q., Deep reinforcement learning-based intelligent reflecting surface for secure wireless communications. IEEE Trans. Wireless Commun. 20:1 (2021), 375–388, 10.1109/TWC.2020.3024860.
Yu, X., Xu, D., Schober, R., 2019. Enabling Secure Wireless Communications via Intelligent Reflecting Surfaces. In: 2019 IEEE Global Communications Conference. GLOBECOM, Waikoloa, HI, USA, pp. 1–6. http://dx.doi.org/10.1109/GLOBECOM38437.2019.9014322.
Zhang, Z., Chen, J., Liu, Y., Wu, Q., He, B., Yang, L., On the secrecy design of STAR-RIS assisted uplink NOMA networks. IEEE Trans. Wireless Commun. 21:12 (2022), 11207–11221, 10.1109/TWC.2022.3190563.
Zhong, R., Liu, Y., Mu, X., Chen, Y., Wang, X., Hanzo, L., Hybrid reinforcement learning for STAR-RISs: A coupled phase-shift model based beamformer. IEEE J. Sel. Areas Commun. 40:9 (2022), 2556–2569, 10.1109/JSAC.2022.3192053.
Zhu, B.O., Chen, K., Jia, N., Sun, L., Zhao, J., Jiang, T., Feng, Y., Dynamic control of electromagnetic wave propagation with the equivalent principle inspired tunable metasurface. Sci. Rep., 4(1), 2014, 4971.
Zhu, B.O., Feng, Y., Passive metasurface for reflectionless and arbitary control of electromagnetic wave transmission. IEEE Trans. Antennas and Propagation 63:12 (2015), 5500–5511, 10.1109/TAP.2015.2481479.
