[en] Satellite and unmanned aerial vehicle (UAV) net-works have been introduced as enhanced approach to providedynamic control, massive connections and global coverage forfuture wireless communication systems. This paper considersa coordinated satellite-UAV communication system, where theUAV performs the environmental reconnaissance task with theassistance of satellite in a hostile jamming environment. To fulfillthis task, the UAV needs to realize autonomous trajectory controland upload the collected data to the satellite. With the aid ofthe uploading data, the satellite builds the environment situationmap integrating the beam quality, jamming status, and trafficdistribution. Accordingly, we propose a closed-loop anti-jammingdynamic trajectory optimization approach, which is divided intothree stages. Firstly, a coarse trajectory planning is made accord-ing to the limited prior information and preset points. Secondly,the flight control between two adjacent preset points is formulatedas a Markov decision process, and reinforcement learning (RL)based automatic flying control algorithms are proposed to explorethe unknown hostile environment and realize autonomous andprecise trajectory control. Thirdly, based on the collected dataduring the UAV’s flight, the satellite utilizes an environmentsituation estimating algorithm to build an environment situationmap, which is used to reselect the preset points for the first stageand provide better initialization for the RL process in the secondstage. Simulation results verify the validity and superiority of theproposed approach.
Disciplines :
Computer science
Author, co-author :
Han, Chen
Liu, Aijun
An, Kang
Wang, Haichao
Zheng, Gan
Chatzinotas, Symeon ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > SigCom
Huo, Liangyu
tong, Xinhai
External co-authors :
yes
Language :
English
Title :
Satellite-assisted UAV Trajectory Control in HostileJamming Environments
C. Han, A. Liu, X. Liang, L. Ruan, and K. Cheng, "UAV trajectory control against hostile jamming in satellite-UAV coordination networks," in Proc. IEEE 6th Int. Conf. Comput. Commun., 2020, pp. 701-705.
F. Dario and W. R. J., "Science, technology and the future of small autonomous drones," Nature, vol. 521, no. 7553, pp. 460-466, 2015.
O. Kodheli et al., "Satellite communications in the new space era: A survey and future challenges," IEEE Commun. Surv. Tut., vol. 23, no. 1, pp. 70-109, Jan.-Mar. 2021, doi: 10.1109/COMST.2020.3028247.
N. C. Coops, T. R. H. Goodbody, and L. Cao, "Four steps to extend drone use in research," Nature, vol. 572, no. 7770, pp. 433-435, 2019.
S. Zhang and J. Liu, "Analysis and optimization of multiple unmanned aerial vehicle-assisted communications in post-disaster areas," IEEE Trans. Veh. Technol., vol. 67, no. 12, pp. 12049-12060, Dec. 2018.
M. Mozaffari, A. Taleb Zadeh Kasgari, W. Saad, M. Bennis, and M. Debbah, "Beyond 5G with UAVs: Foundations of a 3D wireless cellular network," IEEE Trans. Wireless Commun., vol. 18, no. 1, pp. 357-372, Jan. 2019.
C. Han, A. Liu, L. Huo, H. Wang, and X. Liang, "A prediction-based resource matching scheme for rentable LEO satellite communication network," IEEE Commun. Lett., vol. 24, no. 2, pp. 414-417, Feb. 2020.
C. Liu, W. Feng, Y. Chen, C. Wang, and N. Ge, "Cell-free satellite-UAV networks for 6G wide-area Internet of Things," IEEE J. Sel. Areas Commun., vol. 39, no. 4, pp. 1116-1131, Apr. 2021, doi: 10.1109/JSAC.2020.3018837.
S. Gu, Y. Wang, N. Wang, and W. Wu, "Intelligent optimization of availability and communication cost in satellite-UAV mobile edge caching system with fault-tolerant codes," IEEE Trans. Cogn. Commun. Netw., vol. 6, no. 4, pp. 1230-1241, Dec. 2020, doi: 10.1109/TCCN.2020.3005921.
X. Zhang, W. Cheng, and H. Zhang, "Heterogeneous statistical qos provisioning over airborne mobile wireless networks," IEEE J. Sel. Areas Commun., vol. 36, no. 9, pp. 2139-2152, Sep. 2018.
T. Qi, W. Feng, and Y. Wang, "Outage performance of non-orthogonal multiple access based unmanned aerial vehicles satellite networks," China Commun., vol. 15, no. 5, pp. 1-8, 2018.
M. Vondra, M. Ozger, D. Schupke, and C. Cavdar, "Integration of satellite and aerial communications for heterogeneous flying vehicles," IEEE Netw., vol. 32, no. 5, pp. 62-69, Sep./Oct. 2018.
J. Lyu,Y. Zeng, andR. Zhang, "UAV-aided offloading for cellular hotspot," IEEE Trans. Wireless Commun., vol. 17, no. 6, pp. 3988-4001, Jun. 2018.
J. Zhang, Y. Zeng, and R. Zhang, "UAV-enabled radio access network: Multi-mode communication and trajectory design," IEEE Trans. Signal Process., vol. 66, no. 20, pp. 5269-5284, Oct. 2018.
D. H. Tran, T. X. Vu, S. Chatzinotas, S. ShahbazPanahi, and B. Ottersten, "Coarse trajectory design for energyminimization inUAV-enabled," IEEE Trans. Veh. Technol., vol. 69, no. 9, pp. 9483-9496, Sep. 2020.
O. Esrafilian, R. Gangula, and D. Gesbert, "Learning to communicate in UAV-aided wireless networks: Map-based approaches," IEEE Internet Things J., vol. 6, no. 2, pp. 1791-1802, Apr. 2019.
F. Cheng et al., "UAVtrajectory optimization for data offloading at the edge of multiple cells," IEEE Trans.Veh. Technol., vol. 67, no. 7, pp. 6732-6736, Jul. 2018.
J. Xu, Y. Zeng, and R. Zhang, "UAV-enabled wireless power transfer: Trajectory design and energy optimization," IEEE Trans. Wireless Commun., vol. 17, no. 8, pp. 5092-5106, Aug. 2018.
O. M. Bushnaq, A. Celik, H. Elsawy, M. Alouini, and T. Y. Al-Naffouri, "Aeronautical data aggregation and field estimation in IoT networks: Hovering and traveling time dilemma of UAVs," IEEE Trans. Wireless Commun., vol. 18, no. 10, pp. 4620-4635, Oct. 2019.
Y. Zeng and R. Zhang, "Energy-efficient UAV communication with trajectory optimization," IEEE Trans. Wireless Commun., vol. 16, no. 6, pp. 3747-3760, Jul. 2017.
Q.Wu,Y. Zeng, andR. Zhang, "Joint trajectory and communication design formulti-uav enabled wireless networks," IEEE Trans.Wireless Commun., vol. 17, no. 3, pp. 2109-2121, Mar. 2018.
X. Li, W. Feng, Y. Chen, C. Wang, and N. Ge, "Maritime coverage enhancement using UAVs coordinated with hybrid satellite-terrestrial networks," IEEE Trans. Commun., vol. 68, no. 4, pp. 2355-2369, Apr. 2020.
M. Hua, Y. Wang, M. Lin, C. Li, Y. Huang, and L. Yang, "Joint comp transmission for UAV-aided cognitive satellite terrestrial networks," IEEE Access, vol. 7, pp. 14959-14968, 2019.
A. Mostaani, O. Simeone, S. Chatzinotas, and B. Ottersten, "Learningbased physical layer communications for multiagent collaboration," in Proc. IEEE 30th Annu. Int. Symp. Pers., Indoor Mobile Radio Commun., 2019, pp. 1-6.
A. Mostaani, T. X.Vu, S. Chatzinotas, and B. Ottersten, "State aggregation for multiagent communication over rate-limited channels," in Proc. IEEE Glob. Commun. Conf., 2020, pp. 1-7.
B.Wang, Y.Wu, K. R. Liu, and T. C. Clancy, "An anti-jamming stochastic game for cognitive radio networks," IEEE J. Sel. Areas Commun., vol. 29, no. 4, pp. 877-889, Apr. 2011.
Y. Yuan, L. Lei, T. X. Vu, S. Chatzinotas, and B. Ottersten, "Actor-critic deep reinforcement learning for energy minimization in UAV-aided networks," in Proc. Eur. Conf. Netw. Commun., 2020, pp. 348-352.
Y. Yuan, L. Lei, T. X. Vu, S. Chatzinotas, S. Sun, and B. Ottersten, "Actor-critic learning based energy optimization for UAV access-andbackhaul networks," EURASIP J. Wireless Commun. Netw., vol. 2021, no. 1, pp. 1-27, 2021.
C. Han and Y. Niu, "Multi-regional anti-jamming communication scheme based on transfer learning and Q learning," KSII Trans. Internet Inf. Syst., vol. 13, no. 7, pp. 3333-3350, 2019.
C. Han, A. Liu, H. Wang, L. Huo, and X. Liang, "Dynamic anti-jamming coalition for satellite-enabled army IoT: A distributed game approach," IEEE Internet Things J., vol. 7, no. 11, pp. 10932-10944, Nov. 2020.
C. Han, L. Huo, X. Tong, H. Wang, and X. Liu, "Spatial anti-jamming scheme for internet of satellites based on the deep reinforcement learning and stackelberg game," IEEE Trans. Veh. Technol., vol. 69, no. 5, pp. 5331-5342, May 2020.
C. Han and Y. Niu, "Cross-layer anti-jamming scheme: A hierarchical learning approach," IEEE Access, vol. 6, pp. 34874-34883, 2018.
J. Cho, J. Sung, J. Yoon, and H. Lee, "Towards persistent surveillance and reconnaissance using a connected swarm ofmultipleUAVs," IEEE Access, vol. 8, pp. 157906-157917, 2020.
L. Ruan et al., "Energy-efficient multi-UAV coverage deployment in UAV networks: A game-theoretic framework," China Commun., vol. 15, no. 10, pp. 194-209, 2018.
I. D. Moscholios,V. G.Vassilakis, P.G. Sarigiannidis, N. C. Sagias, and M. D. Logothetis, "An analytical framework in LEO mobile satellite systems servicing batched poisson traffic," IET Commun., vol. 12, no. 1, pp. 18-25, 2017.
K. An,M. Lin,W. Zhu, Y. Huang, and G. Zheng, "Outage performance of cognitive hybrid satellite-terrestrial networks with interference constraint," IEEE Trans. Veh. Technol., vol. 65, no. 11, pp. 9397-9404, Nov. 2016.
K. An, M. Lin, and T. Liang, "On the performance of multiuser hybrid satellite-terrestrial relay networks with opportunistic scheduling," IEEE Commun. Lett., vol. 19, no. 10, pp. 1722-1725, Oct. 2015.
Z. Gao, A. Liu, C. Han, and X. Liang, "Max completion time optimization for Internet of Things in LEO satellite-terrestrial integrated networks," IEEE Internet Things J., vol. 8, no. 12, pp. 9981-9994, Jun. 2021.
L. You, K. X. Li, J. Wang, X. Gao, X. G. Xia, and B. Ottersten, "Massive MIMOtransmission forLEOsatellite communications," IEEE J. Sel. Areas Commun., vol. 38, no. 8, pp. 1851-1865, Aug. 2020.
Y. Zeng, J. Xu, and R. Zhang, "Energy minimization for wireless communication with rotary-wing UAV," IEEE Trans. Wireless Commun., vol. 18, no. 4, pp. 2329-2345, Apr. 2019.
M. Dorigo and L. M. Gambardella, "Ant colony system: A cooperative learning approach to the traveling salesman problem," IEEE Trans. Evol. Comput., vol. 1, no. 1, pp. 53-66, Apr. 1997.
C. Groba, A. Sartal, and X. H. Vázquez, "Solving the dynamic traveling salesman problem using a genetic algorithm with trajectory prediction: An application to fish aggregating devices," Comput. Oper. Res., vol. 56, pp. 22-32, 2015.
A. Kianercy and A. Galstyan, "Dynamics of Boltzmann q learning in two-player two-action games,"Phys. Rev. E, vol. 85, no. 4, pp. 1574-1604, 2012.
