References of "Yuan, Yaxiong 50034266"
     in
Bookmark and Share    
Full Text
Peer Reviewed
See detailActor-Critic Deep Reinforcement Learning for Energy Minimization in UAV-Aided Networks
Yuan, Yaxiong UL; Lei, Lei UL; Vu, Thang Xuan UL et al

in 2020 European Conference on Networks and Communications (EuCNC) (2020, September 21)

In this paper, we investigate a user-timeslot scheduling problem for downlink unmanned aerial vehicle (UAV)-aided networks, where the UAV serves as an aerial base station. We formulate an optimization ... [more ▼]

In this paper, we investigate a user-timeslot scheduling problem for downlink unmanned aerial vehicle (UAV)-aided networks, where the UAV serves as an aerial base station. We formulate an optimization problem by jointly determining user scheduling and hovering time to minimize UAV’s transmission and hovering energy. An offline algorithm is proposed to solve the problem based on the branch and bound method and the golden section search. However, executing the offline algorithm suffers from the exponential growth of computational time. Therefore, we apply a deep reinforcement learning (DRL) method to design an online algorithm with less computational time. To this end, we first reformulate the original user scheduling problem to a Markov decision process (MDP). Then, an actor-critic-based RL algorithm is developed to determine the scheduling policy under the guidance of two deep neural networks. Numerical results show the proposed online algorithm obtains a good tradeoff between performance gain and computational time. [less ▲]

Detailed reference viewed: 42 (1 UL)
Full Text
Peer Reviewed
See detailBeam Illumination Pattern Design in Satellite Networks: Learning and Optimization for Efficient Beam Hopping
Lei, Lei UL; Lagunas, Eva UL; Yuan, Yaxiong UL et al

in IEEE Access (2020)

Beam hopping (BH) is considered to provide a high level of flexibility to manage irregular and time-varying traffic requests in future multi-beam satellite systems. In BH optimization, adopting ... [more ▼]

Beam hopping (BH) is considered to provide a high level of flexibility to manage irregular and time-varying traffic requests in future multi-beam satellite systems. In BH optimization, adopting conventional iterative heuristics may have their own limitations in providing timely solutions, and directly using data-driven technique to approximate optimization variables may lead to constraint violation and degraded performance. In this paper, we explore a combined learning-and-optimization (L&O) approach to provide an efficient, feasible, and near-optimal solution. The investigations are from the following aspects: 1) Integration ofBH optimization and learning techniques; 2) Features to be learned in BH design; 3) How to address the feasibility issue incurred by machine learning. We provide numerical results and analysis to show that the learning component in L&O significantly accelerates the procedure of identifying promising BH patterns, resulting in reduced computing time from seconds/minutes to milliseconds level. The identified learning feature enables high accuracy in predictions. In addition, the optimization component in L&O guarantees the solution’s feasibility and improves the overall performance with around 5% gap to the optimum. [less ▲]

Detailed reference viewed: 68 (10 UL)
Full Text
Peer Reviewed
See detailProxSGD: Training Structured Neural Networks under Regularization and Constraints
Yang, Yang; Yuan, Yaxiong UL; Chatzimichailidis, Avraam et al

in International Conference on Learning Representations (ICLR) 2020 (2020)

Detailed reference viewed: 18 (1 UL)