Network Traffic Modeling and Prediction Using Graph Gaussian Processes

;

2022 • In *IEEE Access*

Peer Reviewed verified by ORBi

Network_Traffic_Modeling_and_Prediction_Using_Graph_Gaussian_Processes.pdf

Publisher postprint (1.41 MB)

All documents in ORBilu are protected by a user license.

copy to clipboard copied

Abstract :

[en] Traffic modeling and prediction is a vital task for designing efficient resource allocation
strategies in telecommunication networks. This is challenging because network traffic data exhibits complex
nonlinear spatiotemporal interactions. Moreover, the data can have missing values when traffic statistic
collection is unavailable in certain nodes. In this paper, we introduce a graph Gaussian Process (GP) model
for this challenging problem. The GP is a Bayesian non-parametric model and highly flexible in capturing
complex patterns in the data. Additionally, it provides uncertainty information which can be exploited for
robust resource allocation problems. The developed graph GP model is almost free of hyper-parameter
tuning, can accurately capture short-term and long-term temporal patterns and can infer missing values
by learning spatiotemporal interactions among the nodes in the network. Subsequently, we approximate
the intractable posterior distribution using Variational Bayes (VB) algorithm which can be efficiently
implemented. Finally, we evaluate the accuracy of the proposed model for predicting the data traffic using
two real-world network datasets. Our simulation results shows that the proposed model can achieve better
prediction accuracy with respect to the state-of-the-art approaches

Disciplines :

Computer science

MEHRIZI, Sajad

Chatzinotas, Symeon ^{} ^{}; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > SigCom

External co-authors :

yes

Language :

English

Title :

Network Traffic Modeling and Prediction Using Graph Gaussian Processes

Publication date :

2022

Journal title :

IEEE Access

ISSN :

2169-3536

Publisher :

Institute of Electrical and Electronics Engineers, Piscataway, United States - New Jersey

Peer reviewed :

Peer Reviewed verified by ORBi

Focus Area :

Computational Sciences

Additional URL :

Funders :

European Research Council (Grant Number: 742648)

10.13039/501100001866-Fonds National de la Recherche Luxembourg (Grant Number: 13718904)

10.13039/501100001866-Fonds National de la Recherche Luxembourg (Grant Number: 13718904)

Available on ORBilu :

since 21 December 2022

Scopus citations^{®}

0

Scopus citations^{®}

without self-citations

without self-citations

0

WoS citations^{™}

0

- A. Baiocchi, Network Traffic Engineering Stochastic Models and Applications. Hoboken, NJ, USA: Wiley, 2020.
- R. Mijumbi, J. Serrat, J.-L. Gorricho, N. Bouten, F. De Turck, and R. Boutaba, "Network function virtualization: State-of-the-art and research challenges, " IEEE Commun. Surveys Tuts., vol. 18, no. 1, pp. 236-262, 1st Quart., 2015.
- M. Chen, U. Challita, W. Saad, C. Yin, and M. Debbah, "Artificial neural networks-based machine learning for wireless networks: A tutorial, " IEEE Commun. Surveys Tuts., vol. 21, no. 4, pp. 3039-3071, 4th Quart., 2019.
- H. Feng and Y. Shu, "Study on network traffic prediction techniques, " in Proc. Int. Conf. Wireless Commun., Netw. Mobile Comput., vol. 2, Sep. 2005, pp. 1041-1044.
- A. Azari, P. Papapetrou, S. Denic, and G. Peters, "Cellular traffic prediction and classification: A comparative evaluation of LSTM and ARIMA, " in Proc. Int. Conf. Discovery Sci. Cham, Switzerland: Springer, 2019, pp. 129-144.
- T. Karagiannis, M. Molle, and M. Faloutsos, "Long-range dependence ten years of internet traffic modeling, " IEEE Internet Comput., vol. 8, no. 5, pp. 57-64, Oct. 2004.
- C. Chen, J. Hu, Q. Meng, and Y. Zhang, "Short-time traffic flow prediction with ARIMA-GARCH model, " in Proc. IEEE Intell. Vehicles Symp. (IV), Jun. 2011, pp. 607-612.
- S. Periyanayagi and V. Sumathy, "S-ARMA model for network traffic prediction in wireless sensor networks, " J. Theor. Appl. Inf. Technol., vol. 60, no. 3, pp. 1-7, 2014.
- I. Loumiotis, E. Adamopoulou, K. Demestichas, P. Kosmides, and M. Theologou, "Artificial neural networks for traffic prediction in 4G networks, " in Proc. Int. Wireless Internet Conf. Cham, Switzerland: Springer, 2014, pp. 141-146.
- A. Azzouni and G. Pujolle, "NeuTM: A neural network-based framework for traffic matrix prediction in SDN, " in Proc. IEEE/IFIP Netw. Oper. Manage. Symp., Apr. 2018, pp. 1-5.
- C.-W. Huang, C.-T. Chiang, and Q. Li, "A study of deep learning networks on mobile traffic forecasting, " in Proc. IEEE 28th Annu. Int. Symp. Pers., Indoor, Mobile Radio Commun. (PIMRC), Oct. 2017, pp. 1-6.
- A. Azari, P. Papapetrou, S. Denic, and G. Peters, "User traffic prediction for proactive resource management: Learning-powered approaches, " in Proc. IEEE Global Commun. Conf. (GLOBECOM), Dec. 2019, pp. 1-6.
- A. Rago, G. Piro, G. Boggia, and P. Dini, "Multi-task learning at the mobile edge: An effective way to combine traffic classification and prediction, " IEEE Trans. Veh. Technol., vol. 69, no. 9, pp. 10362-10374, Sep. 2020.
- C. Qiu, Y. Zhang, Z. Feng, P. Zhang, and S. Cui, "Spatio-temporal wireless traffic prediction with recurrent neural network, " IEEE Wireless Commun. Lett., vol. 7, no. 4, pp. 554-557, Aug. 2018.
- X. Cao, Y. Zhong, Y. Zhou, J. Wang, C. Zhu, and W. Zhang, "Interactive temporal recurrent convolution network for traffic prediction in data centers, " IEEE Access, vol. 6, pp. 5276-5289, 2018.
- Y. Seo, M. Defferrard, P. Vandergheynst, and X. Bresson, "Structured sequence modeling with graph convolutional recurrent networks, " in Proc. Int. Conf. Neural Inf. Process. Cham, Switzerland: Springer, 2018, pp. 362-373.
- B. Yu, H. Yin, and Z. Zhu, "Spatio-temporal graph convolutional networks: A deep learning framework for traffic forecasting, " 2017, arXiv:1709.04875.
- D. Andreoletti, S. Troia, F. Musumeci, S. Giordano, G. Maier, and M. Tornatore, "Network traffic prediction based on diffusion convolutional recurrent neural networks, " in Proc. IEEE Conf. Comput. Commun. Workshops, Apr. 2019, pp. 246-251.
- M. Kalander, M. Zhou, C. Zhang, H. Yi, and L. Pan, "Spatioff temporal hybrid graph convolutional network for traffic forecasting in telecommunication networks, " 2020, arXiv:2009.09849.
- S. Sun and X. Xu, "Variational inference for infinite mixtures of Gaussian processes with applications to traffic flow prediction, " IEEE Trans. Intell. Transp. Syst., vol. 12, no. 2, pp. 466-475, Jun. 2011.
- A. Bayati, V. Asghari, K. Nguyen, and M. Cheriet, "Gaussian process regression based traffic modeling and prediction in high-speed networks, " in Proc. IEEE Global Commun. Conf. (GLOBECOM), Dec. 2016, pp. 1-7.
- A. Bayati, K.-K. Nguyen, and M. Cheriet, "Gaussian process regression ensemble model for network traffic prediction, " IEEE Access, vol. 8, pp. 176540-176554, 2020.
- Y. Xu, F. Yin, W. Xu, J. Lin, and S. Cui, "Wireless traffic prediction with scalable Gaussian process: Framework, algorithms, and verification, " IEEE J. Sel. Areas Commun., vol. 37, no. 6, pp. 1291-1306, Jun. 2019.
- C. E. Rasmussen, "Gaussian processes in machine learning, " in Summer School on Machine Learning. Berlin, Germany: Springer, 2003, pp. 63-71.
- A. G. Wilson, "Covariance kernels for fast automatic pattern discovery and extrapolation with Gaussian processes, " Ph.D. dissertation, Univ. Cambridge, Cambridge, U.K., 2014.
- D. J. C. MacKay, "Introduction to Gaussian processes, " NATO ASI F, Comput. Sys. Sci., vol. 168, pp. 133-166, Jan. 1998.
- F. Lindgren, H. Rue, and J. Lindstrom, "An explicit link between Gaussian fields and Gaussian Markov random fields: The stochastic partial differential equation approach, " J. Roy. Stat. Soc., vol. 73, no. 4, pp. 423-498, 2011.
- A. Venkitaraman, S. Chatterjee, and P. Handel, "Gaussian processes over graphs, " in Proc. IEEE Int. Conf. Acoust., Speech Signal Process. (ICASSP), May 2020, pp. 5640-5644.
- K. B. Petersen and M. S. Pedersen, "The matrix cookbook, " Tech. Univ. Denmark, vol. 7, p. 510, Nov. 2008.
- M. J. Beal, Variational Algorithms for Approximate Bayesian Inference. London, U.K.: University of London, University College London, 2003.
- K. P. Murphy, Machine Learning: A Probabilistic Perspective. Cambridge, MA, USA: MIT Press, 2012.
- Networks With Multiple Demand Matrices. Accessed: Dec. 30, 2021. [Online]. Available: http://sndlib.zib.de/home.action
- S. Seabold and J. Perktold, "Statsmodels: Econometric and statistical modeling with Python, " in Proc. 9th Python Sci. Conf., 2010, pp. 1-5.
- S. Hochreiter and J. Schmidhuber, "Long short-term memory, " Neural Comput., vol. 9, no. 8, pp. 1735-1780, 1997.
- C. Zheng, X. Fan, C. Wang, and J. Qi, "GMAN: A graph multi-attention network for traffic prediction, " in Proc. AAAI, 2020, vol. 34, no. 1, pp. 1234-1241.
- D. P. Kingma and J. Ba, "Adam: A method for stochastic optimization, " 2014, arXiv:1412.6980.
- I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning. Cambridge, MA, USA: MIT Press, 2016.