[en] In this paper, we present a distributed algorithm for the reconstruction of large-scale nonlinear networks. In particular, we focus on the identification from time-series data of the nonlinear functional forms and associated parameters of large-scale nonlinear networks. In (Pan et al. (2013)), a nonlinear network reconstruction problem was formulated as a nonconvex optimisation problem based on the combination of a marginal likelihood maximisation procedure with sparsity inducing priors. Using a convex-concave procedure (CCCP), an iterative reweighted lasso algorithm was derived to solve the initial nonconvex optimisation problem. By exploiting the structure of the objective function of this reweighted lasso algorithm, a distributed algorithm can be designed. To this end, we apply the alternating direction method of multipliers (ADMM) to decompose the original problem into several subproblems. To illustrate the effectiveness of the proposed methods, we use our approach to identify a network of interconnected Kuramoto oscillators with different network sizes (500∼100,000 nodes).
Disciplines :
Ingénierie, informatique & technologie: Multidisciplinaire, généralités & autres
C.M. Bishop. Pattern recognition and machine learning, Volume 4. Springer New York, 2006.
S. Boyd, N. Parikh, E. Chu, B. Peleato, and J. Eckstein. Distributed optimization and statistical learning via the alternating direction method of multipliers. Foundations and Trends in Machine Learning, 3(1):1-122, 2011.
E.J. Candès and T. Tao. Decoding by linear programming. Information Theory, IEEE Transactions on, 51(12): 4203-4215, 2005.
D.L. Donoho and M. Elad. Optimally sparse representation in general (nonorthogonal) dictionaries via in minimization. Proceedings of the National Academy of Sciences, 100(5):2197-2202, 2003.
M. Grant, S. Boyd, and Y. Ye. Cvx: Matlab software for disciplined convex programming. Online accessiable: http://stanford.edu/boyd/cvx, 2008.
L. Ljung. System Identification: Theory for the User. Prentice Hall, 1999.
J. Palmer, K. Kreutz-Delgado, B. D. Rao, and D. P. Wipf. Variational em algorithms for non-gaussian latent variable models. In Advances in neural information processing systems, pages 1059-1066, 2005.
W. Pan, Y. Yuan, J. Gonçalves, and G.-B. Stan. Bayesian approaches to nonlinear network reconstruction. submitted, 2013.
W. Pan, A. Sootla, and G.-B. Stan. Distributed Reconstruction of Nonlinear Networks: An ADMM Approach. ArXiv e-prints, 2014. arXiv 1403.7429.
S.H. Strogatz. From kuramoto to crawford: exploring the onset of synchronisation in populations of coupled oscillators. Physica D: Nonlinear Phenomena, 143(1): 1-20, 2000.
R. Tibshirani. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society. Series B (Methodological), pages 267-288, 1996.
M.E. Tipping. Sparse bayesian learning and the relevance vector machine. The Journal of Machine Learning Research, 1:211-244, 2001.
D. Wipf and S. Nagarajan. Iterative reweighted 11 and 12 methods for finding sparse solutions. IEEE Journal of Selected Topics in Signal Processing, 4(2):317-329, 2010.
D.P. Wipf, B.D. Rao, and S. Nagarajan. Latent variable bayesian models for promoting sparsity. Information Theory, IEEE Transactions on, 57(9):6236-6255, 2011.