Sami Abu-El-Haija, Bryan Perozzi, Amol Kapoor, Nazanin Alipourfard, Kristina Lerman, Hrayr Harutyun-yan, Greg Ver Steeg, and Aram Galstyan. Mixhop: Higher-order graph convolutional architectures via sparsified neighborhood mixing. In Proceedings of the 2019 International Conference on Machine Learning (ICML), pp. 21–29. JMLR, 2019.
Waïss Azizian and Marc Lelarge. Characterizing the expressive power of invariant and equivariant graph neural networks. CoRR, abs/2006.15646, 2020.
Peter W. Battaglia, Jessica B. Hamrick, Victor Bapst, Alvaro Sanchez-Gonzalez, Vinícius Flores Zambaldi, Mateusz Malinowski, Andrea Tacchetti, David Raposo, Adam Santoro, Ryan Faulkner, Çaglar Gülçehre, H. Francis Song, Andrew J. Ballard, Justin Gilmer, George E. Dahl, Ashish Vaswani, Kelsey R. Allen, Charles Nash, Victoria Langston, Chris Dyer, Nicolas Heess, Daan Wierstra, Pushmeet Kohli, Matthew Botvinick, Oriol Vinyals, Yujia Li, and Razvan Pascanu. Relational inductive biases, deep learning, and graph networks. CoRR, abs/1806.01261, 2018.
Deyu Bo, Xiao Wang, Chuan Shi, and Huawei Shen. Beyond low-frequency information in graph convo-lutional networks. In Proceedings of the 2021 AAAI Conference on Artificial Intel ligence (AAAI), pp. 3950–3957. AAAI, 2021.
Michael M. Bronstein, Joan Bruna, Taco Cohen, and Petar Velickovic. Geometric deep learning: Grids, groups, graphs, geodesics, and gauges. CoRR, abs/2104.13478, 2021.
Ming Chen, Zhewei Wei, Zengfeng Huang, Bolin Ding, and Yaliang Li. Simple and deep graph convolutional networks. In Proceedings of the 2020 International Conference on Machine Learning (ICML). JMLR, 2020.
Eli Chien, Jianhao Peng, Pan Li, and Olgica Milenkovic. Adaptive universal generalized pagerank graph neural network. In Proceedings of the 2021 International Conference on Learning Representations (ICLR), 2021.
Simon S. Du, Kangcheng Hou, Ruslan Salakhutdinov, Barnabás Póczos, Ruosong Wang, and Keyulu Xu. Graph neural tangent kernel: Fusing graph neural networks with graph kernels. In Proceedings of the 2019 Annual Conference on Neural Information Processing Systems (NeurIPS). NeurIPS, 2019.
Dhivya Eswaran, Stephan Günnemann, Christos Faloutsos, Disha Makhija, and Mohit Kumar. Zoobp: Belief propagation for heterogeneous networks. Proc. VLDB Endow., 10(5):625–636, 2017.
Wolfgang Gatterbauer. Semi-supervised learning with heterophily. CoRR, abs/1412.3100, 2014.
Wolfgang Gatterbauer. The linearization of belief propagation on pairwise markov random fields. In Proceedings of the 2017 AAAI Conference on Artificial Intel ligence (AAAI), pp. 3747–3753. AAAI, 2017.
Wolfgang Gatterbauer, Stephan Günnemann, Danai Koutra, and Christos Faloutsos. Linearized and single-pass belief propagation. Proc. VLDB Endow., 8(5):581–592, 2015.
S. R. Searle H. V. Henderson. The vec-permutation matrix, the vec operator and kronecker products: A review. Linear and multilinear algebra, 9(4):271–288, 1981.
Weihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong, Hongyu Ren, Bowen Liu, Michele Catasta, and Jure Leskovec. Open graph benchmark: Datasets for machine learning on graphs. In Proceedings of the 2020 Annual Conference on Neural Information Processing Systems (NeurIPS). NeurIPS, 2020.
Qian Huang, Horace He, Abhay Singh, Ser-Nam Lim, and Austin R. Benson. Combining label propagation and simple models out-performs graph neural networks. In Proceedings of the 2021 International Conference on Learning Representations (ICLR), 2021.
Sergei Ivanov and Liudmila Prokhorenkova. Boost then convolve: Gradient boosting meets graph neural networks. In Proceedings of the 2021 International Conference on Learning Representations (ICLR), 2021.
Dongkwan Kim and Alice Oh. How to find your friendly neighborhood: Graph attention design with self-supervision. In Proceedings of the 2021 International Conference on Learning Representations (ICLR), 2021.
Thomas N. Kipf and Max Welling. Semi-supervised classification with graph convolutional networks. In Proceedings of the 2017 International Conference on Learning Representations (ICLR), 2017.
Danai Koutra, Tai-You Ke, U Kang, Duen Horng Chau, Hsing-Kuo Kenneth Pao, and Christos Faloutsos. Unifying guilt-by-association approaches: Theorems and fast algorithms. In Machine Learning and Knowledge Discovery in Databases-European Conference (ECMLPKDD), volume 6912, pp. 437–452. Springer, 2011.
Pan Li, Yanbang Wang, Hongwei Wang, and Jure Leskovec. Distance encoding-design provably more powerful graph neural networks for structural representation learning. In Proceedings of the 2020 Annual Conference on Neural Information Processing Systems (NeurIPS). NeurIPS, 2020.
Qimai Li, Zhichao Han, and Xiao-Ming Wu. Deeper insights into graph convolutional networks for semi-supervised learning. In Proceedings of the 2018 AAAI Conference on Artificial Intel ligence (AAAI), pp. 3538–3545. AAAI, 2018.
Derek Lim, Felix Hohne, Xiuyu Li, Sijia Linda Huang, Vaishnavi Gupta, Omkar Bhalerao, and Ser-Nam Lim. Large scale learning on non-homophilous graphs: New benchmarks and strong simple methods. In Proceedings of the 2021 Annual Conference on Neural Information Processing Systems (NeurIPS). NeurIPS, 2021.
Péter Mernyei and Catalina Cangea. Wiki-cs: A wikipedia-based benchmark for graph neural networks. CoRR, abs/2007.02901, 2020.
Yimeng Min, Frederik Wenkel, and Guy Wolf. Scattering GCN: overcoming oversmoothness in graph con-volutional networks. In Proceedings of the 2020 Annual Conference on Neural Information Processing Systems (NeurIPS). NeurIPS, 2020.
Krishna Kumar P., Paul Langton, and Wolfgang Gatterbauer. Factorized graph representations for semi-supervised learning from sparse data. In Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data (SIGMOD), pp. 1383–1398. ACM, 2020.
Leto Peel. Graph-based semi-supervised learning for relational networks. In Proceedings of the 2017 SIAM International Conference on Data Mining, pp. 435–443. SIAM, 2017.
Hongbin Pei, Bingzhe Wei, Kevin Chen-Chuan Chang, Yu Lei, and Bo Yang. Geom-gcn: Geometric graph convolutional networks. In Proceedings of the 2020 International Conference on Learning Representations (ICLR), 2020.
Jeffrey Pennington, Richard Socher, and Christopher D. Manning. Glove: Global vectors for word repre-sentation. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1532–1543. ACL, 2014.
Frank Rosenblatt. Principles of neurodynamics. perceptrons and the theory of brain mechanisms. Technical report, Cornell Aeronautical Lab Inc Buffalo NY, 1961.
Emanuele Rossi, Fabrizio Frasca, Ben Chamberlain, Davide Eynard, Michael M. Bronstein, and Federico Monti. Sign: Scalable inception graph neural networks. CoRR, abs/2004.11198, 2020.
Benedek Rozemberczki, Carl Allen, and Rik Sarkar. Multi-scale attributed node embedding. Journal of Complex Networks, 9(2), 2021.
Yousef Saad. Iterative methods for sparse linear systems. SIAM, 1981.
Oleksandr Shchur, Maximilian Mumme, Aleksandar Bojchevski, and Stephan Günnemann. Pitfalls of graph neural network evaluation. CoRR, abs/1811.05868, 2018.
Richard Sinkhorn and Paul Knopp. Concerning nonnegative matrices and doubly stochastic matrices. Pacific Journal of Mathematics, 21(2):343–348, 1967.
Jie Tang, Jimeng Sun, Chi Wang, and Zi Yang. Social influence analysis in large-scale networks. In Proceedings of the 2009 ACM Conference on Knowledge Discovery and Data Mining (KDD), pp. 807–816. ACM, 2009.
Yu Tian, Long Zhao, Xi Peng, and Dimitris N. Metaxas. Rethinking kernel methods for node representation learning on graphs. In Proceedings of the 2019 Annual Conference on Neural Information Processing Systems (NeurIPS), pp. 11681–11692. NeurIPS, 2019.
Petar Velickovic, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Lio, and Yoshua Bengio. Graph attention networks. In Proceedings of the 2018 International Conference on Learning Representations (ICLR), 2018.
Hongwei Wang and Jure Leskovec. Unifying graph convolutional neural networks and label propagation. abs/2002.06755, 2020.
Eric W Weisstein. Gershgorin circle theorem. https://mathworld. wolfram. com/, 2003.
Zonghan Wu, Shirui Pan, Fengwen Chen, Guodong Long, Chengqi Zhang, and Philip S. Yu. A comprehensive survey on graph neural networks. IEEE Transactions on Neural Networks and Learning Systems, 32(1): 4–24, 2021.
Keyulu Xu, Weihua Hu, Jure Leskovec, and Stefanie Jegelka. How powerful are graph neural networks? In Proceedings of the 2019 International Conference on Machine Learning (ICML). JMLR, 2019.
Yujun Yan, Milad Hashemi, Kevin Swersky, Yaoqing Yang, and Danai Koutra. Two sides of the same coin: Heterophily and oversmoothing in graph convolutional neural networks. abs/2102.06462, 2021.
Cheng Yang, Zhiyuan Liu, Deli Zhao, Maosong Sun, and Edward Y. Chang. Network representation learning with rich text information. In Proceedings of the 2015 International Joint Conferences on Artifical Intel ligence (IJCAI), pp. 2111–2117. IJCAI, 2015.
Ziwei Zhang, Peng Cui, and Wenwu Zhu. Deep learning on graphs: A survey. IEEE Transactions on Knowledge and Data Engineering, 2020.
Lingxiao Zhao and Leman Akoglu. Pairnorm: Tackling oversmoothing in gnns. In Proceedings of the 2020 International Conference on Learning Representations (ICLR), 2020.
Elena Zheleva and Lise Getoor. To join or not to join: the illusion of privacy in social networks with mixed public and private user profiles. In Proceedings of the 2009 International Conference on World Wide Web (WWW), pp. 531–540. ACM, 2009.
Xin Zheng, Yixin Liu, Shirui Pan, Miao Zhang, Di Jin, and Yu Philip S. Graph neural networks for graphs with heterophily: A survey. CoRR, abs/2202.07082, 2022.
Dengyong Zhou, Olivier Bousquet, Thomas Navin Lal, Jason Weston, and Bernhard Schölkopf. Learning with local and global consistency. In Proceedings of the 2003 Annual Conference on Neural Information Processing Systems (NIPS), pp. 321–328. NIPS, 2003.
Jiong Zhu, Yujun Yan, Lingxiao Zhao, Mark Heimann, Leman Akoglu, and Danai Koutra. Beyond homophily in graph neural networks: Current limitations and effective designs. In Proceedings of the 2020 Annual Conference on Neural Information Processing Systems (NeurIPS). NeurIPS, 2020.
Jiong Zhu, Ryan A. Rossi, Anup B. Rao, Tung Mai, Nedim Lipka, Nesreen K. Ahmed, and Danai Koutra. Graph neural networks with heterophily. In Proceedings of the 2021 AAAI Conference on Artificial Intel-ligence (AAAI), pp. 11168–11176. AAAI, 2021.
Xiaojin Zhu. Semi-supervised learning literature survey. Technical report, University of Wisconsin-Madison Department of Computer Sciences, 2005.
