Bayesian neural network; Critical transition temperature; high temperature superconducting (HTS); machine learning; stochastic optimization algorithm; variational inference; Bayesian neural networks; Critical transition temperatures; High temperature superconducting; Stochastic optimization algorithm; Variational inference; Electronic, Optical and Magnetic Materials; Condensed Matter Physics; Electrical and Electronic Engineering
Abstract :
[en] Much research in recent years has focused on using empirical machine learning approaches to extract useful insights on the structure-property relationships of superconductor material. Notably, these approaches are bringing extreme benefits when superconductivity data often come from costly and arduously experimental work. However, this assessment cannot be based solely on an open black-box machine learning, which is not fully interpretable, because it can be counter-intuitive to understand why the model may give an appropriate response to a set of input data for superconductivity characteristic analyses, e.g., critical temperature. The purpose of this study is to describe and examine an alternative approach for predicting the superconducting transition temperature Tc from SuperCon database obtained by Japan's National Institute for Materials Science. We address a generative machine-learning framework called Variational Bayesian Neural Network using superconductors chemical elements and formula to predict Tc. In such a context, the importance of the paper in focus is twofold. First, to improve the interpretability, we adopt a variational inference to approximate the distribution in latent parameter space for the generative model. It statistically captures the mutual correlation of superconductor compounds and; then, gives the estimation for the Tc. Second, a stochastic optimization algorithm, which embraces a statistical inference named Monte Carlo sampler, is utilized to optimally approximate the proposed inference model, ultimately determine and evaluate the predictive performance. As a result, in comparison with the standard evaluation metrics, the results are promising and also agree with the existing models prevalent in the field. The R2 value obtained is very close to the best model (0.94), whereas a considerable improvement is seen in the RMSE value (3.83 K). Notably, the proposed model is known as the first of its kind for predicting a superconductor's Tc.
Disciplines :
Computer science
Author, co-author :
LE, Thanh-Dung ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > SigCom ; Biomedical Information Processing Lab, Ecole de Technologie Superieure, Montreal, Canada
Noumeir, Rita ; Biomedical Information Processing Lab, Ecole de Technologie Superieure, Montreal, Canada
Quach, Huu Luong ; Applied Superconducting Lab, Jeju National University, Jeju-si, South Korea
Kim, Ji Hyung ; Applied Superconducting Lab, Jeju National University, Jeju-si, South Korea
Kim, Jung Ho; Institute for Superconducting and Electronic Materials, Australian Institute of Innovative Materials, University of Wollongong, Wollongong, Australia
Kim, Ho Min ; Applied Superconducting Lab, Jeju National University, Jeju-si, South Korea
External co-authors :
yes
Language :
English
Title :
Critical Temperature Prediction for a Superconductor: A Variational Bayesian Neural Network Approach
Publication date :
June 2020
Journal title :
IEEE Transactions on Applied Superconductivity
ISSN :
1051-8223
Publisher :
Institute of Electrical and Electronics Engineers Inc.
Canada First Research Excellence Fund Program through IVADO Doctoral Scholarship for International Student from Le Fonds de Recherche du Quebec Nature et Technologies
Funding text :
Manuscript received September 24, 2019; accepted January 29, 2020. Date of publication February 4, 2020; date of current version February 25, 2020. The work of T. D. Le was supported in part by the Canada First Research Excellence Fund Program through IVADO, and in part by the Doctoral Scholarship for International Student from Le Fonds de Recherche du Quebec Nature et Technologies. (Corresponding author: Thanh Dung Le.) T. D. Le and R. Noumeir are with the Biomedical Information Processing Lab, Ecole de Technologie Superieure, Montreal, QC H3C 1K3, Canada (e-mail: thanh-dung.le@etsmtl.ca).
N. Wagner and J. M. Rondinelli, "Theory-guided machine learning in materials science, " Frontiers Mater., vol. 3, 2016, Art. no. 28.
D.M. Dimiduk, A. Holm, and S. R. Niezgoda, "Perspectives on the impact of machine learning, deep learning, and artificial intelligence on materials, processes, and structures engineering, " Integrating Mater. Manuf. Innov., pp. 157-172, 2018.
B. Kailkhura et al., "Reliable and explainable machine learning methods for accelerated material discovery, " NPJ Comput. Mater., vol. 5, no. 1, pp. 1-9, 2019.
A. L. Ferguson, "Machine learning and data science in soft materials engineering, " J. Phys.: Condens. Matter, vol. 30, no. 4, 2017, Art. no. 043002.
B. Meredig et al., "Can machine learning identify the next hightemperature superconductor? examining extrapolation performance for materials discovery, " Mol. Syst. Des. Eng., vol. 3, no. 5, pp. 819-825, 2018.
V. Stanev et al., "Machine learning modeling of superconducting critical temperature, " NPJ Comput. Mater., vol. 4, no. 1, 2018, Art. no. 29.
J. Drugowitsch, "Variational Bayesian inference for linear and logistic regression, " 2013, arXiv:1310.5438.
D. P. Kingma and M. Welling, "Auto-encoding variational bayes, " 2013, arXiv:1312.6114.
S. C. Wimbush and N. M. Strickland, "A public database of hightemperature superconductor critical current data, " IEEE Trans. Appl. Supercond., vol. 27, no. 4, Jun. 2016, Art. no. 8000105.
Japan'sNational Institute for Materials Science, SuperconductingMaterial Database, 2019. [Online]. Available: https://supercon.nims.go.jp/index-en.html, Accessed on: Feb. 3, 2019.
K. Hamidieh, "A data-driven statistical model for predicting the critical temperature of a superconductor, " Comput. Mater. Sci., vol. 154, pp. 346-354, 2018.
T. O. Owolabik, O. Akande, and S. O. Olatunji, "Application of computational intelligence technique for estimating superconducting transition temperature of YBCO superconductors, " Appl. Soft Comput., vol. 43, pp. 143-149, 2016.
T. Konno et al., "Deep learning model for finding new superconductors, " Bulletin Amer. Phys. Soc., 2020.
S. Zeng, Y. Zhao, G. Li, R. Wang, X. Wang, and J. Ni, "Atom table convolutional neural networks for an accurate prediction of compounds properties, " NPJ Comput. Mater., vol. 5, no. 1, pp. 1-7, 2019.
E. Abbe and C. Sandon, "Provable limitations of deep learning, " 2019, arXiv:1812.06369.
J. Shi et al., "ZhuSuan: A library for Bayesian deep learning, " 2017, arXiv:1709.05870.
K. G. Sheela and S.N.Deepa, "Reviewonmethods to fix number of hidden neurons in neural networks, " Math. Problems Eng., 2013.
E. Hoffer, I. Hubara, and D. Soudry, "Train longer, generalize better: closing the generalization gap in large batch training of neural networks, " in Proc. Adv. Neural Inf. Process. Syst., 2017, pp. 1731-1741.
L. Chen, H.Wang, J. Zhao, D. Papailiopoulos, and P. Koutris, "The effect of network width on the performance of large-batch training, " in Proc. Adv. Neural Inf. Process. Syst., 2018, pp. 9302-9309.