[en] With the momentum of conversational AI for enhancing
client-to-business interactions, chatbots are sought in various domains,
including FinTech where they can automatically handle requests for
opening/closing bank accounts or issuing/terminating credit cards. Since
they are expected to replace emails and phone calls, chatbots must be
capable to deal with diversities of client populations. In this work, we
focus on the variety of languages, in particular in multilingual countries.
Specifically, we investigate the strategies for training deep learning models
of chatbots with multilingual data. We perform experiments for the
specific tasks of Intent Classification and Slot Filling in financial domain
chatbots and assess the performance of mBERT multilingual model vs
multiple monolingual models.
Disciplines :
Sciences informatiques
Auteur, co-auteur :
LOTHRITZ, Cedric ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > TruX
ALLIX, Kevin ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > TruX
LEBICHOT, Bertrand ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > TruX
VEIBER, Lisa ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > TruX
Dahl, D.A., et al.: Expanding the scope of the atis task: the atis-3 corpus. In: HUMAN LANGUAGE TECHNOLOGY: Proceedings of a Workshop held at Plainsboro, New Jersey, 8–11 March 1994 (1994)
Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: Bert: pre-training of deep bidirectional transformers for language understanding. In: 2019 Conference of the North American Chapter of the ACL: Human Language Technologies (2019)
Lauly, S., Larochelle, H., Khapra, M.M., Ravindran, B., Raykar, V., Saha, A., et al.: An autoencoder approach to learning bilingual word representations. arXiv preprint arXiv:1402.1454 (2014)
Schuster, S., Gupta, S., Shah, R., Lewis, M.: Cross-lingual transfer learning for multilingual task oriented dialog. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, vol. 1 (Long and Short Papers), pp. 3795–3805 (2019)
Upadhyay, S., Faruqui, M., Tür, G., Dilek, H., Heck, L.: (Almost) zero-shot cross-lingual spoken language understanding. In: 2018 IEEE ICASSP, pp. 6034–6038 (2018). https://doi.org/10.1109/ICASSP.2018.8461905
Upadhyay, S., Faruqui, M., Tür, G., Dilek, H.T., Heck, L.: (Almost) zero-shot cross-lingual spoken language understanding. In: 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 6034–6038. IEEE (2018)
Wan, X.: Co-training for cross-lingual sentiment classification. In: Joint Conference of the 47th Annual Meeting of the ACL, pp. 235–243 (2009)
Xu, W., Haider, B., Mansour, S.: End-to-end slot alignment and recognition for cross-lingual NLU. In: Proceedings of EMNLP 2020, November 2020, pp. 5052– 5063. ACL, Online (2020). https://doi.org/10.18653/v1/2020.emnlp-main.410
Zhou, G., He, T., Zhao, J.: Bridging the language gap: learning distributed semantics for cross-lingual sentiment classification. In: International Conference on Natural Language Processing and Chinese Computing, pp. 138–149. Springer, Heidelberg (2014)
Zhou, H., Chen, L., Shi, F., Huang, D.: Learning bilingual sentiment word embeddings for cross-language sentiment classification. In: 53rd Annual Meeting of the ACL and the 7th International Joint Conference on NLP, pp. 430–440 (2015)
