Paper published on a website (Scientific congresses, symposiums and conference proceedings)
Forget NLI, Use a Dictionary: Zero-Shot Topic Classification for Low-Resource Languages with Application to Luxembourgish
PHILIPPY, Fred; Haddadan, Shohreh; Guo, Siwen
20243rd Annual Meeting of the Special Interest Group on Under-resourced Languages @ LREC-COLING 2024
Peer reviewed Dataset
 

Files


Full Text
2024.sigul-1.13.pdf
Publisher postprint (735.79 kB) Creative Commons License - Attribution
Download

All documents in ORBilu are protected by a user license.

Send to



Details



Abstract :
[en] In NLP, zero-shot classification (ZSC) is the task of assigning labels to textual data without any labeled examples for the target classes. A common method for ZSC is to fine-tune a language model on a Natural Language Inference (NLI) dataset and then use it to infer the entailment between the input document and the target labels. However, this approach faces certain challenges, particularly for languages with limited resources. In this paper, we propose an alternative solution that leverages dictionaries as a source of data for ZSC. We focus on Luxembourgish, a low-resource language spoken in Luxembourg, and construct two new topic relevance classification datasets based on a dictionary that provides various synonyms, word translations and example sentences. We evaluate the usability of our dataset and compare it with the NLI-based approach on two topic classification tasks in a zero-shot manner. Our results show that by using the dictionary-based dataset, the trained models outperform the ones following the NLI-based approach for ZSC. While we focus on a single low-resource language in this study, we believe that the efficacy of our approach can also transfer to other languages where such a dictionary is available.
Disciplines :
Computer science
Author, co-author :
PHILIPPY, Fred  ;  University of Luxembourg ; Zortify S.A.
Haddadan, Shohreh;  Zortify S.A.
Guo, Siwen;  Zortify S.A.
External co-authors :
no
Language :
English
Title :
Forget NLI, Use a Dictionary: Zero-Shot Topic Classification for Low-Resource Languages with Application to Luxembourgish
Publication date :
May 2024
Event name :
3rd Annual Meeting of the Special Interest Group on Under-resourced Languages @ LREC-COLING 2024
Event organizer :
ELRA and ICCL
Event place :
Torino, Italy
Event date :
20-21 May 2024
Audience :
International
Peer reviewed :
Peer reviewed
Focus Area :
Computational Sciences
Available on ORBilu :
since 19 November 2024

Statistics


Number of views
55 (2 by Unilu)
Number of downloads
23 (0 by Unilu)

Bibliography


Similar publications



Contact ORBilu