Article (Scientific journals)
Difficulty-level modeling of ontology-based factual questions
Ellampallil Venugopal, Vinu; Kumar, P Sreenivasa
2020In Semantic Web
Peer reviewed
 

Files


Full Text
swj1898.pdf
Author preprint (282.54 kB)
Download

All documents in ORBilu are protected by a user license.

Send to



Details



Abstract :
[en] Semantics-based knowledge representations such as ontologies are found to be very useful in automatically generating meaningful factual questions. Determining the difficulty-level of these system-generated questions is helpful to effectively utilize them in various educational and professional applications. The existing approach for for predicting the difficulty-level of factual questions utilizes only few naive features and, its accuracy (F-measure) is found to be close to only 50% while considering our benchmark set of 185 questions. In this paper, we propose a new methodology for this problem by identifying new features and by incorporating an educational theory, related to difficulty-level of a question, called Item Response Theory (IRT). In the IRT, knowledge proficiency of end users (learners) are considered for assigning difficulty-levels, because of the assumptions that a given question is perceived differently by learners of various proficiency levels. We have done a detailed study on the features/factors of a question statement which could possibly determine its difficulty-level for three learner categories (experts, intermediates, and beginners). We formulate ontology-based metrics for the same. We then train three logistic regression models to predict the difficulty-level corresponding to the three learner categories. The output of these models is interpreted using the IRT to find a question’s overall difficulty-level. The accuracy of the three models based on cross-validation is found to be in satisfactory range (67-84%). The proposed model (containing three classifiers) outperforms the existing model by more than 20% in precision, recall and F1-score measures.
Disciplines :
Computer science
Author, co-author :
Ellampallil Venugopal, Vinu ;  University of Luxembourg > Faculty of Science, Technology and Medicine (FSTM) > Department of Computer Science (DCS)
Kumar, P Sreenivasa
External co-authors :
yes
Language :
English
Title :
Difficulty-level modeling of ontology-based factual questions
Publication date :
12 March 2020
Journal title :
Semantic Web
Publisher :
IOS Press
Peer reviewed :
Peer reviewed
Available on ORBilu :
since 05 January 2021

Statistics


Number of views
201 (4 by Unilu)
Number of downloads
136 (2 by Unilu)

Bibliography


Similar publications



Contact ORBilu