Difficulty-Adjusted Quizzes: An Effectiveness Analysis

[en] To improve long-term retention, regular testing allows students to apply their knowledge to practical tasks and consequently reinforce their memory. To integrate regular testing in a university-level course, the mobile application BEACON Q was developed to provide students with a quiz for each weekly lecture. It dynamically tailors the difficulty of questions to their capabilities and presents detailed explanations to serve as immediate feedback to their answers. This work analyzes the app’s usage during a semester by examining the performance data of the users, their survey answers, as well as potential correlations between the app’s design and the students’ interactions. The results are discussed in terms of the hurdles to overcome when integrating regular testing in the learner’s curriculum while supporting the design principles which constitute the testing effect. Additionally, recommendations are provided for other educators who want to introduce a similar quiz app in their curriculum, which also serves as future work for BEACON Q.

Disciplines :

Computer science

Author, co-author :

ATASHPENDAR, Aryobarzan ; University of Luxembourg > Faculty of Science, Technology and Medicine (FSTM) > Department of Computer Science (DCS)

ROTHKUGEL, Steffen ; University of Luxembourg > Faculty of Science, Technology and Medicine (FSTM) > Department of Computer Science (DCS)

External co-authors :

Language :

English

Title :

Difficulty-Adjusted Quizzes: An Effectiveness Analysis

Publication date :

28 November 2023

Event name :

IEEE International Conference on Teaching, Assessment and Learning for Engineering (TALE 2023)

Event date :

28 November 2023 - 1 December 2023

Audience :

International

Main work title :

Proceedings of the 2023 IEEE International Conference on Teaching, Assessment and Learning for Engineering (TALE)

Publisher :

IEEE Xplore Digital Library

ISBN/EAN :

978-1-6654-5331-8

Peer reviewed :

Peer reviewed

Focus Area :

Educational Sciences

Additional URL :

http://xplorestaging.ieee.org/ielx7/10398281/10398232/10398305.pdf?arnumber=10398305

Available on ORBilu :

since 31 January 2024

Statistics

Number of views

100 (7 by Unilu)

Number of downloads

4 (1 by Unilu)

More statistics

Scopus citations^®

Scopus citations^®
without self-citations

OpenAlex citations

Bibliography

Van Gog, Tamara, and John Sweller. "Not new, but nearly forgotten: The testing effect decreases or even disappears as the complexity of learning materials increases." Educational Psychology Review 27.2 (2015): 247-264.
Roediger III, Henry L., and Jeffrey D. Karpicke. "The power of testing memory: Basic research and implications for educational practice." Perspectives on psychological science 1.3 (2006): 181-210.
Fernandez, Jonathan, and Eric Jamet. "Extending the testing effect to self-regulated learning." Metacognition and Learning 12.2 (2017): 131-156.
Adkins, Joni K., and Diana Linville. "Testing frequency in an introductory computer programming course." Information Systems Education Journal 15.3 (2017): 22.
Cranney, Jacquelyn, et al. "The testing effect, collaborative learning, and retrieval-induced facilitation in a classroom setting." European Journal of Cognitive Psychology 21.6 (2009): 919-940.
Reber, T. P., and N. Rothen. "Educational App-Development needs to be informed by the Cognitive Neurosciences of Learning & Memory." npj Science of Learning 3.1 (2018): 1-2.
Eisenkraemer, Raquel Elo?sa, Ant?onio Jaeger, and Lilian Milnitsky Stein. "A systematic review of the testing effect in learning." Paideia (Ribeirao Preto) 23 (2013): 397-406.
Greving, Sven, and Tobias Richter. "Examining the testing effect in university teaching: Retrievability and question format matter." Frontiers in Psychology 9 (2018): 2412.
Toppino, Thomas C., and Michael S. Cohen. "The testing effect and the retention interval: questions and answers." Experimental psychology 56.4 (2009): 252.
Rowland, Christopher A. "The effect of testing versus restudy on retention: A meta-Analytic review of the testing effect." Psychological bulletin 140.6 (2014): 1432.
Rodrigues, Luiz, et al. "Gamification works, but how and to whom? an experimental study in the context of programming lessons." Proceedings of the 52nd ACM technical symposium on computer science education. 2021
Settles, Burr, and Brendan Meeder. "A trainable spaced repetition model for language learning." Proceedings of the 54th annual meeting of the association for computational linguistics (volume 1: Long papers). 2016.
Pashler, Harold, et al. "Predicting the optimal spacing of study: A multiscale context model of memory." Advances in neural information processing systems 22 (2009).
Ebbingham, H. Memory: A contribution to experimental psychology. 1913.
Resnick, Mitchel, et al. "Scratch: programming for all." Communications of the ACM 52.11 (2009): 60-67.
Pasternak, Erik, Rachel Fenichel, and Andrew N. Marshall. "Tips for creating a block language with blockly." 2017 IEEE blocks and beyond workshop (BB). IEEE, 2017.
Atashpendar, Aryobarzan, and Steffen Rothkugel. "Improving Long-Term Retention through Personalized Recall Testing and Immediate Feedback." 2023 11th International Conference on Information and Education Technology (ICIET). IEEE, 2023.