Laying the Foundation for Augmented Reality in Music Education

Augmented reality; creativity; embodied learning; music education; participatory sense-making; Avatar; Creativity; Design ideas; Educational program; Embodied learning; Extended reality; Music education; Participatory sense-making; Sense making; Computer Science (all); Materials Science (all); Engineering (all); Visualization; Music; Focusing; Computers; Avatars; Educational programs

Abstract :

[en] Since the beginning of humankind, the use and development of technologies have played an essential role in enhancing human abilities and creating new possibilities for action and expression. As such, new technologies have captured the imaginations of educational scholars and practitioners. One of the latest developments in the evolution of digital technologies is the ability to enrich or 'augment' reality with digital content, thereby establishing an 'augmented reality' (AR). This perspective article aims to promote and support advancements in the domain of music educational AR by proposing an interdisciplinary knowledge base and its concrete translation into design ideas for further developments in this emerging domain. We explore the integration of Augmented Reality (AR) into Music Education (MusEdAR), highlighting its nascent state and potential for innovation. First, we provide an overview of the current state-of-the-art, focusing on what types of AR are used, what visual content is digitally added to the learning experience, and how movement is integrated. Next, we discuss how to expand the MusEdAR domain. We argue for a solid interdisciplinary knowledge base to advance the design and use of MusEdAR applications and present themes such as embodied learning or developing creativity and associated theories. Based on these theories, we presented practical design ideas.

Disciplines :

Education & instruction

Author, co-author :

NIJS, Luc ; University of Luxembourg > Faculty of Humanities, Education and Social Sciences (FHSE) > Department of Education and Social Work (DESW) > Institute of Musicology and Arts

Behzadaval, Bahareh ; University of Luxembourg, Esch-sur-Alzette, Luxembourg

External co-authors :

Language :

English

Title :

Laying the Foundation for Augmented Reality in Music Education

Publication date :

2024

Journal title :

IEEE Access

ISSN :

2169-3536

Publisher :

Institute of Electrical and Electronics Engineers Inc.

Volume :

Pages :

100628 - 100645

Peer reviewed :

Peer Reviewed verified by ORBi

Focus Area :

Educational Sciences

Additional URL :

http://xplorestaging.ieee.org/ielx8/6287639/10380310/10597574.pdf?arnumber=10597574

Available on ORBilu :

since 18 December 2024

Statistics

Number of views

111 (0 by Unilu)

Number of downloads

52 (3 by Unilu)

More statistics

Scopus citations^®

Scopus citations^®
without self-citations

OpenCitations

OpenAlex citations

WoS citations^™

Bibliography

N. Jacobs, M. Lanzing, and M. Stevens,Thinking about technology: An introduction to philosophy of technology Second Thoughts: First Introductions to Philosophy, M. Sie and B. Engelen, Eds., Tilburg, The Netherlands: Open Press Tilburg University, Feb. 2023. [Online]. Available: https://doi.org/10.26116/second-Thoughts-openpresstiu-jote
P. Dourish, Where the Action Is: The Foundations of Embodied Interaction. Cambridge, MA, USA: MIT Press, 2001.
C. Martin and H. Leurent,Technology and innovation for the future of production: Accelerating value creation Proc World Economic Forum, Mar. 2017, pp. 1-38.
V. Geroimenko, Augmented Reality in Education. Cham, Switzerland: Springer, 2020.
A. J. Martingano and S. Persky,Virtual reality expands the toolkit for conducting health psychology research Social Personality Psychol. Compass, vol. 15, no. 7, Jul. 2021, Art. no. e12606.
F. T. J. M. Zaal and R. J. Bootsma,Virtual reality as a tool for the study of perception-Action: The case of running to catch fly balls Presence, vol. 20, no. 1, pp. 93-103, Feb. 2011.
R. Vertucci, S. D?Onofrio, S. Ricciardi, and M. De Nino,History of augmented reality Springer Handbooks, A. Y. C. Nee and S. K. Ong, Eds., New York, NY, USA: Springer, 2023, pp. 35-50.
P. Q. Brito and J. Stoyanova,Marker versus markerless augmented reality. Which has more impact on users? Int. J. Human-Computer Interact., vol. 34, no. 9, pp. 819-833, Sep. 2018.
S. Leong,Navigating the emerging futures in music education J. Music, Technol. Educ., vol. 4, no. 2, pp. 233-243, Feb. 2012.
M. Billinghurst and A. Duenser,Augmented reality in the classroom Computer, vol. 45, no. 7, pp. 56-63, Jul. 2012.
N. M. N. Affendy and I. A. Wanis,A review on collaborative learning environment across virtual and augmented reality technology IOP Conf. Ser., Mater. Sci. Eng, vol. 551, Aug. 2019, Art. no. 012050, doi: 10.1088/1757-899X/551/1/012050.
H. Alhumaidan, K. P.Y. Lo, and A. Selby,Co-design of augmented reality book for collaborative learning experience in primary education Proc. SAI Intell. Syst. Conf. (IntelliSys), Nov. 2015, pp. 427-430.
K. Apaydinli,Content analysis of music education studies related to augmented reality technology J. Educ. Technol. Online Learn., vol. 6, no. 2, pp. 447-481, May 2023.
L. Turchet, R. Hamilton, and A. Camci,Music in extended realities IEEE Access, vol. 9, pp. 15810-15832, 2021.
J. A. Deja, S. Mayer, K. C. Pucihar, and M. Kljun,A survey of augmented piano prototypes: Has augmentation improved learning experiences? Proc. ACM Human-Comput. Interact., vol. 6, no. ISS, pp. 226-253, Nov. 2022.
A. Simion, A. Iftene, and D. Gi?fu,An augmented reality piano learning tool Proc. Int. Conf. Human-Comput. Interact., Bucharest, Romania, 2021, pp. 134-141.
K. Marky, A. Weiß, and T. Kosch,Supporting musical practice sessions through HMD-based augmented reality 2021, arXiv:2101.00874.
W. Molloy, E. Huang, and B. C. Wunsche,Mixed reality piano tutor: A gamified piano practice environment Proc. Int. Conf. Electron., Inf., Commun. (ICEIC). Auckland, New Zealand: IEEE, Jan. 2019, pp. 1-7.
J. Chow, H. Feng, R. Amor, and B. C. Wunsche,Music education using augmented reality with a head mounted display Proc. 14th Australas. User Interface Conf., vol. 139, Adelaide, SA, Australia, Jan. 2013, pp. 73-79.
S.-M. Chung, H.-G. Lin, T.-L. Tsou, C.-T. Wu, and C.-H. Huang,Experiencing musical rhythm through interactive installation and AR/VR game development Proc. IEEE Global Eng. Educ. Conf. (EDUCON). Santa Cruz de Tenerife, Spain: IEEE, Apr. 2018, pp. 384-388.
L. Rigby, B. C. Wunsche, and A. Shaw,PiARno-An augmented reality piano tutor Proc. 32nd Austral. Conf. Human-Comput. Interact. New York, NY, USA: ACM, Dec. 2020, pp. 481-491.
S. Das, S. Glickman, F. Y. Hsiao, and B. Lee,Music everywhere-Augmented reality piano improvisation learning system Proc. Intern. Conf. New Interfaces Musical Expression (NIME). Copenhagen, Denmark: Aalborg Univ. Copenhagen, 2017, pp. 511-512.
C. A. T. Fernandez, P. Paliyawan, C. C. Yin, and R. Thawonmas,Piano learning application with feedback provided by an AR virtual character Proc. IEEE 5th Global Conf. Consum. Electron. Kyoto, Japan: IEEE, Oct. 2016, pp. 1-2.
D. Hackl and C. Anthes,HoloKeys-An augmented reality application for learning the piano Forum Media Technology. St. Polten, Austria: St. Polten Univ. Applied Sciences, 2017, pp. 140-144.
F. Trujano, M. Khan, and P. Maes,ARPiano efficient music learning using augmented reality Innovative Technologies and Learning (Lecture Notes in Computer Science), vol. 11003, T. Wu, Y. Huang, R. Shadiev, L. Lin, and A. Starcic, Eds., Cham, Switzerland: Springer, 2018, pp. 3-17.
M. Weing, A. Rohlig, K. Rogers, J. Gugenheimer, F. Schaub, B. Konings, E. Rukzio, and M. Weber,P.I.A.N.O.: Enhancing instrument learning via interactive projected augmentation Proc. ACM Conf. Pervasive Ubiquitous Comput. New York, NY, USA: Association for Computing Machinery, Sep. 2013, pp. 75-78.
H. Zeng, X. He, and H. Pan,FunPianoAR: A novel AR application for piano learning considering paired play based on multi-marker tracking J. Phys., Conf. Ser., vol. 1229, no. 1, May 2019, Art. no. 012072.
Y. Lu, X. Wang, J. Gong, and Y. Liang,ChordAR: An educational AR game design for children?s music theory learning Wireless Commun. Mobile Comput., vol. 2022, pp. 1-9, Feb. 2022.
M. Cai, M. A. Amrizal, T. Abe, and T. Suganuma,Design and implementation of AR-supported system for piano learning Proc. IEEE 8th Global Conf. Consum. Electron. (GCCE). Osaka, Japan: IEEE, Oct. 2019, pp. 49-50.
D. Molero, S. Schez-Sobrino, D. Vallejo, C. Glez-Morcillo, and J. Albusac,A novel approach to learning music and piano based on mixed reality and gamification Multimedia Tools Appl., vol. 80, no. 1, pp. 165-186, Jan. 2021.
O. Cakmakci, F. Berard, and J. Coutaz,An augmented reality-based learning assistant for electric bass guitar Proc. 10th Int. Conf. HCI, Crete, Greece, Jun. 2003.
M. S. Del Rio-Guerra, J. Martin-Gutierrez, V. A. Lopez-Chao, R. Flores Parra, and M. A. Ramirez Sosa,AR graphic representation of musical notes for self-learning on guitar Appl. Sci., vol. 9, no. 21, p. 4527, Oct. 2019.
J. R. Keebler, T. J. Wiltshire, D. C. Smith, S. M. Fiore, and J. S. Bedwell,Shifting the paradigm of music instruction: Implications of embodiment stemming from an augmented reality guitar learning system Frontiers Psychol., vol. 5, p. 471, May 2014.
J. Martin-Gutierrez, M. S. Del Rio Guerra, V. Lopez-Chao, R. H. Soto Gastelum, and J. F. Valenzuela Bojorquez,Augmented reality to facilitate learning of the acoustic guitar Appl. Sci., vol. 10, no. 7, p. 2425, Apr. 2020.
X. Xiao, B. Tome, and H. Ishii,Andante: Walking figures on the piano keyboard to visualize musical motion Proc. Intern. Conf. New Interfaces Musical Expression (NIME), Jun. 2014, pp. 629-632.
X. Xiao, P. Puentes, E. Ackermann, and H. Ishii,Andantino Proc. The 15th Int. Conf. Interact. Design Children. New York, NY, USA: ACM, Jun. 2016, pp. 37-45.
G. Santini,Augmented piano in augmented reality Proc. Int. Conf. New Interfaces Musical Expression (NIME), Jul. 2020, pp. 411-415.
T. Yamabe, H. Asuma, S. Kiyono, and T. Nakajima,Feedback design in augmented musical instruments: A case study with an AR drum kit Proc. IEEE 17th Int. Conf. Embedded Real-Time Comput. Syst. Appl., vol. 2. Toyama, Japan: IEEE, Aug. 2011, pp. 126-129.
O. Gali, S. B. Ercan, G. Atherton, L. Cross, B. Sayis, P. Heaton, and N. Pares,Mediating interpersonal synchronization in children through a full-body mixed reality system: Analysis of the pre-interactive mandala experience PRESENCE, Virtual Augmented Reality, vol. 32, pp. 35-51, Dec. 2023.
T. Hopkins, S. C. C. Weng, R. Vanukuru, E. A. Wenzel, A. Banic, M. D. Gross, and E. Y.-L. Do,AR drum circle: Real-Time collaborative drumming in AR Frontiers Virtual Reality, vol. 3, Aug. 2022, Art. no. 847284.
L. Gerry, S. Dahl, and S. Serafin,ADEPT: Exploring the design, pedagogy, and analysis of a mixed reality application for piano training Proc. 16th Sound Mus. Comp. Conf. (SMC). Malaga, Spain: Sound and Music Computing Network, May 2019, pp. 241-249.
V. Farinazzo Martins, L. Gomez, and A. G. D. Correa,Teaching children musical perception with MUSIC-AR EAI Endorsed Trans. e-Learn., vol. 2, no. 5, p. e3, Mar. 2015.
H. Guclu, S. Kocer, and O. Dundar,Application of augmented reality in music education Eurasia Proc. Sci. Technol. Eng. Math., vol. 14, pp. 45-56, Dec. 2021.
Y. Zhang, S. Liu, L. Tao, C. Yu, Y. Shi, and Y. Xu,ChinAR: Facilitating Chinese Guqin learning through interactive projected augmentation Proc. 3rd Int. Symp. Chin. CHI. New York, NY, USA: Association for Computing Machinery, Apr. 2015, pp. 23-31.
D. Johnson, D. Damian, and G. Tzanetakis,Evaluating the effectiveness of mixed reality music instrument learning with the theremin Virtual Reality, vol. 24, no. 2, pp. 303-317, Jun. 2020.
F. Huang, Y. Zhou, Y. Yu, Z. Wang, and S. Du,Piano AR: A markerless augmented reality based piano teaching system Proc. 3rd Int. Conf. Intell. Human-Machine Syst. Cybern., vol. 2. Hangzhou, China: IEEE, Aug. 2011, pp. 47-52.
C. Kerdvibulvech,An innovative real-Time mobile augmented reality application in arts Proc. 4th Int. Conf. Aug. Real. Virt. Real. Comp. Graph. (AVR). Ugento, Italy: Springer International Publishing, Jun. 2017, pp. 251-260.
M.-L. Juntunen,Ways to enhance embodied learning in Dalcrozeinspired music educationt. J. Music Early Childhood, vol. 15, no. 1, pp. 39-59, Jul. 2020.
G. Santini,Composition as an embodied act: A framework for the gesture-based creation of augmented reality action scores Proc. 17th Sound Mus. Comp. Conf. (SMC), 2020, pp. 357-363.
F. Avanzini, A. Barate, M. Cottini, L. A. Ludovico, and M. Mandanici,Developing music harmony awareness in young students through an augmented reality approach Proc. 4th Int. Conf. Comput.-Human Interact. Res. Appl., 2020, pp. 56-63.
F. Permana, H. Tolle, F. Utaminingrum, and R. Dermawi,Development of augmented reality (AR) based gamelan simulation with leap motion controlt. J. Interact. Mobile Technol. (iJIM), vol. 13, no. 12, p. 120, Dec. 2019.
D. M. Huber, The Midi Manual. A Practical Guide to Midi Within Modern Music Production. New York, NY, USA: Routledge, Oct. 2020.
J. H. Wallevik,TappyBeatsXR: Using a modern mixed reality approach to develop a virtual music creation environment for non-musicians Ph.D. dissertation, Dept. Comput. Sci., Elect. Eng. Math. Sci., Western Norway Univ. Appl. Sci., Bergen, Norway, 2022.
D. Hoppe, M. Sadakata, and P. Desain,Development of real-Time visual feedback assistance in singing training: A review J. Comput. Assist. Learn., vol. 22, no. 4, pp. 308-316, Aug. 2006.
L. Nijs,Moving together while playing music: Promoting involvement through student-centred collaborative practices Becoming Musicians-Student Involvement and Teacher Collaboration in Higher Music Education, S. Gies and J. Sætre, Eds., Oslo, Norway: Norges musikkhogskole, 2019, ch. 1, pp. 239-260.
L. Nijs and M. Leman,Interactive technologies in the instrumental music classroom: A longitudinal study with the music paint machine Comput. Educ., vol. 73, pp. 40-59, Apr. 2014.
G. Wulf and R. Lewthwaite,Attentional and motivational influences on motor performance and learning Art in Motion: Musical and Athletic Motor Learning and Performance, vol. 1, A. Mornell, Ed., Lausanne, Switzerland: Peter Lang, 2009, pp. 95-117.
G. Wulf, N. Mcconnel, M. Gartner, and A. Schwarz,Enhancing the learning of sport skills through external-focus feedback J. Motor Behav., vol. 34, no. 2, pp. 171-182, Jun. 2002.
K. Ng, O. Larkin, T. Koerselman, and B. Ong,i-Maestro gesture and posture support: 3D motion data visualisation for music learning and playing Proc. EVA London Int. Conf., J. P. Bowen, S. Keene, and L. MacDonald, Eds. London, U.K.: London College of Communication, Jul. 2007, pp. 11-13.
P.-T. Yu, Y.-S. Lai, H.-H. Tsai, and Y.-H. Chang,Using a multimodal learning system to support music instruction Educ. Technol. Soc., vol. 13, no. 3, pp. 151-162, Jul. 2010.
T. de Jong,Cognitive load theory, educational research, and instructional design: Some food for thoughtstructional Sci., vol. 38, no. 2, pp. 105-134, Mar. 2010.
J. Sweller, J. J. G. van Merrienboer, and F. G. W. C. Paas,Cognitive architecture and instructional design Educ. Psychol. Rev., vol. 10, no. 3, pp. 251-296, 1998.
R. E. Mayer, R. Moreno, M. Boire, and S. Vagge,Maximizing constructivist learning from multimedia communications by minimizing cognitive load J. Educ. Psychol., vol. 91, no. 4, pp. 638-643, 1999.
M. Leman, The Expressive Moment: How Interaction (with Music) Shapes Human Empowerment. Cambridge, MA, USA: MIT Press, 2016.
M. Bremmer and L. Nijs,Embodied music pedagogy. A vision on the dynamic role of the body in music education European Perspectives on Music Education: Music is What People Do, T. Buchborn, S. Schmid, G. Brunner, and T. De Baets, Eds., Helbling, 2022, pp. 29-46.
M. Bremmer and L. Nijs,Embodiment in music education J. Rech. Educ. Art., vol. 2, Feb. 2024.
G. Lakoff and M. Johnson, MetaphorsWe Live by. Chicago, IL, USA: Univ. Chicago Press, 2008.
L. Nijs, N. Grinspun, and S. Fortuna,Developing musical creativity through movement: Navigating the musical affordance landscape Creativity Res. J., pp. 1-25, Jan. 2024.
E. Rietveld and J. Kiverstein,A rich landscape of affordances Ecological Psychol., vol. 26, no. 4, pp. 325-352, Oct. 2014.
A. Schiavio and H. De Jaegher,Participatory sense-making in joint musical practice The Routledge Companion to Embodied Music Interaction, M. Lesaffre, P.-J. Maes, and M. Leman, Eds., New York, NY, USA: Routledge, 2017, pp. 31-39.
J. Y. Chow, K. Davids, R. Hristovski, D. Araujo, and P. Passos,Nonlinear pedagogy: Learning design for self-organizing neurobiological systems New Ideas Psychol., vol. 29, no. 2, pp. 189-200, Aug. 2011.
W. Bowman,Cognition and the body: Perspectives from music education Knowing Bodies, Moving Minds, 1st ed., L. Bresler, Ed., Dordrecht, The Netherlands: Springer, 2004, pp. 29-50.
J. Shepherd,Howmusicworks. Beyond the immanent and the arbitrary an essay review of music in everyday life Act. Critic. Theory Music Educ., vol. 1, no. 2, pp. 2-18, Dec. 2002.
L. Nijs and M. Bremmer,Embodiment in early childhood music education Music in Early Childhood: Multi-disciplinary Perspectives and Inter-disciplinary Exchanges. International Perspectives on Early Childhood Education and Development, S. Young and B. Ilari, Eds., Cham, Switzerland: Springer, Jul. 2019, ch. 5, pp. 87-102.
M. Clayton, R. Sager, and U. Will,In time with the music: The concept of entrainment and its significance for ethnomusicology ESEM CounterPoint, vol. 1, pp. 1-45, Nov. 2004.
J. Phillips-Silver and L. J. Trainor,Hearing what the body feels: Auditory encoding of rhythmic movement Cognition, vol. 105, no. 3, pp. 533-546, Dec. 2007.
L. Nijs, M. Bremmer, and J. van den Dool, Singewing Space, Augmented Blended-Learning Approach to Music Learn. Amsterdam, The Netherlands: Lectoraat Kunsteducatie, 2018.
S. Gallagher and R. Lindgren,Enactive metaphors: Learning through full-body engagement Educ. Psychol. Rev., vol. 27, no. 3, pp. 391-404, Sep. 2015.
M. Antovic,Metaphor in music or metaphor about music: A contribution to the cooperation of cognitive linguistics and cognitive musicology Metaphors We Study: Contemporar, 2014.
R. Lindgren, M. Tscholl, S. Wang, and E. Johnson,Enhancing learning and engagement through embodied interaction within a mixed reality simulation Comput. Educ., vol. 95, pp. 174-187, Apr. 2016.
M. Johnson,The philosophical significance of image schemas From Perception to Meaning, B. Hampe, Ed., Berlin, Germany: Walter de Gryurter, 2005, pp. 15-34.
H.-Y. Pai and C.-M. Huang,How to use camera view changing and morphing technology to embody the visual representation of metaphor in augmented reality Proc. Knowl. Innov. Design Culture. Singapore: World Scientific, Oct. 2021, pp. 177-181.
K. Wilkie, S. Holland, and P. Mulholland,Towards a participatory approach for interaction design based on conceptual metaphor theory: A case study from music interaction Music and Human-Computer Interaction (Springer Series on Cultural Computing), S. Holland, K. Wilkie, P. Mulholland, and A. Seago, Eds., London, U.K.: Springer, Apr. 2013, pp. 259-270.
L. Zbikowski,Music, metaphor, and creativity Performing Metaphoric Creativity Across Modes and Contexts, L. Hidalgo-Downing and B. K. Mujic, Eds., Amsterdam, The Netherlands: John Benjamins, Jun. 2020, ch. 3, pp. 43-70.
G. Boal-Palheiros and J. Wuytack,Effects of the ?musicogram? on children?s musical perception and learning Proc. 9th Int. Conf. Music Percept. Cogn., Bologna, Italy, Aug. 2005, pp. 1264-1271.
S. Dixon, W. Goebl, and G. Widmer,The ?air worm?: An interface for real-Time manipulation of expressive music performance Proc. Int. Comp. Music Conf. (ICMC), Barcelona, Spain, Sep. 2005.
L. Nijs, B. Moens, M. Lesaffre, and M. Leman,The music paint machine: Stimulating self-monitoring through the generation of creative visual output using a technology-enhanced learning tool J. New Music Res., vol. 41, no. 1, pp. 79-101, Mar. 2012.
L. Nijs,Dalcroze meets technology: Integrating music, movement and visuals with the music paint machine Music Educ. Res., vol. 20, no. 2, pp. 163-183, Mar. 2018.
E. Gordon, Learning Sequences in Music: A Contemporary Music Learning Theory. G.I.A., 2007.
L. H. Baer, J. L. N. Thibodeau, T. M. Gralnick, K. Z. H. Li, and V. B. Penhune,The role of musical training in emergent and event-based timing Frontiers Human Neurosci., vol. 7, p. 191, May 2013.
F. C. Nather, J. L. O. Bueno, E. Bigand, and S. Droit-Volet,Time changes with the embodiment of another?s body posture PLoS ONE, vol. 6, no. 5, May 2011, Art. no. e19818.
K. Overy and I. Molnar-Szakacs,Being together in time: Musical experience and the mirror neuron system Music Perception, vol. 26, no. 5, pp. 489-504, Jun. 2009.
B. Van Kerrebroeck, K. Crombé, S. Wilain, M. Leman, and P.-J. Maes,The virtual drum circle: Polyrhythmic music interactions in extended reality 2023, arXiv:2308.01889.
J. Bruner,The course of cognitive growth Amer. Psychol., vol. 19, no. 1, pp. 1-15, 1964.
G. Pezzulo and P. Cisek,Navigating the affordance landscape: Feedback control as a process model of behavior and cognition Trends Cogn. Sci., vol. 20, no. 6, pp. 414-424, Jun. 2016.
J. Krueger,Affordances and the musically extended mind Frontiers Psychol., vol. 4, p. 1003, Jan. 2014.
A. Penalba, L. Martinez-Alvarez, and A. Schiavio,The active musical room: Fostering sensorimotor discoveries and musical creativity in toddlers J. Res. Music Educ., vol. 69, no. 2, pp. 128-151, Jul. 2021.
V. P. Glaveanu,What can be done with an egg? Creativity, material objects, and the theory of affordances J. Creative Behav., vol. 46, no. 3, pp. 192-208, Dec. 2012.
E. W. Large and M. R. Jones,The dynamics of attending: How people track time-varying events Psychol. Rev., vol. 106, no. 1, pp. 119-159, 1999.
C. T. Kello, G. G. Anderson, J. G. Holden, and G. C. Van Orden,The pervasiveness of 1/f scaling in speech reflects the metastable basis of cognition Cogn. Sci., vol. 32, no. 7, pp. 1217-1231, Oct. 2008.
H. De Jaegher and E. Di Paolo,Participatory sense-making Phenom. Cogn. Sci., vol. 6, no. 4, pp. 485-507, Dec. 2007.
P.-J. Maes, V. Lorenzoni, B. Moens, J. Six, F. Bressan, I. Schepers, and M. Leman,Embodied, participatory sense-making in digitallyaugmented music practices: Theoretical principles and the artistic case ?SoundBike? Crit. Arts, vol. 32, no. 3, pp. 77-94, May 2018.
P. E. Keller and B. H. Repp,Multilevel coordination stability: Integrated goal representations in simultaneous intra-personal and interagent coordination Acta Psychologica, vol. 128, no. 2, pp. 378-386, Jun. 2008.
E. Pacherie,How does it feel to act together? Phenomenology Cogn. Sci., vol. 13, no. 1, pp. 25-46, Mar. 2014.
H. Liebermann-Jordanidis, G. Novembre, I. Koch, and P. E. Keller,Simultaneous self-other integration and segregation support real-Time interpersonal coordination in a musical joint action task Acta Psychologica, vol. 218, Jul. 2021, Art. no. 103348.
C. Hermans,Participatory sense-making: Rhythm, repetition and affective resonance in dance Proc. Lecture Conf. Worlding Brain. Amsterdam, The Netherlands: University of Amsterdam, 2016.
M. Bremmer and L. Nijs,The role of the body in instrumental and vocal music pedagogy: A dynamical systems theory perspective on the music teacher?s bodily engagement in teaching and learning Frontiers Educ., vol. 5, p. 79, Jun. 2020.
K. M. Newell,Change in motor learning: A coordination and control perspective Motriz Rio Claro, vol. 9, no. 1, pp. 1-6, 2003.
I. Renshaw and J.-Y. Chow,A constraint-led approach to sport and physical education pedagogy Phys. Educ. Sport Pedagogy, vol. 24, no. 2, pp. 103-116, Mar. 2019.
K. S. Rosengren and G. S. Braswell,Constraints and the development of children?s drawing and writing skills Development of Movement Coordination in Children: Applications in the Fields of Ergonomics, Health Sciences, and Sport, G. J. P. Savelsbergh, K. Davids, J. v. d. Kamp, and S. Bennet, Eds., New York, NY, USA: Routledge, 2003, ch. 6, pp. 56-74.
T. Hopper,Constraints-led approach and emergent learning: Using complexity thinking to frame collectives in creative dance and inventing games as learning systems Open Sports Sci. J., vol. 5, no. 1, pp. 76-87, Sep. 2012.
M. F. Levin and M. Demers,Motor learning in neurological rehabilitation Disability Rehabil., vol. 43, no. 24, pp. 3445-3453, Nov. 2021.
S. Fortuna and L. Nijs,Children?s representational strategies based on verbal versus bodily interactions with music: An intervention-based study Music Educ. Res., vol. 22, no. 1, pp. 107-127, Jan. 2020.
S. Fortuna and L. Nijs,The influence of discrete versus continuous movements on children?s musical sense-making Brit. J. Music Educ., vol. 39, no. 2, pp. 183-202, Jul. 2022.
L. Oppici, A. Dix, and S. Narciss,When is knowledge of performance (KP) superior to knowledge of results (KR) in promoting motor skill learning? A systematic reviewt. Rev. Sport Exercise Psychol., vol. 17, no. 1, pp. 182-207, Oct. 2021.
A. Sheaff, A Constraints-Led Approach to Swim Coaching. New York, NY, USA: Taylor & Francis, Jul. 2023.
C. J. Larche and M. J. Dixon,The relationship between the skillchallenge balance, game expertise, flow and the urge to keep playing complex mobile games J. Behav. Addictions, vol. 9, no. 3, pp. 606-616, Oct. 2020.
A. R. Addessi,A device for children?s instrumental creativity and learning: An overview of the MIROR platform Frontiers Psychol., vol. 11, Nov. 2020, Art. no. 516478.
A. Khatchatourov, F. Pachet, and V. Rowe,Action identity in style simulation systems: Do players consider machine-generated music as of their own style? Frontiers Psychol., vol. 7, p. 474, May 2016.
U. Bronfenbrenner, The Ecology Human Development: Experiments by Nature Design. Cambridge, MA, USA: Harvard Univ. Press, Sep. 1979.
R. A. Schmidt,Principles of practice for the development of skilled actions: Implications for training and instruction in music Art in Motion. Musical and Athletic Motor Learning and Performance, A. Mornell, Ed., Frankfurt, Germany: Peter Langer, 2008, pp. 41-67.
Y. K. Ro, A. Brem, and P. A. Rauschnabel,Augmented reality smart glasses: Definition, concepts and impact on firm value creation Augmented Reality and Virtual Reality, T. Jung and M. Dieck, Eds., Cham, Switzerland: Springer, 2018, pp. 169-181.
P. Enlof, C. Romare, P. Jildenstal, M. Ringdal, and L. Skar,Smart glasses for anesthesia care: Initial focus group interviews with specialized health care professionals J. PeriAnesthesia Nursing, vol. 36, no. 1, pp. 47-53, Feb. 2021.
H. Shin and G. Gweon,Supporting preschoolers? transitions from screen time to screen-free time using augmented reality and encouraging offline leisure activity Comput. Hum. Behav., vol. 105, Apr. 2020, Art. no. 106212.
T. K. Oswald, A. R. Rumbold, S. G. E. Kedzior, and V. M. Moore,Psychological impacts of ?screen time? and ?green time? for children and adolescents: A systematic scoping review PLoS ONE, vol. 15, no. 9, Sep. 2020, Art. no. e0237725.
R. K. Sawyer,Learning music from collaborationt. J. Educ. Res., vol. 47, no. 1, pp. 50-59, Jan. 2008.
C. Pidel and P. Ackermann,Collaboration in virtual and augmented reality: A systematic overview Proc. 7th Int. Conf. Augmented Reality, Virtual Reality, Comput. Graphics. Lecce, Italy: Springer, Sep. 2020, pp. 141-156.
T. A. Syed, M. S. Siddiqui, H. B. Abdullah, S. Jan, A. Namoun, A. Alzahrani, A. Nadeem, and A. B. Alkhodre,In-depth review of augmented reality: Tracking technologies, development tools, AR displays, collaborative AR, and security concerns Sensors, vol. 23, no. 1, p. 146, Dec. 2022.
Z. Dong, J. Zhang, X. Bai, A. Clark, R. W. Lindeman, W. He, and T. Piumsomboon,Touch-move-release: Studies of surface and motion gestures for mobile augmented reality Frontiers Virtual Reality, vol. 3, Aug. 2022, Art. no. 927258.
M. Kim, S. H. Choi, K.-B. Park, and J. Y. Lee,User interactions for augmented reality smart glasses: A comparative evaluation of visual contexts and interaction gestures Appl. Sci., vol. 9, no. 15, p. 3171, Aug. 2019.
S. Zhao, H. Zhang, C. S. Mishra, S. Bhuyan, Z. Ying, M. T. Kandemir, A. Sivasubramaniam, and C. Das,HoloAR: On-The-fly optimization of 3D holographic processing for augmented reality Proc. 54th Annu. IEEE/ACM Int. Symp. Microarchitecture. New York, NY, USA: ACM, Oct. 2021, pp. 494-506.
O. Danielsson, M. Holm, and A. Syberfeldt,Augmented reality smart glasses in industrial assembly: Current status and future challenges J. Ind. Inf. Integr., vol. 20, Dec. 2020, Art. no. 100175.
L. Lauer, K. Altmeyer, S. Malone, M. Barz, R. Brunken, D. Sonntag, and M. Peschel,Investigating the usability of a head-mounted display augmented reality device in elementary school children Sensors, vol. 21, no. 19, p. 6623, Oct. 2021.
B. Munsinger, G. White, and J. Quarles,The usability of the Microsoft HoloLens for an augmented reality game to teach elementary school children Proc. 11th Int. Conf. Virtual Worlds Games Serious Appl. (VS-Games). Vienna, Austria: IEEE, Sep. 2019, pp. 1-4.
R. Schmidt and G. Wulf, Continuous Concurrent Feedback Degrades Skill Learning: Implications for Training and Simulation. New York, NY, USA: Routledge, Mar. 2017, pp. 375-391.
C. J. Winstein and R. A. Schmidt,Reduced frequency of knowledge of results enhances motor skill learning J. Experim. Psychol., Learn., Memory, Cognition, vol. 16, no. 4, pp. 677-691, 1990.
M. Sadakata, D. Hoppe, A. Brandmeyer, R. Timmers, and P. Desain,Real-Time visual feedback for learning to perform short rhythms with expressive variations in timing and loudness J. New Music Res., vol. 37, no. 3, pp. 207-220, Sep. 2008.
W. Thorpe, J. Callaghan, and J. van Doorn,Visual feedback of acoustic voice features in singing training Proc. 9th Austral. Speech Sci. Technol. Conf., Hong Kong, Jul. 2002, pp. 3-5.
F. Paas, A. Renkl, and J. Sweller,Cognitive load theory and instructional design: Recent developments Educ. Psychologist, vol. 38, no. 1, pp. 1-4, Jan. 2003.
J. S. Bruner, The Process of Education. Harvard, MA, USA: Harvard Univ. Press, 2009.
J. S. Bruner, Toward a Theory of Instruction. Harvard, MA, USA: Harvard Univ. Press, 1974, Paper CNC64.
A. Elby,What students? learning of representations tells us about constructivism J. Math. Behav., vol. 19, no. 4, pp. 481-502, 2000.
J. Buchner, K. Buntins, and M. Kerres,The impact of augmented reality on cognitive load and performance: A systematic review J. Comput. Assist. Learn., vol. 38, no. 1, pp. 285-303, Feb. 2022.
C. Fueger, L. E. Sergio, S. Heuer, L. Petrovska, and W. E. Huddleston,Remote concussion history does not affect visually-guided reaching in young adult females Concussion, vol. 4, no. 3, p. CNC64, Nov. 2019.
S. Vercruysse, M. Gilat, J. M. Shine, E. Heremans, S. Lewis, and A. Nieuwboer,Freezing beyond gait in Parkinson?s disease: A review of current neurobehavioral evidence Neurosci. Biobehavioral Rev., vol. 43, pp. 213-227, Jun. 2014.
J. E. Reiser, E. Wascher, and S. Arnau,Recording mobile EEG in an outdoor environment reveals cognitive-motor interference dependent on movement complexity Sci. Rep., vol. 9, no. 1, p. 13086, Sep. 2019.
C. Hasty, The Image of Thought and Ideas of Music. New York, NY, USA: Routledge, Oct. 2016, pp. 1-22.
J. Garzon,An overview of twenty-five years of augmented reality in education. multimodal technologies and interaction Multimodal Technol. Interact., vol. 5, no. 7, p. 37, Jul. 2021.
J. M. Kruger and D. Bodemer,Application and investigation of multimedia design principles in augmented reality learning environmentsformation, vol. 13, no. 2, p. 74, Feb. 2022.
W. I. Schollhorn,Applications of systems dynamic principles to technique and strength training Acta Acad. Olymp. Eston., vol. 8, pp. 67-85, Jan. 2000