The Music Paint Machine: Stimulating Self-monitoring Through the Generation of Creative Visual Output Using a Technology-enhanced Learning Tool

NIJS, Luc; Moens, Bart; Lesaffre, Micheline; Leman, Marc

doi:10.1080/09298215.2011.650180

Article (Scientific journals)

The Music Paint Machine: Stimulating Self-monitoring Through the Generation of Creative Visual Output Using a Technology-enhanced Learning Tool

NIJS, Luc; Moens, Bart; Lesaffre, Micheline et al.

2012 • In Journal of New Music Research, 41 (1), p. 79 - 101

Peer Reviewed verified by ORBi

Permalink
https://hdl.handle.net/10993/58715

DOI
10.1080/09298215.2011.650180

Files (1)Send to Details Statistics Bibliography Similar publications

Files

Full Text

Nijs_etAl_JNMR (2012).pdf

Author postprint (1.79 MB)

Request a copy

All documents in ORBilu are protected by a user license.

Send to

RIS BibTex APA Chicago Permalink X Linkedin

Details

Keywords :

music education; digital learning; visual learning; music paint machine

Abstract :

[en] In this paper, we discuss the pedagogically grounded and research-based design of a technology-enhanced learning tool, the Music Paint Machine. This interactive music system introduces a musical experience in which the musician creates a digital painting by playing an acoustic musical instrument and by moving the body on a coloured pressure mat. As a learning tool it aims at the development of musical creativity, at the stimulation of embodied understanding of music and at the development of an intimate relationship with the musical instrument.First, the methodological approach is outlined and pedagogical and theoretical backgrounds are discussed. Then, we report on an experiment in which 51 amateur musicians participated. The experiment aimed at probing the application's potential to induce a flow experience and to learn about how participants evaluate the didactic relevance of the Music Paint Machine. Results suggest that the Music Paint Machine has the potential to evoke a flow experience. Furthermore participants acknowledged its didactic relevance with regard to learning to improvise, to developing understanding of musical parameters and to stimulating creativity. © 2012 Taylor and Francis Group, LLC.

Disciplines :

Education & instruction

Author, co-author :

NIJS, Luc ; University of Luxembourg > Faculty of Humanities, Education and Social Sciences (FHSE) > Department of Education and Social Work (DESW) > Institute of Musicology and Arts ; Institute for Psychoacoustics and Electronic Music (IPEM), Ghent University, 9000 Ghent, Belgium

Moens, Bart; Institute for Psychoacoustics and Electronic Music (IPEM), Ghent University, 9000 Ghent, Belgium

Lesaffre, Micheline; Institute for Psychoacoustics and Electronic Music (IPEM), Ghent University, 9000 Ghent, Belgium

Leman, Marc; Institute for Psychoacoustics and Electronic Music (IPEM), Ghent University, 9000 Ghent, Belgium

External co-authors :

yes

Language :

English

Title :

The Music Paint Machine: Stimulating Self-monitoring Through the Generation of Creative Visual Output Using a Technology-enhanced Learning Tool

Publication date :

March 2012

Journal title :

Journal of New Music Research

ISSN :

0929-8215

Publisher :

Informa UK Limited

Volume :

Issue :

Pages :

79 - 101

Peer reviewed :

Peer Reviewed verified by ORBi

Additional URL :

http://www.tandfonline.com/doi/pdf/10.1080/09298215.2011.650180

Available on ORBilu :

since 05 December 2023

Statistics

Number of views

53 (0 by Unilu)

Number of downloads

0 (0 by Unilu)

More statistics

Scopus citations^®

Scopus citations^®
without self-citations

OpenCitations

OpenAlex citations

WoS citations^™

Bibliography

Addessi, A. R., Ferrari, L., Carlotti, S. and Pachet, F. (2006) Young children's musical experiences with a flow machine. 9th International Conference of Music Perception and Cognition. Bologna, Italy. pp.1658-1665.
Addessi, A. R. and Pachet, F. 2005. Experiments with a musical machine: Musical style replication in 3 to 5 year old children. British Journal of Music Education, 22(01): 21-46.
Addessi, A. R. and Young, S. (2009) Proceedings of the 4th Conference of the European Network of Music Educators and Researchers of Young Children. Bologna: Bononia University Press.
Altenmuller, E. and Gruhn, W. 2002. "Brain mechanisms". In The Science and Psychology of Music Performance: Creative Strategies for Teaching and Learning, Edited by: Parncutt, R. and McPherson, G. E. 63-81. New York: Oxford University Press.
Borchers, J. O. (1997) WorldBeat: Designing a baton-based interface for an interactive music exhibit. ACM CHI'97 International Conference on Human Factors in Computing Systems. Atlanta, Georgia. pp.131-138.
Bos, N. 2001. "What do game designers know about scaffolding? Borrowing SimCity design principles for education". Retrieved November 17, 2011, fromhttp://playspace.concord.org/papers.html#report
Bowman, W. and Powell, K. 2007. "The body in a state of music. In L. Bresler (Ed.)". In International Handbook of Research in Arts Education (pp. 1087-1106), Dordrecht, The Netherlands: Springer.
Bresler, L. 2007. International Handbook of Research inArts Education, Vol. 1 & 2, New York: Springer Verlag.
Buldu, M. 2010. Making learning visible in kindergarten classrooms: Pedagogical documentation as a formative assessment technique. Teaching and Teacher Education, 26(7): 1439-1449.
Chen, H., Wigand, R. and Nilan, M. 1999. Optimal experience of Web activities. Computers in Human Behavior, 15(5): 585-608.
Colwell, R. and Richardson, C. 2002. The New Handbook of Research on Music Teaching and Learning, New York: Oxford University Press.
Csikszentmihalyi, M. 1990. Flow: The Psychology of Optimal Experience, New York: Harper & Row Publishers.
Custodero, L. A. 1997. An observational study of flow experience in young children's music learning, Los Angeles, USA: University of Southern California. PhD thesis
Custodero, L. A. 2005. Observable indicators of flow experience: a developmental perspective on musical engagement in young children from infancy to school age. Music Education Research, 7(2): 185-209.
Dahlberg, G., Moss, P. and Pence, A. 1999. Beyond Quality in Early Childhood Education and Care: Postmodern Perspectives, London: Routledge.
Dalcroze, E. J. 1980. Rhythm, Music and Education, London: Dalcroze Society Inc.
Daniel, R. 2004. Peer assessment in musical performance: The development, trial and evaluation of a methodology for the Australian tertiary environment. British Journal of Music Education, 21(1): 89-110.
Deliège, I. and Wiggins, G. 2006. Musical Creativity: Multidisciplinary Research in Theory and Practice, NewYork: Psychology Press.
Denissen, J. J.A., Geenen, R., van Aken, M. A.G., Gosling, S. D. and Potter, J. 2008. Development and validation of a Dutch translation of the Big Five Inventory (BFI). Journal of Personality Assessment, 90(2): 152-157.
Dixon, S., Goebl, W. and Widmer, G. (2005) The 'Air Worm': An interface for real-time manipulation of expressive music performance. ICMC'05 International Computer Music Conference. Barcelona, Spain. pp.614-617.
Elliott, D. 1995. Music Matters. A New Philosophy of Music Education, New York: Oxford University Press.
Elliott, D. 2005. Praxial Music Education: Reflections and Dialogues, New York: Oxford University Press.
Ericsson, K. 1997. "Deliberate practice and the acquisition of expert performance: An overview". In Does Practice Make Perfect? Current Theory and Research on Instrumental Music Practice, Edited by: Jørgensen, H. and Lehmann, A. C. 9-51. Oslo: Norges musikkh[ugrave]gskole.
Ericsson, K. and Lehmann, A. 1996. Expert and exceptional performance: Evidence of maximal adaptation to task constraints. Annual Review of Psychology, 47(1): 273-305.
Fober, D., Letz, S. and Orlarey, Y. (2007) VEMUS-Feedback and Groupware Technologies for Music Instrument Learning. 4th International Music Conference. Lefkada, Greece. pp.117-123.
Ferguson, S., Moere, A. and Cabrera, D. (2005) Seeing sound: Real-time sound visualisation in visual feedback loops used for training musicians. Tenth Symposium on Information Visualization. London. pp.97-102.
François, R. R.J., Chew, E. and Thurmond, D. 2007. MIMI A Musical Improvisation System That Provides Visual Feedback to the Performer, Los Angeles: University of Southern California Dept. of Computer Sciences.
Godøy, R. and Leman, M. 2010. Musical Gestures: Sound, Movement, and Meaning, New York: Routledge.
Goolsby, T. W. 1995. Portfolio assessment for better evaluation. Music Educators Journal, 82(3): 39-44
Hoppe, D., Sadakata, M. and Desain, P. 2006. Development of real-time visual feedback assistance in singing training: A review. Journal of Computer Assisted Learning, 22(4): 308-316.
Howard, D. M., Welch, G. F., Brereton, J., Himonides, E., DeCosta, M., Williams, J. and Howard, A. W. 2004. WinSingad: A real-time display for the singing studio. Logopedics Phonatrics Vocology, 29(3): 135-144.
Ilari, B. and Gluschankof, C. 2009. Music in the early years: Research, theory and practice [Special issue]. Early Child Development and Care, 179(6)
Jackson, S. A. and Eklund, R. C. 2004. The Flow Scales Manual, Morgantown, WV: Fitness Information Technology.
Johnson, D. and Han, D. 2009. Music Coach: Real-time Evaluation of Music Performance using Nokia N900, Santa Barbara: University of California, Dept. of Computer Sciences.
Kun, J. V. 2004. A Real-time Responsive/Interactive System for Musical Conducting Using Motion Capture Technology, Tempe: Arizona State University.
Lappe, C., Herholz, S. C., Trainor, L. J. and Pantev, C. 2008. Cortical plasticity induced by short-term unimodal and multimodal musical training. The Journal of Neuroscience, 28(39): 9632-9639
Lehmann, A. 1997. "Acquired mental representations in music performance: Anecdotal and preliminary empirical evidence". In Does Practice Make Perfect? Current Theory and Research on Instrumental Music Practice, Edited by: Jørgensen, H. and Lehmann, A. C. 141-163. Oslo: Norges musikkh[ugrave]gskole.
Leman, M. 2007. Embodied Music Cognition and Mediation Technology, London: MIT Press.
Leman, M., Lesaffre, M., Nijs, L. and Deweppe, A. 2010. User-oriented Studies in Embodied Music cognition. Musicae Scientiae,: 203-224. (Special issue: Understanding musical structure and form: Papers in honour of Irène Deliège)
MacDonald, M. 2007. Toward formative assessment: The use of pedagogical documentation in early elementary classrooms. Early Childhood Research Quarterly, 22(2): 232-242.
Ng, K., Larkin, O., Koerselman, T. and Ong, B. (2007) i-Maestro gesture and posture support: 3d motion data visualisation for music learning and playing. EVA 2007 London International Conference. London, UK. pp.201-208.
Ng, K., Weyde, T., Larkin, O., Neubarth, K., Koerselman, T. and Ong, B. (2007) 3d augmented mirror: A multimodal interface for string instrument learning and teaching withgesture support. 9th International Conference on Multimodal Interfaces. Nagoya, Japan. pp.339-345.
Nijs, L. 2008. Evaluatie in het DKO: Het schietlood in actie [Assessment in Part time music education: handling the plum line]. Begeleid zelfstandig leren, Alternatieve evaluatie, 6(21): 57-96.
Nijs, L., Coussement, P., Müller, C., Lesaffre, M. and Leman, M. (2010) The Music Paint Machine: A multimodal interactive platform to stimulate musical creativity in instrumental practice. Second International Conference on Computer Supported Education. Valencia, Spain. pp.331-336.
Nijs, L., Lesaffre, M. and Leman, M. (2009) The musical instrument as a natural extension of the musician. Fifth Conference on Interdisciplinary Musicology. Paris, France. pp.132-133.
Olsson, L. 2009. Movement and Experimentation in Young Children's Learning: Deleuze and Guattari in Early Childhood Education, London: Routledge.
Palmer, C. and Drake, C. 1997. Monitoring and planning capacities in the acquisition of music performance skills. Canadian Journal of Experimental Psychology, 51(4): 369-384.
Perkins, D. N. 1992. "Technology meets constructivism: Do they make a marriage". In Constructivism and the Technology of Instruction: A Conversation, Edited by: Duffy, T. M. and Jonassen, D. H. 45-55. Hillsdale, NJ: Lawrence Erlbaum Associates.
Pierce, A. 2007. Deepening Musical Performance Through Movement: The Theory and Practice of Embodied Interpretation, Bloomington and Indianapolis: Indiana University Press.
Pritchard, A. and Woollard, J. 2010. Psychology for the Classroom: Constructivism and Social Learning, NewYork: Routledge.
Puckette, M. S., Apel, T. and Zicarelli, D. D. (1998) Real-time audio analysis tools for Pd and MSP. International Computer Music Conference. San Francisco, CA. pp.109-112.
Riva, G. 2005. "The psychology of ambient intelligence: Activity, situation and presence". In From Communication to Presence: Cognition, Emotions and Culture towards the Ultimate Communicative Experience, Edited by: Riva, G., Anguera, M., Wiederhold, B. and Mantovani, F. 19-34. Amsterdam: IOS Press.
Riva, G. 2008a. "Enacting interactivity: The role of presence". In Enacting Intersubjectivity: A Cognitive and Social Perspective on the Study of Interactions, Edited by: Morganti, F., Carassa, A. and Riva, G. 97-114. Amsterdam: IOS Press.
Riva, G. 2008b. "Presence and social presence: From agency to self and others". 66-72. Padova, Italy: In 1st Annual International Workshop on Presence.
Riva, G., Waterworth, J. A., Waterworth, E. L. and Mantovani, F. 2009. From intention to action: The role of presence. New Ideas in Psychology, 29(1): 24-37.
Russell, J. E. 1997. Autism as an Executive Disorder, NewYork: Oxford University Press.
Schmidt, R. A. and Wulf, G. 1997. Continuous concurrentfeedback degrades skill learning: Implications for training and simulation. Human Factors, 39(4): 509-529.
Schoonderwaldt, E., Hansen, K. and Askenfeld, A. (2004) IMUTUS-an interactive system for learning to play a musical instrument. International Conference of Interactive Computer Aided Learning. Villach, Austria. pp.143-150.
Schoonderwaldt, E. and Wanderley, M. (2007) Visualization of bowing gestures for feedback: The Hodgson plot. Proceedings of the 3rd International Conference on Automated Production of Cross Media Content for Multi-channel Distribution (AXMEDIS07). Barcelona, Spain. Vol. II, pp.65-70.
Schubert, T., Friedmann, F. and Regenbrecht, H. 1999. "Embodied presence in virtual environments". In Visual Representations and Interpretations, Edited by: Paton, R. and Neilson, I. 268-278. Berlin: Springer.
Shea, C. H. and Wulf, G. 1999. Enhancing motor learning through external-focus instructions and feedback. HumanMovement Science, 18(4): 553-571.
Tchernoff, E. (2007) "Music schools in Europe". A European study on the organisation of music schools and the preparation of students for professional music training at higher education level. Retrieved fromhttp://www.polifonia-tn.org
Van Regenmortel, H. and Strobbe, L. 2010. Klansporen. Breinvriendelijk musiceren, Antwerpen: Garant.
Webster, P. R. 2002. "Computer-based technology and music teaching and learning". In The New Handbook of Research on Music Teaching and Learning, Edited by: Colwell, R. and Richardson, C. 416-439. Oxford: Oxford University Press.
Webster, P. R. 2007. "Computer-based technology and music teaching and learning: 2000-2005". In International Handbook of Research in Arts Education, Edited by: Bresler, L. Vol. 2, 1311-1330. Dordrecht: Springer.
Welch, G. F. 2009. "Ecological validity and impact: Key challenges for music education research". In Music Education for Changing Times: Guiding Visions for Practice. Landscapes: The Arts, Aesthetics, and Education, Edited by: Gates, J. T. and Regelksi, T. Vol. 7, 149-159. Dordrecht: Springer.
Welch, G. F., Howard, D. M., Himonides, E. and Brereton, J. 2005. Real-time feedback in the singing studio: An innovatory action-research project using new voice technology. Music Education Research, 7(2): 225-249.
Witmer, B. and Singer, M. 1998. Measuring presence in virtual environments: a presence questionnaire. Presence, 7(3): 225-240.
Woody, R. H. 2001. Learning from the experts: Applying research in expert performance to music education. Update: Appliations of Research in Music Education, 19(2): 9-14.
Wulf, G., Shea, C. H. and Matschiner, S. 1998. Frequent feedback enhances complex motor skill learning. Journal of Motor Behavior, 30(2): 180-192.
Yu, P. T., Lai, Y. S., Tsai, H. H. and Chang, Y. H. 2010. Using a multimodal learning system to support music instruction. Educational Technology & Society, 13(3): 151-162.