[en] Music research aims at developing a research space that, in a proactive sense, can support the development of creative and cultural industries. In that context, we argue that a focus on users and their experiences in using tools may become more important in music research. It implies an expansion of the traditional methods of music psychology with methods that can address relevant features of musical action and musical tool use. This paper discusses epistemological and methodological issues related to this development.
Research center :
IPEM, Ghent University, Ghent (BE)
Disciplines :
Performing arts
Author, co-author :
Leman, Marc; Department of Musicology, Ghent University, Belgium
Lesaffre, Micheline; Department of Musicology, Ghent University, Belgium
NIJS, Luc ; University of Luxembourg > Faculty of Humanities, Education and Social Sciences (FHSE) > Department of Education and Social Work (DESW) > Institute of Musicology and Arts ; Department of Musicology, Ghent University, Belgium
Deweppe, Alexander; Department of Musicology, Ghent University, Belgium
External co-authors :
yes
Language :
English
Title :
User-oriented studies in embodied music cognition research
Publication date :
September 2010
Journal title :
Musicae Scientiae
ISSN :
1029-8649
eISSN :
2045-4147
Publisher :
SAGE Publications Ltd
Special issue title :
Understanding musical structure and form: papers in honour of Irène Deliège.
Åborg C., Sandblad B., Gulliksen J., & Lif M., (2003). Integrating work environment considerations into usability evaluation methods—the ADA approach. Interacting with computers 15(3), 453–471.
Adessi A. R., & Pachet F., (2005). Experiments with a musical machine: musical style replication in 3 to 5 year old children. British Journal of Music Education, 22(1), 21–46.
A. R. Addessi S., Carlotti L., Ferrari F., & Pachet F., (2006). Young children's Musical Experiences with a Flow Machine. Proceedings of 9th International Conference of Music Perception and Cognition (ESCOM), BOLOGNA, Bononia University Press, 2006.
Bainbridge D., Cunningham S. J., & Downie J. S., (2003). How people describe their music information needs: A grounded theory analysis of music queries. In H. Holger, Hoos & D. Bainbridge (Eds.), Proceedings of the fourth international conference on music information retrieval: ISMIR 2003 (pp. 221–222).
Bevan N. (1995). Measuring usability as quality of use. Software Quality Journal 4(2), 115–150.
Bevilaqua F., Guedy F., Schnell N., Flety E., & Leyroy N., (2007). Wireless sensor interface and gesture-follower for music pedagogy. Proceedings of the 7th international conference on New interfaces for musical expression (pp. 124–129). New York, NY, USA, ACM (2007).
Biocca F., & Nowak K., (2001). Plugging your body into the telecommunication system: Mediated embodiment, media interfaces, and social virtual environments. In Lin C., & Atkin D., (Eds.), Communication technology and society. Waverly Hill, VI: Hampton Press.
Borchers J. O., (2001). A pattern approach to interaction design. AI & Society 15(4), 359–376.
Chau T., Eaton C., Schwellnus H., Hamdani Y., Lamont A., Tam C., Knox R., & Johnson P., (2003). Design and usability of a movement-to-music system for the rehabilitation of children with cerebral palsy, International Conference on Cerebral Palsy, Quebec, April 30-May 3, 2003 (Developmental Medicine and Child Neurology, 2003, Supplement No. 94, Vol. 45, p.50).
Chen V., H-H, & Duh H. B-L, (2009). Investigating user experience of online communities: The influence of community type. In Proceedings of International Conference on Computational Science and Engineering (pp 509–514).
Csikszentmihalyi M. (1990). Flow: The psychology of optimal experience. New York: Harper & Row.
Csikszentmihalyi M., & Hunter J., (2003). Happiness in everyday life: The uses of experience sampling. Journal of Happiness Studies, 4(2), 18–199.
Cunningham S. J., Reeves N., & Britland M., (2003). An ethnographic study of music information seeking: Implications for the design of a music digital library. In Proceedings of the 3rd ACM/IEEE-CS joint conference on digital libraries, IEEE Computer Society (pp. 5-16).
Custodero L. A., (2005). Observable indicators of flow experience: A developmental perspective on musical engagement in young children from infancy to school age. Music Education Research, 7(2), 185–209.
De Bruyn L., Leman M., Demey M., Desmet F., & Moelants D., (2008). Measuring and quantifying the impact of social interaction on listeners’ movements to music. Proceedings of the 5th International Symposium on Computer Music Modeling and Retrieval. Copenhagen: Denmark.
De Bruyn L., Moelants D., Coussement P., Leman M., (2009). An interactive sound recognition game for primary school children. In Proceedings of the 4th Conference of the European Network of Music Educators and Researchers of Young Children (MERYC2009). Bologna: Italy.
Decety J., & Jackson P. L., (2006). A social-neuroscience perspective on empathy. Current directions in psychological science, 15(2), 54–58.
Deliège I., (1987). Grouping conditions in listening to music: An approach to Lerdahl & Jackendoff ‘s grouping preference rules. Music Perception 4(4), 325–359.
Deliège I., & Wiggins G., (2006). Musical creativity multidisciplinary research in theory and practice. Hove, UK, and New York, NY: Psychology Press, 2006.
Demey M., Leman M., & Cornelis O., (2008). The IPEM_EME: a Wireless music controller for real-time. Proceedings of the 14th International Conference on Auditory Display.
Demey M., Leman M., De Bruyn L., Bossuyt F., & Vanfleteren J., (2008). The Musical Synchrotron: using wireless motion sensors to study how social interaction affects synchronization with musical tempo. Proceedings of the conference of New Interfaces for Musical Expression (NIME ‘08). Genova, Italy.
Demoucron M., & Rasamimanana N., (2009). Score-based real-time performance with a virtual violin, DAFx.
De Mulder T., Martens J.P., Lesaffre M., Leman M., De Baets B., & De Meyer H., (2003). An auditory model based transcriber of vocal queries. Proceedings of the International Conference on Music Information Retrieval, Baltimore, Maryland, USA and Library of Congress, Washington, DC, US.
Desain P., & Honing H., (2003). The formation of rhythmic categories and metric priming. Perception 32(3), 341–365.
Deutsch D. (1999). The psychology of music. San Diego, Academic Press.
Deweppe A., Leman M., & Lesaffre M., (2009). Discerning user profiles and establishing usability for the interactive music applications that use embodied mediation technology. In Louhivuori J., Eerola T., Saarikallio S., Himberg T., Eerola P-S., (Eds.), Proceedings of the 7th Triennial Conference of the European Society for the Cognitive Sciences of Music (ESCOM 2009), Jyväskylä, Finland.
Dourish P. (2001). Where the action Is: The foundations of embodied interaction. Cambridge: MIT Press
Futrelle J., & Downie J. S., (2002). Interdisciplinary communities and research issues in Music Information Retrieval. In Proceedings of the 3rd International Conference on Music Information Retrieval (ISMIR02) (pp. 215–221), Paris.
Godøy R. I., & Leman M., (Eds.) (2009). Musical gestures: Sound, movement, and meaning. New York, Routledge.
Hallam S., Cross I., (2009). The Oxford handbook of music psychology. Oxford; New York, Oxford University Press.
Heylen E., Moelants D., & Leman M., (2006). Singing along with music to explore tonality. In Proceedings of the 9th International Conference on Music Perception and Cognition, Bologna.
Hirose N. (2002). An ecological approach to embodiment and cognition. Cognitive Systems Research 3(3), 289–299.
Hunt A., Wanderly M., & Kirk R., (2000). Towards a model for instrumental mapping in expert musical interaction. In Proceedings of the 2000 International Computer Music Conference (pp. 209–211). San Francisco, CA: International Computer Music Association.
Hunt A., Wanderly M., & Paradis M., (2003). The importance of parameter mapping in electronic instrument design. Journal of New Music Research, 32(4), 429–440
Insko B. (2003). Measuring presence: Participantive, behavioral and physiological methods. In Riva G., Davide F., Ijsselsteijin W. A., (Eds.). Being there: Concepts, effects and measurement of user presence in synthetic environments. Ios Press: Amsterdam, The Netherlands.
Ivory J. D., & Magee R. G., (2009). You can't take it with you? effects of handheld portable media consoles on physiological and psychological responses to video game and movie content. CyberPsychology & Behavior 12(3), 291–297.
Jackson S., & Eklund R., (2004). The flow scales manual. Fitness Information Technology.
Ji Y. G., Park J. H., Lee C., & Yun M. H., (2006). A usability checklist for the usability evaluation of mobile phone user interface. International journal of human-computer interaction 20(3), 207–231.
Juslin P. N., & Vastfjall D., (2008). Emotional responses to music: The need to consider underlying mechanisms. Behavioral and Brain Sciences 31(5), 559-+.
Keller P. E., (2008). Joint action in music performance. In Morganti F., Carassa A., & Riva G., (Eds.), Enacting intersubjectivity: A cognitive and social perspective to the study of interactions (pp. 205–221). Amsterdam: IOS Press.
Kensing F., & Blomberg J., (1998). Participatory design: Issues and concerns. Computer supported cooperative work 7(3/4), 167–185.
Kiili K. (2005). Digital game-based learning: Towards an experiential gaming model. The Internet and higher education, 8(1), 13–24.
Krumhansl C. L., (1990). Cognitive foundations of musical pitch. New York, Oxford University Press.
Laarni J., Ravaja N., (2004). Personality-related differences in participantive presence. Proceedings of the PRESENCE (pp. 88–95).
Laneau J., Wouters J., & Monnen M., (2006). Improved music perception with explicit pitch coding in cochlear implants. Audio Neorotol 11, 38–52.
Leman M. (1995). Music and schema theory: Cognitive foundations of systematic musicology. Berlin, Springer.
Leman M. (2002). Musical audio mining. In Meij J., (Ed.), Dealing with the Data Flood: Mining Data, text and multimedia. Rotterdam: SST Netherlands Study centre for Technology Trends.
Leman M., Vermeulen V., (2005). Prediction of musical affect using a combination of acoustic structural cues. Journal of New Music Research 34(1), 39–67.
Leman M. (2008). Embodied music cognition and mediation technology. Cambridge, Mass., MIT Press.
Leman M. (2008). Systematic musicology at the crossroads of modern music research. In Systematic and comparative musicology: Concepts, methods, findings (pp. 89–115). Peter Lang.
Leman M. (2009). Music, gesture and the formation of embodied meaning. In Godoy R.I., & Leman M., (Eds.), Music and gesture foundations. Routledge.
Leman M., & Godoy R. I., (2009). Why study musical gestures? In Godoy R.I., & Leman M., (Eds.), Music and gesture foundations. Routledge.
Leman M. (2009). Some reflections on systematic musicology as proactive science. Hamburger Jahrbuch für SystematischeMusikwissenschaft. Frankfurt am Main, Peter Verlag.
Leman M., Demey M., Lesaffre M., van Noorden L., & Moelants D., (2009a). Concepts, technology, and assessment of the social music game ‘Sync-in-Team”. In Proceedings of International Conference on Computational Science and Engineering (pp. 837–842).
Leman M. (2009). An embodied approach to music semantics. Musicae Scientiae, Discussion Forum 5, 43–68.
Lesaffre M., Moelants D., Leman M., De Baets B., De Meyer H., & Martens J.-P., (2003a). User behavior in the spontaneous reproduction of musical pieces by vocal query. In Proceedings of the 5th triennial European Society for the Cognitive sciences of Music conference (ESCOM) (pp. 208–211). Hanover.
Lesaffre M., Tanghe K., Martens G., Moelants D., Leman M., De Baets B., De Meyer H., & Martens J.-P., (2003b). The MAMI query-by-voice experiment: Collecting and annotating vocal queries for music information retrieval. In Proceedings of the 4th International Conference on Music Information Retrieval (ISMIR03) (pp. 65–71). Baltimore.
Lesaffre M., Leman M., De Voogdt L., De Baets B., De Meyer H., & Martens J.-P., (2006a). A user-dependent approach to the perception of high-level semantics of music. Proceedings of the International Conference of Music perception and Cognition (ICMPC). Bologna.
Lesaffre M., & Leman M., (2007). Using fuzzy logic to handle users’ semantic descriptions in a music retrieval system. In Castillo O., (Eds.) Theoretical Advances and Applications of Fuzzy Logic and Soft Computing (pp. 89–98). Advances in Soft Computing 42, Springer-Verlag Heidelberg Berlin New York.
Lesaffre M., De Voogdt L., Leman M., De Baets B., De Meyer H., & Martens J-P., (2008). How potential users of music search and retrieval systems describe the semantic quality of music. Journal of the American Society For Information Science and Technology, 59(5), 1–13.
Lesaffre M., Nijs L., & Leman M., (2009). The experience of presence and flow in interacting with embodied mediation technology for music creativity. In J. Louhivuori, T. Eerola, S. Saarikallio, T. Himberg, P-S. Eerola (Eds.), Proceedings of the 7th Triennial Conference of the European Society for the Cognitive Sciences of Music (ESCOM 2009), Jyväskylä, Finland.
Lombard M., & Ditton T., (1997). At the heart of it all: The concept of presence. Journal of computer-mediated communication 3(2), 20.
Magnusson T., & Mendieta E., (2007). The acoustic, the digital and the body: A survey on musical instruments. Proceedings of the 2007 Conference on New Interfaces for Musical Expression (NIME07). New York, NY, USA.
Malafouris L. (2008). Between brains, bodies and things: Tectonoetic awareness and the extended self. Philosophical Transactions of the Royal Society B: Biological Sciences 363(1499).
Mankoff J., Dey A. K., Hsieh G., Kientz J., Lederer S., & Ames M., (2003). Heuristic evaluation of ambient displays. Proceedings of the Conference on Human factors in computing systems (CHI 03). Fort Lauderdale: USA.
Metzinger T. (2003). Being no one: The self-model theory of participantivity. Cambridge, MA: MIT Press.
Müllensiefen D., & Frieler K., (2006). Evaluating different approaches to measuring the similarity of melodies. In Batagelj V., Bock H.-H., Ferligoj A., & Ziberna A., (Eds.), Data Science and Classification (pp. 299–306). Berlin: Springer.
Newton-Dunn H., Nakano H., (2003). Block jam: a tangible interface for interactive music. Proceedings of the 2003 conference on New interfaces for musical expression. Montreal, Quebec, Canada, National University of Singapore.
Nielsen J., & Molich R., (1990). Heuristic evaluation of user interfaces. In Proceedings of the SIGCHI conference on Human factors in computing systems Empowering people (CHI ‘90) (pp. 249–256).
Nielsen J. (1994). Usability inspection methods. Proceedings of the CHI ‘94 conference. Boston, USA.
Nijs L., Leman M., & Lesaffre M., (2009). The musical instrument as extension of the body. In Proceedings of 5th Conference on Interdisciplinary Musicology. Paris.
Pachet F. (2002). The continuator: Musical interaction with style. Stockholm Music Performance Symposium. Stockholm, Sweden, Swets Zeitlinger Publishers.
Rabardel P. (1995). Les Hommes et les technologies: approche cognitive des instruments contemporains. Paris, Armand Collin.
Riva G. (2006). Being-in-the-world-with: Presence meets social and cognitive neuroscience. In Riva G., Anguera M.T., Wiederhold B.K., & Mantovani F., (Eds.), From Communication to Presence: Cognition, Emotions and Culture towards the Ultimate Communicative Experience. Festschrift in honor of Luigi Anolli (pp. 47–80). Amsterdam: IOS Press.
Riva G. (2009). Is presence a technology issue? Some insights from cognitive sciences. Virtual Reality 13(3), 159–169.
Schwellnus H., Tam C., Chau T., Knox R., Johnson P., & Hamdani Y., (2002). Using movement-to-music technology for play with children with special needs. OT Now, July.
Sethares W. (1998). Tuning, timbre, spectrum, scale. Springer, New York
Squire K. (2003). Video games in education. International journal of intelligent simulations and gaming 2(1), 49–62.
St John P.A., (2006). A community of learners: young music-makers scaffolding flow-experience. In Baroni (Eds.), Proceedings of the 9th International Conference of Music Perception and Cognition. Bononia University Press, Bologna.
Stowell D., Robertson A., Bryan-Kinns N., & Plumbley M. D., (2009). Evaluation of live human-computer music-making: Quantitative and qualitative approaches. International journal of human-computer studies 67(11), 960–975.
Strickler Z. (1999). Elicitation methods in experimental design research. Design issues 15(2), 27–39.
Sweetser P., & Wyeth P., (2005). GameFlow: A model for evaluating player enjoyment in games. Computers in entertainment 3(3), 1–24.
Takatalo J. (2002). Presence and flow in virtual environments: An explorative study. Master's thesis, University of Helsinki, Helsinki, Finland
Talja S. (1999). Analyzing qualitative interview data the discourse analytic method. Library & information science research 21(4), 459–477.
Tselios N., Avouris N., & Vassilis K., (2008). The effective combination of hybrid usability methods in evaluating educational applications of ICT: Issues and challenges. Education and information technologies 13(1), 55–76.
Typke R., Wiering F., & Veltkamp R.C., (2007). Transportation distances and human perception of melodic similarity. Musicae Scientiae, Similarity Perception in Listening to Music, 153–181.
Uitdenbogerd A., & van Schyndel R., (2002). A review of factors affecting music recommender success. In Proceedings of the 3rd International Conference on Music Information Retrieval (ISMIR02) (pp. 204–208). Paris.
Van Baren J., & Ijsselsteijn W., (2004). Measuring presence: A guide to current measurement approaches. OmniPres project IST-2001-39237, Project Report.
Välimäki V., (2004). Physics-based modeling of musical instruments. Acta Acustica United with Acustica 90(4), 611–617.
Varela F. J., Thompson E., & Rosch E., (1991). The embodied mind: Cognitive science and human experience. Cambridge, MA: MIT Press.
Wanderley M. M., & Orio N., (2002). Evaluation of input devices for musical expression: bor-rowing tools from HCI. Computer Music Journal 26(3), 62–76.
Wharton C., Rieman J., Lewis C., & Polson P., (1994). The cognitive walkthrough method: A practitioner's guide. In Nielsen J., Mack R. L., (Eds.), Usability inspection methods. New York: John Wiley & Sons.
Witmer B. G., & Singer M. J., (1998). Measuring presence in virtual environments: A presence questionnaire. Presence: Teleoperators and Virtual Environments, 7(3), 225–240.
