Assessing a Clarinet Player's Performer Gestures in Relation to Locally Intended Musical Targets

[en] Musicianship is known to display high-level skills, which involve different aspects of mental processing and corporeal control. Of particular interest is the match between the musician's mental focus on musical targets (the so-called musical intentions) and the expressive (or so-called auxiliary) body movements. To what extent are these related to each other? And what does this relationship reveal about mind-body connections? To approach these questions, a case study was set up around a clarinet solo performance played from score, covering a style of music unfamiliar to the player. The clarinetist's movements were recorded with an optical movement tracking system. A statistical analysis method was developed, to account for movement data in relation to the potential musical intentions and targets. The bottom-up movement analysis method was validated with the performer's annotations of targets in the musical score and the performer's annotations of communicative/sound facilitating gestures in the performance video. The results reveal that the mental focus on musical targets is related to bodily expression. This finding supports the idea of an embodied model of musical syntax processing, which is strongly related to corporeal gestures. © 2012 Taylor and Francis Group, LLC.

Research center :

IPEM, GHent University, Ghent (BE)

Disciplines :

Performing arts

Author, co-author :

Desmet, Frank; Institute for Psychoacoustics and Electronic Music (IPEM), Ghent University, 9000 Ghent, Belgium

NIJS, Luc ; University of Luxembourg > Faculty of Humanities, Education and Social Sciences (FHSE) > Department of Education and Social Work (DESW) > Institute of Musicology and Arts ; Institute for Psychoacoustics and Electronic Music (IPEM), Ghent University, 9000 Ghent, Belgium

Demey, Michiel; Institute for Psychoacoustics and Electronic Music (IPEM), Ghent University, 9000 Ghent, Belgium

Lesaffre, Micheline; Institute for Psychoacoustics and Electronic Music (IPEM), Ghent University, 9000 Ghent, Belgium

Martens, Jean-Pierre; ELIS, Ghent University, Belgium

Leman, Marc; Institute for Psychoacoustics and Electronic Music (IPEM), Ghent University, 9000 Ghent, Belgium

External co-authors :

yes

Language :

English

Title :

Assessing a Clarinet Player's Performer Gestures in Relation to Locally Intended Musical Targets

Publication date :

March 2012

Journal title :

Journal of New Music Research

ISSN :

0929-8215

Publisher :

Informa UK Limited

Volume :

Issue :

Pages :

31 - 48

Peer reviewed :

Peer Reviewed verified by ORBi

Additional URL :

http://www.tandfonline.com/doi/pdf/10.1080/09298215.2011.649769

Available on ORBilu :

since 31 January 2025

Statistics

Number of views

20 (0 by Unilu)

Number of downloads

0 (0 by Unilu)

More statistics

Scopus citations^®

Scopus citations^®
without self-citations

OpenCitations

OpenAlex citations

WoS citations^™

Bibliography

Abdi, H. 2003. "Factor rotations in factor analyses". In Encyclopedia for Research Methods for the Social Sciences, Edited by: Lewis-Beck, M., Bryman, A. and Futing, T. 792-795. Thousand Oaks, CA: Sage.
Alon, J., Athitsos, V., Yuan, Q. and Sclaroff, S. 2009. A unified framework for gesture recognition and spatiotemporal gesture segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31: 1685-1699.
Bayazit, M., Couture-Beil, A. and Mori, G. (2009) Real-time motion-based gesture recognition using the GPU. Proceedings of the IAPR Conference on Machine Vision Applications. Yokohama, Japan. pp.9-12.
Bowman, A. W. and Azzalini, A. 1997. Applied Smoothing Techniques for Data Analysis: The Kernel Approach with S-Plus Illustrations, New York: Oxford University Press, USA.
Brebner, J. T. and Welford, A. T. 1980. "Introduction: An historical background sketch". In Reaction Times, 1-23. New York: Academic Press.
Cadoz, C. and Wanderley, M. 2000. "Gesture-music". In Trends in Gestural Control of Music, Edited by: Wanderley, M. M. and Battier, M. 71-93. Paris: IRCAM/Centre Pompidou.
Camurri, A., De Poli, G., Leman, M. and Volpe, G. 2005. Communicating expressiveness and affect in multimodal interactive systems. IEEE Multimedia, 12(1): 43-53.
Canazza, S., De Poli, G., Rinaldin, S. and Vidolin, A. 1997. "Sonological analysis of clarinet expressivity". In Music, Gestalt, and Computing, Edited by: Leman, M. 431-440. Berlin, Heidelberg: Springer.
Castellano, G., Mortillaro, M., Camurri, A., Volpe, G. and Scherer, K. 2008. Automated analysis of body movement in emotionally expressive piano performances. Music Perception, 26: 103-119.
Celis, R., Pipinos, I. I., Scott-Pandorf, M. M., Myers, S. A., Stergiou, N. and Johanning, J. M. 2009. Peripheral arterial disease affects kinematics during walking. Journal of Vascular Surgery, 49: 127-132.
Chaffin, R., Imreh, G., Lemieux, A. F. and Chen, C. 2003. 'Seeing the Big Picture': Piano practice as expert problem solving. Music Perception, 20: 465-490.
Clarke, E. and Davidson, J. 1998. "The body in performance". In Composition-Performance-Reception: Studies in the Creative Process in Music, 74-92. Aldershot: Scolar Press.
Cleveland, W. S. and Devlin, S. J. 1988. Locally weighted regression: An approach to regression analysis by local fitting. Journal of the American Statistical Association, 83: 596-610.
Dahl, S. and Friberg, A. 2007. Visual perception of expressiveness in musicians' body movements. Music Perception, 24: 433-454.
Davidson, J. W. 1993. Visual perception of performance manner in the movements of solo musicians. Psychology of Music, 21: 103-113
Davidson, J. W. 2005. "Bodily communication in musical performance". In Musical Communication, Edited by: Miell, D., Macdonald, R. and Hargreaves, D. J. 215-228. New York: Oxford University Press.
Davidson, J. W. 2007. Qualitative insights into the use of expressive body movement in solo piano performance: A case study approach. Psychology of Music, 35: 381-401.
De Poli, G., Mion, L. and Roda, A. 2009. Toward an action based metaphor for gestural interaction with musical contents. Journal of New Music Research, 38: 295-307.
Desmet, F. (2011). A statistical framework for embodied music cognition (PhD thesis). Ghent University, Belgium
Elmezain, M., Al-Hamadi, A., Appenrodt, J. and Michaelis, B. (2009) A Hidden Markov Model-based continuous gesture recognition system for hand motion trajectory. 19th International Conference on Pattern Recognition, 2008, ICPR 2008. Tampa, FL, USA. pp.1-4.
Engel, K. C., Flanders, M. and Soechting, J. F. 1997. Anticipatory and sequential motor control in piano playing. Experimental Brain Research, 113: 189-199.
Field, M., Gordon, S., Peterson, E., Robinson, R., Stahovich, T. and Alvarado, C. (2009) The effect of task on classification accuracy: Using gesture recognition techniques in free-sketch recognition. EUROGRAPHICS Symposium on Sketch-Based Interfaces and Modeling. New Orleans, LA, USA. pp.499-512.
Godøy, R. I. 2010. "Gestural affordances of musical sound. In R.I. Godøy & M. Leman (Eds.)". In Musical Gestures: Sound, Movement, and Meaning (pp. 103-125), New York: Routledge.
Goodall, C. 1991. Procrustes methods in the statistical analysis of shape. Journal of the Royal Statistical Society, Series B (Methodological), 53: 285-339.
He, Z., Jin, L., Zhen, L. and Huang, J. (2009) Gesture recognition based on 3D accelerometer for cell phones interaction. IEEE Asia Pacific Conference on Circuits and Systems APCCAS-2008. Macao, China. pp.217-220.
Huang, E. W. and Fu, L. C. (2009) Gesture stroke recognition using computer vision and linear accelerometer. 8th IEEE Conference on Automatic Face & Gesture Recognition, 2008. FG'08. Amsterdam, The Netherlands. pp.1-6.
Jensen, A. R. 2006. Clocking the Mind: Mental Chronometry and Individual Differences, Oxford: Elsevier Science.
Jensenius, R., Wanderley, M. M., Godøy, R. I. and Leman, M. 2010. "Musical gestures: concepts and methods in research". In Music, Gesture, and the Formation of Embodied Meaning, Edited by: Godøy, R. and Leman, M. 12-35. New York: Routledge.
Kirke, A., Miranda, E. R. and Zhang, Q. 2010. Artificial evolution of expressive performance of music: An imitative multi-agent systems approach. Computer Music Journal, 34: 80-96.
Kratz, S. and Rohs, M. (2010) A 3D gesture recognizer: Simple gesture recognition for devices equipped with 3D acceleration sensors. Proceedings on the 14th International Conference on Intelligent User Interfaces. Hong Kong. pp.341-344.
Lartillot, O. and Toiviainen, P. (2007) A Matlab toolbox for musical feature extraction from audio. Proceedings of the 10th International Conference on Digital Audio Effects. Bordeaux, France. pp.1-8.
Leman, M. 2007. Embodied Music Cognition and Mediation Technology, Cambridge, MA: MIT Press.
Leman, M., Desmet, F., Styns, F., Van Noorden, L. and Moelants, D. 2009. Sharing musical expression through embodied listening: a case study based on Chinese guqin music. Music Perception, 26: 263-278.
Leman, M. and Naveda, L. 2010. Basic gestures as spatiotemporal reference frames for repetitive dance/music patterns in Samba and Charleston. Music Perception, 28: 71-91.
Li, H. and Leman, M. 2007. A gesture-based typology of sliding-tones in guqin music. Journal of New Music Research, 36: 61-82.
Liu, J. and Kavakli, M. 2010. "Hand gesture recognition based on segmented singular value decomposition". In Knowledge-Based and Intelligent Information and Engineering Systems 214-223. Cardiff, UK
McNeill, D. 2000. Language and Gesture, Cambridge: Cambridge University Press.
Mion, L., Poli, G. D. and Rapana, E. 2010. Perceptual organization of affective and sensorial expressive intentions in music performance. ACM Transactions on Applied Perception (TAP), 7(2): article 14
NASA-STD-3000. 1995. "Anthropometric source book: Anthropometry for Designers Anthropology Staff/Webb Associates". NASA. 1. Retrieved from: http://msis.jsc.nasa.gov/Volume1.htm
Naveda, L. 2011. Gesture in Samba: A cross-modal analysis of dance and music from the Afro-Brazilian culture, Belgium: Ghent University. PhD thesis
Nusseck, M. and Wanderley, M. M. 2009. Music and motion - how music-related ancillary body movements contribute to the experience of music. Music Perception, 26: 335-353.
Parncutt, R. and McPherson, G. 2002. The Science & Psychology of Music Performance: Creative Strategies for Teaching and Learning, Oxford: Oxford University Press, USA.
Repp, B. H. and Keller, P. E. 2010. Self versus other in piano performance: detectability of timing perturbations depends on personal playing style. Experimental Brain Research, 202: 101-110.
Rosenbaum, D. A., Cohen, R. G., Jax, S. A., Weiss, D. J. and van der Wel, R. 2007. The problem of serial order in behavior: Lashley's legacy. Human Movement Science, 26: 525-554.
Thompson, M. and Luck, G. (2008) Exploring relationships between expressive and structural elements of music and pianists' gestures. Proceedings of the Fourth Conference on Interdisplinary Musicology (CIM08). Thessaloniki, Greece. pp.1-10.
Wanderley, M. M. (2002) "Quantitative analysis of non-obvious performer gestures". In Gesture and Sign Language in Human-Computer Interaction (GW 2001, LNAI 2298, pp. 241-253). Berlin, Heidelberg: Springer-Verlag In I. Wachsmuth & T. Sowa (Eds.),
Wanderley, M. M. and Vines, B. 2006. "Origins and functions of clarinettist's ancillary gestures". In Music and Gesture, Edited by: Gritten, A. and King, E. 165-191. Aldershot: Ashgate Publishing.
Wanderley, M. M., Vines, B. W., Middleton, N., McKay, C. and Hatch, W. 2005. The musical significance of clarinetists' ancillary gestures: An exploration of the field. Journal of New Music Research, 34: 97-113.
Wilson, M. and Knoblich, G. 2005. The case for motor involvement in perceiving conspecifics. Psychological Bulletin, 131: 460-473.
Winter, D. A. 2009. Biomechanics and Motor Control of Human Movement, Hoboken, NJ: John Wiley & Sons.
Wittenburg, P., Brugman, H., Russel, A., Klassmann, A. and Sloetjes, H. (2006) ELAN: A professional framework for multimodality research. Proceedings of LREC 2006. Genoa, Italy. pp.1556-1559.
Zatorre, R. J., Chen, J. L. and Penhune, V. B. 2007. When the brain plays music: Auditory-motor interactions in music perception and production. Nature Reviews Neuroscience, 8: 547-558.
Zhang, X., Chen, X., Wang, W., Yang, J., Lantz, V. and Wang, K. (2009) Hand gesture recognition and virtual game control based on 3D accelerometer and EMG sensors. Proceedings of the 13th International Conference on Intelligent User Interfaces. Canary Islands, Spain. pp.401-406.
Zhao, L., Costa, M. and Badler, N. (2000) Interpreting movement manner. Proceedings Computer Animation Conference. 2000, Philadelphia, PA, USA. pp.112-120.