Hostname: page-component-cd9895bd7-q99xh Total loading time: 0 Render date: 2024-12-26T08:32:42.411Z Has data issue: false hasContentIssue false

Perspectives on Gesture–Sound Relationships Informed from Acoustic Instrument Studies

Published online by Cambridge University Press:  29 June 2009

Nicolas Rasamimanana*
Affiliation:
IRCAM, CNRS – UMR STMS, Real Time Musical Interactions Team, 1 Place Igor Stravinsky, 75004 PARIS, France
Florian Kaiser*
Affiliation:
IRCAM, CNRS – UMR STMS, Real Time Musical Interactions Team, 1 Place Igor Stravinsky, 75004 PARIS, France
Frederic Bevilacqua*
Affiliation:
IRCAM, CNRS – UMR STMS, Real Time Musical Interactions Team, 1 Place Igor Stravinsky, 75004 PARIS, France

Abstract

We present an experimental study on articulation in bowed strings that provides important elements for a discussion about sound synthesis control. The study focuses on bow acceleration profiles and transient noises, measured for different players for the bowing techniques detaché and martelé. We found that maximum of these profiles are not synchronous, and temporal shifts are dependent on the bowing techniques. These results allow us to bring out important mechanisms in sound and gesture articulation. In particular, the results reveal a potential shortcoming of mapping strategies using simple frame-by-frame data-stream procedures. We propose instead to consider input control data as time functions, and consider gesture co-articulation processes.

Type
Articles
Copyright
Copyright © Cambridge University Press 2009

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Askenfelt, A. 1989. Measurement of the Bowing Parameters in Violin Playing. II: Bow-Bridge Distance, Dynamic Range, and Limits of Bow Force. The Journal of the Acoustical Society of America 86(2).CrossRefGoogle Scholar
Askenfelt, A. 1993. Observations on the Transient Components of the Piano Tone. Proceedings of the Stockholm Music Acoustics Conference (SMAC) 79: 297301.Google Scholar
Badeau, R. 2005. Méthodes à haute résolution pour l’estimation et le suivi de sinusoides modulées. Application aux signaux de musique. PhD thesis, Ecole Nationale Supérieure des Télécommunications.Google Scholar
Badeau, R., Richard, G. David, B. 2005. Fast Adaptive Esprit Algorithm. IEEE Workshop on Statistical Signal Processing SSP’05, Bordeaux.CrossRefGoogle Scholar
Bevilacqua, F., Rasamimanana, N. H., Fléty, E., Lemouton, S. Baschet, F. 2006. The Augmented Violin Project: Research, Composition and Performance Report. Proceedings of the International Conference on New Interfaces for Musical Expression (NIME).Google Scholar
Bevilacqua, F., Guedy, F., Fléty, E., Leroy, N. Schnell, N. 2007. Wireless Sensor Interface and Gesture-Follower for Music Pedagogy. Proceedings of the International Conference on New Interfaces for Musical Expression (NIME).CrossRefGoogle Scholar
Chafe, C. 1990. Pulsed Noise in Self-Sustained Oscillations of Musical Instruments. Proceedings of the International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2: 11571160.CrossRefGoogle Scholar
Dahl, S. 2000. The Playing of an Accent – Preliminary Observations from Temporal and Kinematic Analysis of Percussionists. Journal of New Music Research 29: 225233.CrossRefGoogle Scholar
Dannenberg, R. Derenyi, I. 1998. Combining Instrument and Performance Models for High-Quality Music Synthesis. Journal of New Music Research 27(3): 211238.CrossRefGoogle Scholar
De Poli, G., Rodà, A. Vidolin, A. 1998. Note-by-Note Analysis of the Influence of Expressive Intentions and Musical Structure in Violin Performance. The Journal of New Music Research 27(3): 293321.CrossRefGoogle Scholar
Demoucron, M., Askenfelt, A. Caussé, R. 2008. Observations on Bow Changes in Violin Performance. Proceedings of Acoustics. Journal of the Acoustical Society of America 123(5): 3123.CrossRefGoogle Scholar
Flammer, A. Tordjman, G. 1988. Le violon. Paris: J.-C. Lattès and Salabert.Google Scholar
Fléty, E., Leroy, N., Ravarini, J.-C. Bevilacqua, F. 2004. Versatile Sensor Acquisition System Utilizing Network Technology. Proceedings of the International Conference on New Interfaces for Musical Expression (NIME).Google Scholar
Galamian, I. 1962. Principles of Violin Playing and Teaching. Englewood Cliffs, NJ: Prentice Hall.Google Scholar
Godoy, R. I. 2004. Gestural Imagery in the Service of Musical Imagery. In A. Camurri and G. Volpe (eds.) Lecture Notes in Artificial Intelligence, LNAI 2915. Berlin: Springer Verlag, 5562.Google Scholar
Goebl, W., Bresin, R. Galembo, A. 2004. Once Again: The Perception of Piano Touch and Tone. Can Touch Audibly Change Piano Sound Independently of Intensity? Proceedings of the International Symposium on Musical Acoustics.Google Scholar
Goebl, W., Bresin, R. Galembo, A. 2005. Touch and Temporal Behavior of Grand Piano Actions. The Journal of the Acoustical Society of America 118(2): 11541165.CrossRefGoogle ScholarPubMed
Grey, J. M. 1975. An Exploration of Musical Timbre using Computer-Based Techniques for Analysis, Synthesis and Perceptual Scaling. PhD thesis, Stanford University.Google Scholar
Guettler, K. 2004. Looking at Starting Transients and Tone Coloring of the Bowed String. Proceedings of Frontiers of Research on Speech and Music.Google Scholar
Guettler, K. Askenfelt, A. 1997. Acceptance Limits for the Duration of Pre-Helmholtz Transients in Bowed String Attacks. The Journal of the Acoustical Society of America 101(5): 29032913.CrossRefGoogle Scholar
Henry, C. 2004. Physical Modeling for Pure Data (pmpd) and Real Time Interaction with an Audio Synthesis. Proceedings of the Sound and Music Computing Conference, SMC.Google Scholar
Laroche, J. 1989. A New Analysis/Synthesis System of Musical Signals using Prony’s Method-Application to Heavily Damped Percussive Sounds. Proceedings of the International Conference on Acoustics, Speech, and Signal Processing, ICASSP 3: 20532056.CrossRefGoogle Scholar
Leman, M. 2008. Embodied Music Congnition and Mediation Technology. Cambridge, MA: MIT Press.Google Scholar
McAdams, S., Winsberg, S., de Soete, G. Krimphoff, J. 1995. Perceptual Scaling of Synthesized Musical Timbres: Common Dimensions, Specificities and Latent Subject Classes. Psychological Research 58: 177192.CrossRefGoogle ScholarPubMed
Menuhin, Y. 1973. L’art de jouer du violon. Paris: Buchet/Chastel.Google Scholar
Ortmann, O. 1929. The Physiological Mechanics of Piano Technique. New York: Dutton.Google Scholar
Palmer, C. 2006. Nature of Memory for Music Performance Skills. In Music, Motor Control and the Brain. New York: Oxford University Press.Google Scholar
Rasamimanana, N. H. 2008. Geste instrumental du violoniste en situation de jeu: analyse et modélisation. Violin Player Instrumental Gesture: Analysis and Modelling. Université Paris 6, IRCAM UMR STMS.Google Scholar
Rasamimanana, N. H., Bevilacqua, F. forthcoming. Effort-Based Analysis of Bowing Movements: Evidence of Anticipation Effects. Journal of New Music Research.Google Scholar
Rasamimanana, N. H. Fléty, E., Bevilacqua, F. 2006. Gesture Analysis of Violin Bow Strokes. Gesture in Human-Computer Interaction and Simulation, Lecture Notes in Computer Science/Artificial Intelligence (LNAI) 3881: 145155.Google Scholar
Röbel, A. 2003. A New Approach to Transient Processing in the Phase Vocoder. Proceedings of the 6th International Conference on Digital Audio Effects (DAFx’03).Google Scholar
Serra, X. Smith, J. O. III 1990. Spectral Modeling Synthesis: A Sound Analysis/Synthesis System Based on a Deterministic Plus Stochastic Decomposition. Computer Music Journal 14(4): 1224.CrossRefGoogle Scholar
Verma, T., Levine, S. Meng, T. 1997. Transient Modeling Synthesis: A Flexible Analysis/Synthesis Tool for Transient Signals. Proceedings of the International Computer Music Conference.Google Scholar
Wolfe, J. 2002. Speech and Music, Acoustics and Coding, and What Music Might Be ‘for’. Proceedings of the 7th International Conference on Music Perception and Cognition, Sydney.Google Scholar
Wolfe, J. 2007. Speech and Music: Acoustics, Signals and the Relation between them. Proceedings of the International Conference on Music Communication Science.Google Scholar
Woodhouse, J. Galluzzo, P. M. 2004. The Bowed String as we Know it Today. Acustica – Acta Acustica 90: 579589.Google Scholar