Article

Active listening to a virtual orchestra through an expressive gestural interface: the orchestra explorer

Authors:

Antonio Camurri,

Corrado Canepa,

Gualtiero VolpeAuthors Info & Claims

NIME '07: Proceedings of the 7th international conference on New interfaces for musical expression

Pages 56 - 61

https://doi.org/10.1145/1279740.1279748

Published: 06 June 2007 Publication History

Get Access

Abstract

In this paper, we present a new system, the Orchestra Explorer, enabling a novel paradigm for active fruition of sound and music content. The Orchestra Explorer allows users to physically navigate inside a virtual orchestra, to actively explore the music piece the orchestra is playing, to modify and mold the sound and music content in real-time through their expressive full-body movement and gesture. An implementation of the Orchestra Explorer was developed and presented in the framework of the science exhibition "Cimenti di Invenzione e Armonia", held at Casa Paganini, Genova, from October 2006 to January 2007.

References

[1]

Else, L. The Power of Music - Show Me Emotion. New Scientist magazine, 29 November 2003, 40--42.

Google Scholar

[2]

Rowe, R. Interactive music systems: Machine listening and composition. MIT Press, Cambridge MA, 1993.

Digital Library

Google Scholar

[3]

Lee, E., Karrer, T., and Borchers, J. Toward a Framework for Interactive Systems to Conduct Digital Audio and Video Streams. Computer Music Journal, 30, 1 (Spring 2006), 21--36.

Digital Library

Google Scholar

[4]

Camurri A., Mazzarino B., and Volpe G. Expressive interfaces. Cognition, Technology & Work, 6, 1 (Feb. 2004), 15--22.

Digital Library

Google Scholar

[5]

Camurri A., Lagerl�f I., and Volpe G. Recognizing Emotion from Dance Movement: Comparison of Spectator Recognition and Automated Techniques. International Journal of Human-Computer Studies, 59,(1--2) (July 2003), 213--225.

Digital Library

Google Scholar

[6]

Camurri A., and Volpe G. Multimodal and cross-modal analysis of expressive gesture in tangible acoustic interfaces. In Proceedings of the 15th IEEE International Symposium on Robot and Human Interactive Communication (ROMAN2006) (University of Hertfordshire, Hatfield, United Kingdom, September 2006), IEEE Press.

Crossref

Google Scholar

[7]

Laban R., and Lawrence F. C. Effort. Macdonald & Evans Ltd., London, 1947.

Google Scholar

[8]

Laban R., Modern Educational Dance. Macdonald & Evans Ltd., London, 1963.

Google Scholar

[9]

Camurri A., De Poli G., Leman M., and Volpe G. Toward Communicating Expressiveness and Affect in Multimodal Interactive Systems for Performing Art and Cultural Applications, IEEE Multimedia Magazine, 12, 1 (Jan. 2005), 43--53.

Digital Library

Google Scholar

[10]

Camurri A., Coletta P., Massari A., Mazzarino B., Peri M., Ricchetti M., Ricci A., and Volpe G. Toward real-time multimodal processing: EyesWeb 4.0. In Proc. AISB 2004 Convention: Motion, Emotion and Cognition (Univeristy of Leeds, 2004).

Google Scholar

[11]

Hunt, A. D., Paradis, M., and Wanderley, M., The importance of parameter mapping in electronic instrument design. Journal of New Music Research, 32, 4, (December 2003), 429--440.

Crossref

Google Scholar

[12]

Wanderley, M. M., and Battier, M., (Eds.), Trends in Gestural Control of Music. IRCAM - Centre Georges Pompidou, Paris, 2000

Google Scholar

Cited By

View all

Mandanici MAltieri FPretto NMunaro MCanazza SMenegatti EFurini MMirri SBouchard KGuidi B(2018)The "Good or Bad?" GameProceedings of the 4th EAI International Conference on Smart Objects and Technologies for Social Good10.1145/3284869.3284917(177-182)Online publication date: 28-Nov-2018
https://dl.acm.org/doi/10.1145/3284869.3284917
Core CConci ADe Angeli AMasu RMorreale FHall LTurner P(2017)Designing a musical playground in the kindergartenProceedings of the 31st British Computer Society Human Computer Interaction Conference10.14236/ewic/HCI2017.41(1-12)Online publication date: 3-Jul-2017
https://dl.acm.org/doi/10.14236/ewic/HCI2017.41
Hollenbach ACox MGeigel JHancock MMarquardt NSch�ning JTory M(2016)A Dynamic 3D Performance Space for Control of Virtual Musical InstrumentsProceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces10.1145/2992154.2992178(279-285)Online publication date: 6-Nov-2016
https://dl.acm.org/doi/10.1145/2992154.2992178
Show More Cited By

Active listening to a virtual orchestra through an expressive gestural interface: the orchestra explorer
1. Applied computing
  1. Arts and humanities

Recommendations

Social active listening and making of expressive music: the interactive piece the bow is bent and drawn
DIMEA '08: Proceedings of the 3rd international conference on Digital Interactive Media in Entertainment and Arts

This paper discusses the concepts, the interaction paradigms, the system design and implementation that have been developed for the interactive dance and music performance The Bow is bent and drawn (composer Nicola Ferrari), presented at Casa Paganini, ...
Visual Interface for Conducting Virtual Orchestra
ICPR '00: Proceedings of the International Conference on Pattern Recognition - Volume 1

A real-time visual recognition system, that enables a human conductor to control an electronic orchestra using gestures of a traditional conductor's baton, is described. The positions of the baton and conductor's hand are identified in a sequence of ...
Gestural user interface for audio multitrack real-time stereo mixing
AM '13: Proceedings of the 8th Audio Mostly Conference

Sound mixing is a well-established task applied (directly or indirectly) in many fields of music and sound production. For example, in the case of classical music orchestras, their conductors perform sound mixing by specifying the reproduction gain of ...

Comments

Information & Contributors

Information

Published In

NIME '07: Proceedings of the 7th international conference on New interfaces for musical expression

June 2007

484 pages

ISBN:9781450378376

DOI:10.1145/1279740

Conference Chairs:
Carol Parkinson
Harvestworks Digital Media Arts Center
,
Eric Singer
LEMUR: League of Electronic Musical Urban Robots

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 June 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
263
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Mandanici MAltieri FPretto NMunaro MCanazza SMenegatti EFurini MMirri SBouchard KGuidi B(2018)The "Good or Bad?" GameProceedings of the 4th EAI International Conference on Smart Objects and Technologies for Social Good10.1145/3284869.3284917(177-182)Online publication date: 28-Nov-2018
https://dl.acm.org/doi/10.1145/3284869.3284917
Core CConci ADe Angeli AMasu RMorreale FHall LTurner P(2017)Designing a musical playground in the kindergartenProceedings of the 31st British Computer Society Human Computer Interaction Conference10.14236/ewic/HCI2017.41(1-12)Online publication date: 3-Jul-2017
https://dl.acm.org/doi/10.14236/ewic/HCI2017.41
Hollenbach ACox MGeigel JHancock MMarquardt NSchöning JTory M(2016)A Dynamic 3D Performance Space for Control of Virtual Musical InstrumentsProceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces10.1145/2992154.2992178(279-285)Online publication date: 6-Nov-2016
https://dl.acm.org/doi/10.1145/2992154.2992178
Morreale FDe Angeli ABottoni PCatarci TDe Marsico MFogli D(2015)Evaluating Visitor Experiences with Interactive ArtProceedings of the 11th Biannual Conference of the Italian SIGCHI Chapter10.1145/2808435.2808440(50-57)Online publication date: 28-Sep-2015
https://dl.acm.org/doi/10.1145/2808435.2808440
Morreale FDe Angeli AMasu RRota PConci N(2014)Collaborative creativityPersonal and Ubiquitous Computing10.1007/s00779-013-0728-118:5(1187-1199)Online publication date: 1-Jun-2014
https://dl.acm.org/doi/10.1007/s00779-013-0728-1
Maes PAmelynck DLesaffre MLeman MArvind D(2013)The “Conducting Master”: An Interactive, Real-Time Gesture Monitoring System Based on Spatiotemporal Motion TemplatesInternational Journal of Human-Computer Interaction10.1080/10447318.2012.72019729:7(471-487)Online publication date: 3-Jul-2013
https://doi.org/10.1080/10447318.2012.720197
Mancini MCamurri AVolpe G(2013)A system for mobile music authoring and active listeningEntertainment Computing10.1016/j.entcom.2013.08.0014:3(205-212)Online publication date: Aug-2013
https://doi.org/10.1016/j.entcom.2013.08.001
Glowinski DMancini MMassari A(2012)Evaluation of the Mobile Orchestra Explorer ParadigmIntelligent Technologies for Interactive Entertainment10.1007/978-3-642-30214-5_11(93-102)Online publication date: 2012
https://doi.org/10.1007/978-3-642-30214-5_11
Addessi AVolpe G(2011)The MIROR projectProceedings of the 6th European conference on Technology enhanced learning: towards ubiquitous learning10.5555/2045445.2045450(15-28)Online publication date: 20-Sep-2011
https://dl.acm.org/doi/10.5555/2045445.2045450
Volpe GCamurri A(2011)A system for embodied social active listening to sound and music contentJournal on Computing and Cultural Heritage 10.1145/2001416.20014184:1(1-23)Online publication date: 26-Aug-2011
https://dl.acm.org/doi/10.1145/2001416.2001418
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Recommendations

Social active listening and making of expressive music: the interactive piece the bow is bent and drawn

Visual Interface for Conducting Virtual Orchestra

Gestural user interface for audio multitrack real-time stereo mixing

Comments

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Other Metrics

Article Metrics

Other Metrics

Cited By

Login options

Full Access

PDF

eReader

Abstract

References

Cited By

Recommendations

Social active listening and making of expressive music: the interactive piece the bow is bent and drawn

Visual Interface for Conducting Virtual Orchestra

Gestural user interface for audio multitrack real-time stereo mixing

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Get Access

Login options

Full Access

View options

PDF

eReader

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations