Hostname: page-component-77c89778f8-m42fx Total loading time: 0 Render date: 2024-07-16T19:00:35.389Z Has data issue: false hasContentIssue false
  • English
  • Français

Software Agents in Music and Sound Art Research/Creative Work: current state and a possible direction

Published online by Cambridge University Press:  29 June 2009

Ian Whalley
Ian Whalley*
Affiliation:
The University of Waikato, Private Bag 3105, Hamilton, New Zealand
*
E-mail: musik@waikato.ac.nz
Get access Rights & Permissions [Opens in a new window]

Abstract

Composers, musicians and computer scientists have begun to use software-based agents to create music and sound art in both linear and non-linear (non-predetermined form and/or content) idioms, with some robust approaches now drawing on various disciplines. This paper surveys recent work: agent technology is first introduced, a theoretical framework for its use in creating music/sound art works put forward, and an overview of common approaches then given. Identifying areas of neglect in recent research, a possible direction for further work is then briefly explored. Finally, a vision for a new hybrid model that integrates non-linear, generative, conversational and affective perspectives on interactivity is proposed.

Type
Articles
Information
Organised Sound , Volume 14 , Issue 2 , August 2009 , pp. 156 - 167
Copyright
Copyright © Cambridge University Press 2009

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Anumba, C., Ren, Z. Ugwu, O. (eds.) 2005. Agents and Multi-Agent Systems in Construction. London: Taylor & Francis.Google Scholar
Aronson, J., Liang, T. Turban, E. 2004. Decision Support Systems and Intelligent Systems (7th ed.). Englewood Cliffs, NJ: Prentice Hall.Google Scholar
Balogh, Z., Budinska, I., Dang, T. T., Hluchy, L., Laclavik, M. Nguyen, T. 2002. Agent Platforms Evaluation and Comparison. Institute of Informatics, Slovak Academy of Sciences. Pellucid 5FP IST-2001-34519. Viewed online: http://ups.savba.sk/~giang/publication?tr-2002-06.pdf (accessed 17 April 2009).Google Scholar
Bigus, J. P. Bigus, J. 2001. Constructing Intelligent Agents In Java (2nd ed.). New York: John Wiley & Sons.Google Scholar
Biles, J. 2003. GenJam in Perspective: A Tentative Taxonomy for GA Music and Art Systems. Leonardo 36(1): 43–45.CrossRefGoogle Scholar
Beyls, P. 2007. Interaction and Self-Organisation in a Society of Musical Agents. Proceedings of ECAL 2007 Workshop on Music and Artificial Life. Lisbon, Portugal.Google Scholar
Booker, C. 2004. The Seven Basic Plots. Why We Tell Stories. London: Continuum.Google Scholar
Brown, A. 2002. Opportunities for Evolutionary Music Composition. Proceedings of Australasian Computer Music Association Conference. Melbourne, Australia: 27–34.Google Scholar
Brown, A., Livingstone, S. Muhlberger, R. 2007. Controlling Musical Emotionality: An Affective Computational Architecture for Influencing Musical Emotions. Digital Creativity 18(1): 43–53.Google Scholar
Brown, S. Parsons, L. 2008. The Neuroscience of Dance. Scientific America (July): 58–63.Google ScholarPubMed
Brown, S., Merker, B. Wallin, N. 2001. The Origins of Music. London: The MIT Press.Google Scholar
Bryant, G. Hagen, E. 2003. Music and Dance as a Coalition Signalling System. Human Nature 14(1): 21–51.Google Scholar
Cai, T., Wei-Ying, M., Wang, C., Zhang, C. Zhang, L. 2007. MusicSense: Contextual Music Recommendation using Emotional Allocation Modelling. Proceedings of the 15th International Conference on Multimedia. Augsburg, Germany: 553–6.Google Scholar
Camurri, A. 1993. Applications of Artificial Intelligence Methodologies and Tools for Music Description and Processing. In G. Haus (ed.) Music Processing. Madison, WI: A-R Editions, 233–266.Google Scholar
Chadabe, J. 1996. The History of Electronic Music as a Reflection of Structural Paradigms. Leonardo Music Journal 6: 41–44.CrossRefGoogle Scholar
Chadabe, J. 2004. Electronic Music and Life. Organised Sound 9(1): 3–6.CrossRefGoogle Scholar
Chen, C. Kiss, J. 2003. Setting Up a Self-Organized Multi-Agent System for the Creation Of Sound and Visual Virtual Environments within the Framework of a Collective Interactivity. International Computer Music Conference. Singapore: 11–14.Google Scholar
Cohen, A. 2001. Music as a Source of Emotion in Film. In P. Juslin and J. Sloboda (eds) Music and Emotion: Theory and Research. Oxford: Oxford University Press, 249–272.CrossRefGoogle Scholar
Consoli, A., Ichalkaranje, N., Jarvis, B., Phillips-Wren, G., Tweedale, J. Sioutis, C. 2006. Innovations in Multi-agent Systems. Journal of Network and Computer Applications 30: 1089–1115.Google Scholar
Cope, D. 1991. Computers And Musical Style. Madison, WI: A-R Editions.Google Scholar
Coutinho, E., Miranda, E. R. da Silva, P. 2005. Evolving Emotional Behaviour for the Expressive Performance of Music. Lecture Notes in Computer Science. London: Springer-Verlag: 497.Google Scholar
Detlor, B. Serenko, A. 2002. Agent Toolkits: A General Overview of the Market and an Assessment of the Instructor Satisfaction with Utilizing Toolkits in the Classroom. Working Paper 455. School Of Business, McMaster University, Hamilton, ON.Google Scholar
Dorin, A. 2001. Generative Processes and the Electronic Arts. Organised Sound 6(1): 47–53.CrossRefGoogle Scholar
Drogoul, A., Meurisse, T. Vanbergue, D. 2002. Multi-Agent Based Simulation: Where are the Agents? Proceedings of MABS’02 (Multi-Agent Based Simulation) Bologna, Italy, LNCS, Springer-Verlag.CrossRefGoogle Scholar
Edwards, M., Murray-Rust, A. Smaill, D. 2006. MAMA: An Architecture for Interactive Musical Agents. Frontiers in Artificial Intelligence and Applications 141: 36–40.Google Scholar
Eigenfeldt, A. 2008. Emergent Rhythms through Multi-agency in Max/MSP. In R. Kronland-Martinet, S. Ystad and K. Jensen (eds.) Computer Music Modeling and Retrieval: Sense of Sounds. Copenhagen: CMMR, 368–379.CrossRefGoogle Scholar
Gabrielsson, A. 2001. Emotion in Strong Experiences with Music. In P. Juslin and J. Sloboda (eds.) Music and Emotion: Theory and Research. Oxford: Oxford University Press, 441–449.Google Scholar
Gabrielsson, A., Lindstrom, E. 2001. The Influence or Musical Stucture on Emotional Expression. In P. Juslin and J. Sloboda (eds.) Music and Emotion: Theory and Research. Oxford: Oxford University Press, 223–248.CrossRefGoogle Scholar
Gang, D., Goldman, C. Rosenschein, J. 1999. NegNet: A Connectionist-Agent Integrated System For Representing Musical Knowledge. Annals of Mathematics and Artificial Intelligence 25: 69–90.Google Scholar
Gimenes, M., Miranda, E. R. Johnson, C. 2005. A Memetic Approach to the Evolution of Rhythms in a Society of Software Agents. Proceedings of the 10th Brazilian Symposium on Computer Music (SBCM). Belo Horizonte, Brazil.Google Scholar
Gimenes, M., Miranda, E. R. Johnson, C. 2006. The Development of Musical Styles in a Society of Software Agents. Proceedings of the International Conference on Music Perception and Cognition. Bologna.Google Scholar
Graugaard, L. 2006. Implicit Relevance Feedback in Interactive Music: Issues, Challenges, and Case Studies. Proceedings of the 1st International Conference on Information Interaction, Copenhagen, Denmark. ACM International Conference Proceeding Series 176: 119–28.Google Scholar
Hashimoto, S. 1998. KANSEI as the Third Target of Information Processing and Related Topics in Japan. Proceedings of International Workshop on Kansei – Technology of Emotion, Tokyo, Japan: 101–4.Google Scholar
Hashimoto, Y., Kurihara, S., Legaspi, R., Moriyama, K. Numao, M. 2007. Music Compositional Intelligence with an Affective Flavor. Proceedings of the 12th International Conference on Intelligent User Interfaces. Honolulu: 216–24.Google Scholar
Homer, H., Chen, H., Lin, Y. Su, Y. 2007. Music Emotion Recognition: the Role of Individuality. Proceedings of the International Workshop on Human-centered Multimedia. Augsburg: 13–22.Google Scholar
Juslin, P. 2001. Communicating Emotion in Music Performance: A Review of Theoretical Framework. In P. Juslin and J. Sloboda (eds.) Music and Emotion: Theory and Research. Oxford: Oxford University Press, 309–377.CrossRefGoogle Scholar
Juslin, P. Sloboda, J. (eds.) 2001. Music and Emotion: Theory and Research. Oxford: Oxford University Press.CrossRefGoogle Scholar
Kon, F. Ueda, L. 2004. Andante: Composition and Performance With Mobile Musical Agents. International Computer Music Conference. Miami, FL 1–6 November: 604–7.Google Scholar
Landy, L. 1999. Reviewing the Musicology of Electroacoustic Music: A Plea for Greater Triangulation. Organised Sound 4(1): 61–70.CrossRefGoogle Scholar
Li, C. Shan, M. 2007. Emotion-based Impressionism Slideshow with Automatic Music Accompaniment. International Multimedia Conference Proceedings of the 15th International Conference on Multimedia, Augsburg, Germany, 839–42.Google Scholar
Malt, M. 2004. Khorwa: A Musical Experience with Autonomous Agents. International Computer Music Conference. Miami, FL 1–6 November: 59–62.Google Scholar
Mithen, S. 2005. The Singing Neanderthals. The Origins of Music, Language, Mind and Body. London: Weidenfeld & Nicolson.Google Scholar
Miranda, E. R. 2003. A-Life and Musical Composition. A Brief Survey. IX Brazilian Symposium on Computer Music. Campinas, Brazil.Google Scholar
Miranda, E. Gimenes, M. 2008. An A-Life Approach to Machine Learning of Musical Worldviews for Improvisation Systems. Proceedings of 5th Sound and Music Computing Conference. Berlin.Google Scholar
Nakamura, K., Numao, M. Takagi, S. 2002. CAUI Demonstration – Composing Music Based on Human Feelings. Proceedings of American Association for Artificial Intelligence. www.aaai.org.Google Scholar
Nakayama, L., Wulfhorst, R. Vicari, R. 2003. A Multi-Agent Approach for Musical Interactive System. AAMAS’03, Australia: 584–91.Google Scholar
Nussbaum, C. 2007. The Musical Representation. Meaning, Ontology, and Emotion. London: MIT Press.CrossRefGoogle Scholar
Paine, G. 2002. Interactivity, Where to From Here? Organised Sound 7(3): 295–304.CrossRefGoogle Scholar
Patel, A. 2008. Music, Language and the Brain. Oxford: Oxford University Press.Google Scholar
Peretz, I. 2001. Listen to the Brain: A Biological Persective on Musical Emotions. In P. Juslin and J. Sloboda (eds.) Music and Emotion: Theory and Research. Oxford: Oxford University Press, 105–134.CrossRefGoogle Scholar
Quinlan, R. n.d. FOIL http://www.rulequest.com/Personal.Google Scholar
Rowe, R. 1994. Interactive Music Systems: Machine Listening and Composing. London: MIT Press.Google Scholar
Schubert, E. 2001. Continuous Measurement of Self-Report Emotional Response to Music. In P. Juslin and J. Sloboda (eds.) Music and Emotion: Theory and Research. Oxford: Oxford University Press, 393–414.CrossRefGoogle Scholar
Scherer, K. 2004. Which Emotions Can be Induced? What are the Underlying Mechcanisms? And How Can We Measure Them? Journal of New Music Research 33(3): 239–251.CrossRefGoogle Scholar
Scherer, K. Zentner, M. 2001. Emotional Effects of Music: Production Rules. In P. Juslin and J. Sloboda (eds.) Music and Emotion: Theory and Research. Oxford: Oxford University Press, 361–392.CrossRefGoogle Scholar
Senge, P. 1992. The Fifth Discipline. The Art and Practice of the Learning Organization. New York: Random House.Google Scholar
Smalley, D. 1997. Spectromorphology: Explaining Sound-shapes. Organised Sound 2(2): 107–126.CrossRefGoogle Scholar
Spicer, M. 2004. AALIVENET: An Agent Based Distributed Interactive Composition Environment. International Computer Music Conference. Miami, FL 1–6 November: 201–204.Google Scholar
Spicer, M., Tan, B. T. G. Tan, C. 2003. The Learning Agent Based Interactive Performance System. International Computer Music Association Conference. Singapore: 95–9.Google Scholar
Thaut, M. 2005. Rhythm, Music, and the Brain: Scientific Foundations and Clinical Applications. London: Routledge.Google Scholar
Wang, M., Zhang, N. Zhu, H. 2004. User-adaptive Music Emotion Recognition. 7th International Conference on Signal Processing. Beijing: 1352–5.Google Scholar
Weale, R. 2006. Discovering How Accessible Electroacoustic Music Can Be: The Intention/Reception Project. Organised Sound 11(2): 189–200.CrossRefGoogle Scholar
Weinberg, G. 2005. Interconnected Musical Networks: Toward a Theoretical Framework. Computer Music Journal 29(2): 23–39.CrossRefGoogle Scholar
Weiss, G. (ed.) 2000. Multi-Agent Systems, a Modern Approach to Distributed Artificial Intelligence. Cambridge, MA: MIT Press.Google Scholar
Whalley, I. 2001. Applications of System Dynamics Modelling to Computer Music. Organised Sound 5 (3) 2000: 149–157.CrossRefGoogle Scholar
Whalley, I. 2002. Kansei in Non-linear Automated Composition. Semiotic Structure and Recombinicity. 11th International Symposium on Electronic Arts. Nagoya: 62–5.Google Scholar
Whalley, I. 2004. Adding Machine Cognition to a Web-Based Interactive Composition. International Computer Music Conference. Miami, FL 1–6 November: 197–200.Google Scholar
Whalley, I. 2005. Software Agents and Creating Music/Sound Art: Frames, Directions, and Where to From Here? Proceedings of International Computer Music Conference. Barcelona, 5–9 September: 691–5.Google Scholar
Winkler, T. 1998. Composing Interactive Music: Techniques and Ideas Using MAX. Cambridge, MA: MIT Press.Google Scholar
Wishart, T. 2002. On Sonic Art, ed. S. Emmerson. London: Routledge.Google Scholar