Visual music and musical vision

Xuelong Li*, Dacheng Tao, Stephen J. Maybank, Yuan Yuan

*Corresponding author for this work

Research output: Contribution to journalArticle

Abstract

This paper aims to bridge human hearing and vision from the viewpoint of database search for images or music. The semantic content of an image can be illustrated with music or conversely images can be associated with a piece of music. The theoretical basis of the bridge is synaesthesia, a property of human perception. A prototype cross-media retrieval system is built, using principles established in the neuroscientific study of synaesthesia.

Original languageEnglish
Pages (from-to)2023-2028
Number of pages6
JournalNeurocomputing
Volume71
Issue number10-12
DOIs
Publication statusPublished - 1 Jun 2008

    Fingerprint

Keywords

  • Cross-media retrieval
  • Image retrieval
  • Music retrieval
  • Synaesthesia

Cite this

Li, X., Tao, D., Maybank, S. J., & Yuan, Y. (2008). Visual music and musical vision. Neurocomputing, 71(10-12), 2023-2028. https://doi.org/10.1016/j.neucom.2008.01.025