Visual music and musical vision

Xuelong Li, Dacheng Tao, Stephen J. Maybank, Yuan Yuan

Research output: Contribution to journalArticle

Abstract

This paper aims to bridge human hearing and vision from the viewpoint of database search for images or music. The semantic content of an image can be illustrated with music or conversely images can be associated with a piece of music. The theoretical basis of the bridge is synaesthesia, a property of human perception. A prototype cross-media retrieval system is built, using principles established in the neuroscientific study of synaesthesia.

Original languageEnglish
Pages (from-to)2023-2028
Number of pages6
JournalNeurocomputing
Volume71
Issue number10-12
DOIs
Publication statusPublished - 1 Jun 2008

Fingerprint

Music
Audition
Semantics
Hearing
Databases
Synesthesia

Keywords

  • Cross-media retrieval
  • Image retrieval
  • Music retrieval
  • Synaesthesia

Cite this

Li, X., Tao, D., Maybank, S. J., & Yuan, Y. (2008). Visual music and musical vision. Neurocomputing, 71(10-12), 2023-2028. https://doi.org/10.1016/j.neucom.2008.01.025
Li, Xuelong ; Tao, Dacheng ; Maybank, Stephen J. ; Yuan, Yuan. / Visual music and musical vision. In: Neurocomputing. 2008 ; Vol. 71, No. 10-12. pp. 2023-2028.
@article{0c4895cce6dd46f8a77db6169a157fd1,
title = "Visual music and musical vision",
abstract = "This paper aims to bridge human hearing and vision from the viewpoint of database search for images or music. The semantic content of an image can be illustrated with music or conversely images can be associated with a piece of music. The theoretical basis of the bridge is synaesthesia, a property of human perception. A prototype cross-media retrieval system is built, using principles established in the neuroscientific study of synaesthesia.",
keywords = "Cross-media retrieval, Image retrieval, Music retrieval, Synaesthesia",
author = "Xuelong Li and Dacheng Tao and Maybank, {Stephen J.} and Yuan Yuan",
year = "2008",
month = "6",
day = "1",
doi = "10.1016/j.neucom.2008.01.025",
language = "English",
volume = "71",
pages = "2023--2028",
journal = "Neurocomputing",
issn = "0925-2312",
publisher = "Elsevier",
number = "10-12",

}

Li, X, Tao, D, Maybank, SJ & Yuan, Y 2008, 'Visual music and musical vision', Neurocomputing, vol. 71, no. 10-12, pp. 2023-2028. https://doi.org/10.1016/j.neucom.2008.01.025

Visual music and musical vision. / Li, Xuelong; Tao, Dacheng; Maybank, Stephen J.; Yuan, Yuan.

In: Neurocomputing, Vol. 71, No. 10-12, 01.06.2008, p. 2023-2028.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Visual music and musical vision

AU - Li, Xuelong

AU - Tao, Dacheng

AU - Maybank, Stephen J.

AU - Yuan, Yuan

PY - 2008/6/1

Y1 - 2008/6/1

N2 - This paper aims to bridge human hearing and vision from the viewpoint of database search for images or music. The semantic content of an image can be illustrated with music or conversely images can be associated with a piece of music. The theoretical basis of the bridge is synaesthesia, a property of human perception. A prototype cross-media retrieval system is built, using principles established in the neuroscientific study of synaesthesia.

AB - This paper aims to bridge human hearing and vision from the viewpoint of database search for images or music. The semantic content of an image can be illustrated with music or conversely images can be associated with a piece of music. The theoretical basis of the bridge is synaesthesia, a property of human perception. A prototype cross-media retrieval system is built, using principles established in the neuroscientific study of synaesthesia.

KW - Cross-media retrieval

KW - Image retrieval

KW - Music retrieval

KW - Synaesthesia

UR - http://www.scopus.com/inward/record.url?scp=44649147051&partnerID=8YFLogxK

UR - https://www.sciencedirect.com/science/article/pii/S0925231208001367?via%3Dihub

U2 - 10.1016/j.neucom.2008.01.025

DO - 10.1016/j.neucom.2008.01.025

M3 - Article

VL - 71

SP - 2023

EP - 2028

JO - Neurocomputing

JF - Neurocomputing

SN - 0925-2312

IS - 10-12

ER -

Li X, Tao D, Maybank SJ, Yuan Y. Visual music and musical vision. Neurocomputing. 2008 Jun 1;71(10-12):2023-2028. https://doi.org/10.1016/j.neucom.2008.01.025