Evaluation and benchmarking of image database navigation tools

William Plant*, Gerald Schaefer

*Corresponding author for this work

    Research output: Chapter in Book/Published conference outputConference publication

    Abstract

    Evaluation and benchmarking in content-based image retrieval has always been a somewhat neglected research area, making it difficult to judge the efficacy of many presented approaches. In this paper we investigate the issue of benchmarking for image database navigation tools. Such systems allow the browsing of large image collections in an intuitive manner enabling the user to find or annotate images effectively and efficiently. We present previous work aimed at testing such systems and propose a set of guidelines for a standardised benchmark that can be used to evaluate and compare different image browsing approaches. We argue that such a benchmark needs to be based on a standardised image database, and should include user tasks such as target and category search, and annotation as well as record the opinion of the users. The performance on each of the selected tasks needs to be quantifiable by a defined set of measures in order to allow for comparison between systems.

    Original languageEnglish
    Title of host publicationProceedings of the 2009 International Conference on Image Processing, Computer Vision, and Pattern Recognition, IPCV 2009
    PublisherCSREA
    Pages248-254
    Number of pages7
    Volume1
    ISBN (Print)978-1-6013-2119-0
    Publication statusPublished - 1 Dec 2009
    EventInternational Conference on Image Processing, Computer Vision, and Pattern Recognition, IPCV 2009 - Las Vegas, NV, United States
    Duration: 13 Jul 200916 Jul 2009

    Conference

    ConferenceInternational Conference on Image Processing, Computer Vision, and Pattern Recognition, IPCV 2009
    Country/TerritoryUnited States
    CityLas Vegas, NV
    Period13/07/0916/07/09

    Keywords

    • Benchmarking
    • Browsing
    • Image database navigation
    • Image databases
    • Image retrieval
    • Visualisation

    Fingerprint

    Dive into the research topics of 'Evaluation and benchmarking of image database navigation tools'. Together they form a unique fingerprint.

    Cite this