Evaluation and benchmarking of image database navigation tools

William Plant*, Gerald Schaefer

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference publication

Abstract

Evaluation and benchmarking in content-based image retrieval has always been a somewhat neglected research area, making it difficult to judge the efficacy of many presented approaches. In this paper we investigate the issue of benchmarking for image database navigation tools. Such systems allow the browsing of large image collections in an intuitive manner enabling the user to find or annotate images effectively and efficiently. We present previous work aimed at testing such systems and propose a set of guidelines for a standardised benchmark that can be used to evaluate and compare different image browsing approaches. We argue that such a benchmark needs to be based on a standardised image database, and should include user tasks such as target and category search, and annotation as well as record the opinion of the users. The performance on each of the selected tasks needs to be quantifiable by a defined set of measures in order to allow for comparison between systems.

Original languageEnglish
Title of host publicationProceedings of the 2009 International Conference on Image Processing, Computer Vision, and Pattern Recognition, IPCV 2009
PublisherCSREA
Pages248-254
Number of pages7
Volume1
ISBN (Print)978-1-6013-2119-0
Publication statusPublished - 1 Dec 2009
EventInternational Conference on Image Processing, Computer Vision, and Pattern Recognition, IPCV 2009 - Las Vegas, NV, United States
Duration: 13 Jul 200916 Jul 2009

Conference

ConferenceInternational Conference on Image Processing, Computer Vision, and Pattern Recognition, IPCV 2009
CountryUnited States
CityLas Vegas, NV
Period13/07/0916/07/09

Keywords

  • Benchmarking
  • Browsing
  • Image database navigation
  • Image databases
  • Image retrieval
  • Visualisation

Fingerprint Dive into the research topics of 'Evaluation and benchmarking of image database navigation tools'. Together they form a unique fingerprint.

Cite this