Regrouping metric-space search index for search engine size adaptation

Khalil Al Ruqeishi*, Michal Konečný

*Corresponding author for this work

Research output: Chapter in Book/Published conference outputConference publication

Abstract

This work contributes to the development of search engines that self-adapt their size in response to fluctuations in workload. Deploying a search engine in an Infrastructure as a Service (IaaS) cloud facilitates allocating or deallocating computational resources to or from the engine. In this paper, we focus on the problem of regrouping the metric-space search index when the number of virtual machines used to run the search engine is modified to reflect changes in workload. We propose an algorithm for incrementally adjusting the index to fit the varying number of virtual machines. We tested its performance using a custom-build prototype search engine deployed in the Amazon EC2 cloud, while calibrating the results to compensate for the performance fluctuations of the platform. Our experiments show that, when compared with computing the index from scratch, the incremental algorithm speeds up the index computation 2–10 times while maintaining a similar search performance.
Original languageEnglish
Title of host publicationSimilarity search and applications
Subtitle of host publication8th international conference, SISAP 2015, Glasgow, UK, October 12-14, 2015, proceedings
EditorsGiuseppe Amato, Richard Connor, Fabrizio Falchi, Claudio Gennaro
Place of PublicationChem (CH)
PublisherSpringer
Pages271-282
Number of pages12
ISBN (Electronic)978-3-319-25087-8
ISBN (Print)978-3-319-25086-1
DOIs
Publication statusPublished - 17 Oct 2015
Event8th international conference on Similarity Search and Applications - Glasgow, United Kingdom
Duration: 12 Oct 201514 Oct 2015

Publication series

NameLecture notes in computer science
PublisherSpringer
Volume9371
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference8th international conference on Similarity Search and Applications
Abbreviated titleSISAP 2015
Country/TerritoryUnited Kingdom
CityGlasgow
Period12/10/1514/10/15

Bibliographical note

© Springer International Publishing Switzerland

Fingerprint

Dive into the research topics of 'Regrouping metric-space search index for search engine size adaptation'. Together they form a unique fingerprint.

Cite this