Learning using privileged information in prototype based models

Shereen Fouad*, Peter Tino, Somak Raychaudhury, Petra Schneider

*Corresponding author for this work

Research output: Chapter in Book/Published conference outputConference publication

Abstract

In some pattern analysis problems, there exists expert knowledge, in addition to the original data involved in the classification process. Most of existing approaches ignore such auxiliary (privileged) knowledge. Recently a new learning paradigm - Learning Using Hidden Information - was introduced in the SVM+ framework. This approach is formulated for binary classification and, as typical for many kernel based methods, can scale unfavorably with the number of training examples. In this contribution we present a more direct novel methodology, based on a prototype metric learning model, for incorporation of valuable privileged knowledge. This is done by changing the global metric in the input space, based on distance relations revealed by the privileged information. Our method achieves competitive performance against the SVM+ formulations. We also present a successful application of our method to a large scale multi-class real world problem of galaxy morphology classification.

Original languageEnglish
Title of host publicationArtificial Neural Networks and Machine Learning, ICANN 2012 - 22nd International Conference on Artificial Neural Networks, Proceedings
PublisherSpringer
Pages322-329
Number of pages8
EditionPART 2
ISBN (Print)9783642332654
DOIs
Publication statusPublished - 2012
Event22nd International Conference on Artificial Neural Networks, ICANN 2012 - Lausanne, Switzerland
Duration: 11 Sep 201214 Sep 2012

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
NumberPART 2
Volume7553 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference22nd International Conference on Artificial Neural Networks, ICANN 2012
Country/TerritorySwitzerland
CityLausanne
Period11/09/1214/09/12

Keywords

  • Generalized Matrix Learning Vector Quantization (GMLVQ)
  • Information Theoretic Metric Learning (ITML)
  • Learning Using Hidden Information (LUHI)

Fingerprint

Dive into the research topics of 'Learning using privileged information in prototype based models'. Together they form a unique fingerprint.

Cite this