Abstract
Original language | English |
---|---|
Pages (from-to) | 322-328 |
Number of pages | 7 |
Journal | Advances in Neural Information Processing Systems |
Volume | 10 |
Publication status | Published - Jan 1998 |
Event | Advances in Neural Information Processing Systems 1994 - Singapore, Singapore Duration: 16 Nov 1994 → 18 Nov 1994 |
Fingerprint
Bibliographical note
Copyright of the Massachusetts Institute of Technology Press (MIT Press)Keywords
- on-line learning
- statistical mechanics
- generalization error
- optimal rule
- resulting rule
Cite this
}
Globally optimal on-line learning rules. / Rattray, Magnus; Saad, David; Jordan, Michael I. (Editor); Kearns, Michael J. (Editor); Solla, Sara A. (Editor).
In: Advances in Neural Information Processing Systems, Vol. 10, 01.1998, p. 322-328.Research output: Contribution to journal › Article
TY - JOUR
T1 - Globally optimal on-line learning rules
AU - Rattray, Magnus
AU - Saad, David
A2 - Jordan, Michael I.
A2 - Kearns, Michael J.
A2 - Solla, Sara A.
N1 - Copyright of the Massachusetts Institute of Technology Press (MIT Press)
PY - 1998/1
Y1 - 1998/1
N2 - We present a method for determining the globally optimal on-line learning rule for a soft committee machine under a statistical mechanics framework. This work complements previous results on locally optimal rules, where only the rate of change in generalization error was considered. We maximize the total reduction in generalization error over the whole learning process and show how the resulting rule can significantly outperform the locally optimal rule.
AB - We present a method for determining the globally optimal on-line learning rule for a soft committee machine under a statistical mechanics framework. This work complements previous results on locally optimal rules, where only the rate of change in generalization error was considered. We maximize the total reduction in generalization error over the whole learning process and show how the resulting rule can significantly outperform the locally optimal rule.
KW - on-line learning
KW - statistical mechanics
KW - generalization error
KW - optimal rule
KW - resulting rule
UR - http://www.scopus.com/inward/record.url?scp=84898946683&partnerID=8YFLogxK
UR - http://mitpress.mit.edu/catalog/item/default.asp?ttype=2&tid=8363
M3 - Article
VL - 10
SP - 322
EP - 328
JO - Advances in Neural Information Processing Systems
JF - Advances in Neural Information Processing Systems
SN - 1049-5258
ER -