### Abstract

Original language | English |
---|---|

Journal | Annals of Mathematics And artificial Intelligence |

Publication status | Published - 2 Jul 1995 |

Event | Proc. Mathematics of Neural Networks and Applications - Duration: 2 Jul 1995 → 2 Jul 1995 |

### Fingerprint

### Bibliographical note

Copyright of SpringerLink### Keywords

- neural networks
- Bayesian
- information geometry
- estimator
- error
- Banach

### Cite this

*Annals of Mathematics And artificial Intelligence*.

}

*Annals of Mathematics And artificial Intelligence*.

**Measurements of generalisation based on information geometry.** / Zhu, Huaiyu; Rohwer, Richard.

Research output: Contribution to journal › Article

TY - JOUR

T1 - Measurements of generalisation based on information geometry

AU - Zhu, Huaiyu

AU - Rohwer, Richard

N1 - Copyright of SpringerLink

PY - 1995/7/2

Y1 - 1995/7/2

N2 - Neural networks are statistical models and learning rules are estimators. In this paper a theory for measuring generalisation is developed by combining Bayesian decision theory with information geometry. The performance of an estimator is measured by the information divergence between the true distribution and the estimate, averaged over the Bayesian posterior. This unifies the majority of error measures currently in use. The optimal estimators also reveal some intricate interrelationships among information geometry, Banach spaces and sufficient statistics.

AB - Neural networks are statistical models and learning rules are estimators. In this paper a theory for measuring generalisation is developed by combining Bayesian decision theory with information geometry. The performance of an estimator is measured by the information divergence between the true distribution and the estimate, averaged over the Bayesian posterior. This unifies the majority of error measures currently in use. The optimal estimators also reveal some intricate interrelationships among information geometry, Banach spaces and sufficient statistics.

KW - neural networks

KW - Bayesian

KW - information geometry

KW - estimator

KW - error

KW - Banach

UR - http://www.springer.com/computer/artificial/journal/10472

M3 - Article

JO - Annals of Mathematics And artificial Intelligence

JF - Annals of Mathematics And artificial Intelligence

SN - 1012-2443

ER -