Abstract
Natural gradient descent (NGD) is an on-line algorithm for redefining the steepest descent direction. An analysis of NGD for training a multilayer neural network is presented using statistical mechanics. The performance can be significantly improved using NGD algorithm and can be used for both the transient and asymptotic stages of learning.
| Original language | English |
|---|---|
| Pages (from-to) | 4523-4532 |
| Number of pages | 10 |
| Journal | Physical Review E |
| Volume | 59 |
| Issue number | 4 |
| Publication status | Published - 1 Apr 1999 |