Radial Basis Function networks with linear outputs are often used in regression problems because they can be substantially faster to train than Multi-layer Perceptrons. For classification problems, the use of linear outputs is less appropriate as the outputs are not guaranteed to represent probabilities. We show how RBFs with logistic and softmax outputs can be trained efficiently using the Fisher scoring algorithm. This approach can be used with any model which consists of a generalised linear output function applied to a model which is linear in its parameters. We compare this approach with standard non-linear optimisation algorithms on a number of datasets.
Bibliographical noteElectronic version of an article published as International Journal of Neural Systems, 14 (3), 2004, pp. 201-208, Article DOI: 10.1142/S0129065704001930 © World Scientific Publishing Company http://www.worldscinet.com/ijns/ijns.shtml
- radial basis function
- non-linear optimisation
- probabilistic modelling