Storage capacity of ultrametric committee machines

Research output: Contribution to journalArticle

View graph of relations Save citation

Open

Authors

Research units

Abstract

The problem of computing the storage capacity of a feed-forward network, with L hidden layers, N inputs, and K units in the first hidden layer, is analyzed using techniques from statistical mechanics. We found that the storage capacity strongly depends on the network architecture αc ∼ (log K)1-1/2L and that the number of units K limits the number of possible hidden layers L through the relationship 2L - 1 < 2log K.

Documents

Details

Original languageEnglish
Article number065002
Number of pages16
JournalJournal of Physics A: Mathematical and Theoretical
Volume47
Issue6
Early online date27 Jan 2014
DOIs
StatePublished - 14 Feb 2014

Bibliographic note

© 2014 IOP Publishing

    Keywords

  • 84.35.+i, adaptive systems PACS numbers: 89.70., replica trick, storage capacity

DOI

Download statistics

No data available

Employable Graduates; Exploitable Research

Copy the text from this field...