Storage capacity of ultrametric committee machines

J.P. Neirotti*

*Corresponding author for this work

Research output: Contribution to journalArticle

Abstract

The problem of computing the storage capacity of a feed-forward network, with L hidden layers, N inputs, and K units in the first hidden layer, is analyzed using techniques from statistical mechanics. We found that the storage capacity strongly depends on the network architecture αc ∼ (log K)1-1/2L and that the number of units K limits the number of possible hidden layers L through the relationship 2L - 1 < 2log K.

Original languageEnglish
Article number065002
Number of pages16
JournalJournal of Physics A: Mathematical and Theoretical
Volume47
Issue number6
Early online date27 Jan 2014
DOIs
Publication statusPublished - 14 Feb 2014

Bibliographical note

© 2014 IOP Publishing

Keywords

  • 84.35.+i
  • adaptive systems PACS numbers: 89.70.
  • replica trick
  • storage capacity

Fingerprint Dive into the research topics of 'Storage capacity of ultrametric committee machines'. Together they form a unique fingerprint.

  • Cite this