Storage capacity of ultrametric committee machines

J.P. Neirotti*

*Corresponding author for this work

    Research output: Contribution to journalArticlepeer-review

    Abstract

    The problem of computing the storage capacity of a feed-forward network, with L hidden layers, N inputs, and K units in the first hidden layer, is analyzed using techniques from statistical mechanics. We found that the storage capacity strongly depends on the network architecture αc ∼ (log K)1-1/2L and that the number of units K limits the number of possible hidden layers L through the relationship 2L - 1 < 2log K.

    Original languageEnglish
    Article number065002
    Number of pages16
    JournalJournal of Physics A: Mathematical and Theoretical
    Volume47
    Issue number6
    Early online date27 Jan 2014
    DOIs
    Publication statusPublished - 14 Feb 2014

    Bibliographical note

    © 2014 IOP Publishing

    Keywords

    • 84.35.+i
    • adaptive systems PACS numbers: 89.70.
    • replica trick
    • storage capacity

    Fingerprint

    Dive into the research topics of 'Storage capacity of ultrametric committee machines'. Together they form a unique fingerprint.

    Cite this