Storage capacity of ultrametric committee machines

J.P. Neirotti

doi:10.1088/1751-8113/47/6/065002

Storage capacity of ultrametric committee machines

J.P. Neirotti^*

^*Corresponding author for this work

Research output: Contribution to journal › Article › peer-review

1 Citation (Scopus)

101 Downloads (Pure)

Abstract

The problem of computing the storage capacity of a feed-forward network, with L hidden layers, N inputs, and K units in the first hidden layer, is analyzed using techniques from statistical mechanics. We found that the storage capacity strongly depends on the network architecture α_c∼ (log K)^_1-1/2L and that the number of units K limits the number of possible hidden layers L through the relationship 2^L - 1 < 2log K.

Original language	English
Article number	065002
Number of pages	16
Journal	Journal of Physics A: Mathematical and Theoretical
Volume	47
Issue number	6
Early online date	27 Jan 2014
DOIs	https://doi.org/10.1088/1751-8113/47/6/065002
Publication status	Published - 14 Feb 2014

Bibliographical note

Keywords

84.35.+i
adaptive systems PACS numbers: 89.70.
replica trick
storage capacity

Access to Document

10.1088/1751-8113/47/6/065002

Storage capacity of ultrametric committee machines
© 2014 IOP Publishing
Accepted author manuscript, 200 KB

http://iopscience.iop.org/1751-8121/47/6/065002/

Cite this

@article{39f0f8642f47493c9c2e19740034d4d7,

title = "Storage capacity of ultrametric committee machines",

abstract = "The problem of computing the storage capacity of a feed-forward network, with L hidden layers, N inputs, and K units in the first hidden layer, is analyzed using techniques from statistical mechanics. We found that the storage capacity strongly depends on the network architecture αc ∼ (log K)1-1/2L and that the number of units K limits the number of possible hidden layers L through the relationship 2L - 1 < 2log K.",

keywords = "84.35.+i, adaptive systems PACS numbers: 89.70., replica trick, storage capacity",

author = "J.P. Neirotti",

note = "{\textcopyright} 2014 IOP Publishing",

year = "2014",

month = feb,

day = "14",

doi = "10.1088/1751-8113/47/6/065002",

language = "English",

volume = "47",

journal = "Journal of Physics A: Mathematical and Theoretical",

issn = "1751-8113",

publisher = "IOP Publishing Ltd.",

number = "6",

}

TY - JOUR

T1 - Storage capacity of ultrametric committee machines

AU - Neirotti, J.P.

PY - 2014/2/14

Y1 - 2014/2/14

N2 - The problem of computing the storage capacity of a feed-forward network, with L hidden layers, N inputs, and K units in the first hidden layer, is analyzed using techniques from statistical mechanics. We found that the storage capacity strongly depends on the network architecture αc ∼ (log K)1-1/2L and that the number of units K limits the number of possible hidden layers L through the relationship 2L - 1 < 2log K.

AB - The problem of computing the storage capacity of a feed-forward network, with L hidden layers, N inputs, and K units in the first hidden layer, is analyzed using techniques from statistical mechanics. We found that the storage capacity strongly depends on the network architecture αc ∼ (log K)1-1/2L and that the number of units K limits the number of possible hidden layers L through the relationship 2L - 1 < 2log K.

KW - 84.35.+i

KW - adaptive systems PACS numbers: 89.70.

KW - replica trick

KW - storage capacity

UR - http://www.scopus.com/inward/record.url?scp=84893428494&partnerID=8YFLogxK

U2 - 10.1088/1751-8113/47/6/065002

DO - 10.1088/1751-8113/47/6/065002

M3 - Article

AN - SCOPUS:84893428494

SN - 1751-8113

VL - 47

JO - Journal of Physics A: Mathematical and Theoretical

JF - Journal of Physics A: Mathematical and Theoretical

IS - 6

M1 - 065002

ER -

Storage capacity of ultrametric committee machines

Abstract

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this