High storage capacity in the Hopfield model with auto-interactions - stability analysis

Jacopo Rocchi, David Saad, Daniele Tantari

Research output: Contribution to journalArticle

Abstract

Recent studies point to the potential storage of a large number of patterns in the celebrated Hopfield associative memory model, well beyond the limits obtained previously. We investigate the properties of new fixed points to discover that they exhibit instabilities for small perturbations and are therefore of limited value as
associative memories. Moreover, a large deviations approach also shows that errors introduced to the original patterns induce additional errors and increased corruption with respect to the stored patterns.
Original languageEnglish
Article number465001
Number of pages9
JournalJournal of Physics A: Mathematical and Theoretical
Volume50
DOIs
Publication statusPublished - 23 Oct 2017

Fingerprint

Hopfield Model
Storage Capacity
Stability Analysis
Data storage equipment
Interaction
associative memory
Associative Memory
Memory Model
interactions
Small Perturbations
Large Deviations
Fixed point
deviation
perturbation

Bibliographical note

This is an author-created, un-copyedited version of an article accepted for publication/published in Journal of Physics A: Mathematical and Theoretical. IOP Publishing Ltd is not responsible for any errors or omissions in this version of the manuscript or any version derived from it. The Version of Record is available online at http://iopscience.iop.org/article/10.1088/1751-8121/aa8fd7/meta.

Funding: The Leverhulme Trust grant RPG-2013-48, National Group of Mathematical Physics (GNFM-Indam)

Keywords

  • Hopfield model
  • associative memory
  • stability
  • statistical physics

Cite this

@article{39564e9a1d4f42f3a85f03295cb60875,
title = "High storage capacity in the Hopfield model with auto-interactions - stability analysis",
abstract = "Recent studies point to the potential storage of a large number of patterns in the celebrated Hopfield associative memory model, well beyond the limits obtained previously. We investigate the properties of new fixed points to discover that they exhibit instabilities for small perturbations and are therefore of limited value asassociative memories. Moreover, a large deviations approach also shows that errors introduced to the original patterns induce additional errors and increased corruption with respect to the stored patterns.",
keywords = "Hopfield model, associative memory, stability, statistical physics",
author = "Jacopo Rocchi and David Saad and Daniele Tantari",
note = "This is an author-created, un-copyedited version of an article accepted for publication/published in Journal of Physics A: Mathematical and Theoretical. IOP Publishing Ltd is not responsible for any errors or omissions in this version of the manuscript or any version derived from it. The Version of Record is available online at http://iopscience.iop.org/article/10.1088/1751-8121/aa8fd7/meta. Funding: The Leverhulme Trust grant RPG-2013-48, National Group of Mathematical Physics (GNFM-Indam)",
year = "2017",
month = "10",
day = "23",
doi = "10.1088/1751-8121/aa8fd7",
language = "English",
volume = "50",
journal = "Journal of Physics A: Mathematical and Theoretical",
issn = "1751-8113",
publisher = "IOP Publishing Ltd.",

}

High storage capacity in the Hopfield model with auto-interactions - stability analysis. / Rocchi, Jacopo; Saad, David; Tantari, Daniele.

In: Journal of Physics A: Mathematical and Theoretical, Vol. 50, 465001, 23.10.2017.

Research output: Contribution to journalArticle

TY - JOUR

T1 - High storage capacity in the Hopfield model with auto-interactions - stability analysis

AU - Rocchi, Jacopo

AU - Saad, David

AU - Tantari, Daniele

N1 - This is an author-created, un-copyedited version of an article accepted for publication/published in Journal of Physics A: Mathematical and Theoretical. IOP Publishing Ltd is not responsible for any errors or omissions in this version of the manuscript or any version derived from it. The Version of Record is available online at http://iopscience.iop.org/article/10.1088/1751-8121/aa8fd7/meta. Funding: The Leverhulme Trust grant RPG-2013-48, National Group of Mathematical Physics (GNFM-Indam)

PY - 2017/10/23

Y1 - 2017/10/23

N2 - Recent studies point to the potential storage of a large number of patterns in the celebrated Hopfield associative memory model, well beyond the limits obtained previously. We investigate the properties of new fixed points to discover that they exhibit instabilities for small perturbations and are therefore of limited value asassociative memories. Moreover, a large deviations approach also shows that errors introduced to the original patterns induce additional errors and increased corruption with respect to the stored patterns.

AB - Recent studies point to the potential storage of a large number of patterns in the celebrated Hopfield associative memory model, well beyond the limits obtained previously. We investigate the properties of new fixed points to discover that they exhibit instabilities for small perturbations and are therefore of limited value asassociative memories. Moreover, a large deviations approach also shows that errors introduced to the original patterns induce additional errors and increased corruption with respect to the stored patterns.

KW - Hopfield model

KW - associative memory

KW - stability

KW - statistical physics

U2 - 10.1088/1751-8121/aa8fd7

DO - 10.1088/1751-8121/aa8fd7

M3 - Article

VL - 50

JO - Journal of Physics A: Mathematical and Theoretical

JF - Journal of Physics A: Mathematical and Theoretical

SN - 1751-8113

M1 - 465001

ER -