Statistical mechanics of program systems

Juan P. Neirotti*, Nestor Caticha

*Corresponding author for this work

Research output: Contribution to journalArticle

Abstract

We discuss the collective behaviour of a set of operators and variables that constitute a program and the emergence of meaningful computational properties in the language of statistical mechanics. This is done by appropriately modifying available Monte Carlo methods to deal with hierarchical structures. The study suggests, in analogy with simulated annealing, a method to automatically design programs. Reasonable solutions can be found, at low temperatures, when the method is applied to simple toy problems such as finding an algorithm that determines the roots of a function or one that makes a nonlinear regression. Peaks in the specific heat are interpreted as signalling phase transitions which separate regions where different algorithmic strategies are used to solve the problem.

Original languageEnglish
Article number006
Pages (from-to)10355-10361
Number of pages7
JournalJournal of Physics A: Mathematical and General
Volume39
Issue number33
DOIs
Publication statusPublished - 18 Aug 2006

Fingerprint

statistical mechanics
Statistical Mechanics
Collective Behavior
Nonlinear Regression
simulated annealing
Specific Heat
Hierarchical Structure
Simulated Annealing
Monte Carlo method
Analogy
regression analysis
Phase Transition
Roots
specific heat
operators
Operator
Language
Design
Strategy

Cite this

Neirotti, Juan P. ; Caticha, Nestor. / Statistical mechanics of program systems. In: Journal of Physics A: Mathematical and General. 2006 ; Vol. 39, No. 33. pp. 10355-10361.
@article{44da19c276e44f56874b4241c5c58d10,
title = "Statistical mechanics of program systems",
abstract = "We discuss the collective behaviour of a set of operators and variables that constitute a program and the emergence of meaningful computational properties in the language of statistical mechanics. This is done by appropriately modifying available Monte Carlo methods to deal with hierarchical structures. The study suggests, in analogy with simulated annealing, a method to automatically design programs. Reasonable solutions can be found, at low temperatures, when the method is applied to simple toy problems such as finding an algorithm that determines the roots of a function or one that makes a nonlinear regression. Peaks in the specific heat are interpreted as signalling phase transitions which separate regions where different algorithmic strategies are used to solve the problem.",
author = "Neirotti, {Juan P.} and Nestor Caticha",
year = "2006",
month = "8",
day = "18",
doi = "10.1088/0305-4470/39/33/006",
language = "English",
volume = "39",
pages = "10355--10361",
journal = "Journal of Physics A: Mathematical and General",
issn = "0305-4470",
publisher = "IOP Publishing Ltd.",
number = "33",

}

Statistical mechanics of program systems. / Neirotti, Juan P.; Caticha, Nestor.

In: Journal of Physics A: Mathematical and General, Vol. 39, No. 33, 006, 18.08.2006, p. 10355-10361.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Statistical mechanics of program systems

AU - Neirotti, Juan P.

AU - Caticha, Nestor

PY - 2006/8/18

Y1 - 2006/8/18

N2 - We discuss the collective behaviour of a set of operators and variables that constitute a program and the emergence of meaningful computational properties in the language of statistical mechanics. This is done by appropriately modifying available Monte Carlo methods to deal with hierarchical structures. The study suggests, in analogy with simulated annealing, a method to automatically design programs. Reasonable solutions can be found, at low temperatures, when the method is applied to simple toy problems such as finding an algorithm that determines the roots of a function or one that makes a nonlinear regression. Peaks in the specific heat are interpreted as signalling phase transitions which separate regions where different algorithmic strategies are used to solve the problem.

AB - We discuss the collective behaviour of a set of operators and variables that constitute a program and the emergence of meaningful computational properties in the language of statistical mechanics. This is done by appropriately modifying available Monte Carlo methods to deal with hierarchical structures. The study suggests, in analogy with simulated annealing, a method to automatically design programs. Reasonable solutions can be found, at low temperatures, when the method is applied to simple toy problems such as finding an algorithm that determines the roots of a function or one that makes a nonlinear regression. Peaks in the specific heat are interpreted as signalling phase transitions which separate regions where different algorithmic strategies are used to solve the problem.

UR - http://www.scopus.com/inward/record.url?scp=33746926758&partnerID=8YFLogxK

UR - https://iopscience.iop.org/article/10.1088/0305-4470/39/33/006/meta

U2 - 10.1088/0305-4470/39/33/006

DO - 10.1088/0305-4470/39/33/006

M3 - Article

AN - SCOPUS:33746926758

VL - 39

SP - 10355

EP - 10361

JO - Journal of Physics A: Mathematical and General

JF - Journal of Physics A: Mathematical and General

SN - 0305-4470

IS - 33

M1 - 006

ER -