Multiconnected neural network models
- 1 August 1987
- journal article
- Published by IOP Publishing in Journal of Physics A: General Physics
- Vol. 20 (11), 3453-3464
- https://doi.org/10.1088/0305-4470/20/11/046
Abstract
A generalisation of the Hopfield model which includes interactions between p()2) Ising spins is considered. The exact storage capacity behaves as Np-1/2(p-1)! ln N when the number of nodes, N, is large. In the limit p to infinity , the thermodynamics of the model can be solved exactly without using the replica method; at zero temperature, a solution which is completely correlated with the input pattern exists for alpha < alpha c where alpha c to infinity as p to infinity and this solution has lower energy than the spin-glass solution if alpha < alpha 1=1/4 ln 2 where the number of patterns n=(2 alpha /p!)Np-1. For finite values of p, the correlation with the input pattern is not complete; for p=3 and 4, approximate values of alpha c and alpha 1 are obtained and for p to infinity the replica symmetric approximation gives alpha c approximately p/4 ln p.Keywords
This publication has 15 references indexed in Scilit:
- A Learning Algorithm for Boltzmann Machines*Published by Wiley ,2010
- Dynamics and statistical mechanics of the Hopfield modelJournal of Physics A: General Physics, 1987
- Structure of metastable states in the Hopfield modelJournal of Physics A: General Physics, 1986
- Saturation Level of the Hopfield Model for Neural NetworkEurophysics Letters, 1986
- Storing Infinite Numbers of Patterns in a Spin-Glass Model of Neural NetworksPhysical Review Letters, 1985
- Spin-glass models of neural networksPhysical Review A, 1985
- Spin glasses with p-spin interactionsNuclear Physics B, 1985
- The simplest spin glassNuclear Physics B, 1984
- Random-energy model: An exactly solvable model of disordered systemsPhysical Review B, 1981
- Random-Energy Model: Limit of a Family of Disordered ModelsPhysical Review Letters, 1980