Titolo della tesi: Retrieving mismatched memory patterns in the Hopfield model of neural networks
The main objective of this thesis is to explore the physical mechanisms of the so called Hopfield model of neural networks and to recover some quantitative results regarding a few of its possible variations.
In order to do that, we start, in Section 2 , by studying a class of Hopfield models where the memories are represented by a mixture of Gaussian and binary variables and the neurons are Ising spins and for this reason we say that the continuous pattern variables are partially mismatched with the binary system variables. We study the properties of this family of models as the relative weight of the two kinds of variables in the patterns varies. We quantitatively determine how the maximum number of memories that can be stored without letting the system lose the property to act as an associative memory squeezes towards zero as the memory patterns contain a larger fraction of mismatched variables. As the memory is purely Gaussian retrieval is lost for any positive storage capacity. It is shown that this comes about because of the spherical symmetry of the free energy in the Gaussian case. Introducing two different memory pattern overlaps between spin configurations and each contribution to the pattern from the two kinds of variables one can observe that the Gaussian parts of the patterns act as a noise, making retrieval more difficult. The basins of attraction of the states, the accuracy of the retrieval and the storage capacity are studied by means of Monte Carlo numerical simulations. We uncover that even in the limit where the network capacity shrinks to zero, the (few) retrieval states maintain a large basin of attraction and large overlaps with the mismatched patterns. So the network can be used for retrieval, but with a very small capacity.
In Section 3 , we take into account other possible variations of the Hopfield model and, precisely, the spherical Hopfield model with Gaussian and bimodal memorized patterns. In both cases, the same spherical symmetry that causes the aforementioned lack of retrieval persists and, this time, we use a higher order term in the Hamiltonian (4-bodies interactions) to recover retrieval.
In Section 4 we obtain the mean field dynamical equation of the spherical (2+4)- Hopfield model for the macroscopic observables and we present a gradient descent analysis of the out of equilibrium dynamics of such a model in order to better understand its retrieval properties.