Source author record

Adriano Barra

Adriano Barra appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

61works
20topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

61 published item(s)

preprint2026arXiv

Serial vs parallel recall in the Blume-Every-Griffiths neural networks

Fully connected Blume-Emery-Griffiths neural networks performing pattern recognition and associative memory have been heuristically studied in the past (mainly via the replica trick and under the replica symmetric assumption) as generalization of the standard Hopfield reference. In these notes, at first, by relying upon Guerra interpolation, we re-obtain the existing picture rigorously. Next we show that, due to dilution in the patterns, these networks are able to switch from serial recall (where one pattern is retrieved per time) to parallel recall (where several patterns are retrieved at once) and the larger the dilution, the stronger this emerging multi-tasking capability. In particular, we inspect the regimes of mild dilution (where solely a low storage of pattern can be enabled) and extreme dilution (where a medium storage of patterns can be sustained) separately as they give rise to different outcomes: the former displays hierarchical recall (distributing the amplitudes of the retrieved signals with different amplitudes), the latter -- instead -- performs a equal-strength recall (where a O(1) fraction of all the patterns is simultaneously retrieved with the same amplitude per pattern). Finally, in order to implement graded responses in the neurons, variations on theme obtained by enlarging the possible values of neural activity these neurons may sustain are also discussed generalizing the Ghatak-Sherrington model for inverse freezing in Hebbian terms.

preprint2022arXiv

Pavlov Learning Machines

As well known, Hebb's learning traces its origin in Pavlov's Classical Conditioning, however, while the former has been extensively modelled in the past decades (e.g., by Hopfield model and countless variations on theme), as for the latter modelling has remained largely unaddressed so far; further, a bridge between these two pillars is totally lacking. The main difficulty towards this goal lays in the intrinsically different scales of the information involved: Pavlov's theory is about correlations among \emph{concepts} that are (dynamically) stored in the synaptic matrix as exemplified by the celebrated experiment starring a dog and a ring bell; conversely, Hebb's theory is about correlations among pairs of adjacent neurons as summarized by the famous statement {\em neurons that fire together wire together}. In this paper we rely on stochastic-process theory and model neural and synaptic dynamics via Langevin equations, to prove that -- as long as we keep neurons' and synapses' timescales largely split -- Pavlov mechanism spontaneously takes place and ultimately gives rise to synaptic weights that recover the Hebbian kernel.

preprint2022arXiv

Recurrent neural networks that generalize from examples and optimize by dreaming

The gap between the huge volumes of data needed to train artificial neural networks and the relatively small amount of data needed by their biological counterparts is a central puzzle in machine learning. Here, inspired by biological information-processing, we introduce a generalized Hopfield network where pairwise couplings between neurons are built according to Hebb's prescription for on-line learning and allow also for (suitably stylized) off-line sleeping mechanisms. Moreover, in order to retain a learning framework, here the patterns are not assumed to be available, instead, we let the network experience solely a dataset made of a sample of noisy examples for each pattern. We analyze the model by statistical-mechanics tools and we obtain a quantitative picture of its capabilities as functions of its control parameters: the resulting network is an associative memory for pattern recognition that learns from examples on-line, generalizes and optimizes its storage capacity by off-line sleeping. Remarkably, the sleeping mechanisms always significantly reduce (up to $\approx 90\%$) the dataset size required to correctly generalize, further, there are memory loads that are prohibitive to Hebbian networks without sleeping (no matter the size and quality of the provided examples), but that are easily handled by the present "rested" neural networks.

preprint2021arXiv

Towards the development of human immune-system-on-a-chip platforms

Organ-on-a-chip (OoCs) platforms could revolutionize drug discovery and might ultimately become essential tools for precision therapy. Although many single-organ and interconnected systems have been described, the immune system has been comparatively neglected, despite its pervasive role in the body and the trend towards newer therapeutic products (i.e., complex biologics, nanoparticles, immune checkpoint inhibitors, and engineered T cells) that often cause, or are based on, immune reactions. In this review, we recapitulate some distinctive features of the immune system before reviewing microfluidic devices that mimic lymphoid organs or other organs and/or tissues with an integrated immune system component.

preprint2020arXiv

Annealing and replica-symmetry in Deep Boltzmann Machines

In this paper we study the properties of the quenched pressure of a multi-layer spin-glass model (a deep Boltzmann Machine in artificial intelligence jargon) whose pairwise interactions are allowed between spins lying in adjacent layers and not inside the same layer nor among layers at distance larger than one. We prove a theorem that bounds the quenched pressure of such a K-layer machine in terms of K Sherrington-Kirkpatrick spin glasses and use it to investigate its annealed region. The replica-symmetric approximation of the quenched pressure is identified and its relation to the annealed one is considered. The paper also presents some observation on the model's architectural structure related to machine learning. Since escaping the annealed region is mandatory for a meaningful training, by squeezing such region we obtain thermodynamical constraints on the form factors. Remarkably, its optimal escape is achieved by requiring the last layer to scale sub-linearly in the network size.

preprint2020arXiv

Generalized Guerra's interpolation schemes for dense associative neural networks

In this work we develop analytical techniques to investigate a broad class of associative neural networks set in the high-storage regime. These techniques translate the original statistical-mechanical problem into an analytical-mechanical one which implies solving a set of partial differential equations, rather than tackling the canonical probabilistic route. We test the method on the classical Hopfield model - where the cost function includes only two-body interactions (i.e., quadratic terms) - and on the "relativistic" Hopfield model - where the (expansion of the) cost function includes p-body (i.e., of degree p) contributions. Under the replica symmetric assumption, we paint the phase diagrams of these models by obtaining the explicit expression of their free energy as a function of the model parameters (i.e., noise level and memory storage). Further, since for non-pairwise models ergodicity breaking is non necessarily a critical phenomenon, we develop a fluctuation analysis and find that criticality is preserved in the relativistic model.

preprint2020arXiv

Replica symmetry breaking in neural networks: a few steps toward rigorous results

In this paper we adapt the broken replica interpolation technique (developed by Francesco Guerra to deal with the Sherrington-Kirkpatrick model, namely a pairwise mean-field spin-glass whose couplings are i.i.d. standard Gaussian variables) in order to work also with the Hopfield model (i.e., a pairwise mean-field neural-network whose couplings are drawn according to Hebb's learning rule): this is accomplished by grafting Guerra's telescopic averages on the transport equation technique, recently developed by some of the Authors. As an overture, we apply the technique to solve the Sherrington-Kirkpatrick model with i.i.d. Gaussian couplings centered at $J_0$ and with finite variance $J$; the mean $J_0$ plays the role of a signal to be detected in a noisy environment tuned by $J$, hence making this model a natural test-case to be investigated before addressing the Hopfield model. For both the models, an explicit expression of their quenched free energy in terms of their natural order parameters is obtained at the K-th step (K arbitrary, but finite) of replica-symmetry-breaking. In particular, for the Hopfield model, by assuming that the overlaps respect Parisi's decomposition (following the ziqqurat ansatz) and that the Mattis magnetization is self-averaging, we recover previous results obtained via replica-trick by Amit, Crisanti and Gutfreund (1RSB) and by Steffan and Kühn (2RSB).

preprint2019arXiv

A statistical-inference approach to reconstruct inter-cellular interactions in cell-migration experiments

Migration of cells can be characterized by two, prototypical types of motion: individual and collective migration. We propose a statistical-inference approach designed to detect the presence of cell-cell interactions that give rise to collective behaviors in cell-motility experiments. Such inference method has been first successfully tested on synthetic motional data, and then applied to two experiments. In the first experiment, cell migrate in a wound-healing model: when applied to this experiment, the inference method predicts the existence of cell-cell interactions, correctly mirroring the strong intercellular contacts which are present in the experiment. In the second experiment, dendritic cells migrate in a chemokine gradient. Our inference analysis does not provide evidence for interactions, indicating that cells migrate by sensing independently the chemokine source. According to this prediction, we speculate that mature dendritic cells disregard inter-cellular signals that could otherwise delay their arrival to lymph vessels.

preprint2019arXiv

Neural networks with redundant representation: detecting the undetectable

We consider a three-layer Sejnowski machine and show that features learnt via contrastive divergence have a dual representation as patterns in a dense associative memory of order P=4. The latter is known to be able to Hebbian-store an amount of patterns scaling as N^{P-1}, where N denotes the number of constituting binary neurons interacting P-wisely. We also prove that, by keeping the dense associative network far from the saturation regime (namely, allowing for a number of patterns scaling only linearly with N, while P>2) such a system is able to perform pattern recognition far below the standard signal-to-noise threshold. In particular, a network with P=4 is able to retrieve information whose intensity is O(1) even in the presence of a noise O(\sqrt{N}) in the large N limit. This striking skill stems from a redundancy representation of patterns -- which is afforded given the (relatively) low-load information storage -- and it contributes to explain the impressive abilities in pattern recognition exhibited by new-generation neural networks. The whole theory is developed rigorously, at the replica symmetric level of approximation, and corroborated by signal-to-noise analysis and Monte Carlo simulations.

preprint2018arXiv

Dreaming neural networks: rigorous results

Recently a daily routine for associative neural networks has been proposed: the network Hebbian-learns during the awake state (thus behaving as a standard Hopfield model), then, during its sleep state, optimizing information storage, it consolidates pure patterns and removes spurious ones: this forces the synaptic matrix to collapse to the projector one (ultimately approaching the Kanter-Sompolinksy model). This procedure keeps the learning Hebbian-based (a biological must) but, by taking advantage of a (properly stylized) sleep phase, still reaches the maximal critical capacity (for symmetric interactions). So far this emerging picture (as well as the bulk of papers on unlearning techniques) was supported solely by mathematically-challenging routes, e.g. mainly replica-trick analysis and numerical simulations: here we rely extensively on Guerra's interpolation techniques developed for neural networks and, in particular, we extend the generalized stochastic stability approach to the case. Confining our description within the replica symmetric approximation (where the previous ones lie), the picture painted regarding this generalization (and the previously existing variations on theme) is here entirely confirmed. Further, still relying on Guerra's schemes, we develop a systematic fluctuation analysis to check where ergodicity is broken (an analysis entirely absent in previous investigations). We find that, as long as the network is awake, ergodicity is bounded by the Amit-Gutfreund-Sompolinsky critical line (as it should), but, as the network sleeps, sleeping destroys spin glass states by extending both the retrieval as well as the ergodic region: after an entire sleeping session the solely surviving regions are retrieval and ergodic ones and this allows the network to achieve the perfect retrieval regime (the number of storable patterns equals the number of neurons in the network).

preprint2015arXiv

Emerging heterogeneities in Italian customs and comparison with nearby countries

In this work we apply techniques and modus operandi typical of Statistical Mechanics to a large dataset about key social quantifiers and compare the resulting behaviours of five European nations, namely France, Germany, Italy, Spain and Switzerland. The social quantifiers considered are $i.$ the evolution of the number of autochthonous marriages (i.e. between two natives) within a given territorial district and $ii.$ the evolution of the number of mixed marriages (i.e. between a native and an immigrant) within a given territorial district. Our investigations are twofold. From a theoretical perspective, we develop novel techniques, complementary to classical methods (e.g. historical series and logistic regression), in order to detect possible collective features underlying the empirical behaviours; from an experimental perspective, we evidence a clear outline for the evolution of the social quantifiers considered. The comparison between experimental results and theoretical predictions is excellent and allows speculating that France, Italy and Spain display a certain degree of {\em internal heterogeneity}, that is not found in Germany and Switzerland; such heterogeneity, quite mild in France and in Spain, is not negligible in Italy and highlights quantitative differences in the customs of Northern and Southern regions. These findings may suggest the persistence of two culturally distinct communities, long-term lasting heritages of different and well-established cultures.

preprint2015arXiv

Exact solution of the van der Waals model in the critical region

The celebrated van der Waals model describes simple fluids in the thermodynamic limit and predicts the existence of a critical point associated to the gas-liquid phase transition. However the behaviour of critical isotherms according to the equation of state, where a gas-liquid phase transition occurs, significantly departs from experimental observations. The correct critical isotherms are heuristically re-established via the Maxwell equal areas rule. A long standing open problem in mean field theory is concerned with the analytic description of van der Waals isotherms for a finite size system that is consistent, in the thermodynamic limit, with the Maxwell prescription. Inspired by the theory of nonlinear conservation laws, we propose a novel mean field approach, based on statistical mechanics, that allows to calculate the van der Waals partition function for a system of large but finite number of particles $N$. Our partition function naturally extends to the whole space of thermodynamic variables, reproduces, in the thermodynamic limit $N\to \infty$, the classical results outside the critical region and automatically encodes Maxwell's prescription. We show that isothermal curves evolve in the space of thermodynamic variables like nonlinear breaking waves and the criticality is explained as the mechanism of formation of a classical hydrodynamic shock.

preprint2015arXiv

Insights in Economical Complexity in Spain: the hidden boost of migrants in international tradings

We consider extensive data on Spanish international trades and population composition and, through statistical-mechanics and graph-theory driven analysis, we unveil that the social network made of native and foreign-born individuals plays a role in the evolution and in the diversification of trades. Indeed, migrants naturally provide key information on policies and needs in their native countries, hence allowing firm's holders to leverage transactional costs of exports and duties. As a consequence, international trading is affordable for a larger basin of firms and thus results in an increased number of transactions, which, in turn, implies a larger diversification of international traded products. These results corroborate the novel scenario depicted by "Economical Complexity", where the pattern of production and trade of more developed countries is highly diversified. We also address a central question in Economics, concerning the existence of a critical threshold for migrants (within a given territorial district) over which they effectively contribute to boost international trades: in our physically-driven picture, this phenomenon corresponds to the emergence of a phase transition and, tackling the problem from this perspective, results in a novel successful quantitative route. Finally, we can infer that the pattern of interaction between native and foreign-born population exhibits small-world features as small diameter, large clustering, and weak ties working as optimal cut-edge, in complete agreement with findings in "Social Complexity".

preprint2015arXiv

Interpolating the Sherrington-Kirkpatrick replica trick

The interpolation techniques have become, in the past decades, a powerful approach to lighten several properties of spin glasses within a simple mathematical framework. Intrinsically, for their construction, these schemes were naturally implemented into the cavity field technique, or its variants as the stochastic stability or the random overlap structures. However the first and most famous approach to mean field statistical mechanics with quenched disorder is the replica trick. Among the models where these methods have been used (namely, dealing with frustration and complexity), probably the best known is the Sherrington-Kirkpatrick spin glass: In this paper we are pleased to apply the interpolation scheme to the replica trick framework and test it directly to the cited paradigmatic model: interestingly this allows to obtain easily the replica-symmetric control and, synergically with the broken replica bounds, a description of the full RSB scenario, both coupled with several minor theorems. Furthermore, by treating the amount of replicas $n\in(0,1]$ as an interpolating parameter (far from its original interpretation) this can be though of as a quenching temperature close to the one introduce in off-equilibrium approaches and, within this viewpoint, the proof of the attended commutativity of the zero replica and the infinite volume limits can be obtained.

preprint2015arXiv

On quantum and relativistic mechanical analogues in mean field spin models

Conceptual analogies among statistical mechanics and classical (or quantum) mechanics often appeared in the literature. For classical two-body mean field models, an analogy develops into a proper identification between the free energy of Curie-Weiss type magnetic models and the Hamilton-Jacobi action for a one dimensional mechanical system. Similarly, the partition function plays the role of the wave function in quantum mechanics and satisfies the heat equation that plays, in this context, the role of the Schrodinger equation in quantum mechanics. We show that this identification can be remarkably extended to include a wide family of magnetic models classified by normal forms of suitable real algebraic dispersion curves. In all these cases, the model turns out to be completely solvable as the free energy as well as the order parameter are obtained as solutions of an integrable nonlinear PDE of Hamilton-Jacobi type. We observe that the mechanical analog of these models can be viewed as the relativistic analog of the Curie-Weiss model and this helps to clarify the connection between generalised self-averaging and in statistical thermodynamics and the semi-classical dynamics of viscous conservation laws.

preprint2015arXiv

Topological properties of hierarchical networks

Hierarchical networks are attracting a renewal interest for modelling the organization of a number of biological systems and for tackling the complexity of statistical mechanical models beyond mean-field limitations. Here we consider the Dyson hierarchical construction for ferromagnets, neural networks and spin-glasses, recently analyzed from a statistical-mechanics perspective, and we focus on the topological properties of the underlying structures. In particular, we find that such structures are weighted graphs that exhibit high degree of clustering and of modularity, with small spectral gap; the robustness of such features with respect to link removal is also studied. These outcomes are then discussed and related to the statistical mechanics scenario in full consistency. Lastly, we look at these weighted graphs as Markov chains and we show that in the limit of infinite size, the emergence of ergodicity breakdown for the stochastic process mirrors the emergence of meta-stabilities in the corresponding statistical mechanical analysis.

preprint2014arXiv

A stochastic approach for quantifying immigrant integration: the Spanish test case

We apply stochastic process theory to the analysis of immigrant integration. Using a unique and detailed data set from Spain, we study the relationship between local immigrant density and two social and two economic immigration quantifiers for the period 1999-2010. As opposed to the classic time-series approach, by letting immigrant density play the role of "time", and the quantifier the role of "space" it become possible to analyze the behavior of the quantifiers by means of continuous time random walks. Two classes of results are obtained. First we show that social integration quantifiers evolve following pure diffusion law, while the evolution of economic quantifiers exhibit ballistic dynamics. Second we make predictions of best and worst case scenarios taking into account large local fluctuations. Our stochastic process approach to integration lends itself to interesting forecasting scenarios which, in the hands of policy makers, have the potential to improve political responses to integration problems. For instance, estimating the standard first-passage time and maximum-span walk reveals local differences in integration performance for different immigration scenarios. Thus, by recognizing the importance of local fluctuations around national means, this research constitutes an important tool to assess the impact of immigration phenomena on municipal budgets and to set up solid multi-ethnic plans at the municipal level as immigration pressure build.

preprint2014arXiv

A walk in the statistical mechanical formulation of neural networks

Neural networks are nowadays both powerful operational tools (e.g., for pattern recognition, data mining, error correction codes) and complex theoretical models on the focus of scientific investigation. As for the research branch, neural networks are handled and studied by psychologists, neurobiologists, engineers, mathematicians and theoretical physicists. In particular, in theoretical physics, the key instrument for the quantitative analysis of neural networks is statistical mechanics. From this perspective, here, we first review attractor networks: starting from ferromagnets and spin-glass models, we discuss the underlying philosophy and we recover the strand paved by Hopfield, Amit-Gutfreund-Sompolinky. One step forward, we highlight the structural equivalence between Hopfield networks (modeling retrieval) and Boltzmann machines (modeling learning), hence realizing a deep bridge linking two inseparable aspects of biological and robotic spontaneous cognition. As a sideline, in this walk we derive two alternative (with respect to the original Hebb proposal) ways to recover the Hebbian paradigm, stemming from ferromagnets and from spin-glasses, respectively. Further, as these notes are thought of for an Engineering audience, we highlight also the mappings between ferromagnets and operational amplifiers and between antiferromagnets and flip-flops (as neural networks -built by op-amp and flip-flops- are particular spin-glasses and the latter are indeed combinations of ferromagnets and antiferromagnets), hoping that such a bridge plays as a concrete prescription to capture the beauty of robotics from the statistical mechanical perspective.

preprint2014arXiv

An analysis of a large dataset on immigrant integration in Spain. The Statistical Mechanics perspective on Social Action

How does immigrant integration in a country change with immigration density? Guided by a statistical mechanics perspective we propose a novel approach to this problem. The analysis focuses on classical integration quantifiers such as the percentage of jobs (temporary and permanent) given to immigrants, mixed marriages, and newborns with parents of mixed origin. We find that the average values of different quantifi?ers may exhibit either linear or non-linear growth on immigrant density and we suggest that social action, a concept identified by Max Weber, causes the observed non- linearity. Using the statistical mechanics notion of interaction to quantitatively emulate social action, a unified mathematical model for integration is proposed and it is shown to explain both growth behaviors observed. The linear theory instead, ignoring the possibility of interaction effects would underestimate the quantifiers up to 30% when immigrant densities are low, and overestimate them as much when densities are high. The capacity to quantitatively isolate different types of integration mechanisms makes our framework a suitable tool in the quest for more efficient integration policies.

preprint2014arXiv

Cancer-driven dynamics of immune cells in a microfluidic environment

Scope of the present work is to frame into a rigorous, quantitative scaffold - stemmed from stochastic process theory - two sets of experiments designed to infer the spontaneous organization of leukocytes against cancer cells, namely mice splenocytes vs. B16 mouse tumor cells, and embedded in an "ad hoc" microfluidic environment developed on a LabOnChip technology. In the former, splenocytes from knocked out (KO) mice engineered to silence the transcription factor IRF-8, crucial for the development and function of several immune populations, were used. In this case lymphocytes and cancer cells exhibited a poor reciprocal exchange, resulting in the inability of coordinating or mounting an effective immune response against melanoma. In the second class of tests, wild type (WT) splenocytes were able to interact with and to coordinate a response against the tumor cells through physical interaction. The environment where cells moved was built of by two different chambers, containing respectively melanoma cells and splenocytes, connected by capillary migration channels allowing leucocytes to migrate from their chamber toward the melanoma one. We collected and analyzed data on the motility of the cells and found that the first ensemble of IRF-8 KO cells performed pure uncorrelated random walks, while WT splenocytes were able to make singular drifted random walks, that, averaged over the ensemble of cells, collapsed on a straight ballistic motion for the system as a whole. At a finer level of investigation, we found that IRF-8 KO splenocytes moved rather uniformly since their step lengths were exponentially distributed, while WT counterpart displayed a qualitatively broader motion as their step lengths along the direction of the melanoma were log-normally distributed.

preprint2014arXiv

Extensive load in multitasking associative networks

We use belief-propagation techniques to study the equilibrium behavior of a bipartite spin-glass, with interactions between two sets of $N$ and $P = αN$ spins. Each spin has a finite degree, i.e.\ number of interaction partners in the opposite set; an equivalent view is then of a system of $N$ neurons storing $P$ diluted patterns. We show that in a large part of the parameter space of noise, dilution and storage load, delimited by a critical surface, the network behaves as an extensive parallel processor, retrieving all $P$ patterns {\it in parallel} without falling into spurious states due to pattern cross-talk and typical of the structural glassiness built into the network. Our approach allows us to consider effects beyond those studied in replica theory so far, including pattern asymmetry and heterogeneous dilution. Parallel extensive retrieval is more robust for homogeneous degree distributions, and is not disrupted by biases in the distributions of the spin-glass links.

preprint2014arXiv

Free-energy bounds for hierarchical spin models

In this paper we study two non-mean-field spin models built on a hierarchical lattice: The hierarchical Edward-Anderson model (HEA) of a spin glass, and Dyson's hierarchical model (DHM) of a ferromagnet. For the HEA, we prove the existence of the thermodynamic limit of the free energy and the replica-symmetry-breaking (RSB) free-energy bounds previously derived for the Sherrington-Kirkpatrick model of a spin glass. These RSB mean-field bounds are exact only if the order-parameter fluctuations (OPF) vanish: Given that such fluctuations are not negligible in non-mean-field models, we develop a novel strategy to tackle part of OPF in hierarchical models. The method is based on absorbing part of OPF of a block of spins into an effective Hamiltonian of the underlying spin blocks. We illustrate this method for DHM and show that, compared to the mean-field bound for the free energy, it provides a tighter non-mean-field bound, with a critical temperature closer to the exact one. To extend this method to the HEA model, a suitable generalization of Griffith's correlation inequalities for Ising ferromagnets is needed: Since correlation inequalities for spin glasses are still an open topic, we leave the extension of this method to hierarchical spin glasses as a future perspective.

preprint2014arXiv

From Dyson to Hopfield: Processing on hierarchical networks

We consider statistical-mechanical models for spin systems built on hierarchical structures, which provide a simple example of non-mean-field framework. We show that the coupling decay with spin distance can give rise to peculiar features and phase diagrams much richer that their mean-field counterpart. In particular, we consider the Dyson model, mimicking ferromagnetism in lattices, and we prove the existence of a number of meta-stabilities, beyond the ordered state, which get stable in the thermodynamic limit. Such a feature is retained when the hierarchical structure is coupled with the Hebb rule for learning, hence mimicking the modular architecture of neurons, and gives rise to an associative network able to perform both as a serial processor as well as a parallel processor, depending crucially on the external stimuli and on the rate of interaction decay with distance; however, those emergent multitasking features reduce the network capacity with respect to the mean-field counterpart. The analysis is accomplished through statistical mechanics, graph theory, signal-to-noise technique and numerical simulations in full consistency. Our results shed light on the biological complexity shown by real networks, and suggest future directions for understanding more realistic models.

preprint2014arXiv

Hierarchical neural networks perform both serial and parallel processing

In this work we study a Hebbian neural network, where neurons are arranged according to a hierarchical architecture such that their couplings scale with their reciprocal distance. As a full statistical mechanics solution is not yet available, after a streamlined introduction to the state of the art via that route, the problem is consistently approached through signal- to-noise technique and extensive numerical simulations. Focusing on the low-storage regime, where the amount of stored patterns grows at most logarithmical with the system size, we prove that these non-mean-field Hopfield-like networks display a richer phase diagram than their classical counterparts. In particular, these networks are able to perform serial processing (i.e. retrieve one pattern at a time through a complete rearrangement of the whole ensemble of neurons) as well as parallel processing (i.e. retrieve several patterns simultaneously, delegating the management of diff erent patterns to diverse communities that build network). The tune between the two regimes is given by the rate of the coupling decay and by the level of noise affecting the system. The price to pay for those remarkable capabilities lies in a network's capacity smaller than the mean field counterpart, thus yielding a new budget principle: the wider the multitasking capabilities, the lower the network load and viceversa. This may have important implications in our understanding of biological complexity.

preprint2014arXiv

Meta-stable states in the hierarchical Dyson model drive parallel processing in the hierarchical Hopfield network

In this paper we introduce and investigate the statistical mechanics of hierarchical neural networks: First, we approach these systems à la Mattis, by thinking at the Dyson model as a single-pattern hierarchical neural network and we discuss the stability of different retrievable states as predicted by the related self-consistencies obtained from a mean-field bound and from a bound that bypasses the mean-field limitation. The latter is worked out by properly reabsorbing fluctuations of the magnetization related to higher levels of the hierarchy into effective fields for the lower levels. Remarkably, mixing Amit's ansatz technique (to select candidate retrievable states) with the interpolation procedure (to solve for the free energy of these states) we prove that (due to gauge symmetry) the Dyson model accomplishes both serial and parallel processing. One step forward, we extend this scenario toward multiple stored patterns by implementing the Hebb prescription for learning within the couplings. This results in an Hopfield-like networks constrained on a hierarchical topology, for which, restricting to the low storage regime (where the number of patterns grows at most logarithmical with the amount of neurons), we prove the existence of the thermodynamic limit for the free energy and we give an explicit expression of its mean field bound and of the related improved bound

preprint2014arXiv

Multi-species mean-field spin-glasses. Rigorous results

We study a multi-species spin glass system where the density of each species is kept fixed at increasing volumes. The model reduces to the Sherrington-Kirkpatrick one for the single species case. The existence of the thermodynamic limit is proved for all densities values under a convexity condition on the interaction. The thermodynamic properties of the model are investigated and the annealed, the replica symmetric and the replica symmetry breaking bounds are proved using Guerra's scheme. The annealed approximation is proved to be exact under a high temperature condition. We show that the replica symmetric solution has negative entropy at low temperatures. We study the properties of a suitably defined replica symmetry breaking solution and we optimise it within a ziggurat ansatz. The generalized order parameter is described by a Parisi-like partial differential equation.

preprint2014arXiv

Notes on stochastic (bio)-logic gates: the role of allosteric cooperativity

Recent experimental breakthroughs have finally allowed to implement in-vitro reaction kinetics (the so called {\em enzyme based logic}) which code for two-inputs logic gates and mimic the stochastic AND (and NAND) as well as the stochastic OR (and NOR). This accomplishment, together with the already-known single-input gates (performing as YES and NOT), provides a logic base and paves the way to the development of powerful biotechnological devices. The investigation of this field would enormously benefit from a self-consistent, predictive, theoretical framework. Here we formulate a complete statistical mechanical description of the Monod-Wyman-Changeaux allosteric model for both single and double ligand systems, with the purpose of exploring their practical capabilities to express logical operators and/or perform logical operations. Mixing statistical mechanics with logics, and quantitatively our findings with the available biochemical data, we successfully revise the concept of cooperativity (and anti-cooperativity) for allosteric systems, with particular emphasis on its computational capabilities, the related ranges and scaling of the involved parameters and its differences with classical cooperativity (and anti-cooperativity).

preprint2013arXiv

Application of a stochastic modeling to evaluate tuberculosis onset in patients treated with tumor necrosis factor inhibitors

In this manuscript we apply stochastic modeling to investigate the risk of reactivation of latent mycobacterial infections in patients undergoing treatment with tumor necrosis factor inhibitors. First, we review the perspective proposed by one of the authors in a previous work and which consists in predicting the occurrence of reactivation of latent tuberculosis infection or newly acquired tuberculosis during treatment; this is based on variational procedures on a simple set of parameters (e.g. rate of reactivation of a latent infection). Then, we develop a full analytical study of this approach through a Markov chain analysis and we find an exact solution for the temporal evolution of the number of cases of tuberculosis infection (re)activation. The analytical solution is compared with Monte Carlo simulations and with experimental data, showing overall excellent agreement. The generality of this theoretical framework allows to investigate also the case of non-tuberculous mycobacteria infections; in particular, we show that reactivation in that context plays a minor role. This may suggest that, while the screening for tuberculous is necessary prior to initiating biologics, when considering non-tuberculous mycobacteria only a watchful monitoring during the treatment is recommended. The framework outlined in this paper is quite general and could be extremely promising in further researches on drug-related adverse events.

preprint2013arXiv

Collective behaviours: from biochemical kinetics to electronic circuits

In this work we aim to highlight a close analogy between cooperative behaviors in chemical kinetics and cybernetics; this is realized by using a common language for their description, that is mean-field statistical mechanics. First, we perform a one-to-one mapping between paradigmatic behaviors in chemical kinetics (i.e., non-cooperative, cooperative, ultra-sensitive, anti-cooperative) and in mean-field statistical mechanics (i.e., paramagnetic, high and low temperature ferromagnetic, anti-ferromagnetic). Interestingly, the statistical mechanics approach allows a unified, broad theory for all scenarios and, in particular, Michaelis-Menten, Hill and Adair equations are consistently recovered. This framework is then tested against experimental biological data with an overall excellent agreement. One step forward, we consistently read the whole mapping from a cybernetic perspective, highlighting deep structural analogies between the above-mentioned kinetics and fundamental bricks in electronics (i.e. operational amplifiers, flashes, flip-flops), so to build a clear bridge linking biochemical kinetics and cybernetics.

preprint2013arXiv

Ferromagnetic models for cooperative behavior: Revisiting Universality in complex phenomena

Ferromagnetic models are harmonic oscillators in statistical mechanics. Beyond their original scope in tackling phase transition and symmetry breaking in theoretical physics, they are nowadays experiencing a renewal applicative interest as they capture the main features of disparate complex phenomena, whose quantitative investigation in the past were forbidden due to data lacking. After a streamlined introduction to these models, suitably embedded on random graphs, aim of the present paper is to show their importance in a plethora of widespread research fields, so to highlight the unifying framework reached by using statistical mechanics as a tool for their investigation. Specifically we will deal with examples stemmed from sociology, chemistry, cybernetics (electronics) and biology (immunology).

preprint2013arXiv

Immune networks: multi-tasking capabilities at medium load

Associative network models featuring multi-tasking properties have been introduced recently and studied in the low load regime, where the number $P$ of simultaneously retrievable patterns scales with the number $N$ of nodes as $P\sim \log N$. In addition to their relevance in artificial intelligence, these models are increasingly important in immunology, where stored patterns represent strategies to fight pathogens and nodes represent lymphocyte clones. They allow us to understand the crucial ability of the immune system to respond simultaneously to multiple distinct antigen invasions. Here we develop further the statistical mechanical analysis of such systems, by studying the medium load regime, $P \sim N^δ$ with $δ\in (0,1]$. We derive three main results. First, we reveal the nontrivial architecture of these networks: they exhibit a high degree of modularity and clustering, which is linked to their retrieval abilities. Second, by solving the model we demonstrate for $δ<1$ the existence of large regions in the phase diagram where the network can retrieve all stored patterns simultaneously. Finally, in the high load regime $δ=1$ we find that the system behaves as a spin glass, suggesting that finite-connectivity frameworks are required to achieve effective retrieval.

preprint2013arXiv

Immune networks: multi-tasking capabilities near saturation

Pattern-diluted associative networks were introduced recently as models for the immune system, with nodes representing T-lymphocytes and stored patterns representing signalling protocols between T- and B-lymphocytes. It was shown earlier that in the regime of extreme pattern dilution, a system with $N_T$ T-lymphocytes can manage a number $N_B!=!\order(N_T^δ)$ of B-lymphocytes simultaneously, with $δ!<!1$. Here we study this model in the extensive load regime $N_B!=!αN_T$, with also a high degree of pattern dilution, in agreement with immunological findings. We use graph theory and statistical mechanical analysis based on replica methods to show that in the finite-connectivity regime, where each T-lymphocyte interacts with a finite number of B-lymphocytes as $N_T\to\infty$, the T-lymphocytes can coordinate effective immune responses to an extensive number of distinct antigen invasions in parallel. As $α$ increases, the system eventually undergoes a second order transition to a phase with clonal cross-talk interference, where the system's performance degrades gracefully. Mathematically, the model is equivalent to a spin system on a finitely connected graph with many short loops, so one would expect the available analytical methods, which all assume locally tree-like graphs, to fail. Yet it turns out to be solvable. Our results are supported by numerical simulations.

preprint2013arXiv

Mean field bipartite spin models treated with mechanical techniques

Inspired by a continuously increasing interest in modeling and framing complex systems in a thermody- namic rationale, in this paper we continue our investigation in adapting well known techniques (originally stemmed in fields of physics and mathematics far from the present) for solving for the free energy of mean field spin models in a statistical mechanics scenario. Focusing on the test cases of bipartite spin systems embedded with all the possible interactions (self and reciprocal), we show that both the fully interacting bipartite ferromagnet as well as the spin glass counterpart, at least at the replica symmetric level, can be solved via the fundamental theorem of calculus, trough an analogy with the Hamilton-Jacobi theory and lastly with a mapping to a Fourier diffusion problem. All these technologies are shown symmetrically for ferromagnets and spin-glasses in full details and contribute as powerful tools in the investigation of complex systems.

preprint2013arXiv

Mean field spin glasses treated with PDE techniques

Following an original idea of F. Guerra, in this notes we analyze the Sherrington-Kirkpatrick model from different perspectives, all sharing the underlying approach which consists in linking the resolution of the statistical mechanics of the model (e.g. solving for the free energy) to well-known partial differential equation (PDE) problems (in suitable spaces). The plan is then to solve the related PDE using techniques involved in their native field and lastly bringing back the solution in the proper statistical mechanics framework. Within this strand, after a streamlined test-case on the Curie-Weiss model to highlight the methods more than the physics behind, we solve the SK both at the replica symmetric and at the 1-RSB level, obtaining the correct expression for the free energy via an analogy to a Fourier equation and for the self-consistencies with an analogy to a Burger equation, whose shock wave develops exactly at critical noise level (triggering the phase transition). Our approach, beyond acting as a new alternative method (with respect to the standard routes) for tackling the complexity of spin glasses, links symmetries in PDE theory with constraints in statistical mechanics and, as a novel result from the theoretical physics perspective, we obtain a new class of polynomial identities (namely of Aizenman-Contucci type but merged within the Guerra's broken replica measures), whose interest lies in understanding, via the recent Panchenko breakthroughs, how to force the overlap organization to the ultrametric tree predicted by Parisi.

preprint2013arXiv

Multitasking network with fast noise

We consider the multitasking associative network in the low-storage limit and we study its phase diagram with respect to the noise level $T$ and the degree $d$ of dilution in pattern entries. We find that the system is characterized by a rich variety of stable states, among which pure states, parallel retrieval states, hierarchically organized states and symmetric mixtures (remarkably, both even and odd), whose complexity increases as the number of patterns $P$ grows. The analysis is performed both analytically and numerically: Exploiting techniques based on partial differential equations, allows us to get the self-consistencies for the order parameters. Such self-consistence equations are then solved and the solutions are further checked through stability theory to catalog their organizations into the phase diagram, which is completely outlined at the end. This is a further step toward the understanding of spontaneous parallel processing in associative networks.

preprint2013arXiv

Parallel processing in immune networks

In this work we adopt a statistical mechanics approach to investigate basic, systemic features exhibited by adaptive immune systems. The lymphocyte network made by B-cells and T-cells is modeled by a bipartite spin-glass, where, following biological prescriptions, links connecting B-cells and T-cells are sparse. Interestingly, the dilution performed on links is shown to make the system able to orchestrate parallel strategies to fight several pathogens at the same time; this multitasking capability constitutes a remarkable, key property of immune systems as multiple antigens are always present within the host. We also define the stochastic process ruling the temporal evolution of lymphocyte activity, and show its relaxation toward an equilibrium measure allowing statistical mechanics investigations. Analytical results are compared with Monte Carlo simulations and signal-to-noise outcomes showing overall excellent agreement. Finally, within our model, a rationale for the experimentally well-evidenced correlation between lymphocytosis and autoimmunity is achieved; this sheds further light on the systemic features exhibited by immune networks.

preprint2012arXiv

A Solvable Mean Field Model of a Gaussian Spin Glass

We introduce a mean field spin glass model with gaussian distribuited spins and pairwise interactions, whose couplings are drawn randomly from a normal gaussian distribution too. We completely control the main thermodynamical properties of the model (free energy, phase diagram, fluctuations theory) in the whole phase space. In particular we prove that in thermodynamic limit the free energy equals its replica symmetric expression.

preprint2012arXiv

A thermodynamical perspective of immune capabilities

We consider the mutual interactions, via cytokine exchanges, among helper lymphocytes, B lymphocytes and killer lymphocytes, and we model them as a unique system by means of a tripartite network. Each part includes all the different clones of the same lymphatic subpopulation, whose couplings to the others are either excitatory or inhibitory (mirroring elicitation and suppression by cytokine). First of all, we show that this system can be mapped into an associative neural network, where helper cells directly interact with each other and are able to secrete cytokines according to "strategies" learnt by the system and profitable to cope with possible antigenic stimulation; the ability of such a retrieval corresponds to a healthy reaction of the immune system. We then investigate the possible conditions for the failure of a correct retrieval and distinguish between the following outcomes: massive lymphocyte expansion/suppression (e.g. lymphoproliferative syndromes), subpopulation unbalance (e.g. HIV, EBV infections) and ageing (thought of as noise growth); the correlation of such states to auto-immune diseases is also highlighted. Lastly, we discuss how self-regulatory effects within each effector branch (i.e. B and killer lymphocytes) can be modeled in terms of a stochastic process, ultimately providing a consistent bridge between the tripartite-network approach introduced here and the immune networks developed in the last decades.

preprint2012arXiv

Analogue neural networks on correlated random graphs

We consider a generalization of the Hopfield model, where the entries of patterns are Gaussian and diluted. We focus on the high-storage regime and we investigate analytically the topological properties of the emergent network, as well as the thermodynamic properties of the model. We find that, by properly tuning the dilution in the pattern entries, the network can recover different topological regimes characterized by peculiar scalings of the average coordination number with respect to the system size. The structure is also shown to exhibit a large degree of cliquishness, even when very sparse. Moreover, we obtain explicitly the replica symmetric free energy and the self-consistency equations for the overlaps (order parameters of the theory), which turn out to be classical weighted sums of 'sub-overlaps' defined on all possible sub-graphs. Finally, a study of criticality is performed through a small-overlap expansion of the self-consistencies and through a whole fluctuation theory developed for their rescaled correlations: Both approaches show that the net effect of dilution in pattern entries is to rescale the critical noise level at which ergodicity breaks down.

preprint2012arXiv

Anergy in self-directed B lymphocytes from a statistical mechanics perspective

The ability of the adaptive immune system to discriminate between self and non-self mainly stems from the ontogenic clonal-deletion of lymphocytes expressing strong binding affinity with self-peptides. However, some self-directed lymphocytes may evade selection and still be harmless due to a mechanism called clonal anergy. As for B lymphocytes, two major explanations for anergy developed over three decades: according to "Varela theory", it stems from a proper orchestration of the whole B-repertoire, in such a way that self-reactive clones, due to intensive interactions and feed-back from other clones, display more inertia to mount a response. On the other hand, according to the `two-signal model", which has prevailed nowadays, self-reacting cells are not stimulated by helper lymphocytes and the absence of such signaling yields anergy. The first result we present, achieved through disordered statistical mechanics, shows that helper cells do not prompt the activation and proliferation of a certain sub-group of B cells, which turn out to be just those broadly interacting, hence it merges the two approaches as a whole (in particular, Varela theory is then contained into the two-signal model). As a second result, we outline a minimal topological architecture for the B-world, where highly connected clones are self-directed as a natural consequence of an ontogenetic learning; this provides a mathematical framework to Varela perspective. As a consequence of these two achievements, clonal deletion and clonal anergy can be seen as two inter-playing aspects of the same phenomenon too.

preprint2012arXiv

Can persistent Epstein-Barr virus infection induce Chronic Fatigue Syndrome as a Pavlov reflex of the immune response?

Chronic Fatigue Syndrome is a protracted illness condition (lasting even years) appearing with strong flu symptoms and systemic defiances by the immune system. Here, by means of statistical mechanics techniques, we study the most widely accepted picture for its genesis, namely a persistent acute mononucleosis infection, and we show how such infection may drive the immune system toward an out-of-equilibrium metastable state displaying chronic activation of both humoral and cellular responses (a state of full inflammation without a direct "causes-effect" reason). By exploiting a bridge with a neural scenario, we mirror killer lymphocytes $T_K$ and $B$ cells to neurons and helper lymphocytes $T_{H_1},T_{H_2}$ to synapses, hence showing that the immune system may experience the Pavlov conditional reflex phenomenon: if the exposition to a stimulus (EBV antigens) lasts for too long, strong internal correlations among $B,T_K,T_H$ may develop ultimately resulting in a persistent activation even though the stimulus itself is removed. These outcomes are corroborated by several experimental findings.

preprint2012arXiv

How glassy are neural networks?

In this paper we continue our investigation on the high storage regime of a neural network with Gaussian patterns. Through an exact mapping between its partition function and one of a bipartite spin glass (whose parties consist of Ising and Gaussian spins respectively), we give a complete control of the whole annealed region. The strategy explored is based on an interpolation between the bipartite system and two independent spin glasses built respectively by dichotomic and Gaussian spins: Critical line, behavior of the principal thermodynamic observables and their fluctuations as well as overlap fluctuations are obtained and discussed. Then, we move further, extending such an equivalence beyond the critical line, to explore the broken ergodicity phase under the assumption of replica symmetry and we show that the quenched free energy of this (analogical) Hopfield model can be described as a linear combination of the two quenched spin-glass free energies even in the replica symmetric framework.

preprint2012arXiv

Multitasking associative networks

We introduce a bipartite, diluted and frustrated, network as a sparse restricted Boltzman machine and we show its thermodynamical equivalence to an associative working memory able to retrieve multiple patterns in parallel without falling into spurious states typical of classical neural networks. We focus on systems processing in parallel a finite (up to logarithmic growth in the volume) amount of patterns, mirroring the low-level storage of standard Amit-Gutfreund-Sompolinsky theory. Results obtained trough statistical mechanics, signal-to-noise technique and Monte Carlo simulations are overall in perfect agreement and carry interesting biological insights. Indeed, these associative networks pave new perspectives in the understanding of multitasking features expressed by complex systems, e.g. neural and immune networks.

preprint2012arXiv

Notes on the p-spin glass studied via Hamilton-Jacobi and Smooth-Cavity techniques

In these notes, we continue our investigation of classical toy models of disordered statistical mechanics through various techniques recently developed and tested mainly on the paradigmatic SK spin glass. Here we consider the p-spin-glass model with Ising spins and interactions drawn from a normal distribution N[0,1]. After a general presentation of its properties (e.g. self-averaging of the free energy, existence of a suitable thermodynamic limit), we study its equilibrium behavior within the Hamilton-Jacobi framework and the smooth cavity approach. Through the former we find both the RS and the 1RSB expressions for the free energy, coupled with their self-consistent relations for the overlaps. Through the latter, we recover these results as irreducible expression, and we study the generalization of the overlap polynomial identities suitable for this model; a discussion on their deep connection with the structure of the internal energy and the entropy closes the investigation.

preprint2012arXiv

Notes on the polynomial identities in random overlap structures

In these notes we review first in some detail the concept of random overlap structure (ROSt) applied to fully connected and diluted spin glasses. We then sketch how to write down the general term of the expansion of the energy part from the Boltzmann ROSt (for the Sherrington-Kirkpatrick model) and the corresponding term from the RaMOSt, which is the diluted extension suitable for the Viana-Bray model. From the ROSt energy term, a set of polynomial identities (often known as Aizenman-Contucci or AC relations) is shown to hold rigorously at every order because of a recursive structure of these polynomials that we prove. We show also, however, that this set is smaller than the full set of AC identities that is already known. Furthermore, when investigating the RaMOSt energy for the diluted counterpart, at higher orders, combinations of such AC identities appear, ultimately suggesting a crucial role for the entropy in generating these constraints in spin glasses.

preprint2012arXiv

On the equivalence of Hopfield Networks and Boltzmann Machines

A specific type of neural network, the Restricted Boltzmann Machine (RBM), is implemented for classification and feature detection in machine learning. RBM is characterized by separate layers of visible and hidden units, which are able to learn efficiently a generative model of the observed data. We study a "hybrid" version of RBM's, in which hidden units are analog and visible units are binary, and we show that thermodynamics of visible units are equivalent to those of a Hopfield network, in which the N visible units are the neurons and the P hidden units are the learned patterns. We apply the method of stochastic stability to derive the thermodynamics of the model, by considering a formal extension of this technique to the case of multiple sets of stored patterns, which may act as a benchmark for the study of correlated sets. Our results imply that simulating the dynamics of a Hopfield network, requiring the update of N neurons and the storage of N(N-1)/2 synapses, can be accomplished by a hybrid Boltzmann Machine, requiring the update of N+P neurons but the storage of only NP synapses. In addition, the well known glass transition of the Hopfield network has a counterpart in the Boltzmann Machine: It corresponds to an optimum criterion for selecting the relative sizes of the hidden and visible layers, resolving the trade-off between flexibility and generality of the model. The low storage phase of the Hopfield model corresponds to few hidden units and hence a overly constrained RBM, while the spin-glass phase (too many hidden units) corresponds to unconstrained RBM prone to overfitting of the observed data.

preprint2012arXiv

Organization and evolution of synthetic idiotypic networks

We introduce a class of weighted graphs whose properties are meant to mimic the topological features of idiotypic networks, namely the interaction networks involving the B-core of the immune system. Each node is endowed with a bit-string representing the idiotypic specificity of the corresponding B cell and a proper distance between any couple of bit-strings provides the coupling strength between the two nodes. We show that a biased distribution of the entries in bit-strings can yield fringes in the (weighted) degree distribution, small-worlds features, and scaling laws, in agreement with experimental findings. We also investigate the role of ageing, thought of as a progressive increase in the degree of bias in bit-strings, and we show that it can possibly induce mild percolation phenomena, which are investigated too.

preprint2012arXiv

Parallel retrieval of correlated patterns

In this work, we first revise some extensions of the standard Hopfield model in the low storage limit, namely the correlated attractor case and the multitasking case recently introduced by the authors. The former case is based on a modification of the Hebbian prescription, which induces a coupling between consecutive patterns and this effect is tuned by a parameter $a$. In the latter case, dilution is introduced in pattern entries, in such a way that a fraction $d$ of them is blank. Then, we merge these two extensions to obtain a system able to retrieve several patterns in parallel and the quality of retrieval, encoded by the set of Mattis magnetizations ${m^μ}$, is reminiscent of the correlation among patterns. By tuning the parameters $d$ and $a$, qualitatively different outputs emerge, ranging from highly hierarchical, to symmetric. The investigations are accomplished by means of both numerical simulations and statistical mechanics analysis, properly adapting a novel technique originally developed for spin glasses, i.e. the Hamilton-Jacobi interpolation, with excellent agreement. Finally, we show the thermodynamical equivalence of this associative network with a (restricted) Boltzmann machine and study its stochastic dynamics to obtain even a dynamical picture, perfectly consistent with the static scenario earlier discussed.

preprint2012arXiv

Spin glass polynomial identities from entropic constraints

The core idea of stochastic stability is that thermodynamic observables must be robust under small (random) perturbations of the quenched Gibbs measure. Combining this idea with the cavity field technique, which aims to measure the free energy increment under addition of a spin to the system, we sketch how to write a stochastic stability approach to diluted mean field spin glasses which explicitly gives overlap constraints as the outcome. We then show that, under minimal mathematical assumptions and for gauge invariant systems (namely those with even Ising interactions), it is possible to "reverse" the idea of stochastic stability and use it to derive a broad class of constraints on the unperturbed quenched Gibbs measure. This paper extends a previous study where we showed how to derive (linear) polynomial identities from the "energy" contribution to the free energy, while here we focus on the consequences of "entropic" constraints. Interestingly, in diluted spin glasses, the entropic approach generates more identities than those found by the energy route or other techniques. The two sets of identities become identical on a fully connected topology, where they reduce to the ones derived by Aizenman and Contucci.

preprint2011arXiv

Mean-field cooperativity in chemical kinetics

We consider cooperative reactions and we study the effects of the interaction strength among the system components on the reaction rate, hence realizing a connection between microscopic and macroscopic observables. Our approach is based on statistical mechanics models and it is developed analytically via mean-field techniques. First of all, we show that, when the coupling strength is set positive, the model is able to consistently recover all the various cooperative measures previously introduced, hence obtaining a single unifying framework. Furthermore, we introduce a criterion to discriminate between weak and strong cooperativity, based on a measure of "susceptibility". We also properly extend the model in order to account for multiple attachments phenomena: this is realized by incorporating within the model $p$-body interactions, whose non-trivial cooperative capability is investigated too.

preprint2010arXiv

A Hebbian approach to complex network generation

Through a redefinition of patterns in an Hopfield-like model, we introduce and develop an approach to model discrete systems made up of many, interacting components with inner degrees of freedom. Our approach clarifies the intrinsic connection between the kind of interactions among components and the emergent topology describing the system itself; also, it allows to effectively address the statistical mechanics on the resulting networks. Indeed, a wide class of analytically treatable, weighted random graphs with a tunable level of correlation can be recovered and controlled. We especially focus on the case of imitative couplings among components endowed with similar patterns (i.e. attributes), which, as we show, naturally and without any a-priori assumption, gives rise to small-world effects. We also solve the thermodynamics (at a replica symmetric level) by extending the double stochastic stability technique: free energy, self consistency relations and fluctuation analysis for a picture of criticality are obtained.

preprint2010arXiv

A statistical mechanics approach to autopoietic immune networks

The aim of this work is to try to bridge over theoretical immunology and disordered statistical mechanics. Our long term hope is to contribute to the development of a quantitative theoretical immunology from which practical applications may stem. In order to make theoretical immunology appealing to the statistical physicist audience we are going to work out a research article which, from one side, may hopefully act as a benchmark for future improvements and developments, from the other side, it is written in a very pedagogical way both from a theoretical physics viewpoint as well as from the theoretical immunology one. Furthermore, we have chosen to test our model describing a wide range of features of the adaptive immune response in only a paper: this has been necessary in order to emphasize the benefit available when using disordered statistical mechanics as a tool for the investigation. However, as a consequence, each section is not at all exhaustive and would deserve deep investigation: for the sake of completeness, we restricted details in the analysis of each feature with the aim of introducing a self-consistent model.

preprint2010arXiv

A statistical mechanics approach to Granovetter theory

In this paper we try to bridge breakthroughs in quantitative sociology/econometrics pioneered during the last decades by Mac Fadden, Brock-Durlauf, Granovetter and Watts-Strogats through introducing a minimal model able to reproduce essentially all the features of social behavior highlighted by these authors. Our model relies on a pairwise Hamiltonian for decision maker interactions which naturally extends the multi-populations approaches by shifting and biasing the pattern definitions of an Hopfield model of neural networks. Once introduced, the model is investigated trough graph theory (to recover Granovetter and Watts-Strogats results) and statistical mechanics (to recover Mac-Fadden and Brock-Durlauf results). Due to internal symmetries of our model, the latter is obtained as the relaxation of a proper Markov process, allowing even to study its out of equilibrium properties. The method used to solve its equilibrium is an adaptation of the Hamilton-Jacobi technique recently introduced by Guerra in the spin glass scenario and the picture obtained is the following: just by assuming that the larger the amount of similarities among decision makers, the stronger their relative influence, this is enough to explain both the different role of strong and weak ties in the social network as well as its small world properties. As a result, imitative interaction strengths seem essentially a robust request (enough to break the gauge symmetry in the couplings), furthermore, this naturally leads to a discrete choice modelization when dealing with the external influences and to imitative behavior a la Curie-Weiss as the one introduced by Brock and Durlauf.

preprint2010arXiv

Equilibrium statistical mechanics of bipartite spin systems

Aim of this paper is to give an extensive treatment of bipartite mean field spin systems, ordered and disordered: at first, bipartite ferromagnets are investigated, achieving an explicit expression for the free energy trough a new minimax variational principle. Furthermore via the Hamilton-Jacobi technique the same free energy structure is obtained together with the existence of its thermodynamic limit and the minimax principle is connected to a standard max one. The same is investigated for bipartite spin-glasses: By the Borel-Cantelli lemma a control of the high temperature regime is obtained, while via the double stochastic stability technique we get also the explicit expression of the free energy at the replica symmetric level, uniquely defined by a minimax variational principle again. A general results that states that the free energies of these systems are convex linear combinations of their independent one party model counterparts is achieved too. For the sake of completeness we show further that at zero temperature the replica symmetric entropy becomes negative and, consequently, such a symmetry must be broken. The treatment of the fully broken replica symmetry case is deferred to a forthcoming paper. As a first step in this direction, we start deriving the linear and quadratic constraints to overlap fluctuations.

preprint2010arXiv

Equilibrium statistical mechanics on correlated random graphs

Biological and social networks have recently attracted enormous attention between physicists. Among several, two main aspects may be stressed: A non trivial topology of the graph describing the mutual interactions between agents exists and/or, typically, such interactions are essentially (weighted) imitative. Despite such aspects are widely accepted and empirically confirmed, the schemes currently exploited in order to generate the expected topology are based on a-priori assumptions and in most cases still implement constant intensities for links. Here we propose a simple shift in the definition of patterns in an Hopfield model to convert frustration into dilution: By varying the bias of the pattern distribution, the network topology -which is generated by the reciprocal affinities among agents - crosses various well known regimes (fully connected, linearly diverging connectivity, extreme dilution scenario, no network), coupled with small world properties, which, in this context, are emergent and no longer imposed a-priori. The model is investigated at first focusing on these topological properties of the emergent network, then its thermodynamics is analytically solved (at a replica symmetric level) by extending the double stochastic stability technique, and presented together with its fluctuation theory for a picture of criticality. At least at equilibrium, dilution simply decreases the strength of the coupling felt by the spins, but leaves the paramagnetic/ferromagnetic flavors unchanged. The main difference with respect to previous investigations and a naive picture is that within our approach replicas do not appear: instead of (multi)-overlaps as order parameters, we introduce a class of magnetizations on all the possible sub-graphs belonging to the main one investigated: As a consequence, for these objects a closure for a self-consistent relation is achieved.

preprint2010arXiv

Replica symmetry breaking in mean field spin glasses trough Hamilton-Jacobi technique

During the last years, through the combined effort of the insight, coming from physical intuition and computer simulation, and the exploitation of rigorous mathematical methods, the main features of the mean field Sherrington-Kirkpatrick spin glass model have been firmly established. In particular, it has been possible to prove the existence and uniqueness of the infinite volume limit for the free energy, and its Parisi expression, in terms of a variational principle, involving a functional order parameter. Even the expected property of ultrametricity, for the infinite volume states, seems to be near to a complete proof. The main structural feature of this model, and related models, is the deep phenomenon of spontaneous replica symmetry breaking (RSB), discovered by Parisi many years ago. By expanding on our previous work, the aim of this paper is to investigate a general frame, where replica symmetry breaking is embedded in a kind of mechanical scheme of the Hamilton-Jacobi type. Here, the analog of the "time" variable is a parameter characterizing the strength of the interaction, while the "space" variables rule out quantitatively the broken replica symmetry pattern. Starting from the simple cases, where annealing is assumed, or replica symmetry, we build up a progression of dynamical systems, with an increasing number of space variables, which allow to weaken the effect of the potential in the Hamilton-Jacobi equation, as the level of symmetry braking is increased. This new machinery allows to work out mechanically the general K-step RSB solutions, in a different interpretation with respect to the replica trick, and lightens easily their properties as existence or uniqueness.

preprint2010arXiv

Some thoughts on the ontogenesis in B-cell immune networks

We are interested in modeling theoretical immunology within a statistical mechanics flavor: focusing on the antigen-independent maturation process of B-cells, in this paper we try to revise the problem of self vs non-self discrimination by mature B lymphocytes. We consider only B lymphocytes: despite this is of course an oversimplification, however such a toy model may help to highlight features of their interactions otherwise shadowed by main driven mechanisms due to i.e. helper T-cell signalling. By analyzing possible influences of the ontogenesis of the immune system on the final behavior of B lymphocytes, we try to merge over the purely negative selection mechanism at their birth with the adult self-regulation process. The final goal is a "thermodynamical picture" by which both the scenarios can exist and, actually, be synergically complementary: Trough numerical simulations we impose on a recent scheme for B-cell interactions, that part of self-reactive lymphocytes are killed during the ontogenesis by which two observations stem: At first the so built system is able to show anergy with respect to the previously encountered self even in its mature life, then this naturally leads to an increasing variance (and average) in the connectivity distribution of the resulting idiotypic network. As a consequence, following Varela perspective, this shift may contribute to push to anergy those self-directed cells which are free to explore the body: identifying the latter as the highly connected ones, anergy is imposed even via the B-network regulation, and its strength is influenced by the negative selection.

preprint2009arXiv

A mechanical approach to mean field spin models

Inspired by the bridge pioneered by Guerra among statistical mechanics on lattice and analytical mechanics on 1+1 continuous Euclidean space-time, we built a self-consistent method to solve for the thermodynamics of mean-field models defined on lattice, whose order parameters self average. We show the whole procedure by analyzing in full details the simplest test case, namely the Curie-Weiss model. Further we report some applications also to models whose order parameters do not self-average, by using the Sherrington-Kirkpatrick spin glass as a guide.

preprint2009arXiv

The replica symmetric behavior of the analogical neural network

In this paper we continue our investigation of the analogical neural network, paying interest to its replica symmetric behavior in the absence of external fields of any type. Bridging the neural network to a bipartite spin-glass, we introduce and apply a new interpolation scheme to its free energy that naturally extends the interpolation via cavity fields or stochastic perturbations to these models. As a result we obtain the free energy of the system as a sum rule, which, at least at the replica symmetric level, can be solved exactly. As a next step we study its related self-consistent equations for the order parameters and their rescaled fluctuations, found to diverge on the same critical line of the standard Amit-Gutfreund-Sompolinsky theory.

preprint2009arXiv

Toward a quantitative approach to migrants integration

Migration phenomena and all the related issues, like integration of different social groups, are intrinsically complex problems since they strongly depend on several competitive mechanisms as economic factors, cultural differences and many others. By identifying a few essential assumptions, and using the statistical mechanics of complex systems, we propose a novel quantitative approach that provides a minimal theory for those phenomena. We show that the competitive interactions in decision making among a population of $N$ host citizens and $P$ immigrants, a bi-partite spin-glass, give rise to a "social consciousness" inside the host community in the sense of the associative memory of neural networks. The theory leads to a natural quantitative definition of migrant's "integration" inside the community. From the technical point of view this minimal picture assumes, as control parameters, only general notions like strength of the random interactions, the ratio among the two party sizes and the cultural influence. Few steps forward, toward more refined models, which include some structure on the random interaction topology (as dilution to avoid the plain mean field approach) and correlations of experiences felt among the two parties (biasing the distribution of the coupling) are discussed at the end, where we show the robustness of our approach.

preprint2006arXiv

Overlap Fluctuations from Random Overlap Structures

We investigate overlap fluctuations of the Sherrington-Kirkpatrick mean field spin glass model in the framework of the Random Over- lap Structure (ROSt). The concept of ROSt has been introduced recently by Aizenman and coworkers, who developed a variational approach to the Sherrington-Kirkpatrick model. We propose here an iterative procedure to show that, in the so-called Boltzmann ROSt, Aizenman-Contucci (AC) polynomials naturally arise for almost all values of the inverse temperature (not in average over some interval only). The same results can be obtained in any ROSt, including therefore the Parisi structure. The AC polynomials impose restric- tions on the overlap fluctuations in agreement with Parisi theory.