Researcher profile

Adriano Barra

Adriano Barra contributes to research discovery and scholarly infrastructure.

ResearcherAffiliation not importedOpen to collaborate

Trust snapshot

Quick read

Trust 21 - EmergingVerification L1Unclaimed author
20works
0followers
14topics
4close collaborators

Actions

Decide how to stay connected

Follow researcher0

Identity and collaboration

How to connect with this researcher

Claiming links this public author record to a researcher profile and unlocks direct collaboration workflows.

Log in to claim

Direct collaboration

Open a focused conversation when the fit is right

Claim this author entity first to unlock direct invitations.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

20 published item(s)

preprint2026arXiv

Serial vs parallel recall in the Blume-Every-Griffiths neural networks

Fully connected Blume-Emery-Griffiths neural networks performing pattern recognition and associative memory have been heuristically studied in the past (mainly via the replica trick and under the replica symmetric assumption) as generalization of the standard Hopfield reference. In these notes, at first, by relying upon Guerra interpolation, we re-obtain the existing picture rigorously. Next we show that, due to dilution in the patterns, these networks are able to switch from serial recall (where one pattern is retrieved per time) to parallel recall (where several patterns are retrieved at once) and the larger the dilution, the stronger this emerging multi-tasking capability. In particular, we inspect the regimes of mild dilution (where solely a low storage of pattern can be enabled) and extreme dilution (where a medium storage of patterns can be sustained) separately as they give rise to different outcomes: the former displays hierarchical recall (distributing the amplitudes of the retrieved signals with different amplitudes), the latter -- instead -- performs a equal-strength recall (where a O(1) fraction of all the patterns is simultaneously retrieved with the same amplitude per pattern). Finally, in order to implement graded responses in the neurons, variations on theme obtained by enlarging the possible values of neural activity these neurons may sustain are also discussed generalizing the Ghatak-Sherrington model for inverse freezing in Hebbian terms.

preprint2022arXiv

Pavlov Learning Machines

As well known, Hebb's learning traces its origin in Pavlov's Classical Conditioning, however, while the former has been extensively modelled in the past decades (e.g., by Hopfield model and countless variations on theme), as for the latter modelling has remained largely unaddressed so far; further, a bridge between these two pillars is totally lacking. The main difficulty towards this goal lays in the intrinsically different scales of the information involved: Pavlov's theory is about correlations among \emph{concepts} that are (dynamically) stored in the synaptic matrix as exemplified by the celebrated experiment starring a dog and a ring bell; conversely, Hebb's theory is about correlations among pairs of adjacent neurons as summarized by the famous statement {\em neurons that fire together wire together}. In this paper we rely on stochastic-process theory and model neural and synaptic dynamics via Langevin equations, to prove that -- as long as we keep neurons' and synapses' timescales largely split -- Pavlov mechanism spontaneously takes place and ultimately gives rise to synaptic weights that recover the Hebbian kernel.

preprint2022arXiv

Recurrent neural networks that generalize from examples and optimize by dreaming

The gap between the huge volumes of data needed to train artificial neural networks and the relatively small amount of data needed by their biological counterparts is a central puzzle in machine learning. Here, inspired by biological information-processing, we introduce a generalized Hopfield network where pairwise couplings between neurons are built according to Hebb's prescription for on-line learning and allow also for (suitably stylized) off-line sleeping mechanisms. Moreover, in order to retain a learning framework, here the patterns are not assumed to be available, instead, we let the network experience solely a dataset made of a sample of noisy examples for each pattern. We analyze the model by statistical-mechanics tools and we obtain a quantitative picture of its capabilities as functions of its control parameters: the resulting network is an associative memory for pattern recognition that learns from examples on-line, generalizes and optimizes its storage capacity by off-line sleeping. Remarkably, the sleeping mechanisms always significantly reduce (up to $\approx 90\%$) the dataset size required to correctly generalize, further, there are memory loads that are prohibitive to Hebbian networks without sleeping (no matter the size and quality of the provided examples), but that are easily handled by the present "rested" neural networks.

preprint2021arXiv

Towards the development of human immune-system-on-a-chip platforms

Organ-on-a-chip (OoCs) platforms could revolutionize drug discovery and might ultimately become essential tools for precision therapy. Although many single-organ and interconnected systems have been described, the immune system has been comparatively neglected, despite its pervasive role in the body and the trend towards newer therapeutic products (i.e., complex biologics, nanoparticles, immune checkpoint inhibitors, and engineered T cells) that often cause, or are based on, immune reactions. In this review, we recapitulate some distinctive features of the immune system before reviewing microfluidic devices that mimic lymphoid organs or other organs and/or tissues with an integrated immune system component.

preprint2020arXiv

Annealing and replica-symmetry in Deep Boltzmann Machines

In this paper we study the properties of the quenched pressure of a multi-layer spin-glass model (a deep Boltzmann Machine in artificial intelligence jargon) whose pairwise interactions are allowed between spins lying in adjacent layers and not inside the same layer nor among layers at distance larger than one. We prove a theorem that bounds the quenched pressure of such a K-layer machine in terms of K Sherrington-Kirkpatrick spin glasses and use it to investigate its annealed region. The replica-symmetric approximation of the quenched pressure is identified and its relation to the annealed one is considered. The paper also presents some observation on the model's architectural structure related to machine learning. Since escaping the annealed region is mandatory for a meaningful training, by squeezing such region we obtain thermodynamical constraints on the form factors. Remarkably, its optimal escape is achieved by requiring the last layer to scale sub-linearly in the network size.

preprint2020arXiv

Generalized Guerra's interpolation schemes for dense associative neural networks

In this work we develop analytical techniques to investigate a broad class of associative neural networks set in the high-storage regime. These techniques translate the original statistical-mechanical problem into an analytical-mechanical one which implies solving a set of partial differential equations, rather than tackling the canonical probabilistic route. We test the method on the classical Hopfield model - where the cost function includes only two-body interactions (i.e., quadratic terms) - and on the "relativistic" Hopfield model - where the (expansion of the) cost function includes p-body (i.e., of degree p) contributions. Under the replica symmetric assumption, we paint the phase diagrams of these models by obtaining the explicit expression of their free energy as a function of the model parameters (i.e., noise level and memory storage). Further, since for non-pairwise models ergodicity breaking is non necessarily a critical phenomenon, we develop a fluctuation analysis and find that criticality is preserved in the relativistic model.

preprint2020arXiv

Replica symmetry breaking in neural networks: a few steps toward rigorous results

In this paper we adapt the broken replica interpolation technique (developed by Francesco Guerra to deal with the Sherrington-Kirkpatrick model, namely a pairwise mean-field spin-glass whose couplings are i.i.d. standard Gaussian variables) in order to work also with the Hopfield model (i.e., a pairwise mean-field neural-network whose couplings are drawn according to Hebb's learning rule): this is accomplished by grafting Guerra's telescopic averages on the transport equation technique, recently developed by some of the Authors. As an overture, we apply the technique to solve the Sherrington-Kirkpatrick model with i.i.d. Gaussian couplings centered at $J_0$ and with finite variance $J$; the mean $J_0$ plays the role of a signal to be detected in a noisy environment tuned by $J$, hence making this model a natural test-case to be investigated before addressing the Hopfield model. For both the models, an explicit expression of their quenched free energy in terms of their natural order parameters is obtained at the K-th step (K arbitrary, but finite) of replica-symmetry-breaking. In particular, for the Hopfield model, by assuming that the overlaps respect Parisi's decomposition (following the ziqqurat ansatz) and that the Mattis magnetization is self-averaging, we recover previous results obtained via replica-trick by Amit, Crisanti and Gutfreund (1RSB) and by Steffan and Kühn (2RSB).

preprint2019arXiv

A statistical-inference approach to reconstruct inter-cellular interactions in cell-migration experiments

Migration of cells can be characterized by two, prototypical types of motion: individual and collective migration. We propose a statistical-inference approach designed to detect the presence of cell-cell interactions that give rise to collective behaviors in cell-motility experiments. Such inference method has been first successfully tested on synthetic motional data, and then applied to two experiments. In the first experiment, cell migrate in a wound-healing model: when applied to this experiment, the inference method predicts the existence of cell-cell interactions, correctly mirroring the strong intercellular contacts which are present in the experiment. In the second experiment, dendritic cells migrate in a chemokine gradient. Our inference analysis does not provide evidence for interactions, indicating that cells migrate by sensing independently the chemokine source. According to this prediction, we speculate that mature dendritic cells disregard inter-cellular signals that could otherwise delay their arrival to lymph vessels.

preprint2019arXiv

Neural networks with redundant representation: detecting the undetectable

We consider a three-layer Sejnowski machine and show that features learnt via contrastive divergence have a dual representation as patterns in a dense associative memory of order P=4. The latter is known to be able to Hebbian-store an amount of patterns scaling as N^{P-1}, where N denotes the number of constituting binary neurons interacting P-wisely. We also prove that, by keeping the dense associative network far from the saturation regime (namely, allowing for a number of patterns scaling only linearly with N, while P>2) such a system is able to perform pattern recognition far below the standard signal-to-noise threshold. In particular, a network with P=4 is able to retrieve information whose intensity is O(1) even in the presence of a noise O(\sqrt{N}) in the large N limit. This striking skill stems from a redundancy representation of patterns -- which is afforded given the (relatively) low-load information storage -- and it contributes to explain the impressive abilities in pattern recognition exhibited by new-generation neural networks. The whole theory is developed rigorously, at the replica symmetric level of approximation, and corroborated by signal-to-noise analysis and Monte Carlo simulations.

preprint2018arXiv

Dreaming neural networks: rigorous results

Recently a daily routine for associative neural networks has been proposed: the network Hebbian-learns during the awake state (thus behaving as a standard Hopfield model), then, during its sleep state, optimizing information storage, it consolidates pure patterns and removes spurious ones: this forces the synaptic matrix to collapse to the projector one (ultimately approaching the Kanter-Sompolinksy model). This procedure keeps the learning Hebbian-based (a biological must) but, by taking advantage of a (properly stylized) sleep phase, still reaches the maximal critical capacity (for symmetric interactions). So far this emerging picture (as well as the bulk of papers on unlearning techniques) was supported solely by mathematically-challenging routes, e.g. mainly replica-trick analysis and numerical simulations: here we rely extensively on Guerra's interpolation techniques developed for neural networks and, in particular, we extend the generalized stochastic stability approach to the case. Confining our description within the replica symmetric approximation (where the previous ones lie), the picture painted regarding this generalization (and the previously existing variations on theme) is here entirely confirmed. Further, still relying on Guerra's schemes, we develop a systematic fluctuation analysis to check where ergodicity is broken (an analysis entirely absent in previous investigations). We find that, as long as the network is awake, ergodicity is bounded by the Amit-Gutfreund-Sompolinsky critical line (as it should), but, as the network sleeps, sleeping destroys spin glass states by extending both the retrieval as well as the ergodic region: after an entire sleeping session the solely surviving regions are retrieval and ergodic ones and this allows the network to achieve the perfect retrieval regime (the number of storable patterns equals the number of neurons in the network).

preprint2013arXiv

Collective behaviours: from biochemical kinetics to electronic circuits

In this work we aim to highlight a close analogy between cooperative behaviors in chemical kinetics and cybernetics; this is realized by using a common language for their description, that is mean-field statistical mechanics. First, we perform a one-to-one mapping between paradigmatic behaviors in chemical kinetics (i.e., non-cooperative, cooperative, ultra-sensitive, anti-cooperative) and in mean-field statistical mechanics (i.e., paramagnetic, high and low temperature ferromagnetic, anti-ferromagnetic). Interestingly, the statistical mechanics approach allows a unified, broad theory for all scenarios and, in particular, Michaelis-Menten, Hill and Adair equations are consistently recovered. This framework is then tested against experimental biological data with an overall excellent agreement. One step forward, we consistently read the whole mapping from a cybernetic perspective, highlighting deep structural analogies between the above-mentioned kinetics and fundamental bricks in electronics (i.e. operational amplifiers, flashes, flip-flops), so to build a clear bridge linking biochemical kinetics and cybernetics.

preprint2013arXiv

Immune networks: multi-tasking capabilities at medium load

Associative network models featuring multi-tasking properties have been introduced recently and studied in the low load regime, where the number $P$ of simultaneously retrievable patterns scales with the number $N$ of nodes as $P\sim \log N$. In addition to their relevance in artificial intelligence, these models are increasingly important in immunology, where stored patterns represent strategies to fight pathogens and nodes represent lymphocyte clones. They allow us to understand the crucial ability of the immune system to respond simultaneously to multiple distinct antigen invasions. Here we develop further the statistical mechanical analysis of such systems, by studying the medium load regime, $P \sim N^δ$ with $δ\in (0,1]$. We derive three main results. First, we reveal the nontrivial architecture of these networks: they exhibit a high degree of modularity and clustering, which is linked to their retrieval abilities. Second, by solving the model we demonstrate for $δ<1$ the existence of large regions in the phase diagram where the network can retrieve all stored patterns simultaneously. Finally, in the high load regime $δ=1$ we find that the system behaves as a spin glass, suggesting that finite-connectivity frameworks are required to achieve effective retrieval.

preprint2012arXiv

A Solvable Mean Field Model of a Gaussian Spin Glass

We introduce a mean field spin glass model with gaussian distribuited spins and pairwise interactions, whose couplings are drawn randomly from a normal gaussian distribution too. We completely control the main thermodynamical properties of the model (free energy, phase diagram, fluctuations theory) in the whole phase space. In particular we prove that in thermodynamic limit the free energy equals its replica symmetric expression.

preprint2012arXiv

Analogue neural networks on correlated random graphs

We consider a generalization of the Hopfield model, where the entries of patterns are Gaussian and diluted. We focus on the high-storage regime and we investigate analytically the topological properties of the emergent network, as well as the thermodynamic properties of the model. We find that, by properly tuning the dilution in the pattern entries, the network can recover different topological regimes characterized by peculiar scalings of the average coordination number with respect to the system size. The structure is also shown to exhibit a large degree of cliquishness, even when very sparse. Moreover, we obtain explicitly the replica symmetric free energy and the self-consistency equations for the overlaps (order parameters of the theory), which turn out to be classical weighted sums of &#39;sub-overlaps&#39; defined on all possible sub-graphs. Finally, a study of criticality is performed through a small-overlap expansion of the self-consistencies and through a whole fluctuation theory developed for their rescaled correlations: Both approaches show that the net effect of dilution in pattern entries is to rescale the critical noise level at which ergodicity breaks down.

preprint2012arXiv

Anergy in self-directed B lymphocytes from a statistical mechanics perspective

The ability of the adaptive immune system to discriminate between self and non-self mainly stems from the ontogenic clonal-deletion of lymphocytes expressing strong binding affinity with self-peptides. However, some self-directed lymphocytes may evade selection and still be harmless due to a mechanism called clonal anergy. As for B lymphocytes, two major explanations for anergy developed over three decades: according to &#34;Varela theory&#34;, it stems from a proper orchestration of the whole B-repertoire, in such a way that self-reactive clones, due to intensive interactions and feed-back from other clones, display more inertia to mount a response. On the other hand, according to the `two-signal model&#34;, which has prevailed nowadays, self-reacting cells are not stimulated by helper lymphocytes and the absence of such signaling yields anergy. The first result we present, achieved through disordered statistical mechanics, shows that helper cells do not prompt the activation and proliferation of a certain sub-group of B cells, which turn out to be just those broadly interacting, hence it merges the two approaches as a whole (in particular, Varela theory is then contained into the two-signal model). As a second result, we outline a minimal topological architecture for the B-world, where highly connected clones are self-directed as a natural consequence of an ontogenetic learning; this provides a mathematical framework to Varela perspective. As a consequence of these two achievements, clonal deletion and clonal anergy can be seen as two inter-playing aspects of the same phenomenon too.

preprint2012arXiv

Can persistent Epstein-Barr virus infection induce Chronic Fatigue Syndrome as a Pavlov reflex of the immune response?

Chronic Fatigue Syndrome is a protracted illness condition (lasting even years) appearing with strong flu symptoms and systemic defiances by the immune system. Here, by means of statistical mechanics techniques, we study the most widely accepted picture for its genesis, namely a persistent acute mononucleosis infection, and we show how such infection may drive the immune system toward an out-of-equilibrium metastable state displaying chronic activation of both humoral and cellular responses (a state of full inflammation without a direct &#34;causes-effect&#34; reason). By exploiting a bridge with a neural scenario, we mirror killer lymphocytes $T_K$ and $B$ cells to neurons and helper lymphocytes $T_{H_1},T_{H_2}$ to synapses, hence showing that the immune system may experience the Pavlov conditional reflex phenomenon: if the exposition to a stimulus (EBV antigens) lasts for too long, strong internal correlations among $B,T_K,T_H$ may develop ultimately resulting in a persistent activation even though the stimulus itself is removed. These outcomes are corroborated by several experimental findings.

preprint2012arXiv

On the equivalence of Hopfield Networks and Boltzmann Machines

A specific type of neural network, the Restricted Boltzmann Machine (RBM), is implemented for classification and feature detection in machine learning. RBM is characterized by separate layers of visible and hidden units, which are able to learn efficiently a generative model of the observed data. We study a &#34;hybrid&#34; version of RBM&#39;s, in which hidden units are analog and visible units are binary, and we show that thermodynamics of visible units are equivalent to those of a Hopfield network, in which the N visible units are the neurons and the P hidden units are the learned patterns. We apply the method of stochastic stability to derive the thermodynamics of the model, by considering a formal extension of this technique to the case of multiple sets of stored patterns, which may act as a benchmark for the study of correlated sets. Our results imply that simulating the dynamics of a Hopfield network, requiring the update of N neurons and the storage of N(N-1)/2 synapses, can be accomplished by a hybrid Boltzmann Machine, requiring the update of N+P neurons but the storage of only NP synapses. In addition, the well known glass transition of the Hopfield network has a counterpart in the Boltzmann Machine: It corresponds to an optimum criterion for selecting the relative sizes of the hidden and visible layers, resolving the trade-off between flexibility and generality of the model. The low storage phase of the Hopfield model corresponds to few hidden units and hence a overly constrained RBM, while the spin-glass phase (too many hidden units) corresponds to unconstrained RBM prone to overfitting of the observed data.

preprint2012arXiv

Parallel retrieval of correlated patterns

In this work, we first revise some extensions of the standard Hopfield model in the low storage limit, namely the correlated attractor case and the multitasking case recently introduced by the authors. The former case is based on a modification of the Hebbian prescription, which induces a coupling between consecutive patterns and this effect is tuned by a parameter $a$. In the latter case, dilution is introduced in pattern entries, in such a way that a fraction $d$ of them is blank. Then, we merge these two extensions to obtain a system able to retrieve several patterns in parallel and the quality of retrieval, encoded by the set of Mattis magnetizations ${m^μ}$, is reminiscent of the correlation among patterns. By tuning the parameters $d$ and $a$, qualitatively different outputs emerge, ranging from highly hierarchical, to symmetric. The investigations are accomplished by means of both numerical simulations and statistical mechanics analysis, properly adapting a novel technique originally developed for spin glasses, i.e. the Hamilton-Jacobi interpolation, with excellent agreement. Finally, we show the thermodynamical equivalence of this associative network with a (restricted) Boltzmann machine and study its stochastic dynamics to obtain even a dynamical picture, perfectly consistent with the static scenario earlier discussed.

preprint2011arXiv

Mean-field cooperativity in chemical kinetics

We consider cooperative reactions and we study the effects of the interaction strength among the system components on the reaction rate, hence realizing a connection between microscopic and macroscopic observables. Our approach is based on statistical mechanics models and it is developed analytically via mean-field techniques. First of all, we show that, when the coupling strength is set positive, the model is able to consistently recover all the various cooperative measures previously introduced, hence obtaining a single unifying framework. Furthermore, we introduce a criterion to discriminate between weak and strong cooperativity, based on a measure of &#34;susceptibility&#34;. We also properly extend the model in order to account for multiple attachments phenomena: this is realized by incorporating within the model $p$-body interactions, whose non-trivial cooperative capability is investigated too.

preprint2010arXiv

Some thoughts on the ontogenesis in B-cell immune networks

We are interested in modeling theoretical immunology within a statistical mechanics flavor: focusing on the antigen-independent maturation process of B-cells, in this paper we try to revise the problem of self vs non-self discrimination by mature B lymphocytes. We consider only B lymphocytes: despite this is of course an oversimplification, however such a toy model may help to highlight features of their interactions otherwise shadowed by main driven mechanisms due to i.e. helper T-cell signalling. By analyzing possible influences of the ontogenesis of the immune system on the final behavior of B lymphocytes, we try to merge over the purely negative selection mechanism at their birth with the adult self-regulation process. The final goal is a &#34;thermodynamical picture&#34; by which both the scenarios can exist and, actually, be synergically complementary: Trough numerical simulations we impose on a recent scheme for B-cell interactions, that part of self-reactive lymphocytes are killed during the ontogenesis by which two observations stem: At first the so built system is able to show anergy with respect to the previously encountered self even in its mature life, then this naturally leads to an increasing variance (and average) in the connectivity distribution of the resulting idiotypic network. As a consequence, following Varela perspective, this shift may contribute to push to anergy those self-directed cells which are free to explore the body: identifying the latter as the highly connected ones, anergy is imposed even via the B-network regulation, and its strength is influenced by the negative selection.