Source author record

Chiara Cammarota

Chiara Cammarota appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

16works
8topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

16 published item(s)

preprint2020arXiv

Complex Dynamics in Simple Neural Networks: Understanding Gradient Flow in Phase Retrieval

Despite the widespread use of gradient-based algorithms for optimizing high-dimensional non-convex functions, understanding their ability of finding good minima instead of being trapped in spurious ones remains to a large extent an open problem. Here we focus on gradient flow dynamics for phase retrieval from random measurements. When the ratio of the number of measurements over the input dimension is small the dynamics remains trapped in spurious minima with large basins of attraction. We find analytically that above a critical ratio those critical points become unstable developing a negative direction toward the signal. By numerical experiments we show that in this regime the gradient flow algorithm is not trapped; it drifts away from the spurious critical points along the unstable direction and succeeds in finding the global minimum. Using tools from statistical physics we characterize this phenomenon, which is related to a BBP-type transition in the Hessian of the spurious minima.

preprint2020arXiv

Dynamical Mean-Field Theory and Aging Dynamics

Dynamical Mean-Field Theory (DMFT) replaces the many-body dynamical problem with one for a single degree of freedom in a thermal bath whose features are determined self-consistently. By focusing on models with soft disordered $p$-spin interactions, we show how to incorporate the mean-field theory of aging within dynamical mean-field theory. We study cases with only one slow time-scale, corresponding statically to the one-step replica symmetry breaking (1RSB) phase, and cases with an infinite number of slow time-scales, corresponding statically to the full replica symmetry breaking (FRSB) phase. For the former, we show that the effective temperature of the slow degrees of freedom is fixed by requiring critical dynamical behavior on short time-scales, i.e. marginality. For the latter, we find that aging on an infinite number of slow time-scales is governed by a stochastic equation where the clock for dynamical evolution is fixed by the change of effective temperature, hence obtaining a dynamical derivation of the stochastic equation at the basis of the FRSB phase. Our results extend the realm of the mean-field theory of aging to all situations where DMFT holds.

preprint2020arXiv

How to iron out rough landscapes and get optimal performances: Averaged Gradient Descent and its application to tensor PCA

In many high-dimensional estimation problems the main task consists in minimizing a cost function, which is often strongly non-convex when scanned in the space of parameters to be estimated. A standard solution to flatten the corresponding rough landscape consists in summing the losses associated to different data points and obtain a smoother empirical risk. Here we propose a complementary method that works for a single data point. The main idea is that a large amount of the roughness is uncorrelated in different parts of the landscape. One can then substantially reduce the noise by evaluating an empirical average of the gradient obtained as a sum over many random independent positions in the space of parameters to be optimized. We present an algorithm, called Averaged Gradient Descent, based on this idea and we apply it to tensor PCA, which is a very hard estimation problem. We show that Averaged Gradient Descent over-performs physical algorithms such as gradient descent and approximate message passing and matches the best algorithmic thresholds known so far, obtained by tensor unfolding and methods based on sum-of-squares.

preprint2020arXiv

Marvels and Pitfalls of the Langevin Algorithm in Noisy High-dimensional Inference

Gradient-descent-based algorithms and their stochastic versions have widespread applications in machine learning and statistical inference. In this work we perform an analytic study of the performances of one of them, the Langevin algorithm, in the context of noisy high-dimensional inference. We employ the Langevin algorithm to sample the posterior probability measure for the spiked matrix-tensor model. The typical behaviour of this algorithm is described by a system of integro-differential equations that we call the Langevin state evolution, whose solution is compared with the one of the state evolution of approximate message passing (AMP). Our results show that, remarkably, the algorithmic threshold of the Langevin algorithm is sub-optimal with respect to the one given by AMP. We conjecture this phenomenon to be due to the residual glassiness present in that region of parameters. Finally we show how a landscape-annealing protocol, that uses the Langevin algorithm but violate the Bayes-optimality condition, can approach the performance of AMP.

preprint2020arXiv

Opinion dynamics with emergent collective memory: the impact of a long and heterogeneous news history

In modern society people are being exposed to numerous information, with some of them being frequently repeated or more disruptive than others. In this paper we use a model of opinion dynamics to study how this news impact the society. In particular, our study aims to explain how the exposure of the society to certain events deeply change people's perception of the present and future. The evolution of opinions which we consider is influenced both by external information and the pressure of the society. The latter includes imitation, differentiation, homophily and its opposite, xenophobia. The combination of these ingredients gives rise to a collective memory effect, which is triggered by external information. In this paper we focus our attention on how this memory arises when the order of appearance of external news is random. We will show which characteristics a piece of news needs to have in order to be embedded in the society's memory. We will also provide an analytical way to measure how many information a society can remember when an extensive number of news items is presented. Finally we will show that, when a certain piece of news is present in the society's history, even a distorted version of it is sufficient to trigger the memory of the originally stored information.

preprint2020arXiv

Opinion dynamics with memory: how a society is shaped by its own past

In order to understand the development of common orientation of opinions in the modern world we propose a model of a society described as a large collection of agents that exchange their expressed opinions under the influence of their mutual interactions and external events. In particular we introduce an interaction bias which creates a collective memory effect such that the society is able to store and recall information coming from several external signals. Our model shows how the inner structure of the society and its future reactions can be shaped by its own history. We will provide an analytical explanation of how this might occur and we will show the emergent similarity between the reaction of a society modelled in this way and the Hopfield mechanism for information retrieval.

preprint2020arXiv

Who is Afraid of Big Bad Minima? Analysis of Gradient-Flow in a Spiked Matrix-Tensor Model

Gradient-based algorithms are effective for many machine learning tasks, but despite ample recent effort and some progress, it often remains unclear why they work in practice in optimising high-dimensional non-convex functions and why they find good minima instead of being trapped in spurious ones. Here we present a quantitative theory explaining this behaviour in a spiked matrix-tensor model. Our framework is based on the Kac-Rice analysis of stationary points and a closed-form analysis of gradient-flow originating from statistical physics. We show that there is a well defined region of parameters where the gradient-flow algorithm finds a good global minimum despite the presence of exponentially many spurious local minima. We show that this is achieved by surfing on saddles that have strong negative direction towards the global minima, a phenomenon that is connected to a BBP-type threshold in the Hessian describing the critical points of the landscapes.

preprint2019arXiv

Numerical implementation of dynamical mean field theory for disordered systems: application to the Lotka-Volterra model of ecosystems

Dynamical mean field theory (DMFT) is a tool that allows to analyze the stochastic dynamics of $N$ interacting degrees of freedom in terms of a self-consistent $1$-body problem. In this work, focusing on models of ecosystems, we present the derivation of DMFT through the dynamical cavity method, and we develop a method for solving it numerically. Our numerical procedure can be applied to a large variety of systems for which DMFT holds. We implement and test it for the generalized random Lotka-Volterra model, and show that complex dynamical regimes characterized by chaos and aging can be captured and studied by this framework.

preprint2014arXiv

Spontaneous energy-barrier formation in an entropy-driven glassy dynamics

The description of activated relaxation of glassy systems in the multidimensional configurational space is a long-standing open problem. We develop a phenomenological description of the out-of-equilibrium dynamics of a model with a rough potential energy landscape and we analyse it both numerically and analytically. The model provides an example of dynamics where typical relaxation channels go over finite potential energy barriers despite the presence of less-energy-demanding escaping paths in configurational space; we expect this phenomenon to be also relevant in the thermally activated regime of realistic models of glass-formers. In this case, we found that typical dynamical paths episodically reach an high fixed threshold energy unexpectedly giving rise to a simple thermally activated aging phenomenology. In order to unveil this peculiar aging behavior we introduce a novel description of the dynamics in terms of spontaneously emerging dynamical basins.

preprint2013arXiv

Random-field-like criticality in glass-forming liquids

We introduce an approach to derive an effective scalar field theory for the glass transition; the fluctuating field is the overlap between equilibrium configurations. We apply it to the case of constrained liquids for which the introduction of a conjugate source to the overlap field was predicted to lead to an equilibrium critical point. We show that the long-distance physics in the vicinity of this critical point is in the same universality class as that of a paradigmatic disordered model: the random-field Ising model. The quenched disorder is provided here by a reference equilibrium liquid configuration. We discuss to what extent this field-theoretical description and the mapping to the random field Ising model hold in the whole supercooled liquid regime, in particular near the glass transition.

preprint2012arXiv

A general approach to systems with randomly pinned particles: unfolding and clarifying the Random Pinning Glass Transition

Pinning a fraction of particles from an equilibrium configuration in supercooled liquids has been recently proposed as a way to induce a new kind of glass transition, the Random Pinning Glass Transition (RPGT). The RPGT has been predicted to share some features of standard thermodynamic glass transitions and usual first order ones. Thanks to its special nature, the approach and the study of the RPGT appears to be a fairly reachable task compared to the daunting problem of inspecting standard glass transitions. In this Letter we generalize the pinning particle procedure. We study a mean-field system where the pinned configuration is extracted from the equilibrium distribution at temperature $T'$ and the thermodynamics of the non pinned particles is observed at a lower temperature $T$. A more complicated physics emerges from this generalization eventually clarifying the origin and the peculiar characteristics of the RPGT.

preprint2012arXiv

Patch-repetition correlation length in glassy systems

We obtain the patch-repetition entropy Sigma within the Random First Order Transition theory (RFOT) and for the square plaquette system, a model related to the dynamical facilitation theory of glassy dynamics. We find that in both cases the entropy of patches of linear size l, Sigma(l), scales as s_c l^d+A l^{d-1} down to length-scales of the order of one, where A is a positive constant, s_c is the configurational entropy density and d the spatial dimension. In consequence, the only meaningful length that can be defined from patch-repetition is the cross-over length xi=A/s_c. We relate xi to the typical length-scales already discussed in the literature and show that it is always of the order of the largest static length. Our results provide new insights, which are particularly relevant for RFOT theory, on the possible real space structure of super-cooled liquids. They suggest that this structure differs from a mosaic of different patches having roughly the same size.

preprint2012arXiv

Random Pinning Glass Transition: Hallmarks, Mean-Field Theory and Renormalization Group Analysis

We present a detailed analysis of glass transitions induced by pinning particles at random from an equilibrium configuration. We first develop a mean-field analysis based on the study of p-spin spherical disordered models and then obtain the three dimensional critical behavior by the Migdal-Kadanoff real space renormalization group method. We unveil the important physical differences with the case in which particles are pinned from a random (or very high temperature) configuration. We contrast the pinning particles approach to the ones based on biasing dynamical trajectories with respect to their activity and on coupling to equilibrium configurations. Finally, we discuss numerical and experimental tests.

preprint2011arXiv

Aging and relaxation near Random Pinning Glass Transitions

Pinning particles at random in supercooled liquids is a promising route to make substantial progress on the glass transition problem. Here we develop a mean-field theory by studying the equilibrium and non-equilibrium dynamics of the spherical p-spin model in presence of a fraction c of pinned spins. Our study shows the existence of two dynamic critical lines: one corresponding to usual Mode Coupling transitions and the other one to dynamic spinodal transitions. Quenches in the portion of the c - T phase diagram delimited by those two lines leads to aging. By extending our results to finite dimensional systems we predict non-interrupted aging only for quenches on the ideal glass transition line and two very different types of equilibrium relaxations for quenches below and above it.

preprint2011arXiv

Ideal Glass Transitions by Random Pinning

We study the effect of freezing the positions of a fraction $c$ of particles from an equilibrium configuration of a supercooled liquid at a temperature $T$. We show that within the Random First-Order Transition theory pinning particles leads to an ideal glass transition for a critical fraction $c=c_{K}(T)$ even for moderate super-cooling, e.g. close to the Mode-Coupling transition temperature. We first derive the phase diagram in the $T-c$ plane by mean field approximations. Then, by applying a real-space renormalization group method, we obtain the critical properties for $|c-c_{K}(T)|\rightarrow 0$, in particular the divergence of length and time scales. These are dominated by two zero-temperature fixed points. We also show that for $c=c_{K}(T)$ the typical distance between frozen particles is related to the static point-to-set lengthscale of the unconstrained liquid. We discuss what are the main differences when particles are frozen in other geometries and not from an equilibrium configuration. Finally, we explain why the glass transition induced by freezing particles provides a new and very promising avenue of research to probe the glassy state and ascertain, or disprove, the validity of the theories of the glass transition.

preprint2010arXiv

Renormalization group analysis of the random first order transition

We consider the approach describing glass formation in liquids as a progressive trapping in an exponentially large number of metastable states. To go beyond the mean-field setting, we provide a real-space renormalization group (RG) analysis of the associated replica free-energy functional. The present approximation yields in finite dimensions an ideal glass transition similar to that found in mean field. However, we find that along the RG flow the properties associated with metastable glassy states, such as the configurational entropy, are only defined up to a characteristic length scale that diverges as one approaches the ideal glass transition. The critical exponents characterizing the vicinity of the transition are the usual ones associated with a first-order discontinuity fixed point.