Source author record

Pietro Rotondo

Pietro Rotondo appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

10works
9topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

10 published item(s)

preprint2020arXiv

Intrinsic dimension estimation for locally undersampled data

High-dimensional data are ubiquitous in contemporary science and finding methods to compress them is one of the primary goals of machine learning. Given a dataset lying in a high-dimensional space (in principle hundreds to several thousands of dimensions), it is often useful to project it onto a lower-dimensional manifold, without loss of information. Identifying the minimal dimension of such manifold is a challenging problem known in the literature as intrinsic dimension estimation (IDE). Traditionally, most IDE algorithms are either based on multiscale principal component analysis (PCA) or on the notion of correlation dimension (and more in general on k-nearest-neighbors distances). These methods are affected, in different ways, by a severe curse of dimensionality. In particular, none of the existing algorithms can provide accurate ID estimates in the extreme locally undersampled regime, i.e. in the limit where the number of samples in any local patch of the manifold is less than (or of the same order of) the ID of the dataset. Here we introduce a new ID estimator that leverages on simple properties of the tangent space of a manifold to overcome these shortcomings. The method is based on the full correlation integral, going beyond the limit of small radius used for the estimation of the correlation dimension. Our estimator alleviates the extreme undersampling problem, intractable with other methods. Based on this insight, we explore a multiscale generalization of the algorithm. We show that it is capable of (i) identifying multiple dimensionalities in a dataset, and (ii) providing accurate estimates of the ID of extremely curved manifolds. In particular, we test the method on manifolds generated from global transformations of high-contrast images, relevant for invariant object recognition and considered a challenge for state-of-the-art ID estimators.

preprint2020arXiv

Random geometric graphs in high dimension

Many machine learning algorithms used for dimensional reduction and manifold learning leverage on the computation of the nearest neighbours to each point of a dataset to perform their tasks. These proximity relations define a so-called geometric graph, where two nodes are linked if they are sufficiently close to each other. Random geometric graphs, where the positions of nodes are randomly generated in a subset of $\mathbb{R}^{d}$, offer a null model to study typical properties of datasets and of machine learning algorithms. Up to now, most of the literature focused on the characterization of low-dimensional random geometric graphs whereas typical datasets of interest in machine learning live in high-dimensional spaces ($d \gg 10^{2}$). In this work, we consider the infinite dimensions limit of hard and soft random geometric graphs and we show how to compute the average number of subgraphs of given finite size $k$, e.g. the average number of $k$-cliques. This analysis highlights that local observables display different behaviors depending on the chosen ensemble: soft random geometric graphs with continuous activation functions converge to the naive infinite dimensional limit provided by Erdös-Rényi graphs, whereas hard random geometric graphs can show systematic deviations from it. We present numerical evidence that our analytical insights, exact in infinite dimensions, provide a good approximation also for dimension $d\gtrsim10$.

preprint2020arXiv

Signatures of associative memory behavior in a multi-mode spin-boson model

Spin-boson models can describe a variety of physical systems, such as atoms in a cavity or vibrating ion chains. In equilibrium these systems often feature a radical change in their behavior when switching from weak to strong spin-boson interaction. This usually manifests in a transition from a "dark" to a "superradiant" phase. However, understanding the out-of-equilibrium physics of these models is extremely challenging, and even more so for strong spin-boson coupling. Here we show that non-equilibrium strongly interacting spin-boson systems can mimic some fundamental properties of an associative memory - a system which permits the recognition of patterns, such as letters of an alphabet. Patterns are encoded in the couplings between spins and bosons, and we discuss the dynamics of the spins from the perspective of pattern retrieval in associative memory models. We identify two phases, a "paramagnetic" and a "ferromagnetic" one, and a crossover behavior between these regimes. The "ferromagnetic" phase is reminiscent of pattern retrieval. We highlight similarities and differences with the thermal dynamics of a Hopfield associative memory and show that indeed elements of "machine learning behavior" emerge in strongly coupled spin-boson systems.

preprint2019arXiv

Counting the learnable functions of structured data

Cover's function counting theorem is a milestone in the theory of artificial neural networks. It provides an answer to the fundamental question of determining how many binary assignments (dichotomies) of $p$ points in $n$ dimensions can be linearly realized. Regrettably, it has proved hard to extend the same approach to more advanced problems than the classification of points. In particular, an emerging necessity is to find methods to deal with structured data, and specifically with non-pointlike patterns. A prominent case is that of invariant recognition, whereby identification of a stimulus is insensitive to irrelevant transformations on the inputs (such as rotations or changes in perspective in an image). An object is therefore represented by an extended perceptual manifold, consisting of inputs that are classified similarly. Here, we develop a function counting theory for structured data of this kind, by extending Cover's combinatorial technique, and we derive analytical expressions for the average number of dichotomies of generically correlated sets of patterns. As an application, we obtain a closed formula for the capacity of a binary classifier trained to distinguish general polytopes of any dimension. These results may help extend our theoretical understanding of generalization, feature extraction, and invariant object recognition by neural networks.

preprint2019arXiv

Dynamics of strongly coupled disordered dissipative spin-boson systems

Spin-boson Hamiltonians are an effective description for numerous quantum many-body systems such as atoms coupled to cavity modes, quantum electrodynamics in circuits and trapped ion systems. While reaching the limit of strong coupling is possible in current experiments, the understanding of the physics in this parameter regime remains a challenge, especially when disorder and dissipation are taken into account. Here we investigate a regime where the many-body spin dynamics can be related to a Ising energy function defined in terms of the spin-boson couplings. While in the coherent weak coupling regime it is known that an effective description in terms of spin Hamiltonian is possible, we show that a similar viewpoint can be adopted in the presence of dissipation and strong couplings. The resulting many-body dynamics features approximately thermal regimes, separated by out-of-equilibrium ones in which detailed balance is broken. Moreover, we show that under appropriately chosen conditions one can even achieve cooling of the spin degrees of freedom. This points towards the possibility of using strongly coupled dissipative spin-boson systems for engineering complex energy landscapes together with an appropriate cooling dynamics.

preprint2019arXiv

Generalization from correlated sets of patterns in the perceptron

Generalization is a central aspect of learning theory. Here, we propose a framework that explores an auxiliary task-dependent notion of generalization, and attempts to quantitatively answer the following question: given two sets of patterns with a given degree of dissimilarity, how easily will a network be able to "unify" their interpretation? This is quantified by the volume of the configurations of synaptic weights that classify the two sets in a similar manner. To show the applicability of our idea in a concrete setting, we compute this quantity for the perceptron, a simple binary classifier, using the classical statistical physics approach in the replica-symmetric ansatz. In this case, we show how an analytical expression measures the "distance-based capacity", the maximum load of patterns sustainable by the network, at fixed dissimilarity between patterns and fixed allowed number of errors. This curve indicates that generalization is possible at any distance, but with decreasing capacity. We propose that a distance-based definition of generalization may be useful in numerical experiments with real-world neural networks, and to explore computationally sub-dominant sets of synaptic solutions.

preprint2016arXiv

Devil's staircase phase diagram of the fractional quantum Hall effect in the thin-torus limit

After more than three decades the fractional quantum Hall effect still poses challenges to contemporary physics. Recent experiments point toward a fractal scenario for the Hall resistivity as a function of the magnetic field. Here, we consider the so-called thin-torus limit of the Hamiltonian describing interacting electrons in a strong magnetic field, restricted to the lowest Landau level, and we show that it can be mapped onto a one-dimensional lattice gas with repulsive interactions, with the magnetic field playing the role of a chemical potential. The statistical mechanics of such models leads to interpret the sequence of Hall plateaux as a fractal phase diagram, whose landscape shows a qualitative agreement with experiments.

preprint2016arXiv

Measuring logic complexity can guide pattern discovery in empirical systems

We explore a definition of complexity based on logic functions, which are widely used as compact descriptions of rules in diverse fields of contemporary science. Detailed numerical analysis shows that (i) logic complexity is effective in discriminating between classes of functions commonly employed in modelling contexts; (ii) it extends the notion of canalisation, used in the study of genetic regulation, to a more general and detailed measure; (iii) it is tightly linked to the resilience of a function's output to noise affecting its inputs. We demonstrate its utility by measuring it in empirical data on gene regulation, digital circuitry, and propositional calculus. Logic complexity is exceptionally low in these systems. The asymmetry between "on" and "off" states in the data correlates with the complexity in a non-null way; a model of random Boolean networks clarifies this trend and indicates a common hierarchical architecture in the three systems.

preprint2015arXiv

Dicke simulators with emergent collective quantum computational abilities

Using an approach inspired from Spin Glasses, we show that the multimode disordered Dicke model is equivalent to a quantum Hopfield network. We propose variational ground states for the system at zero temperature, which we conjecture to be exact in the thermodynamic limit. These ground states contain the information on the disordered qubit-photon couplings. These results lead to two intriguing physical implications. First, once the qubit-photon couplings can be engineered, it should be possible to build scalable pattern-storing systems whose dynamics is governed by quantum laws. Second, we argue with an example how such Dicke quantum simulators might be used as a solver of "hard" combinatorial optimization problems.

preprint2014arXiv

Replica Symmetry Breaking in Cold Atoms and Spin Glasses

We consider a system composed by N atoms trapped within a multimode cavity, whose theoretical description is captured by a disordered multimode Dicke model. We show that in the resonant, zero field limit the system exactly realizes the Sherrington-Kirkpatrick model. Upon a redefinition of the temperature, the same dynamics is realized in the dispersive, strong field limit. This regime also gives access to spin-glass observables which can be used to detect Replica Symmetry Breaking.