Source author record

Gilles Wainrib

Gilles Wainrib appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

math.PR cond-mat.dis-nn Neurons and Cognition Machine Learning math-ph math.DS math.MP Neural and Evolutionary Computing nlin.CD Computer Vision cond-mat.stat-mech math.AP nlin.AO

Catalog footprint

What is connected

17works

13topics

4close collaborators

Actions

Connect this record

Open graph Browse works

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

preprint2020arXiv

Classification and Disease Localization in Histopathology Using Only Global Labels: A Weakly-Supervised Approach

Analysis of histopathology slides is a critical step for many diagnoses, and in particular in oncology where it defines the gold standard. In the case of digital histopathological analysis, highly trained pathologists must review vast whole-slide-images of extreme digital resolution ($100,000^2$ pixels) across multiple zoom levels in order to locate abnormal regions of cells, or in some cases single cells, out of millions. The application of deep learning to this problem is hampered not only by small sample sizes, as typical datasets contain only a few hundred samples, but also by the generation of ground-truth localized annotations for training interpretable classification and segmentation models. We propose a method for disease localization in the context of weakly supervised learning, where only image-level labels are available during training. Even without pixel-level annotations, we are able to demonstrate performance comparable with models trained with strong annotations on the Camelyon-16 lymph node metastases detection challenge. We accomplish this through the use of pre-trained deep convolutional networks, feature embedding, as well as learning via top instances and negative evidence, a multiple instance learning technique from the field of semantic segmentation and object detection.

preprint2016arXiv

Branching Random Walks on Binary Strings for Evolutionary Processes

In this article, we study branching random walks on graphs modeling division-mutation processes inspired by adaptive immunity. We apply the theory of expander graphs on mutation rules in evolutionary processes and obtain estimates for the cover times of the branching random walks. This analysis reveals an unexpected saturation phenomenon : increasing the mutation rate above a certain threshold does not enhance the speed of state-space exploration.

preprint2016arXiv

Context-dependent representation in recurrent neural networks

In order to assess the short-term memory performance of non-linear random neural networks, we introduce a measure to quantify the dependence of a neural representation upon the past context. We study this measure both numerically and theoretically using the mean-field theory for random neural networks, showing the existence of an optimal level of synaptic weights heterogeneity. We further investigate the influence of the network topology, in particular the symmetry of reciprocal synaptic connections, on this measure of context dependence, revealing the importance of considering the interplay between non-linearities and connectivity structure.

preprint2016arXiv

Random walks on binary strings applied to the somatic hypermutation of B-cells

Within the germinal center in follicles, B-cells proliferate, mutate and differentiate, while being submitted to a powerful selection~: a micro-evolutionary mechanism at the heart of adaptive immunity. A new foreign pathogen is confronted to our immune system, the mutation mechanism that allows B-cells to adapt to it is called {\em somatic hypermutation}~: a programmed process of mutation affecting B-cell receptors at extremely high rate. By considering random walks on graphs, we introduce and analyze a simplified mathematical model in order to understand this extremely efficient learning process. The structure of the graph reflects the choice of the mutation rule. We focus on the impact of this choice on typical time-scales of the graphs' exploration. We derive explicit formulas to evaluate the expected hitting time to cover a given Hamming distance on the graphs under consideration. This characterizes the efficiency of these processes in driving antibody affinity maturation. In a further step we present a biologically more involved model and discuss its numerical outputs within our mathematical framework. We provide as well limitations and possible extensions of our approach.

preprint2016arXiv

The Asymptotic Performance of Linear Echo State Neural Networks

In this article, a study of the mean-square error (MSE) performance of linear echo-state neural networks is performed, both for training and testing tasks. Considering the realistic setting of noise present at the network nodes, we derive deterministic equivalents for the aforementioned MSE in the limit where the number of input data $T$ and network size $n$ both grow large. Specializing then the network connectivity matrix to specific random settings, we further obtain simple formulas that provide new insights on the performance of such networks.

preprint2015arXiv

A local Echo State Property through the largest Lyapunov exponent

Echo State Networks are efficient time-series predictors, which highly depend on the value of the spectral radius of the reservoir connectivity matrix. Based on recent results on the mean field theory of driven random recurrent neural networks, enabling the computation of the largest Lyapunov exponent of an ESN, we develop a cheap algorithm to establish a local and operational version of the Echo State Property.

preprint2015arXiv

Absorption properties of stochastic equations with Hölder diffusion coefficients

In this article, we address the absorption properties of a class of stochastic differ- ential equations around singular points where both the drift and diffusion functions vanish. According to the Hölder coefficient alpha of the diffusion function around the singular point, we identify different regimes. Stability of the absorbing state, large deviations for the absorption time, existence of stationary or quasi-stationary distributions are discussed. In particular, we show that quasi-stationary distributions only exist for alpha < 3/4, and for alpha in the interval (3/4, 1), no quasi-stationary distribution is found and numerical simulations tend to show that the process conditioned on not being absorbed initiates an almost sure exponential convergence towards the absorbing state (as is demonstrated to be true for alpha = 1). Applications of these results to stochastic bifurcations are discussed.

preprint2015arXiv

Mathematical modeling of lymphocytes selection in the germinal center

Lymphocyte selection is a fundamental operation of adaptive immunity. In order to produce B-lymphocytes with a desired antigenic profile, a process of mutation-selection occurs in the germinal center, which is part of the lymph nodes. We introduce in this article a simplified mathematical model of this process, taking into account the main mechanisms of division, mutation and selection. This model is written as a non-linear, non-local, inhomogeneous second order partial differential equation, for which we develop a mathematical analysis in the case of piecewise-constant coefficients. We assess, mathematically and numerically, the performance of the biological function by evaluating the duration of this production process as a function of several parameters such as the mutation rate or the selection profile, in various asymptotic regimes.

preprint2015arXiv

The real Ginibre ensemble with $k = O(n)$ real eigenvalues

We consider the ensemble of Real Ginibre matrices with a positive fraction $α>0$ of real eigenvalues. We demonstrate a large deviations principle for the joint eigenvalue density of such matrices and we introduce a two phase log-gas whose stationary distribution coincides with the spectral measure of the ensemble. Using these tools we provide an asymptotic expansion for the probability $p^n_{αn}$ that an $n\times n$ Ginibre matrix has $k=αn$ real eigenvalues and we characterize the spectral measures of these matrices.

preprint2014arXiv

Index Distribution of the Ginibre Ensemble

Complex systems, and in particular random neural networks, are often described by randomly interacting dynamical systems with no specific symmetry. In that context, characterizing the number of relevant directions necessitates fine estimates on the Ginibre ensemble. In this Letter, we compute analytically the probability distribution of the number of eigenvalues $N_R$ with modulus greater than $R$ (the index) of a large $N\times N$ random matrix in the real or complex Ginibre ensemble. We show that the fraction $N_R/N=p$ has a distribution scaling as $\exp(-βN^2 ψ_R(p))$ with $β=1$ (respectively $β=1/2$) for the complex (resp. real) Ginibre ensemble. For any $p\in[0,1]$, the equilibrium spectral densities as well as the rate function $ψ_R(p)$ are explicitly derived. This function displays a third order phase transition at the critical (minimum) value $p^*_R=1-R^2$, associated to a phase transition of the Coulomb gas. We deduce that, in the central regime, the fluctuations of the index $N_R$ around its typical value $p^*_R N$ scale as $N^{1/3}$.

preprint2014arXiv

Regular graphs maximize the variability of random neural networks

In this work we study the dynamics of systems composed of numerous interacting elements interconnected through a random weighted directed graph, such as models of random neural networks. We develop an original theoretical approach based on a combination of a classical mean-field theory originally developed in the context of dynamical spin-glass models, and the heterogeneous mean-field theory developed to study epidemic propagation on graphs. Our main result is that, surprisingly, increasing the variance of the in-degree distribution does not result in a more variable dynamical behavior, but on the contrary that the most variable behaviors are obtained in the regular graph setting. We further study how the dynamical complexity of the attractors is influenced by the statistical properties of the in-degree distribution.

preprint2014arXiv

Relative entropy minimizing noisy non-linear neural network to approximate stochastic processes

A method is provided for designing and training noise-driven recurrent neural networks as models of stochastic processes. The method unifies and generalizes two known separate modeling approaches, Echo State Networks (ESN) and Linear Inverse Modeling (LIM), under the common principle of relative entropy minimization. The power of the new method is demonstrated on a stochastic approximation of the El Nino phenomenon studied in climate research.

preprint2013arXiv

A biological gradient descent for prediction through a combination of STDP and homeostatic plasticity

Identifying, formalizing and combining biological mechanisms which implement known brain functions, such as prediction, is a main aspect of current research in theoretical neuroscience. In this letter, the mechanisms of Spike Timing Dependent Plasticity (STDP) and homeostatic plasticity, combined in an original mathematical formalism, are shown to shape recurrent neural networks into predictors. Following a rigorous mathematical treatment, we prove that they implement the online gradient descent of a distance between the network activity and its stimuli. The convergence to an equilibrium, where the network can spontaneously reproduce or predict its stimuli, does not suffer from bifurcation issues usually encountered in learning in recurrent neural networks.

preprint2013arXiv

Optimal system size for complex dynamics in random neural networks near criticality

In this Letter, we consider a model of dynamical agents coupled through a random connectivity matrix, as introduced in [Sompolinsky et. al, 1988] in the context of random neural networks. It is known that increasing the disorder parameter induces a phase transition leading to chaotic dynamics. We observe and investigate here a novel phenomenon in the subcritical regime : the probability of observing complex dynamics is maximal for an intermediate system size when the disorder is close enough to criticality. We give a more general explanation of this type of system size resonance in the framework of extreme values theory for eigenvalues of random matrices.

preprint2013arXiv

Synchronization in random balanced networks

Characterizing the in uence of network properties on the global emerging behavior of interacting elements constitutes a central question in many areas, from physical to social sciences. In this article we study a primary model of disordered neuronal networks with excitatory-inhibitory structure and balance constraints. We show how the interplay between structure and disorder in the connectivity leads to a universal transition from trivial to synchronized stationary or periodic states. This transition cannot be explained only through the analysis of the spectral density of the connectivity matrix. We provide a low dimensional approximation that shows the role of both the structure and disorder in the dynamics.

preprint2013arXiv

Topological and Dynamical Complexity of Random Neural Networks

Random neural networks are dynamical descriptions of randomly interconnected neural units. These show a phase transition to chaos as a disorder parameter is increased. The microscopic mechanisms underlying this phase transition are unknown, and similarly to spin-glasses, shall be fundamentally related to the behavior of the system. In this Letter we investigate the explosion of complexity arising near that phase transition. We show that the mean number of equilibria undergoes a sharp transition from one equilibrium to a very large number scaling exponentially with the dimension on the system. Near criticality, we compute the exponential rate of divergence, called topological complexity. Strikingly, we show that it behaves exactly as the maximal Lyapunov exponent, a classical measure of dynamical complexity. This relationship unravels a microscopic mechanism leading to chaos which we further demonstrate on a simpler class of disordered systems, suggesting a deep and underexplored link between topological and dynamical complexity.

preprint2012arXiv

Limit theorems for infinite-dimensional piecewise deterministic Markov processes. Applications to stochastic excitable membrane models

We present limit theorems for a sequence of Piecewise Deterministic Markov Processes (PDMPs) taking values in a separable Hilbert space. This class of processes provides a rigorous framework for stochastic spatial models in which discrete random events are globally coupled with continuous space-dependent variables solving partial differential equations, e.g., stochastic hybrid models of excitable membranes. We derive a law of large numbers which establishes a connection to deterministic macroscopic models and a martingale central limit theorem which connects the stochastic fluctuations to diffusion processes. As a prerequisite we carry out a thorough discussion of Hilbert space valued martingales associated to the PDMPs. Furthermore, these limit theorems provide the basis for a general Langevin approximation to PDMPs, i.e., stochastic partial differential equations that are expected to be similar in their dynamics to PDMPs. We apply these results to compartmental-type models of spatially extended excitable membranes. Ultimately this yields a system of stochastic partial differential equations which models the internal noise of a biological excitable membrane based on a theoretical derivation from exact stochastic hybrid models.

Gilles Wainrib

What is connected

Connect this record

See the researcher in context

Building this map preview

17 published item(s)

Classification and Disease Localization in Histopathology Using Only Global Labels: A Weakly-Supervised Approach

Branching Random Walks on Binary Strings for Evolutionary Processes

Context-dependent representation in recurrent neural networks

Random walks on binary strings applied to the somatic hypermutation of B-cells

The Asymptotic Performance of Linear Echo State Neural Networks

A local Echo State Property through the largest Lyapunov exponent

Absorption properties of stochastic equations with Hölder diffusion coefficients

Mathematical modeling of lymphocytes selection in the germinal center

The real Ginibre ensemble with $k = O(n)$ real eigenvalues

Index Distribution of the Ginibre Ensemble

Regular graphs maximize the variability of random neural networks

Relative entropy minimizing noisy non-linear neural network to approximate stochastic processes

A biological gradient descent for prediction through a combination of STDP and homeostatic plasticity

Optimal system size for complex dynamics in random neural networks near criticality

Synchronization in random balanced networks

Topological and Dynamical Complexity of Random Neural Networks

Limit theorems for infinite-dimensional piecewise deterministic Markov processes. Applications to stochastic excitable membrane models