Source author record

Pierre Tarrès

Pierre Tarrès appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

12works
5topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

12 published item(s)

preprint2019arXiv

Fine mesh limit of the VRJP in dimension one and Bass-Burdzy flow

We introduce a continuous space limit of the Vertex Reinforced Jump Process (VRJP) in dimension one, which we call Linearly Reinforced Motion (LRM) on $\R$. It is constructed out of a convergent Bass-Burdzy flow. The proof goes through the representation of the VRJP as a mixture of Markov jump processes. As a by-product this gives a representation in terms of a mixture of diffusions of the LRM and of the Bass-Burdzy flow itself. We also show that our continuous space limit can be obtained out of the Edge Reinforced Random Walk (ERRW), since the ERRW and the VRJP are known to be closely related. Compared to the discrete space processes, the LRM has an additional symmetry in the initial local times (initial occupation profile): changing them amounts to a deterministic change of the space and time scales.

preprint2019arXiv

Inverting the coupling of the signed Gausssian free field with a loop soup

Lupu introduced a coupling between a random walk loop-soup and a Gaussian free field, where the sign of the field is constant on each cluster of loops. This coupling is a signed version of isomorphism theorems relating the square of the GFF to the occupation field of Markovian trajectories. His construction starts with a loop-soup, and by adding additional randomness samples a GFF out of it. In this article we provide the inverse construction: starting from a signed free field and using a self-interacting random walk related to this field, we construct a random walk loop-soup. Our construction relies on the previous work by Sabot and Tarrès, which inverts the coupling from the square of the GFF rather than the signed GFF itself. As a consequence, we also deduce an inversion of the coupling between the random current and the FK-Ising random cluster models introduced by Lupu and Werner.

preprint2016arXiv

Reinforcement learning in social networks

We propose a model of network formation based on reinforcement learning, which can be seen as a generalization as the one proposed by Skyrms for signaling games. On a discrete graph, whose vertices represent individuals, at any time step each of them picks one of its neighbors with a probability proportional to their past number of communications; independently, Nature chooses, with an independent identical distribution in time, which ones are allowed to communicate. Communications occur when any two neighbors mutually pick each other and are both allowed by Nature to communicate. Our results generalize the ones obtained by Hu, Skyrms and Tarrès (2011). We prove that, up to an error term, the expected rate of communications increases in average, and thus a.s. converges. If we define the limit graph as the non-oriented subgraph on which edges are pairs of vertices communicating with a positive asymptotic rate, then, for stable configurations, within which every vertex is connected to at least another one, the connected components of this limit graph are star-shaped and satisfy a certain balance condition. Conversely, given any stable equilibrium $q$ whose associated graph satisfies that property, the occupation measure converges with positive probability to a stable equilibrium in a neighborhood of $q$ with the same limit graph.

preprint2016arXiv

The Vertex Reinforced Jump Process and a Random Schrödinger operator on finite graphs

We introduce a new exponential family of probability distributions, which can be viewed as a multivariate generalization of the Inverse Gaussian distribution. Considered as the potential of a random Schrödinger operator, this exponential family is related to the random field that gives the mixing measure of the Vertex Reinforced Jump Process (VRJP), and hence to the mixing measure of the Edge Reinforced Random Walk (ERRW), the so-called magic formula. In particular, it yields by direct computation the value of the normalizing constants of these mixing measures, which solves a question raised by Diaconis. The results of this paper are instrumental in [Sabot-Zeng,2015], where several properties of the VRJP and the ERRW are proved, in particular a functional central limit theorem in transient regimes, and recurrence of the 2-dimensional ERRW.

preprint2015arXiv

Inverting Ray-Knight identity

We provide a short proof of the Ray-Knight second generalized Theorem, using a martingale which can be seen (on the positive quadrant) as the Radon-Nikodym derivative of the reversed vertex-reinforced jump process measure with respect to the Markov jump process with the same conductances. Next we show that a variant of this process provides an inversion of that Ray-Knight identity. We give a similar result for the Ray-Knight first generalized Theorem.

preprint2014arXiv

Transience of Edge-Reinforced Random Walk

We show transience of the edge-reinforced random walk (ERRW) for small reinforcement in dimension d greater than 2. This proves the existence of a phase transition between recurrent and transient behavior, thus solving an open problem stated by Diaconis in 1986. The argument adapts the proof of quasi-diffusive behavior of the SuSy hyperbolic model for fixed conductances by Disertori, Spencer and Zirnbauer [CMP 2010], using the representation of ERRW as a mixture of vertex-reinforced jump processes (VRJP) with independent gamma conductances, and the interpretation of the limit law of VRJP as a supersymmetric (SuSy) hyperbolic sigma model developed by Sabot and Tarrès in [JEMS 2014].

preprint2013arXiv

Online Learning as Stochastic Approximation of Regularization Paths

In this paper, an online learning algorithm is proposed as sequential stochastic approximation of a regularization path converging to the regression function in reproducing kernel Hilbert spaces (RKHSs). We show that it is possible to produce the best known strong (RKHS norm) convergence rate of batch learning, through a careful choice of the gain or step size sequences, depending on regularity assumptions on the regression function. The corresponding weak (mean square distance) convergence rate is optimal in the sense that it reaches the minimax and individual lower rates in the literature. In both cases we deduce almost sure convergence, using Bernstein-type inequalities for martingales in Hilbert spaces. To achieve this we develop a bias-variance decomposition similar to the batch learning setting; the bias consists in the approximation and drift errors along the regularization path, which display the same rates of convergence, and the variance arises from the sample error analysed as a reverse martingale difference sequence. The rates above are obtained by an optimal trade-off between the bias and the variance.

preprint2012arXiv

Diffusivity bounds for 1D Brownian polymers

We study the asymptotic behavior of a self-interacting one-dimensional Brownian polymer first introduced by Durrett and Rogers [Probab. Theory Related Fields 92 (1992) 337--349]. The polymer describes a stochastic process with a drift which is a certain average of its local time. We show that a smeared out version of the local time function as viewed from the actual position of the process is a Markov process in a suitably chosen function space, and that this process has a Gaussian stationary measure. As a first consequence, this enables us to partially prove a conjecture about the law of large numbers for the end-to-end displacement of the polymer formulated in Durrett and Rogers [Probab. Theory Related Fields 92 (1992) 337--349]. Next we give upper and lower bounds for the variance of the process under the stationary measure, in terms of the qualitative infrared behavior of the interaction function. In particular, we show that in the locally self-repelling case (when the process is essentially pushed by the negative gradient of its own local time) the process is super-diffusive.

preprint2012arXiv

Dynamics of vertex-reinforced random walks

We generalize a result from Volkov [Ann. Probab. 29 (2001) 66--91] and prove that, on a large class of locally finite connected graphs of bounded degree $(G,\sim)$ and symmetric reinforcement matrices $a=(a_{i,j})_{i,j\in G}$, the vertex-reinforced random walk (VRRW) eventually localizes with positive probability on subsets which consist of a complete $d$-partite subgraph with possible loops plus its outer boundary. We first show that, in general, any stable equilibrium of a linear symmetric replicator dynamics with positive payoffs on a graph $G$ satisfies the property that its support is a complete $d$-partite subgraph of $G$ with possible loops, for some $d\ge1$. This result is used here for the study of VRRWs, but also applies to other contexts such as evolutionary models in population genetics and game theory. Next we generalize the result of Pemantle [Probab. Theory Related Fields 92 (1992) 117--136] and Bena\"{ı}m [Ann. Probab. 25 (1997) 361--392] relating the asymptotic behavior of the VRRW to replicator dynamics. This enables us to conclude that, given any neighborhood of a strictly stable equilibrium with support $S$, the following event occurs with positive probability: the walk localizes on $S\cup\partial S$ (where $\partial S$ is the outer boundary of $S$) and the density of occupation of the VRRW converges, with polynomial rate, to a strictly stable equilibrium in this neighborhood.

preprint2012arXiv

On ergodic two-armed bandits

A device has two arms with unknown deterministic payoffs and the aim is to asymptotically identify the best one without spending too much time on the other. The Narendra algorithm offers a stochastic procedure to this end. We show under weak ergodic assumptions on these deterministic payoffs that the procedure eventually chooses the best arm (i.e., with greatest Cesaro limit) with probability one for appropriate step sequences of the algorithm. In the case of i.i.d. payoffs, this implies a "quenched" version of the "annealed" result of Lamberton, Pagès and Tarrès [Ann. Appl. Probab. 14 (2004) 1424--1454] by the law of iterated logarithm, thus generalizing it. More precisely, if $(η_{\ell,i})_{i\in \mathbb {N}}\in\{0,1\}^{\mathbb {N}}$, $\ell\in\{A,B\}$, are the deterministic reward sequences we would get if we played at time $i$, we obtain infallibility with the same assumption on nonincreasing step sequences on the payoffs as in Lamberton, Pagès and Tarrès [Ann. Appl. Probab. 14 (2004) 1424--1454], replacing the i.i.d. assumption by the hypothesis that the empirical averages $\sum_{i=1}^nη_{A,i}/n$ and $\sum_{i=1}^nη_{B,i}/n$ converge, as $n$ tends to infinity, respectively, to $θ_A$ and $θ_B$, with rate at least $1/(\log n)^{1+\varepsilon}$, for some $\varepsilon >0$. We also show a fallibility result, that is, convergence with positive probability to the choice of the wrong arm, which implies the corresponding result of Lamberton, Pagès and Tarrès [Ann. Appl. Probab. 14 (2004) 1424--1454] in the i.i.d. case.

preprint2011arXiv

Localization of reinforced random walks

We describe and analyze how reinforced random walks can eventually localize, i.e. only visit finitely many sites. After introducing vertex and edge self-interacting walks on a discrete graph in a general setting, and stating the main results and conjectures so far on the topic, we present martingale techniques that provide an alternative proof of the a.s. localization of vertex-reinforced random walks (VRRWs) on the integers on finitely many sites and, with positive probability, on five consecutive sites, initially proved by Pemantle and Volkov (1999). Next we introduce the continuous time-lines representation (sometimes called Rubin construction) and its martingale counterpart, and explain how it has been used to prove localization of some reinforced walks on one attracting edge. Then we show how a modified version of this construction enables one to propose a new short proof of the a.s. localization of VRRWs on five sites on Z.

preprint2011arXiv

Reinforcement learning in signaling game

We consider a signaling game originally introduced by Skyrms, which models how two interacting players learn to signal each other and thus create a common language. The first rigorous analysis was done by Argiento, Pemantle, Skyrms and Volkov (2009) with 2 states, 2 signals and 2 acts. We study the case of M_1 states, M_2 signals and M_1 acts for general M_1, M_2. We prove that the expected payoff increases in average and thus converges a.s., and that a limit bipartite graph emerges, such that no signal-state correspondence is associated to both a synonym and an informational bottleneck. Finally, we show that any graph correspondence with the above property is a limit configuration with positive probability.