Source author record

Jian Ding

Jian Ding appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

55works
21topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

55 published item(s)

preprint2026arXiv

On the gap between cluster dimensions of loop soups on $\mathbb{R}^3$ and the metric graph of $\mathbb{Z}^3$

The question of understanding the scaling limit of metric graph critical loop soup clusters and its relation to loop soups in the continuum appears to be one of the subtle cases that reveal interesting new scenarios about scaling limits, with a mixture of macroscopic and microscopic randomness. In the present paper, we show that in three dimensions, scaling limits of the metric graph clusters are strictly larger than the clusters of the limiting continuum Brownian loop soup. We actually show that the upper box counting dimension of the latter clusters is strictly smaller than $5/2$, while that of the former is $5/2$.

preprint2026arXiv

Separation and cut edge in macroscopic clusters for metric graph Gaussian free fields

We prove that for the Gaussian free field (GFF) on the metric graph of $\mathbb{Z}^d$ (for all $d\ge 3$ except the critical dimension $d_c=6$), with uniformly positive probability there exist two distinct sign clusters of diameter at least $cN$ within a box of size $N$ such that their graph distance is less than $N^{-[(d-2)\vee (2d-8)]}$. This phenomenon contrasts sharply with the two-dimensional case, where the distance between two macroscopic clusters is typically on the order of their diameters, following from the basic property of the scaling limit ``conformal loop ensembles'' $\mathrm{CLE}_4$ (Sheffield-Werner'2001). As a byproduct, we derive that the number of pivotal edges for the one-arm event (i.e., the sign cluster containing the origin has diameter at least $N$) is typically of order $N^{(\frac{d}{2}-1)\land 2}$. This immediately implies that for the incipient infinite cluster (IIC) of the metric graph GFF, the dimension of cut edges (i.e., edges whose removal disconnects the IIC) equals $(\frac{d}{2}-1)\land 2$. Translated in the language of critical loop soups (whose clusters, by the isomorphism theorem, have the same distribution as GFF sign clusters), this leads to the analogous estimates where the counterpart of a pivotal edge is a pivotal loop at scale $1$. This result hints at the new and possibly surprising idea that already in dimension $3$, microscopic loops (even those at scale $1$) play a crucial role in the construction of macroscopic loop clusters.

preprint2022arXiv

A New Correlation Inequality for Ising Models with External Fields

We study ferromagnetic Ising models on finite graphs with an inhomogeneous external field, where a subset of vertices is designated as the boundary. We show that the influence of boundary conditions on any given spin is maximised when the external field is identically $0$. One corollary is that spin-spin correlations are maximised when the external field vanishes and the boundary condition is free, which proves a conjecture of Shlosman. In particular, the random field Ising model on ${\mathbb Z}^d$, $d\geq 3$, exhibits exponential decay of correlations in the entire high temperature regime of the pure Ising model. Another corollary is that the pure Ising model in $d\geq 3$ satisfies the conjectured strong spatial mixing property in the entire high temperature regime.

preprint2022arXiv

Correlation length of the two-dimensional random field Ising model via greedy lattice animal

For the two-dimensional random field Ising model where the random field is given by i.i.d.\ mean zero Gaussian variables with variance $ε^2$, we study (one natural notion of) the correlation length, which is the critical size of a box at which the influences of the random field and of the boundary condition on the spin magnetization are comparable. We show that as $ε\to 0$, at zero temperature the correlation length scales as $e^{Θ(ε^{-4/3})}$ (and our upper bound applies for all positive temperatures).

preprint2022arXiv

Decoupling Zero-Shot Semantic Segmentation

Zero-shot semantic segmentation (ZS3) aims to segment the novel categories that have not been seen in the training. Existing works formulate ZS3 as a pixel-level zeroshot classification problem, and transfer semantic knowledge from seen classes to unseen ones with the help of language models pre-trained only with texts. While simple, the pixel-level ZS3 formulation shows the limited capability to integrate vision-language models that are often pre-trained with image-text pairs and currently demonstrate great potential for vision tasks. Inspired by the observation that humans often perform segment-level semantic labeling, we propose to decouple the ZS3 into two sub-tasks: 1) a classagnostic grouping task to group the pixels into segments. 2) a zero-shot classification task on segments. The former task does not involve category information and can be directly transferred to group pixels for unseen classes. The latter task performs at segment-level and provides a natural way to leverage large-scale vision-language models pre-trained with image-text pairs (e.g. CLIP) for ZS3. Based on the decoupling formulation, we propose a simple and effective zero-shot semantic segmentation model, called ZegFormer, which outperforms the previous methods on ZS3 standard benchmarks by large margins, e.g., 22 points on the PASCAL VOC and 3 points on the COCO-Stuff in terms of mIoU for unseen classes. Code will be released at https://github.com/dingjiansw101/ZegFormer.

preprint2022arXiv

Deeply Unsupervised Patch Re-Identification for Pre-training Object Detectors

Unsupervised pre-training aims at learning transferable features that are beneficial for downstream tasks. However, most state-of-the-art unsupervised methods concentrate on learning global representations for image-level classification tasks instead of discriminative local region representations, which limits their transferability to region-level downstream tasks, such as object detection. To improve the transferability of pre-trained features to object detection, we present Deeply Unsupervised Patch Re-ID (DUPR), a simple yet effective method for unsupervised visual representation learning. The patch Re-ID task treats individual patch as a pseudo-identity and contrastively learns its correspondence in two views, enabling us to obtain discriminative local features for object detection. Then the proposed patch Re-ID is performed in a deeply unsupervised manner, appealing to object detection, which usually requires multilevel feature maps. Extensive experiments demonstrate that DUPR outperforms state-of-the-art unsupervised pre-trainings and even the ImageNet supervised pre-training on various downstream tasks related to object detection.

preprint2022arXiv

Detection threshold for correlated Erdős-Rényi graphs via densest subgraphs

The problem of detecting edge correlation between two Erdős-Rényi random graphs on $n$ unlabeled nodes can be formulated as a hypothesis testing problem: under the null hypothesis, the two graphs are sampled independently; under the alternative, the two graphs are independently sub-sampled from a parent graph which is Erdős-Rényi $\mathbf{G}(n, p)$ (so that their marginal distributions are the same as the null). We establish a sharp information-theoretic threshold when $p = n^{-α+o(1)}$ for $α\in (0, 1]$ which sharpens a constant factor in a recent work by Wu, Xu and Yu. A key novelty in our work is an interesting connection between the detection problem and the densest subgraph of an Erdős-Rényi graph.

preprint2022arXiv

Expanding Low-Density Latent Regions for Open-Set Object Detection

Modern object detectors have achieved impressive progress under the close-set setup. However, open-set object detection (OSOD) remains challenging since objects of unknown categories are often misclassified to existing known classes. In this work, we propose to identify unknown objects by separating high/low-density regions in the latent space, based on the consensus that unknown objects are usually distributed in low-density latent regions. As traditional threshold-based methods only maintain limited low-density regions, which cannot cover all unknown objects, we present a novel Open-set Detector (OpenDet) with expanded low-density regions. To this aim, we equip OpenDet with two learners, Contrastive Feature Learner (CFL) and Unknown Probability Learner (UPL). CFL performs instance-level contrastive learning to encourage compact features of known classes, leaving more low-density regions for unknown classes; UPL optimizes unknown probability based on the uncertainty of predictions, which further divides more low-density regions around the cluster of known classes. Thus, unknown objects in low-density regions can be easily identified with the learned unknown probability. Extensive experiments demonstrate that our method can significantly improve the OSOD performance, e.g., OpenDet reduces the Absolute Open-Set Errors by 25%-35% on six OSOD benchmarks. Code is available at: https://github.com/csuhan/opendet2.

preprint2022arXiv

Matching recovery threshold for correlated random graphs

For two correlated graphs which are independently sub-sampled from a common Erdős-Rényi graph $\mathbf{G}(n, p)$, we wish to recover their \emph{latent} vertex matching from the observation of these two graphs \emph{without labels}. When $p = n^{-α+o(1)}$ for $α\in (0, 1]$, we establish a sharp information-theoretic threshold for whether it is possible to correctly match a positive fraction of vertices. Our result sharpens a constant factor in a recent work by Wu, Xu and Yu.

preprint2022arXiv

Shotgun threshold for sparse Erdős-Rényi graphs

In the shotgun assembly problem for a graph, we are given the empirical profile for rooted neighborhoods of depth $r$ (up to isomorphism) for some $r\geq 1$ and we wish to recover the underlying graph up to isomorphism. When the underlying graph is an Erdős-Rényi $\mathcal G(n, \fracλ{n})$, we show that the shotgun assembly threshold $r_* \approx \frac{ \log n}{\log (λ^2 γ_λ)^{-1}}$ where $γ_λ$ is the probability for two independent Poisson-Galton-Watson trees with parameter $λ$ to be rooted isomorphic with each other. Our result sharpens a constant factor in a previous work by Mossel and Ross (2019) and thus solves a question therein.

preprint2020arXiv

Crossing estimates from metric graph and discrete GFF

We compare level-set percolation for Gaussian free fields (GFFs) defined on a rectangular subset of $δ\mathbb{Z}^2$ to level-set percolation for GFFs defined on the corresponding metric graph as the mesh size $δ$ goes to 0. In particular, we look at the probability that there is a path that crosses the rectangle in the horizontal direction on which the field is positive. We show this probability is strictly larger in the discrete graph. In the metric graph case, we show that for appropriate boundary conditions the probability that there exists a closed pivotal edge for the horizontal crossing event decays logarithmically in $δ$. In the discrete graph case, we compute the limit of the probability of a horizontal crossing for appropriate boundary conditions.

preprint2020arXiv

Dirac series for some real exceptional Lie groups

Up to equivalence, this paper classifies all the irreducible unitary representations with non-zero Dirac cohomology for the following simple real exceptional Lie groups: ${\rm EI}=E_{6(6)}, {\rm EIV}=E_{6(-26)}, {\rm FI}=F_{4(4)}, {\rm FII}=F_{4(-20)}$. Along the way, we find an irreducible unitary representation of $F_{4(4)}$ whose Dirac index vanishes, while its Dirac cohomology is non-zero. This disproves a conjecture raised in 2015 asserting that there should be no cancellation between the even part and the odd part of the Dirac cohomology.

preprint2020arXiv

Efficient random graph matching via degree profiles

Random graph matching refers to recovering the underlying vertex correspondence between two random graphs with correlated edges; a prominent example is when the two random graphs are given by Erdős-Rényi graphs $G(n,\frac{d}{n})$. This can be viewed as an average-case and noisy version of the graph isomorphism problem. Under this model, the maximum likelihood estimator is equivalent to solving the intractable quadratic assignment problem. This work develops an $\tilde{O}(n d^2+n^2)$-time algorithm which perfectly recovers the true vertex correspondence with high probability, provided that the average degree is at least $d = Ω(\log^2 n)$ and the two graphs differ by at most $δ= O( \log^{-2}(n) )$ fraction of edges. For dense graphs and sparse graphs, this can be improved to $δ= O( \log^{-2/3}(n) )$ and $δ= O( \log^{-2}(d) )$ respectively, both in polynomial time. The methodology is based on appropriately chosen distance statistics of the degree profiles (empirical distribution of the degrees of neighbors). Before this work, the best known result achieves $δ=O(1)$ and $n^{o(1)} \leq d \leq n^c$ for some constant $c$ with an $n^{O(\log n)}$-time algorithm \cite{barak2018nearly} and $δ=\tilde O((d/n)^4)$ and $d = \tildeΩ(n^{4/5})$ with a polynomial-time algorithm \cite{dai2018performance}.

preprint2020arXiv

Modeling the Control of COVID-19: Impact of Policy Interventions and Meteorological Factors

In this paper, we propose a dynamical model to describe the transmission of COVID-19, which is spreading in China and many other countries. To avoid a larger outbreak in the worldwide, Chinese government carried out a series of strong strategies to prevent the situation from deteriorating. Home quarantine is the most important one to prevent the spread of COVID-19. In order to estimate the effect of population quarantine, we divide the population into seven categories for simulation. Based on a Least-Squares procedure and officially published data, the estimation of parameters for the proposed model is given. Numerical simulations show that the proposed model can describe the transmission of COVID-19 accurately, the corresponding prediction of the trend of the disease is given. The home quarantine strategy plays an important role in controlling the disease spread and speeding up the decline of COVID-19. The control reproduction number of most provinces in China are analyzed and discussed adequately. We should pay attention to that, though the epidemic is in decline in China, the disease still has high risk of human-to-human transmission continuously. Once the control strategy is removed, COVID-19 may become a normal epidemic disease just like flu. Further control for the disease is still necessary, we focus on the relationship between the spread rate of the virus and the meteorological conditions. A comprehensive meteorological index is introduced to represent the impact of meteorological factors on both high and low migration groups. As the progress on the new vaccine, we design detail vaccination strategies for COVID-19 in different control phases and show the effectiveness of efficient vaccination. Once the vaccine comes into use, the numerical simulation provide a promptly prospective research.

preprint2020arXiv

Unitary Representations with Dirac cohomology: a finiteness result for complex Lie groups

Let $G$ be a connected complex simple Lie group, and let $\widehat{G}^{\mathrm{d}}$ be the set of all equivalence classes of irreducible unitary representations with non-vanishing Dirac cohomology. We show that $\widehat{G}^{\mathrm{d}}$ consists of two parts: finitely many scattered representations, and finitely many strings of representations. Moreover, the strings of $\widehat{G}^{\mathrm{d}}$ come from $\widehat{L}^{\mathrm{d}}$ via cohomological induction and they are all in the good range. Here $L$ runs over the Levi factors of proper $θ$-stable parabolic subgroups of $G$. It follows that figuring out $\widehat{G}^{\mathrm{d}}$ requires a finite calculation in total. As an application, we report a complete description of $\widehat{F}_4^{\mathrm{d}}$.

preprint2019arXiv

Biased random walk conditioned on survival among Bernoulli obstacles: subcritical phase

We consider a discrete time biased random walk conditioned to avoid Bernoulli obstacles on ${\mathbb Z}^d$ ($d\geq 2$) up to time $N$. This model is known to undergo a phase transition: for a large bias, the walk is ballistic whereas for a small bias, it is sub-ballistic. We prove that in the sub-ballistic phase, the random walk is contained in a ball of radius $O(N^{1/(d+2)})$, which is the same scale as for the unbiased case. As an intermediate step, we also prove large deviation principles for the endpoint distribution for the unbiased random walk at scales between $N^{1/(d+2)}$ and $o(N^{d/(d+2)})$. These results improve and complement earlier work by Sznitman [Ann. Sci. Ecole Norm. Sup. (4), 28(3):345--370, 371--390, 1995].

preprint2019arXiv

Geometry of the random walk range conditioned on survival among Bernoulli obstacles

We consider a discrete time simple symmetric random walk among Bernoulli obstacles on $\mathbb{Z}^d$, $d\geq 2$, where the walk is killed when it hits an obstacle. It is known that conditioned on survival up to time $N$, the random walk range is asymptotically contained in a ball of radius $\varrho_N=C N^{1/(d+2)}$ for any $d\geq 2$. For $d=2$, it is also known that the range asymptotically contains a ball of radius $(1-ε)\varrho_N$ for any $ε>0$, while the case $d\geq 3$ remains open. We complete the picture by showing that for any $d\geq 2$, the random walk range asymptotically contains a ball of radius $\varrho_N-\varrho_N^ε$ for some $ε\in (0,1)$. Furthermore, we show that its boundary is of size at most $\varrho_N^{d-1}(\log \varrho_N)^a$ for some $a>0$.

preprint2019arXiv

Return probability and recurrence for the random walk driven by two-dimensional Gaussian free field

Given any $γ>0$ and for $η=\{η_v\}_{v\in \mathbb Z^2}$ denoting a sample of the two-dimensional discrete Gaussian free field on $\mathbb Z^2$ pinned at the origin, we consider the random walk on~$\mathbb Z^2$ among random conductances where the conductance of edge $(u, v)$ is given by $\mathrm{e}^{γ(η_u + η_v)}$. We show that, for almost every~$η$, this random walk is recurrent and that, with probability tending to~1 as $T\to \infty$, the return probability at time~$2T$ decays as $T^{-1+o(1)}$. In addition, we prove a version of subdiffusive behavior by showing that the expected exit time from a ball of radius~$N$ scales as $N^{ψ(γ)+o(1)}$ with $ψ(γ)>2$ for all~$γ>0$. Our results rely on delicate control of the effective resistance for this random network. In particular, we show that the effective resistance between two vertices at Euclidean distance~$N$ behaves as~$N^{o(1)}$.

preprint2019arXiv

The fractal dimension of Liouville quantum gravity: universality, monotonicity, and bounds

We prove that for each $γ\in (0,2)$, there is an exponent $d_γ> 2$, the "fractal dimension of $γ$-Liouville quantum gravity (LQG)", which describes the ball volume growth exponent for certain random planar maps in the $γ$-LQG universality class, the exponent for the Liouville heat kernel, and exponents for various continuum approximations of $γ$-LQG distances such as Liouville graph distance and Liouville first passage percolation. We also show that $d_γ$ is a continuous, strictly increasing function of $γ$ and prove upper and lower bounds for $d_γ$ which in some cases greatly improve on previously known bounds for the aforementioned exponents. For example, for $γ=\sqrt 2$ (which corresponds to spanning-tree weighted planar maps) our bounds give $3.4641 \leq d_{\sqrt 2} \leq 3.63299$ and in the limiting case we get $4.77485 \leq \lim_{γ\rightarrow 2^-} d_γ\leq 4.89898$.

preprint2016arXiv

Convergence in law of the maximum of nonlattice branching random walk

Let $η^*_n$ denote the maximum, at time $n$, of a nonlattice one-dimensional branching random walk $η_n$ possessing (enough) exponential moments. In a seminal paper, Aidekon demonstrated convergence of $η^*_n$ in law, after recentering, and gave a representation of the limit. We give here a shorter proof of this convergence by employing reasoning motivated by Bramson, Ding and Zeitouni. Instead of spine methods and a careful analysis of the renewal measure for killed random walks, our approach employs a modified version of the second moment method that may be of independent interest.

preprint2016arXiv

Liouville first passage percolation: the weight exponent is strictly less than 1 at high temperatures

Let $\{η_{N, v}: v\in V_N\}$ be a discrete Gaussian free field in a two-dimensional box $V_N$ of side length $N$ with Dirichlet boundary conditions. We study the Liouville first passage percolation, i.e., the shortest path metric where each vertex is given a weight of $e^{γη_{N, v}}$ for some $γ>0$. We show that for sufficiently small but fixed $γ>0$, the expected Liouville FPP distance between any pair of vertices is $O(N^{1-γ^2/10^3})$.

preprint2016arXiv

New quantum codes from dual-containing cyclic codes over finite rings

Let $R=\mathbb{F}_{2^{m}}+u\mathbb{F}_{2^{m}}+\cdots+u^{k}\mathbb{F}_{2^{m}}$ , where $\mathbb{F}_{2^{m}}$ is a finite field with $2^{m}$ elements, $m$ is a positive integer, $u$ is an indeterminate with $u^{k+1}=0.$ In this paper, we propose the constructions of two new families of quantum codes obtained from dual-containing cyclic codes of odd length over $R$. A new Gray map over $R$ is defined and a sufficient and necessary condition for the existence of dual-containing cyclic codes over $R$ is given. A new family of $2^{m}$-ary quantum codes is obtained via the Gray map and the Calderbank-Shor-Steane construction from dual-containing cyclic codes over $R.$ Furthermore, a new family of binary quantum codes is obtained via the Gray map, the trace map and the Calderbank-Shor-Steane construction from dual-containing cyclic codes over $R.$

preprint2016arXiv

When multiplicative noise stymies control

We consider the stabilization of an unstable discrete-time linear system that is observed over a channel corrupted by continuous multiplicative noise. Our main result shows that if the system growth is large enough, then the system cannot be stabilized in a second-moment sense. This is done by showing that the probability that the state magnitude remains bounded must go to zero with time. Our proof technique recursively bounds the conditional density of the system state (instead of focusing on the second moment) to bound the progress the controller can make. This sidesteps the difficulty encountered in using the standard data-rate theorem style approach; that approach does not work because the mutual information per round between the system state and the observation is potentially unbounded. It was known that a system with multiplicative observation noise can be stabilized using a simple memoryless linear strategy if the system growth is suitably bounded. In this paper, we show that while memory cannot improve the performance of a linear scheme, a simple non-linear scheme that uses one-step memory can do better than the best linear scheme.

preprint2015arXiv

Distances in critical long range percolation

We study the long range percolation model on $\mathbb{Z}$ where sites $i$ and $j$ are connected with probability $β|i-j|^{-s}$. Graph distances are now well understood for all exponents $s$ except in the case $s=2$ where the model exhibits non-trivial self-similar scaling. Establishing a conjecture of Benjamini and Berger \cite{BenBer:01}, we prove that the typical distance from site 0 to $n$ grows as a power law $n^{θ(β)}$ up to a multiplicative constant for some exponent $0<θ(β)<1$ as does the diameter of the graph on a box of length $n$.

preprint2015arXiv

Percolation of averages in the stochastic mean field model: the near-supercritical regime

For a complete graph of size $n$, assign each edge an i.i.d.\ exponential variable with mean $n$. For $λ>0$, consider the length of the longest path whose average weight is at most $λ$. It was shown by Aldous (1998) that the length is of order $\log n$ for $λ< 1/\mathrm{e}$ and of order $n$ for $λ> 1/\mathrm{e}$. In this paper, we study the near-supercritical regime where $λ= \mathrm{e}^{-1} +η$ with $η>0$ a small fixed number. We show that there exist two absolute constants $c^*, C^*>0$ such that with high probability the length is in between $n \mathrm{e}^{-C^*/\sqrtη}$ and $n \mathrm{e}^{-c^*/\sqrtη}$. Our result corrects a non-rigorous prediction of Aldous (2005).

preprint2015arXiv

Supercritical minimum mean-weight cycles

We study the weight and length of the minimum mean-weight cycle in the stochastic mean-field distance model, i.e., in the complete graph on $n$ vertices with edges weighted by independent exponential random variables. Mathieu and Wilson showed that the minimum mean-weight cycle exhibits one of two distinct behaviors, according to whether its mean weight is smaller or larger than $1/(ne)$; and that both scenarios occur with positive probability in the limit $n\to\infty$. If the mean weight is $< 1/(ne)$, the length is of constant order. If the mean weight is $> 1/(ne)$, it is concentrated just above $1/(n e)$, and the length diverges with $n$. The analysis of Mathieu--Wilson gives a detailed characterization of the subcritical regime, including the (non-degenerate) limiting distributions of the weight and length, but leaves open the supercritical behavior. We determine the asymptotics for the supercritical regime, showing that with high probability, the minimum mean weight is $(n e)^{-1}[1 + π^2/(2 \log^2 n) + O((\log n)^{-3})]$, and the cycle achieving this minimum has length on the order of $(\log n)^3$.

preprint2015arXiv

Testing for high-dimensional geometry in random graphs

We study the problem of detecting the presence of an underlying high-dimensional geometric structure in a random graph. Under the null hypothesis, the observed graph is a realization of an Erdős-Rényi random graph $G(n,p)$. Under the alternative, the graph is generated from the $G(n,p,d)$ model, where each vertex corresponds to a latent independent random vector uniformly distributed on the sphere $\mathbb{S}^{d-1}$, and two vertices are connected if the corresponding latent vectors are close enough. In the dense regime (i.e., $p$ is a constant), we propose a near-optimal and computationally efficient testing procedure based on a new quantity which we call signed triangles. The proof of the detection lower bound is based on a new bound on the total variation distance between a Wishart matrix and an appropriately normalized GOE matrix. In the sparse regime, we make a conjecture for the optimal detection boundary. We conclude the paper with some preliminary steps on the problem of estimating the dimension in $G(n,p,d)$.

preprint2014arXiv

Asymptotics of cover times via Gaussian free fields: Bounded-degree graphs and general trees

In this paper we show that on bounded degree graphs and general trees, the cover time of the simple random walk is asymptotically equal to the product of the number of edges and the square of the expected supremum of the Gaussian free field on the graph, assuming that the maximal hitting time is significantly smaller than the cover time. Previously, this was only proved for regular trees and the 2D lattice. Furthermore, for general trees, we derive exponential concentration for the cover time, which implies that the standard deviation of the cover time is bounded by the geometric mean of the cover time and the maximal hitting time.

preprint2014arXiv

Online Learning with Composite Loss Functions

We study a new class of online learning problems where each of the online algorithm's actions is assigned an adversarial value, and the loss of the algorithm at each step is a known and deterministic function of the values assigned to its recent actions. This class includes problems where the algorithm's loss is the minimum over the recent adversarial values, the maximum over the recent values, or a linear combination of the recent values. We analyze the minimax regret of this class of problems when the algorithm receives bandit feedback, and prove that when the minimum or maximum functions are used, the minimax regret is $\tilde Ω(T^{2/3})$ (so called hard online learning problems), and when a linear function is used, the minimax regret is $\tilde O(\sqrt{T})$ (so called easy learning problems). Previously, the only online learning problem that was known to be provably hard was the multi-armed bandit with switching costs.

preprint2013arXiv

Bandits with Switching Costs: T^{2/3} Regret

We study the adversarial multi-armed bandit problem in a setting where the player incurs a unit cost each time he switches actions. We prove that the player's $T$-round minimax regret in this setting is $\widetildeΘ(T^{2/3})$, thereby closing a fundamental gap in our understanding of learning with bandit feedback. In the corresponding full-information version of the problem, the minimax regret is known to grow at a much slower rate of $Θ(\sqrt{T})$. The difference between these two rates provides the \emph{first} indication that learning with bandit feedback can be significantly harder than learning with full-information feedback (previous results only showed a different dependence on the number of actions, but not on $T$.) In addition to characterizing the inherent difficulty of the multi-armed bandit problem with switching costs, our results also resolve several other open problems in online learning. One direct implication is that learning with bandit feedback against bounded-memory adaptive adversaries has a minimax regret of $\widetildeΘ(T^{2/3})$. Another implication is that the minimax regret of online learning in adversarial Markov decision processes (MDPs) is $\widetildeΘ(T^{2/3})$. The key to all of our results is a new randomized construction of a multi-scale random walk, which is of independent interest and likely to prove useful in additional settings.

preprint2013arXiv

Extreme values for two-dimensional discrete Gaussian free field

We consider in this paper the collection of near maxima of the discrete, two dimensional Gaussian free field in a box with Dirichlet boundary conditions. We provide a rough description of the geometry of the set of near maxima, estimates on the gap between the two largest maxima, and an estimate for the right tail up to a multiplicative constant on the law of the centered maximum.

preprint2013arXiv

Markov type and threshold embeddings

For two metric spaces X and Y, say that X {threshold-embeds} into Y if there exist a number K > 0 and a family of Lipschitz maps $f_τ : X \to Y : τ> 0 \}$ such that for every $x,y \in X$, \[ d_X(x,y) \geq τ=> d_Y(f_τ(x),f_τ(y)) \geq \|φ_τ\|_{\Lip} τ/K \] where $\|f_τ\|_{\Lip}$ denotes the Lipschitz constant of $f_τ$. We show that if a metric space X threshold-embeds into a Hilbert space, then X has Markov type 2. As a consequence, planar graph metrics and doubling metrics have Markov type 2, answering questions of Naor, Peres, Schramm, and Sheffield. More generally, if a metric space X threshold-embeds into a p-uniformly smooth Banach space, then X has Markov type p. This suggests some non-linear analogs of Kwapien's theorem. For instance, a subset $X \subseteq L_1$ threshold-embeds into Hilbert space if and only if X has Markov type 2.

preprint2013arXiv

Maximum independent sets on random regular graphs

We determine the asymptotics of the independence number of the random $d$-regular graph for all $d \ge d_0$. It is highly concentrated, with constant-order fluctuations around $nα_* - c_*\log n$ for explicit constants $α_*(d)$ and $c_*(d)$. Our proof rigorously confirms the one-step replica symmetry breaking heuristics for this problem, and we believe the techniques will be more broadly applicable to the study of other combinatorial properties of random graphs.

preprint2013arXiv

Mixing time for the Ising model: a uniform lower bound for all graphs

Consider Glauber dynamics for the Ising model on a graph of $n$ vertices. Hayes and Sinclair showed that the mixing time for this dynamics is at least $n\log n/f(Δ)$, where $Δ$ is the maximum degree and $f(Δ) = Θ(Δ\log^2 Δ)$. Their result applies to more general spin systems, and in that generality, they showed that some dependence on $Δ$ is necessary. In this paper, we focus on the ferromagnetic Ising model and prove that the mixing time of Glauber dynamics on any $n$-vertex graph is at least $(1/4+o(1))n \log n$.

preprint2013arXiv

Mixing under monotone censoring

We initiate the study of mixing times of Markov chain under monotone censoring. Suppose we have some Markov Chain $M$ on a state space $Ω$ with stationary distribution $π$ and a monotone set $A \subset Ω$. We consider the chain $M'$ which is the same as the chain $M$ started at some $x \in A$ except that moves of $M$ of the form $x \to y$ where $x \in A$ and $y \notin A$ are {\em censored} and replaced by the move $x \to x$. If $M$ is ergodic and $A$ is connected, the new chain converges to $π$ conditional on $A$. In this paper we are interested in the mixing time of the chain $M'$ in terms of properties of $M$ and $A$. Our results are based on new connections with the field of property testing. A number of open problems are presented.

preprint2013arXiv

On multiple peaks and moderate deviations for supremum of Gaussian field

We prove two theorems concerning extreme values of general Gaussian fields. Our first theorem concerns with the concept of multiple peaks. A theorem of Chatterjee states that when a centered Gaussian field admits the so-called superconcentration property, it typically attains values near its maximum on multiple near-orthogonal sites, known as multiple peaks. We improve his theorem in two aspects: (i) the number of peaks attained by our bound is of the order $\exp(c / σ^2)$ (as opposed to Chatterjee's polynomial bound in $1/σ$), where $σ$ is the standard deviation of the supremum of the Gaussian field, which is assumed to have variance at most $1$ and (ii) our bound need not assume that the correlations are non-negative. We also prove a similar result based on the superconcentration of the free energy. As primary applications, we infer that for the S-K spin glass model on the $n$-hypercube and directed polymers on $\mathbb{Z}_n^2$, there are polynomially (in $n$) many near-orthogonal sites that achieve values near their respective maxima. Our second theorem gives an upper bound on moderate deviation for the supremum of a general Gaussian field. While the Gaussian isoperimetric inequality implies a sub-Gaussian concentration bound for the supremum, we show that the exponent in that bound can be improved under the assumption that the expectation of the supremum is of the same order as that of the independent case.

preprint2013arXiv

Satisfiability threshold for random regular NAE-SAT

We consider the random regular $k$-NAE-SAT problem with $n$ variables each appearing in exactly $d$ clauses. For all $k$ exceeding an absolute constant $k_0$, we establish explicitly the satisfiability threshold $d_*=d_*(k)$. We prove that for $d<d_*$ the problem is satisfiable with high probability while for $d>d_*$ the problem is unsatisfiable with high probability. If the threshold $d_*$ lands exactly on an integer, we show that the problem is satisfiable with probability bounded away from both zero and one. This is the first result to locate the exact satisfiability threshold in a random constraint satisfaction problem exhibiting the condensation phenomenon identified by Krzakala et al. (2007). Our proof verifies the one-step replica symmetry breaking formalism for this model. We expect our methods to be applicable to a broad range of random constraint satisfaction problems and combinatorial problems on random graphs.

preprint2013arXiv

Scaling window for mean-field percolation of averages

For a complete graph of size $n$, assign each edge an i.i.d. exponential variable with mean $n$. For $λ>0$, consider the length of the longest path whose average weight is at most $λ$. It was shown by Aldous (1998) that the length is of order $\log n$ for $λ< 1/\mathrm{e}$ and of order $n$ for $λ> 1/\mathrm{e}$. Aldous (2003) posed the question on detailed behavior at and near criticality $1/\mathrm{e}$. In particular, Aldous asked whether there exist scaling exponents $μ, ν$ such that for $λ$ within $1/\mathrm{e}$ of order $n^{-μ}$, the length for the longest path of average weight at most $λ$ has order $n^ν$. We answer this question by showing that the critical behavior is far richer: For $λ$ around $1/\mathrm{e}$ within a window of $α(\log n)^{-2}$ with a small absolute constant $α>0$, the longest path is of order $(\log n)^3$. Furthermore, for $λ\geq 1/\mathrm{e} + β(\log n)^{-2}$ with $β$ a large absolute constant, the longest path is at least of length a polynomial in $n$. An interesting consequence of our result is the existence of a second transition point in $1/\mathrm{e} + [α(\log n)^{-2}, β(\log n)^{-2}]$. In addition, we demonstrate a smooth transition from subcritical to critical regime. Our results were not known before even in a heuristic sense.

preprint2012arXiv

Anatomy of the giant component: The strictly supercritical regime

In a recent work of the authors and Kim, we derived a complete description of the largest component of the Erdős-Rényi random graph $G(n,p)$ as it emerges from the critical window, i.e. for $p = (1+ε)/n$ where $ε^3 n \to\infty$ and $ε=o(1)$, in terms of a tractable contiguous model. Here we provide the analogous description for the supercritical giant component, i.e., the largest component of $G(n,p)$ for $p = λ/n$ where $λ>1$ is fixed. The contiguous model is roughly as follows: Take a random degree sequence and sample a random multigraph with these degrees to arrive at the kernel; Replace the edges by paths whose lengths are i.i.d. geometric variables to arrive at the 2-core; Attach i.i.d. Poisson Galton-Watson trees to the vertices for the final giant component. As in the case of the emerging giant, we obtain this result via a sequence of contiguity arguments at the heart of which are Kim's Poisson-cloning method and the Pittel-Wormald local limit theorems.

preprint2012arXiv

Exponential and double exponential tails for maximum of two-dimensional discrete Gaussian free field

We study the tail behavior for the maximum of discrete Gaussian free field on a 2D box with Dirichlet boundary condition after centering by its expectation. We show that it exhibits an exponential decay for the right tail and a double exponential decay for the left tail. In particular, our result implies that the variance of the maximum is of order 1, improving an $o(\log n)$ bound by Chatterjee (2008) and confirming a folklore conjecture. An important ingredient for our proof is a result of Bramson and Zeitouni (2010), who proved the tightness of the centered maximum together with an evaluation of the expectation up to an additive constant.

preprint2012arXiv

Glauber Dynamics for the mean-field Potts Model

We study Glauber dynamics for the mean-field (Curie-Weiss) Potts model with $q\geq 3$ states and show that it undergoes a critical slowdown at an inverse-temperature $β_s(q)$ strictly lower than the critical $β_c(q)$ for uniqueness of the thermodynamic limit. The dynamical critical $β_s(q)$ is the spinodal point marking the onset of metastability. We prove that when $β<β_s(q)$ the mixing time is asymptotically $C(β, q) n \log n$ and the dynamics exhibits the cutoff phenomena, a sharp transition in mixing, with a window of order $n$. At $β=β_s(q)$ the dynamics no longer exhibits cutoff and its mixing obeys a power-law of order $n^{4/3}$. For $β>β_s(q)$ the mixing time is exponentially large in $n$. Furthermore, as $β\uparrow β_s$ with $n$, the mixing time interpolates smoothly from subcritical to critical behavior, with the latter reached at a scaling window of $O(n^{-2/3})$ around $β_s$. These results form the first complete analysis of mixing around the critical dynamical temperature --- including the critical power law --- for a model with a first order phase transition.

preprint2012arXiv

Mixing time of near-critical random graphs

Let $\mathcal{C}_1$ be the largest component of the Erdős--Rényi random graph $\mathcal{G}(n,p)$. The mixing time of random walk on $\mathcal {C}_1$ in the strictly supercritical regime, $p=c/n$ with fixed $c>1$, was shown to have order $\log^2n$ by Fountoulakis and Reed, and independently by Benjamini, Kozma and Wormald. In the critical window, $p=(1+\varepsilon)/n$ where $λ=\varepsilon^3n$ is bounded, Nachmias and Peres proved that the mixing time on $\mathcal{C}_1$ is of order $n$. However, it was unclear how to interpolate between these results, and estimate the mixing time as the giant component emerges from the critical window. Indeed, even the asymptotics of the diameter of $\mathcal{C}_1$ in this regime were only recently obtained by Riordan and Wormald, as well as the present authors and Kim. In this paper, we show that for $p=(1+\varepsilon)/n$ with $λ=\varepsilon^3n\to\infty$ and $λ=o(n)$, the mixing time on $\mathcal{C}_1$ is with high probability of order $(n/λ)\log^2λ$. In addition, we show that this is the order of the largest mixing time over all components, both in the slightly supercritical and in the slightly subcritical regime [i.e., $p=(1-\varepsilon)/n$ with $λ$ as above].

preprint2012arXiv

On cover times for 2D lattices

We study the cover time $τ_{\mathrm{cov}}$ by (continuous-time) random walk on the 2D box of side length $n$ with wired boundary or on the 2D torus, and show that in both cases with probability approaching 1 as $n$ increases, $\sqrt{τ_{\mathrm{cov}}}=\sqrt{2n^2}[\sqrt{2/π} \log n + O(\log\log n)]$. This improves a result of Dembo, Peres, Rosen, and Zeitouni (2004) and makes progress towards a conjecture of Bramson and Zeitouni (2009).

preprint2012arXiv

Persistence of iterated partial sums

Let $S_n^{(2)}$ denote the iterated partial sums. That is, $S_n^{(2)}=S_1+S_2+ ... +S_n$, where $S_i=X_1+X_2+ ... s+X_i$. Assuming $X_1, X_2,....,X_n$ are integrable, zero-mean, i.i.d. random variables, we show that the persistence probabilities $$p_n^{(2)}:=\PP(\max_{1\le i \le n}S_i^{(2)}< 0) \le c\sqrt{\frac{\EE|S_{n+1}|}{(n+1)\EE|X_1|}},$$ with $c \le 6 \sqrt{30}$ (and $c=2$ whenever $X_1$ is symmetric). The converse inequality holds whenever the non-zero $\min(-X_1,0)$ is bounded or when it has only finite third moment and in addition $X_1$ is squared integrable. Furthermore, $p_n^{(2)}\asymp n^{-1/4}$ for any non-degenerate squared integrable, i.i.d., zero-mean $X_i$. In contrast, we show that for any $0 < γ< 1/4$ there exist integrable, zero-mean random variables for which the rate of decay of $p_n^{(2)}$ is $n^{-γ}$.

preprint2011arXiv

A sharp estimate for cover times on binary trees

We compute the second order correction for the cover time of the binary tree of depth $n$ by (continuous-time) random walk, and show that with probability approaching 1 as $n$ increases, $\sqrt{τ_{\mathrm{cov}}}=\sqrt{|E|}[\sqrt{2\log 2}\cdot n - {\log n}/{\sqrt{2\log 2}} + O((\log\logn)^8]$, thus showing that the second order correction differs from the corresponding one for the maximum of the Gaussian free field on the tree.

preprint2011arXiv

Cover times, blanket times, and majorizing measures

We exhibit a strong connection between cover times of graphs, Gaussian processes, and Talagrand's theory of majorizing measures. In particular, we show that the cover time of any graph $G$ is equivalent, up to universal constants, to the square of the expected maximum of the Gaussian free field on $G$, scaled by the number of edges in $G$. This allows us to resolve a number of open questions. We give a deterministic polynomial-time algorithm that computes the cover time to within an O(1) factor for any graph, answering a question of Aldous and Fill (1994). We also positively resolve the blanket time conjectures of Winkler and Zuckerman (1996), showing that for any graph, the blanket and cover times are within an O(1) factor. The best previous approximation factor for both these problems was $O((\log \log n)^2)$ for $n$-vertex graphs, due to Kahn, Kim, Lovasz, and Vu (2000).

preprint2010arXiv

Diameters in supercritical random graphs via first passage percolation

We study the diameter of $C_1$, the largest component of the Erdős-Rényi random graph $G(n,p)$ in the emerging supercritical phase, i.e., for $p = \frac{1+ε}n$ where $ε^3 n \to \infty$ and $ε=o(1)$. This parameter was extensively studied for fixed $ε> 0$, yet results for $ε=o(1)$ outside the critical window were only obtained very recently. Prior to this work, Riordan and Wormald gave precise estimates on the diameter, however these did not cover the entire supercritical regime (namely, when $ε^3 n\to\infty$ arbitrarily slowly). Łuczak and Seierstad estimated its order throughout this regime, yet their upper and lower bounds differed by a factor of $1000/7$. We show that throughout the emerging supercritical phase, i.e. for any $ε=o(1)$ with $ε^3 n \to \infty$, the diameter of $C_1$ is with high probability asymptotic to $D(ε,n)=(3/ε)\log(ε^3 n)$. This constitutes the first proof of the asymptotics of the diameter valid throughout this phase. The proof relies on a recent structure result for the supercritical giant component, which reduces the problem of estimating distances between its vertices to the study of passage times in first-passage percolation. The main advantage of our method is its flexibility. It also implies that in the emerging supercritical phase the diameter of the 2-core of $C_1$ is w.h.p. asymptotic to $(2/3)D(ε,n)$, and the maximal distance in $C_1$ between any pair of kernel vertices is w.h.p. asymptotic to $(5/9)D(ε,n)$.

preprint2010arXiv

The evolution of the cover time

The cover time of a graph is a celebrated example of a parameter that is easy to approximate using a randomized algorithm, but for which no constant factor deterministic polynomial time approximation is known. A breakthrough due to Kahn, Kim, Lovasz and Vu yielded a (log log n)^2 polynomial time approximation. We refine this upper bound, and show that the resulting bound is sharp and explicitly computable in random graphs. Cooper and Frieze showed that the cover time of the largest component of the Erdos-Renyi random graph G(n,c/n) in the supercritical regime with c>1 fixed, is asymptotic to f(c) n \log^2 n, where f(c) tends to 1 as c tends to 1. However, our new bound implies that the cover time for the critical Erdos-Renyi random graph G(n,1/n) has order n, and shows how the cover time evolves from the critical window to the supercritical phase. Our general estimate also yields the order of the cover time for a variety of other concrete graphs, including critical percolation clusters on the Hamming hypercube {0,1}^n, on high-girth expanders, and on tori Z_n^d for fixed large d. For the graphs we consider, our results show that the blanket time, introduced by Winkler and Zuckerman, is within a constant factor of the cover time. Finally, we prove that for any connected graph, adding an edge can increase the cover time by at most a factor of 4.

preprint2010arXiv

The Hitchhiker's Guide to Affiliation Networks: A Game-Theoretic Approach

We propose a new class of game-theoretic models for network formation in which strategies are not directly related to edge choices, but instead correspond more generally to the exertion of social effort. The observed social network is thus a byproduct of an expressive strategic interaction, which can more naturally explain the emergence of complex social structures. Within this framework, we present a natural network formation game in which agent utilities are locally defined and that, despite its simplicity, produces a rich class of equilibria that exhibit structural properties commonly observed in social networks - such as triadic closure - that have proved elusive in most existing models. Specifically, we consider a game in which players organize networking events at a cost that grows with the number of attendees. An event's cost is assumed by the organizer but the benefit accrues equally to all attendees: a link is formed between any two players who see each other at more than a certain number r of events per time period. The graph of connections so obtained is the social network of the model. We analyze the Nash equilibria of this game when each player derives a benefit a>0 from all her neighbors in the network and when the costs are linear, i.e., when the cost of an event with L invitees is b+cL, with b>0 and c>0. For a/cr > 1 and b sufficiently small, all Nash equilibria have the complete graph as their social network; for a/cr < 1 the Nash equilibria correspond to a rich class of social networks, all of which have substantial clustering in the sense that the clustering coefficient is bounded below by the inverse of the average degree. Additionally, for any degree sequence with finite mean, and not too many vertices of degree one or two, we can construct a Nash equilibrium producing a social network with the given degree sequence.

preprint2009arXiv

Electron heating and acceleration by magnetic reconnection in hot accretion flows

Both analytical and numerical works show that magnetic reconnection must occur in hot accretion flows. This process will effectively heat and accelerate electrons. In this paper we use the numerical hybrid simulation of magnetic reconnection plus test-electron method to investigate the electron acceleration and heating due to magnetic reconnection in hot accretion flows. We consider fiducial values of density, temperature, and magnetic parameter $β_e$ (defined as the ratio of the electron pressure to the magnetic pressure) of the accretion flow as $n_{0} \sim 10^{6} {\rm cm^{-3}}$, $T_{e}^0\sim 2\times 10^9 {\rm K}$, and $β_e=1$. We find that electrons are heated to a higher temperature $T_{e}=5\times 10^9$K, and a fraction $η\sim 8%$ of electrons are accelerated into a broken power-law distribution, $dN(γ)\propto γ^{-p}$, with $p\approx 1.5$ and 4 below and above $\sim 1$ MeV, respectively. We also investigate the effect of varying $β$ and $n_0$. We find that when $β_e$ is smaller or $n_0$ is larger, i.e, the magnetic field is stronger, $T_e$, $η$, and $p$ all become larger.

preprint2009arXiv

Mixing time of critical Ising model on trees is polynomial in the height

In the heat-bath Glauber dynamics for the Ising model on the lattice, physicists believe that the spectral gap of the continuous-time chain exhibits the following behavior. For some critical inverse-temperature $β_c$, the inverse-gap is bounded for $β< β_c$, polynomial in the surface area for $β= β_c$ and exponential in it for $β> β_c$. This has been proved for $\Z^2$ except at criticality. So far, the only underlying geometry where the critical behavior has been confirmed is the complete graph. Recently, the dynamics for the Ising model on a regular tree, also known as the Bethe lattice, has been intensively studied. The facts that the inverse-gap is bounded for $β< β_c$ and exponential for $β> β_c$ were established, where $β_c$ is the critical spin-glass parameter, and the tree-height $h$ plays the role of the surface area. In this work, we complete the picture for the inverse-gap of the Ising model on the $b$-ary tree, by showing that it is indeed polynomial in $h$ at criticality. The degree of our polynomial bound does not depend on $b$, and furthermore, this result holds under any boundary condition. We also obtain analogous bounds for the mixing-time of the chain. In addition, we study the near critical behavior, and show that for $β> β_c$, the inverse-gap and mixing-time are both $\exp[Θ((β-β_c) h)]$.

preprint2008arXiv

Censored Glauber Dynamics for the mean field Ising Model

We study Glauber dynamics for the Ising model on the complete graph on $n$ vertices, known as the Curie-Weiss Model. It is well known that at high temperature ($β< 1$) the mixing time is $Θ(n\log n)$, whereas at low temperature ($β> 1$) it is $\exp(Θ(n))$. Recently, Levin, Luczak and Peres considered a censored version of this dynamics, which is restricted to non-negative magnetization. They proved that for fixed $β> 1$, the mixing-time of this model is $Θ(n\log n)$, analogous to the high-temperature regime of the original dynamics. Furthermore, they showed \emph{cutoff} for the original dynamics for fixed $β<1$. The question whether the censored dynamics also exhibits cutoff remained unsettled. In a companion paper, we extended the results of Levin et al. into a complete characterization of the mixing-time for the Currie-Weiss model. Namely, we found a scaling window of order $1/\sqrt{n}$ around the critical temperature $β_c=1$, beyond which there is cutoff at high temperature. However, determining the behavior of the censored dynamics outside this critical window seemed significantly more challenging. In this work we answer the above question in the affirmative, and establish the cutoff point and its window for the censored dynamics beyond the critical window, thus completing its analogy to the original dynamics at high temperature. Namely, if $β= 1 + δ$ for some $δ> 0$ with $δ^2 n \to \infty$, then the mixing-time has order $(n / δ)\log(δ^2 n)$. The cutoff constant is $(1/2+[2(ζ^2 β/ δ- 1)]^{-1})$, where $ζ$ is the unique positive root of $g(x)=\tanh(βx)-x$, and the cutoff window has order $n / δ$.