BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

Amarjit Budhiraja

Amarjit Budhiraja appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
math.PRmath.OCBiomoleculesComputational Engineering, Finance, and ScienceComputer VisionMachine Learningmath.COmath.NAmath.STMultiagent SystemsStatistics Theory

Catalog footprint

What is connected

41works
11topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

41 published item(s)

preprint2026arXiv

Long Time Asymptotics for the Stochastic Follow-the-Leader System

We introduce and analyze a class of interacting particle systems on the real line that combine features of the stochastic rat race and (deterministic) follow-the-leader models. The particle system evolves as a continuous-time pure jump process: the leading particle moves independently, at Exponential jump times, with constant jump rate and iid jump sizes distributed according to a law $θ$, while each of the remaining particles jumps forward, at Exponential times, at rate equal to its distance from the particle immediately ahead, with jump sizes drawn uniformly from the corresponding gap. The dynamics thus encode competition for leadership together with distance-dependent stochastic interactions. Our main focus is the associated gap process, representing the vector of inter-particle distances. We establish the existence of a unique stationary distribution for the gap process and prove uniform geometric ergodicity. Further, when the leader's jump sizes follow an Exponential distribution, we identify the stationary law explicitly as a product of independent Exponential laws, and show that the associated mixing time scales between $Θ(n)$ and $O(n(\log n)^2)$ for an $n$-particle system. As an application of the mixing time results we establish a functional limit theorem that characterizes fluctuations of particle states at large time, under a suitable spatial and temporal scaling and large particle limit. Finally, when the leader's jumps have heavy but integrable tails, we show that each gap has at least one additional finite moment under stationarity than that of the leader's jump size distribution. The model offers a tractable setting for exploring ergodicity, explicit invariant laws, and mixing behavior in non-diffusive particle systems.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Does Momentum Help? A Sample Complexity Analysis

Stochastic Heavy Ball (SHB) and Nesterov's Accelerated Stochastic Gradient (ASG) are popular momentum methods in stochastic optimization. While benefits of such acceleration ideas in deterministic settings are well understood, their advantages in stochastic optimization is still unclear. In fact, in some specific instances, it is known that momentum does not help in the sample complexity sense. Our work shows that a similar outcome actually holds for the whole of quadratic optimization. Specifically, we obtain a lower bound on the sample complexity of SHB and ASG for this family and show that the same bound can be achieved by the vanilla SGD. We note that there exist results claiming the superiority of momentum based methods in quadratic optimization, but these are based on one-sided or flawed analyses.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Domains of attraction of invariant distributions of the infinite Atlas model

The infinite Atlas model describes a countable system of competing Brownian particles where the lowest particle gets a unit upward drift and the rest evolve as standard Brownian motions. The stochastic process of gaps between the particles in the infinite Atlas model does not have a unique stationary distribution and in fact for every $a \ge 0$, $π_a := \bigotimes_{i=1}^{\infty} \operatorname{Exp}(2 + ia)$ is a stationary measure for the gap process. We say that an initial distribution of gaps is in the weak domain of attraction of the stationary measure $π_a$ if the time averaged laws of the stochastic process of the gaps, when initialized using that distribution, converge to $π_a$ weakly in the large time limit. We provide general sufficient conditions on the initial gap distribution of the Atlas particles for it to lie in the weak domain of attraction of $π_a$ for each $a\ge 0$. The cases $a=0$ and $a>0$ are qualitatively different as is seen from the analysis and the sufficient conditions that we provide. Proofs are based on the analysis of synchronous couplings, namely, couplings of the ranked particle systems started from different initial configurations, but driven using the same set of Brownian motions.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Empirical Measure Large Deviations for Reinforced Chains on Finite Spaces

Let $A$ be a transition probability kernel on a finite state space $Δ^o =\{1, \ldots , d\}$ such that $A(x,y)>0$ for all $x,y \in Δ^o$. Consider a reinforced chain given as a sequence $\{X_n, \; n \in \mathbb{N}_0\}$ of $Δ^o$-valued random variables, defined recursively according to, $$L^n = \frac{1}{n}\sum_{i=0}^{n-1} δ_{X_i}, \;\; P(X_{n+1} \in \cdot \mid X_0, \ldots, X_n) = L^n A(\cdot).$$ We establish a large deviation principle for $\{L^n\}$. The rate function takes a strikingly different form than the Donsker-Varadhan rate function associated with the empirical measure of the Markov chain with transition kernel $A$ and is described in terms of a novel deterministic infinite horizon discounted cost control problem with an associated linear controlled dynamics and a nonlinear running cost involving the relative entropy function. Proofs are based on an analysis of time-reversal of controlled dynamics in representations for log-transforms of exponential moments, and on weak convergence methods.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Long Time Behavior of Finite and Infinite Dimensional Reflected Brownian Motions

This article presents a review of some old and new results on the long time behavior of reflected diffusions. First, we present a summary of prior results on construction, ergodicity and geometric ergodicity of reflected diffusions in the positive orthant $\mathbb{R}^d_+$, $d \in \mathbb{N}$. The geometric ergodicity results, although very general, usually give implicit convergence rates due to abstract couplings and Lyapunov functions used in obtaining them. This leads us to some recent results on an important subclass of reflected Brownian motions (RBM) (constant drift and diffusion coefficients and oblique reflection at boundaries), known as the Harrison-Reiman class, where explicit rates of convergence are obtained as functions of the system parameters and underlying dimension. In addition, sufficient conditions on system parameters of the RBM are provided under which local convergence to stationarity holds at a `dimension-free' rate, that is, for any fixed $k \in \mathbb{N}$, the rate of convergence of the $k$-marginal to equilibrium does not depend on the dimension of the whole system. Finally, we study the long time behavior of infinite dimensional rank-based diffusions, including the well-studied infinite Atlas model. The gaps between the ordered particles evolve as infinite dimensional RBM and this gap process has uncountably many explicit product form stationary distributions. Sufficient conditions for initial configurations to lie in the weak domain of attraction of the various stationary distributions are provided. Finally, it is shown that, under conditions, all of these explicit stationary distributions are extremal (equivalently, ergodic) and, in some sense, the only product form invariant probability distributions. Proof techniques involve a pathwise analysis of RBM using explicit synchronous and mirror couplings and constructing Lyapunov functions.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Quasistationary Distributions and Ergodic Control Problems

We introduce and study the basic properties of two ergodic stochastic control problems associated with the quasistationary distribution (QSD) of a diffusion process $X$ relative to a bounded domain. The two problems are in some sense dual, with one defined in terms of the generator associated with $X$ and the other in terms of its adjoint. Besides proving wellposedness of the associated Hamilton-Jacobi-Bellman equations, we describe how they can be used to characterize important properties of the QSD. Of particular note is that the QSD itself can be identified, up to normalization, in terms of the cost potential of the control problem associated with the adjoint.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Augmenting Molecular Images with Vector Representations as a Featurization Technique for Drug Classification

One of the key steps in building deep learning systems for drug classification and generation is the choice of featurization for the molecules. Previous featurization methods have included molecular images, binary strings, graphs, and SMILES strings. This paper proposes the creation of molecular images captioned with binary vectors that encode information not contained in or easily understood from a molecular image alone. Specifically, we use Morgan fingerprints, which encode higher level structural information, and MACCS keys, which encode yes or no questions about a molecules properties and structure. We tested our method on the HIV dataset published by the Pande lab, which consists of 41,127 molecules labeled by if they inhibit the HIV virus. Our final model achieved a state of the art AUC ROC on the HIV dataset, outperforming all other methods. Moreover, the model converged significantly faster than most other methods, requiring dramatically less computational power than unaugmented images.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Empirical Measure and Small Noise Asymptotics under Large Deviation Scaling for Interacting Diffusions

Consider a collection of particles whose state evolution is described through a system of interacting diffusions in which each particle is driven by an independent individual source of noise and also by a small amount of noise that is common to all particles. The interaction between the particles is due to the common noise and also through the drift and diffusion coefficients that depend on the state empirical measure. We study large deviation behavior of the empirical measure process which is governed by two types of scaling, one corresponding to mean field asymptotics and the other to the Freidlin-Wentzell small noise asymptotics. Different levels of intensity of the small common noise lead to different types of large deviation behavior, and we provide a precise characterization of the various regimes. We also study large deviation behavior of interacting particle systems approximating various types of Feynman-Kac functionals. Proofs are based on stochastic control representations for exponential functionals of Brownian motions and on uniqueness results for weak solutions of stochastic differential equations associated with controlled nonlinear Markov processes.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Large deviation principles for stochastic dynamical systems with a fractional Brownian noise

We study small noise large deviation asymptotics for stochastic differential equations with a multiplicative noise given as a fractional Brownian motion $B^H$ with Hurst parameter $H>\frac12$. The solutions of the stochastic differential equations are defined pathwise under appropriate conditions on the coefficients. The ingredients in the proof of the large deviation principle, which include a variational representation for nonnegative functionals of fractional Brownian motions and a general sufficient condition for a LDP for a collection of functionals of a fractional Brownian motions, have a broader applicability than the model considered here.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Large Deviations for the Single Server Queue and the Reneging Paradox

For the M/M/1+M model at the law-of-large-numbers scale, the long run reneging count per unit time does not depend on the individual (i.e., per customer) reneging rate. This paradoxical statement has a simple proof. Less obvious is a large deviations analogue of this fact, stated as follows: The decay rate of the probability that the long run reneging count per unit time is atypically large or atypically small does not depend on the individual reneging rate. In this paper, the sample path large deviations principle for the model is proved and the rate function is computed. Next, large time asymptotics for the reneging rate are studied for the case when the arrival rate exceeds the service rate. The key ingredient is a calculus of variations analysis of the variational problem associated with atypical reneging. A characterization of the aforementioned decay rate, given explicitly in terms of the arrival and service rate parameters of the model, is provided yielding a precise mathematical description of this paradoxical behavior.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Near Equilibrium Fluctuations for Supermarket Models with Growing Choices

We consider the supermarket model in the usual Markovian setting where jobs arrive at rate $n λ_n$ for some $λ_n > 0$, with $n$ parallel servers each processing jobs in its queue at rate 1. An arriving job joins the shortest among $d_n \le n$ randomly selected service queues. We show that when $d_n \to \infty$ and $λ_n \to λ\in (0, \infty)$, under natural conditions on the initial queues, the state occupancy process converges in probability, in a suitable path space, to the unique solution of an infinite system of constrained ordinary differential equations parametrized by $λ$. Our main interest is in the study of fluctuations of the state process about its near equilibrium state in the critical regime, namely when $λ_n \to 1$. Previous papers have considered the regime $\frac{d_n}{\sqrt{n}\log n} \to \infty$ while the objective of the current work is to develop diffusion approximations for the state occupancy process that allow for all possible rates of growth of $d_n$. In particular we consider the three canonical regimes (a) ${d_n}/{\sqrt{n}} \to 0$; (b) ${d_n}/{\sqrt{n}} \to c\in (0,\infty)$ and, (c) ${d_n}/{\sqrt{n}} \to \infty$. In all three regimes we show, by establishing suitable functional limit theorems, that (under conditions on $λ_n$) fluctuations of the state process about its near equilibrium are of order $n^{-1/2}$ and are governed asymptotically by a one dimensional Brownian motion. The forms of the limit processes in the three regimes are quite different; in the first case we get a linear diffusion; in the second case we get a diffusion with an exponential drift; and in the third case we obtain a reflected diffusion in a half space. In the special case ${d_n}/({\sqrt{n}\log n}) \to \infty$ our work gives alternative proofs for the universality results established by Mukherjee et al in 2018.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Rare event asymptotics for exploration processes for random graphs

Much work in the study of large deviations for random graph models is focused on the dense regime where the theory of graphons has emerged as a principal tool. These tools do not give a good approach to large deviation problems for random graph models in the sparse regime. The aim of this paper is to study an approach for large deviation problems in this regime by establishing Large Deviation Principles (LDP) on suitable path spaces for certain exploration processes of the associated random graph sequence. Our work focuses on the study of one particular class of random graph models, namely the configuration model; however the general approach of using exploration processes for studying large deviation properties of sparse random graph models has broader applicability. The goal is to study asymptotics of probabilities of non-typical behavior in the large network limit. The first key step for this is to establish a LDP for an exploration process associated with the configuration model. A suitable exploration process here turns out to be an infinite dimensional Markov process with transition probability rates that diminish to zero in certain parts of the state space. Large deviation properties of such Markovian models is challenging due to poor regularity behavior of the associated local rate functions. Next, using the rate function in the LDP for the exploration process we formulate a calculus of variations problem associated with the asymptotics of component degree distributions. The second key ingredient in our study is a careful analysis of the infinite dimensional Euler-Lagrange equations associated with this calculus of variations problem. Exact solutions are identified which then provide explicit formulas for decay rates of probabilities of non-typical component degree distributions and related quantities. Please see the paper for the complete abstract.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Robust bounds and optimization at the large deviations scale for queueing models via Rényi divergence

This paper develops tools to obtain robust probabilistic estimates for queueing models at the large deviations (LD) scale. These tools are based on the recently introduced robust Rényi bounds, which provide LD estimates (and more generally risk-sensitive (RS) cost estimates) that hold uniformly over an uncertainty class of models, provided that the class is defined in terms of Rényi divergence with respect to a reference model and that estimates are available for the reference model. One very attractive quality of the approach is that the class to which the estimates apply may consist of hard models, such as highly non-Markovian models and ones for which the LD principle is not available. Our treatment provides exact expressions as well as bounds on the Rényi divergence rate on families of marked point processes, including as a special case renewal processes. Another contribution is a general result that translates robust RS control problems, where robustness is formulated via Rényi divergence, to finite dimensional convex optimization problems, when the control set is a finite dimensional convex set. The implications to queueing are vast, as they apply in great generality. This is demonstrated on two non-Markovian queueing models. One is the multiclass single-server queue considered as a RS control problem, with scheduling as the control process and exponential weighted queue length as cost. The second is the many-server queue with reneging, with the probability of atypically large reneging count as performance criterion. As far as LD analysis is concerned, no robust estimates or non-Markovian treatment were previously available for either of these models.

0 citations0 reviewsNo code linkedOpen access
preprint2018arXiv

Supermarket Model on Graphs

We consider a variation of the supermarket model in which the servers can communicate with their neighbors and where the neighborhood relationships are described in terms of a suitable graph. Tasks with unit-exponential service time distributions arrive at each vertex as independent Poisson processes with rate $λ$, and each task is irrevocably assigned to the shortest queue among the one it first appears and its $d-1$ randomly selected neighbors. This model has been extensively studied when the underlying graph is a clique in which case it reduces to the well known power-of-$d$ scheme. In particular, results of Mitzenmacher (1996) and Vvedenskaya et al. (1996) show that as the size of the clique gets large, the occupancy process associated with the queue-lengths at the various servers converges to a deterministic limit described by an infinite system of ordinary differential equations (ODE). In this work, we consider settings where the underlying graph need not be a clique and is allowed to be suitably sparse. We show that if the minimum degree approaches infinity (however slowly) as the number of servers $N$ approaches infinity, and the ratio between the maximum degree and the minimum degree in each connected component approaches 1 uniformly, the occupancy process converges to the same system of ODE as the classical supermarket model. In particular, the asymptotic behavior of the occupancy process is insensitive to the precise network topology. We also study the case where the graph sequence is random, with the $N$-th graph given as an Erdős-Rényi random graph on $N$ vertices with average degree $c(N)$. Annealed convergence of the occupancy process to the same deterministic limit is established under the condition $c(N)\to\infty$, and under a stronger condition $c(N)/\ln N\to\infty$, convergence (in probability) is shown for almost every realization of the random graph.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Diffusion Approximations for Controlled Weakly Interacting Large Finite State Systems with Simultaneous Jumps

We consider a rate control problem for an $N$-particle weakly interacting finite state Markov process. The process models the state evolution of a large collection of particles and allows for multiple particles to change state simultaneously. Such models have been proposed for large communication systems (e.g. ad hoc wireless networks) but are also suitable for other settings such as chemical-reaction networks. An associated diffusion control problem is presented and we show that the value function of the $N$-particle controlled system converges to the value function of the limit diffusion control problem as $N\to\infty$. The diffusion coefficient in the limit model is typically degenerate, however under suitable conditions there is an equivalent formulation in terms of a controlled diffusion with a uniformly non-degenerate diffusion coefficient. Using this equivalence, we show that near optimal continuous feedback controls exist for the diffusion control problem. We then construct near asymptotically optimal control policies for the $N$-particle system based on such continuous feedback controls. Results from some numerical experiments are presented.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Construction of Asymptotically Optimal Control for a Stochastic Network from a Free Boundary Problem

An asymptotic framework for optimal control of multiclass stochastic processing networks, using formal diffusion approximations under suitable temporal and spatial scaling, by Brownian control problems (BCP) and their equivalent workload formulations (EWF), has been developed by Harrison (1988). This framework has been implemented in many works for constructing asymptotically optimal control policies for a broad range of stochastic network models. To date all asymptotic optimality results for such networks correspond to settings where the solution of the EWF is a reflected Brownian motion in the positive orthant with normal reflections. In this work we consider a well studied stochastic network which is perhaps the simplest example of a model with more than one dimensional workload process. In the regime considered here, the singular control problem corresponding to the EWF does not have a simple form explicit solution, however by considering an associated free boundary problem one can give a representation for an optimal controlled process as a two dimensional reflected Brownian motion in a Lipschitz domain whose boundary is determined by the solution of the free boundary problem. Using the form of the optimal solution we propose a sequence of control policies, given in terms of suitable thresholds, for the scaled stochastic network control problems and prove that this sequence of policies is asymptotically optimal. As suggested by the solution of the EWF, the policy we propose requires a server to idle under certain conditions which are specified in terms of the thresholds determined from the free boundary.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Limits of relative entropies associated with weakly interacting particle systems

The limits of scaled relative entropies between probability distributions associated with N-particle weakly interacting Markov processes are considered. The convergence of such scaled relative entropies is established in various settings. The analysis is motivated by the role relative entropy plays as a Lyapunov function for the (linear) Kolmogorov forward equation associated with an ergodic Markov process, and Lyapunov function properties of these scaling limits with respect to nonlinear finite-state Markov processes are studied in the companion paper [6].

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Local stability of Kolmogorov forward equations for finite state nonlinear Markov processes

The focus of this work is on local stability of a class of nonlinear ordinary differential equations (ODE) that describe limits of empirical measures associated with finite-state weakly interacting N-particle systems. Local Lyapunov functions are identified for several classes of such ODE, including those associated with systems with slow adaptation and Gibbs systems. Using results from [5] and large deviations heuristics, a partial differential equation (PDE) associated with the nonlinear ODE is introduced and it is shown that positive definite subsolutions of this PDE serve as local Lyapunov functions for the ODE. This PDE characterization is used to construct explicit Lyapunov functions for a broad class of models called locally Gibbs systems. This class of models is significantly larger than the family of Gibbs systems and several examples of such systems are presented, including models with nearest neighbor jumps and models with simultaneous jumps that arise in applications.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Moderate Deviation Principles for Weakly Interacting Particle Systems

Moderate deviation principles for empirical measure processes associated with weakly interacting Markov processes are established. Two families of models are considered: the first corresponds to a system of interacting diffusions whereas the second describes a collection of pure jump Markov processes with a countable state space. For both cases the moderate deviation principle is formulated in terms of a large deviation principle (LDP), with an appropriate speed function, for suitably centered and normalized empirical measure processes. For the first family of models the LDP is established in the path space of an appropriate Schwartz distribution space whereas for the second family the LDP is proved in the space of $l_2$ (the Hilbert space of square summable sequences)-valued paths. Proofs rely on certain variational representations for exponential functionals of Brownian motions and Poisson random measures.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Some Fluctuation Results for Weakly Interacting Multi-type Particle System

A collection of $N$-diffusing interacting particles where each particle belongs to one of $K$ different populations is considered. Evolution equation for a particle from population $k$ depends on the $K$ empirical measures of particle states corresponding to the various populations and the form of this dependence may change from one population to another. In addition, the drift coefficients in the particle evolution equations may depend on a factor that is common to all particles and which is described through the solution of a stochastic differential equation coupled, through the empirical measures, with the $N$-particle dynamics. We are interested in the asymptotic behavior as $N\to \infty$. Although the full system is not exchangeable, particles in the same population have an exchangeable distribution. Using this structure, one can prove using standard techniques a law of large numbers result and a propagation of chaos property. In the current work we study fluctuations about the law of large number limit. For the case where the common factor is absent the limit is given in terms of a Gaussian field whereas in the presence of a common factor it is characterized through a mixture of Gaussian distributions. We also obtain, as a corollary, new fluctuation results for disjoint sub-families of single type particle systems, i.e. when $K=1$. Finally, we establish limit theorems for multi-type statistics of such weakly interacting particles, given in terms of multiple Wiener integrals.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Source detection algorithms for dynamic contaminants based on the analysis of a hydrodynamic limit

In this work we propose and numerically analyze an algorithm for detection of a contaminant source using a dynamic sensor network. The algorithm is motivated using a global probabilistic optimization problem and is based on the analysis of the hydrodynamic limit of a discrete time evolution equation on the lattice under a suitable scaling of time and space. Numerical results illustrating the effectiveness of the algorithm are presented.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Individual confidence intervals for true solutions to stochastic variational inequalities

Stochastic variational inequalities (SVI) provide a means for modeling various optimization and equilibrium problems where data are subject to uncertainty. Often it is necessary to estimate the true SVI solution by the solution of a sample average approximation (SAA) problem. This paper proposes three methods for building confidence intervals for components of the true solution, and those intervals are computable from a single SAA solution. The first two methods use an "indirect approach" that requires initially computing asymptotically exact confidence intervals for the solution to the normal map formulation of the SVI. The third method directly constructs confidence intervals for the true SVI solution; intervals produced with this method meet a minimum specified level of confidence in the same situations for which the first two methods are applicable. We justify the three methods theoretically with weak convergence results, discuss how to implement these methods, and test their performance using two numerical examples.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Infinite Dimensional Forward-Backward Stochastic Differential Equations and the KPZ Equation

Kardar-Parisi-Zhang (KPZ) equation is a quasilinear stochastic partial differential equation(SPDE) driven by a space-time white noise. In recent years there have been several works directed towards giving a rigorous meaning to a solution of this equation. Bertini, Cancrini and Giacomin have proposed a notion of a solution through a limiting procedure and a certain renormalization of the nonlinearity. In this work we study connections between the KPZ equation and certain infinite dimensional forward-backward stochastic differential equations. Forward-backward equations with a finite dimensional noise have been studied extensively, mainly motivated by problems in mathematical finance. Equations considered here differ from the classical works in that, in addition to having an infinite dimensional driving noise, the associated SPDE involves a non-Lipschitz (namely a quadratic) function of the gradient. Existence and uniqueness of solutions of such infinite dimensional forward-backward equations is established and the terminal values of the solutions are then used to give a new probabilistic representation for the solution of the KPZ equation.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Large deviations for multidimensional state-dependent shot noise processes

Shot noise processes are used in applied probability to model a variety of physical systems in, for example, teletraffic theory, insurance and risk theory and in the engineering sciences. In this work we prove a large deviation principle for the sample-paths of a general class of multidimensional state-dependent Poisson shot noise processes. The result covers previously known large deviation results for one dimensional state-independent shot noise processes with light tails. We use the weak convergence approach to large deviations, which reduces the proof to establishing the appropriate convergence of certain controlled versions of the original processes together with relevant results on existence and uniqueness.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Long Time Results for a Weakly Interacting Particle System in Discrete Time

We study long time behavior of a discrete time weakly interacting particle system, and the corresponding nonlinear Markov process in $\mathbb{R}^d$, described in terms of a general stochastic evolution equation. In a setting where the state space of the particles is compact such questions have been studied in previous works, however for the case of an unbounded state space very few results are available. Under suitable assumptions on the problem data we study several time asymptotic properties of the $N$-particle system and the associated nonlinear Markov chain. In particular we show that the evolution equation for the law of the nonlinear Markov chain has a unique fixed point and starting from an arbitrary initial condition convergence to the fixed point occurs at an exponential rate. The empirical measure $μ_{n}^{N}$ of the $N$-particles at time $n$ is shown to converge to the law $μ_{n}$ of the nonlinear Markov process at time $n$, in the Wasserstein-1 distance, in $L^{1}$, as $N\to \infty$, uniformly in $n$. Several consequences of this uniform convergence are studied, including the interchangeability of the limits $n\to \infty$ and $N\to\infty$ and the propagation of chaos property at $n = \infty$. Rate of convergence of $μ_{n}^{N}$ to $μ_{n}$ is studied by establishing uniform in time polynomial and exponential probability concentration estimates.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Near critical catalyst reactant branching processes with controlled immigration

Near critical catalyst-reactant branching processes with controlled immigration are studied. The reactant population evolves according to a branching process whose branching rate is proportional to the total mass of the catalyst. The bulk catalyst evolution is that of a classical continuous time branching process; in addition there is a specific form of immigration. Immigration takes place exactly when the catalyst population falls below a certain threshold, in which case the population is instantaneously replenished to the threshold. Such models are motivated by problems in chemical kinetics where one wants to keep the level of a catalyst above a certain threshold in order to maintain a desired level of reaction activity. A diffusion limit theorem for the scaled processes is presented, in which the catalyst limit is described through a reflected diffusion, while the reactant limit is a diffusion with coefficients that are functions of both the reactant and the catalyst. Stochastic averaging principles under fast catalyst dynamics are established. In the case where the catalyst evolves "much faster" than the reactant, a scaling limit, in which the reactant is described through a one dimensional SDE with coefficients depending on the invariant distribution of the reflected diffusion, is obtained. Proofs rely on constrained martingale problem characterizations, Lyapunov function constructions, moment estimates that are uniform in time and the scaling parameter and occupation measure techniques.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

On Uniform Positivity of Transition Densities of Small Noise Constrained Diffusions

Constrained diffusions in convex polyhedral domains with a general oblique reflection field, and with a diffusion coefficient scaled by a small parameter, are considered. Using an interior Dirichlet heat kernel lower bound estimate for second order elliptic operators in bounded domains from [13], certain uniform in the scaling parameter lower bounds on transition densities of such constrained diffusions are established. These lower bounds together with results from [1] give, under additional stability conditions, an exponential leveling property, as the scaling parameter approaches zero, for exit times from suitable bounded domains.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

A Numerical Scheme for Invariant Distributions of Constrained Diffusions

Reflected diffusions in polyhedral domains are commonly used as approximate models for stochastic processing networks in heavy traffic. Stationary distributions of such models give useful information on the steady state performance of the corresponding stochastic networks and thus it is important to develop reliable and efficient algorithms for numerical computation of such distributions. In this work we propose and analyze a Monte-Carlo scheme based on an Euler type discretization of the reflected stochastic differential equation using a single sequence of time discretization steps which decrease to zero as time approaches infinity. Appropriately weighted empirical measures constructed from the simulated discretized reflected diffusion are proposed as approximations for the invariant probability measure of the true diffusion model. Almost sure consistency results are established that in particular show that weighted averages of polynomially growing continuous functionals evaluated on the discretized simulated system converge a.s. to the corresponding integrals with respect to the invariant measure. Proofs rely on constructing suitable Lyapunov functions for tightness and uniform integrability and characterizing almost sure limit points through an extension of Echeverria's criteria for reflected diffusions. Regularity properties of the underlying Skorohod problems play a key role in the proofs. Rates of convergence for suitable families of test functions are also obtained. A key advantage of Monte-Carlo methods is the ease of implementation, particularly for high dimensional problems. A numerical example of a eight dimensional Skorohod problem is presented to illustrate the applicability of the approach.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Admission Control for Multidimensional Workload with Heavy Tails and Fractional Ornstein-Uhlenbeck Process

The infinite source Poisson arrival model with heavy-tailed workload distributions has attracted much attention, especially in the modeling of data packet traffic in communication networks. In particular, it is well known that under suitable assumptions on the source arrival rate, the centered and scaled cumulative workload process for the underlying processing system can be approximated by fractional Brownian motion. In many applications one is interested in the stabilization of the work inflow to the system by modifying the net input rate, using an appropriate admission control policy. In this work we study a natural family of admission control policies which keep the associated scaled cumulative workload asymptotically close to a pre-specified linear trajectory, uniformly over time. Under such admission control policies and with natural assumptions on arrival distributions, suitably scaled and centered cumulative workload processes are shown to converge weakly in the path space to the solution of a $d$-dimensional stochastic differential equation (SDE) driven by a Gaussian process. It is shown that the admission control policy achieves moment stabilization in that the second moment of the solution to the SDE (averaged over the $d$-stations) is bounded uniformly for all times. In one special case of control policies, as time approaches infinity, we obtain a fractional version of a stationary Ornstein-Uhlenbeck process that is driven by fractional Brownian motion with Hurst parameter $H>1/2$.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Controlled stochastic networks in heavy traffic: Convergence of value functions

Scheduling control problems for a family of unitary networks under heavy traffic with general interarrival and service times, probabilistic routing and an infinite horizon discounted linear holding cost are studied. Diffusion control problems, that have been proposed as approximate models for the study of these critically loaded controlled stochastic networks, can be regarded as formal scaling limits of such stochastic systems. However, to date, a rigorous limit theory that justifies the use of such approximations for a general family of controlled networks has been lacking. It is shown that, under broad conditions, the value function of the suitably scaled network control problem converges to that of the associated diffusion control problem. This scaling limit result, in addition to giving a precise mathematical basis for the above approximation approach, suggests a general strategy for constructing near optimal controls for the physical stochastic networks by solving the associated diffusion control problem.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Dynamic Scheduling for Markov Modulated Single-server Multiclass Queueing Systems in Heavy Traffic

This paper studies a scheduling control problem for a single-server multiclass queueing network in heavy traffic, operating in a changing environment. The changing environment is modeled as a finite state Markov process that modulates the arrival and service rates in the system. Various cases are considered: fast changing environment, fixed environment and slow changing environment. In each of the cases, using weak convergence analysis, in particular functional limit theorems for renewal processes and ergodic Markov processes, it is shown that an appropriate "averaged" version of the classical cμ-policy (the priority policy that favors classes with higher values of the product of holding cost c and service rate μ) is asymptotically optimal for an infinite horizon discounted cost criterion.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Large deviation properties of weakly interacting processes via weak convergence methods

We study large deviation properties of systems of weakly interacting particles modeled by Itô stochastic differential equations (SDEs). It is known under certain conditions that the corresponding sequence of empirical measures converges, as the number of particles tends to infinity, to the weak solution of an associated McKean-Vlasov equation. We derive a large deviation principle via the weak convergence approach. The proof, which avoids discretization arguments, is based on a representation theorem, weak convergence and ideas from stochastic optimal control. The method works under rather mild assumptions and also for models described by SDEs not of diffusion type. To illustrate this, we treat the case of SDEs with delay.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Large Deviations for Stochastic Partial Differential Equations Driven by a Poisson Random Measure

Stochastic partial differential equations driven by Poisson random measures (PRM) have been proposed as models for many different physical systems, where they are viewed as a refinement of a corresponding noiseless partial differential equations (PDE). A systematic framework for the study of probabilities of deviations of the stochastic PDE from the deterministic PDE is through the theory of large deviations. The goal of this work is to develop the large deviation theory for small Poisson noise perturbations of a general class of deterministic infinite dimensional models. Although the analogous questions for finite dimensional systems have been well studied, there are currently no general results in the infinite dimensional setting. This is in part due to the fact that in this setting solutions may have little spatial regularity, and thus classical approximation methods for large deviation analysis become intractable. The approach taken here, which is based on a variational representation for nonnegative functionals of general PRM, reduces the proof of the large deviation principle to establishing basic qualitative properties for controlled analogues of the underlying stochastic system. As an illustration of the general theory, we consider a particular system that models the spread of a pollutant in a waterway.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

The augmented multiplicative coalescent and critical dynamic random graph models

Random graph models with limited choice have been studied extensively with the goal of understanding the mechanism of the emergence of the giant component. One of the standard models are the Achlioptas random graph processes on a fixed set of $n$ vertices. Here at each step, one chooses two edges uniformly at random and then decides which one to add to the existing configuration according to some criterion. An important class of such rules are the bounded-size rules where for a fixed $K\geq 1$, all components of size greater than $K$ are treated equally. While a great deal of work has gone into analyzing the subcritical and supercritical regimes, the nature of the critical scaling window, the size and complexity (deviation from trees) of the components in the critical regime and nature of the merging dynamics has not been well understood. In this work we study such questions for general bounded-size rules. Our first main contribution is the construction of an extension of Aldous's standard multiplicative coalescent process which describes the asymptotic evolution of the vector of sizes and surplus of all components. We show that this process, referred to as the standard augmented multiplicative coalescent (AMC) is `nearly' Feller with a suitable topology on the state space. Our second main result proves the convergence of suitably scaled component size and surplus vector, for any bounded-size rule, to the standard AMC. The key ingredients here are a precise analysis of the asymptotic behavior of various susceptibility functions near criticality and certain bounds from [8], on the size of the largest component in the barely subcritical regime.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

Bohman-Frieze processes at criticality and emergence of the giant component

The evolution of the usual Erdős-Rényi random graph model on n vertices can be described as follows: At time 0 start with the empty graph, with n vertices and no edges. Now at each time k, choose 2 vertices uniformly at random and attach an edge between these two vertices. Let \bfG_n(k) be the graph obtained at step k. Refined analysis in random graph theory now shows that for fixed t\in \Rbold, when k(n) = n/2+ n^{2/3} t/2, the sizes of the components in \bfG_n(k(n)) scale like n^{2/3} and rescaled component sizes converge to the standard multiplicative coalescent at time $t$. The last decade has seen variants of this process introduced, under the name Achlioptas processes, to understand the effect of simple changes in the edge formation scheme on the emergence of the giant component. Stimulated by a question of Achlioptas, one of the simplest and most popular of such models is the Bohman Frieze (BF) model wherein at each stage $k$, 2 edges e_1(k)=(v_1,v_2) and e_2(k) = (v_3, v_4) are chosen uniformly at random. If at this time v_1, v_2 are both isolated then this edge is added, otherwise e_2 is added. Then \cite{bohman2001avoiding} (and further analysis in \cite{spencer2007birth}) show that once again there is a critical parameter, which is larger than 1, above and below which the asymptotic behavior is as in the Erdős-Rényi setting. While an intense study for this and related models seems to suggest that at criticality, this model should be in the same universality class as the original Erdős-Rényi process, a precise mathematical treatment of the dynamics in the critical window has to date escaped analysis. In this work we study the component structure of the BF model in the critical window and show that at criticality the sizes of components properly rescaled and re-centered converge to the standard multiplicative coalescent.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

Discrete Time Markovian Agents Interacting Through a Potential

A discrete time stochastic model for a multiagent system given in terms of a large collection of interacting Markov chains is studied. The evolution of the interacting particles is described through a time inhomogeneous transition probability kernel that depends on the 'gradient' of the potential field. The particles, in turn, dynamically modify the potential field through their cumulative input. Interacting Markov processes of the above form have been suggested as models for active biological transport in response to external stimulus such as a chemical gradient. One of the basic mathematical challenges is to develop a general theory of stability for such interacting Markovian systems and for the corresponding nonlinear Markov processes that arise in the large agent limit. Such a theory would be key to a mathematical understanding of the interactive structure formation that results from the complex feedback between the agents and the potential field. It will also be a crucial ingredient in developing simulation schemes that are faithful to the underlying model over long periods of time. The goal of this work is to study qualitative properties of the above stochastic system as the number of particles (N) and the time parameter (n) approach infinity. In this regard asymptotic properties of a deterministic nonlinear dynamical system, that arises in the propagation of chaos limit of the stochastic model, play a key role. We show that under suitable conditions this dynamical system has a unique fixed point. This result allows us to study stability properties of the underlying stochastic model. We show that as N \rightarrow \infty, the stochastic system is well approximated by the dynamical system, uniformly over time. As a consequence, for an arbitrarily initialized system, as N\rightarrow \infty and n \rightarrow \infty, the potential field and the empirical measure of the interacting particles are shown to converge to the unique fixed point of the dynamical system. In general, simulation of such interacting Markovian systems is a computationally daunting task. We propose a particle based approximation for the dynamic potential field which allows for a numerically tractable simulation scheme. It is shown that this simulation scheme well approximates the true physical system, uniformly over an infinite time horizon.

0 citations0 reviewsNo code linkedOpen access
preprint2010arXiv

A stochastic differential game for the inhomogeneous $\infty$-Laplace equation

Given a bounded $\mathcaligr{C}^2$ domain $G\subset{\mathbb{R}}^m$, functions $g\in\mathcaligr{C}(\partial G,{\mathbb{R}})$ and $h\in\mathcaligr {C}(\bar{G},{\mathbb{R}}\setminus\{0\})$, let $u$ denote the unique viscosity solution to the equation $-2Δ_{\infty}u=h$ in $G$ with boundary data $g$. We provide a representation for $u$ as the value of a two-player zero-sum stochastic differential game.

0 citations0 reviewsNo code linkedOpen access
preprint2005arXiv

Stability Properties of Constrained Jump-Diffusion Processes

We consider a class of jump-diffusion processes, constrained to a polyhedral cone $G\subset\R^n$, where the constraint vector field is constant on each face of the boundary. The constraining mechanism corrects for ``attempts'' of the process to jump outside the domain. Under Lipschitz continuity of the Skorohod map Γ, it is known that there is a cone \mathcalC such that the image Γϕof a deterministic linear trajectory ϕremains bounded if and only if \dotϕ\in\mathcalC. Denoting the generator of a corresponding unconstrained jump-diffusion by \cll, we show that a key condition for the process to admit an invariant probability measure is that for x\in G, \cll \id(x) belongs to a compact subset of \mathcalC^o.

0 citations0 reviewsNo code linkedOpen access