BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

Ramon van Handel

Ramon van Handel appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
math.PRmath.STStatistics TheoryInformation Theorymath.ITmath-phmath.MPmath.MGmath.OCmath.COmath.DGmath.DSmath.FAq-fin.RM

Catalog footprint

What is connected

18works
14topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

18 published item(s)

preprint2024arXiv

A localization-delocalization transition for nonhomogeneous random matrices

We consider $N\times N$ self-adjoint Gaussian random matrices defined by an arbitrary deterministic sparsity pattern with $d$ nonzero entries per row. We show that such random matrices exhibit a canonical localization-delocalization transition near the edge of the spectrum: when $d\gg\log N$ the random matrix possesses a delocalized approximate top eigenvector, while when $d\ll\log N$ any approximate top eigenvector is localized. The key feature of this phenomenon is that it is universal with respect to the sparsity pattern, in contrast to the delocalization properties of exact eigenvectors which are sensitive to the specific sparsity pattern of the random matrix.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Shephard's inequalities, Hodge-Riemann relations, and a conjecture of Fedotov

A well-known family of determinantal inequalities for mixed volumes of convex bodies were derived by Shephard from the Alexandrov-Fenchel inequality. The classic monograph Geometric Inequalities by Burago and Zalgaller states a conjecture on the validity of higher-order analogues of Shephard's inequalities, which is attributed to Fedotov. In this note we disprove Fedotov's conjecture by showing that it contradicts the Hodge-Riemann relations for simple convex polytopes. Along the way, we make some expository remarks on the linear algebraic and geometric aspects of these inequalities.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

The Extremals of the Alexandrov-Fenchel Inequality for Convex Polytopes

The Alexandrov-Fenchel inequality, a far-reaching generalization of the classical isoperimetric inequality to arbitrary mixed volumes, lies at the heart of convex geometry. The characterization of its extremal bodies is a long-standing open problem that dates back to Alexandrov's original 1937 paper. The known extremals already form a very rich family, and even the fundamental conjectures on their general structure, due to Schneider, are incomplete. In this paper, we completely settle the extremals of the Alexandrov-Fenchel inequality for convex polytopes. In particular, we show that the extremals arise from the combination of three distinct mechanisms: translation, support, and dimensionality. The characterization of these mechanisms requires the development of a diverse range of techniques that shed new light on the geometry of mixed volumes of nonsmooth convex bodies. Our main result extends further beyond polytopes in a number of ways, including to the setting of quermassintegrals of arbitrary convex bodies. As an application of our main result, we settle a question of Stanley on the extremal behavior of certain log-concave sequences that arise in the combinatorics of partially ordered sets.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Sharp nonasymptotic bounds on the norm of random matrices with independent entries

We obtain nonasymptotic bounds on the spectral norm of random matrices with independent entries that improve significantly on earlier results. If $X$ is the $n\times n$ symmetric matrix with $X_{ij}\sim N(0,b_{ij}^2)$, we show that \[\mathbf{E}\Vert X\Vert \lesssim\max_i\sqrt{\sum_jb_{ij}^2}+\max _{ij}\vert b_{ij}\vert \sqrt{\log n}.\] This bound is optimal in the sense that a matching lower bound holds under mild assumptions, and the constants are sufficiently sharp that we can often capture the precise edge of the spectrum. Analogous results are obtained for rectangular matrices and for more general sub-Gaussian or heavy-tailed distributions of the entries, and we derive tail bounds in addition to bounds on the expected norm. The proofs are based on a combination of the moment method and geometric functional analysis techniques. As an application, we show that our bounds immediately yield the correct phase transition behavior of the spectral edge of random band matrices and of sparse Wigner matrices. We also recover a result of Seginer on the norm of Rademacher matrices.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Can local particle filters beat the curse of dimensionality?

The discovery of particle filtering methods has enabled the use of nonlinear filtering in a wide array of applications. Unfortunately, the approximation error of particle filters typically grows exponentially in the dimension of the underlying model. This phenomenon has rendered particle filters of limited use in complex data assimilation problems. In this paper, we argue that it is often possible, at least in principle, to develop local particle filtering algorithms whose approximation error is dimension-free. The key to such developments is the decay of correlations property, which is a spatial counterpart of the much better understood stability property of nonlinear filters. For the simplest possible algorithm of this type, our results provide under suitable assumptions an approximation error bound that is uniform both in time and in the model dimension. More broadly, our results provide a framework for the investigation of filtering problems and algorithms in high dimension.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Conditional ergodicity in infinite dimension

The goal of this paper is to develop a general method to establish conditional ergodicity of infinite-dimensional Markov chains. Given a Markov chain in a product space, we aim to understand the ergodic properties of its conditional distributions given one of the components. Such questions play a fundamental role in the ergodic theory of nonlinear filters. In the setting of Harris chains, conditional ergodicity has been established under general nondegeneracy assumptions. Unfortunately, Markov chains in infinite-dimensional state spaces are rarely amenable to the classical theory of Harris chains due to the singularity of their transition probabilities, while topological and functional methods that have been developed in the ergodic theory of infinite-dimensional Markov chains are not well suited to the investigation of conditional distributions. We must therefore develop new measure-theoretic tools in the ergodic theory of Markov chains that enable the investigation of conditional ergodicity for infinite dimensional or weak-* ergodic processes. To this end, we first develop local counterparts of zero-two laws that arise in the theory of Harris chains. These results give rise to ergodic theorems for Markov chains that admit asymptotic couplings or that are locally mixing in the sense of H. Föllmer, and to a non-Markovian ergodic theorem for stationary absolutely regular sequences. We proceed to show that local ergodicity is inherited by conditioning on a nondegenerate observation process. This is used to prove stability and unique ergodicity of the nonlinear filter. Finally, we show that our abstract results can be applied to infinite-dimensional Markov processes that arise in several settings, including dissipative stochastic partial differential equations, stochastic spin systems and stochastic differential delay equations.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Phase Transitions in Nonlinear Filtering

It has been established under very general conditions that the ergodic properties of Markov processes are inherited by their conditional distributions given partial information. While the existing theory provides a rather complete picture of classical filtering models, many infinite-dimensional problems are outside its scope. Far from being a technical issue, the infinite-dimensional setting gives rise to surprising phenomena and new questions in filtering theory. The aim of this paper is to discuss some elementary examples, conjectures, and general theory that arise in this setting, and to highlight connections with problems in statistical mechanics and ergodic theory. In particular, we exhibit a simple example of a uniformly ergodic model in which ergodicity of the filter undergoes a phase transition, and we develop some qualitative understanding as to when such phenomena can and cannot occur. We also discuss closely related problems in the setting of conditional Markov random fields.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Comparison Theorems for Gibbs Measures

The Dobrushin comparison theorem is a powerful tool to bound the difference between the marginals of high-dimensional probability distributions in terms of their local specifications. Originally introduced to prove uniqueness and decay of correlations of Gibbs measures, it has been widely used in statistical mechanics as well as in the analysis of algorithms on random fields and interacting Markov chains. However, the classical comparison theorem requires validity of the Dobrushin uniqueness criterion, essentially restricting its applicability in most models to a small subset of the natural parameter space. In this paper we develop generalized Dobrushin comparison theorems in terms of influences between blocks of sites, in the spirit of Dobrushin-Shlosman and Weitz, that substantially extend the range of applicability of the classical comparison theorem. Our proofs are based on the analysis of an associated family of Markov chains. We develop in detail an application of our main results to the analysis of sequential Monte Carlo algorithms for filtering in high dimension.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Constructing Sublinear Expectations on Path Space

We provide a general construction of time-consistent sublinear expectations on the space of continuous paths. It yields the existence of the conditional G-expectation of a Borel-measurable (rather than quasi-continuous) random variable, a generalization of the random G-expectation, and an optional sampling theorem that holds without exceptional set. Our results also shed light on the inherent limitations to constructing sublinear expectations through aggregation.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Consistent order estimation and minimal penalties

Consider an i.i.d. sequence of random variables whose distribution f* lies in one of a nested family of models M_q, q>=1. The smallest index q* such that M_{q*} contains f* is called the model order. We establish strong consistency of the penalized likelihood order estimator in a general setting with penalties of order η(q) log log n, where η(q) is a dimensional quantity. Moreover, such penalties are shown to be minimal. In contrast to previous work, an a priori upper bound on the model order is not assumed. The results rely on a sharp characterization of the pathwise fluctuations of the generalized likelihood ratio statistic under entropy assumptions on the model classes. Our results are applied to the geometrically complex problem of location mixture order estimation, which is widely used but poorly understood.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Ergodicity and stability of the conditional distributions of nondegenerate Markov chains

We consider a bivariate stationary Markov chain $(X_n,Y_n)_{n\ge0}$ in a Polish state space, where only the process $(Y_n)_{n\ge0}$ is presumed to be observable. The goal of this paper is to investigate the ergodic theory and stability properties of the measure-valued process $(Π_n)_{n\ge0}$, where $Π_n$ is the conditional distribution of $X_n$ given $Y_0,...,Y_n$. We show that the ergodic and stability properties of $(Π_n)_{n\ge0}$ are inherited from the ergodicity of the unobserved process $(X_n)_{n\ge0}$ provided that the Markov chain $(X_n,Y_n)_{n\ge0}$ is nondegenerate, that is, its transition kernel is equivalent to the product of independent transition kernels. Our main results generalize, subsume and in some cases correct previous results on the ergodic theory of nonlinear filters.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Ergodicity, Decisions, and Partial Information

In the simplest sequential decision problem for an ergodic stochastic process X, at each time n a decision u_n is made as a function of past observations X_0,...,X_{n-1}, and a loss l(u_n,X_n) is incurred. In this setting, it is known that one may choose (under a mild integrability assumption) a decision strategy whose pathwise time-average loss is asymptotically smaller than that of any other strategy. The corresponding problem in the case of partial information proves to be much more delicate, however: if the process X is not observable, but decisions must be based on the observation of a different process Y, the existence of pathwise optimal strategies is not guaranteed. The aim of this paper is to exhibit connections between pathwise optimal strategies and notions from ergodic theory. The sequential decision problem is developed in the general setting of an ergodic dynamical system (Ω,B,P,T) with partial information Y\subseteq B. The existence of pathwise optimal strategies grounded in two basic properties: the conditional ergodic theory of the dynamical system, and the complexity of the loss function. When the loss function is not too complex, a general sufficient condition for the existence of pathwise optimal strategies is that the dynamical system is a conditional K-automorphism relative to the past observations \bigvee_n T^n Y. If the conditional ergodicity assumption is strengthened, the complexity assumption can be weakened. Several examples demonstrate the interplay between complexity and ergodicity, which does not arise in the case of full information. Our results also yield a decision-theoretic characterization of weak mixing in ergodic theory, and establish pathwise optimality of ergodic nonlinear filters.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

The local geometry of finite mixtures

We establish that for q>=1, the class of convex combinations of q translates of a smooth probability density has local doubling dimension proportional to q. The key difficulty in the proof is to control the local geometric structure of mixture classes. Our local geometry theorem yields a bound on the (bracketing) metric entropy of a class of normalized densities, from which a local entropy bound is deduced by a general slicing procedure.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

Consistency of the maximum likelihood estimator for general hidden Markov models

Consider a parametrized family of general hidden Markov models, where both the observed and unobserved components take values in a complete separable metric space. We prove that the maximum likelihood estimator (MLE) of the parameter is strongly consistent under a rather minimal set of assumptions. As special cases of our main result, we obtain consistency in a large class of nonlinear state space models, as well as general results on linear Gaussian state space models and finite state models. A novel aspect of our approach is an information-theoretic technique for proving identifiability, which does not require an explicit representation for the relative entropy rate. Our method of proof could therefore form a foundation for the investigation of MLE consistency in more general dependent and non-Markovian time series. Also of independent interest is a general concentration inequality for $V$-uniformly ergodic Markov chains.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

On the exchange of intersection and supremum of sigma-fields in filtering theory

We construct a stationary Markov process with trivial tail sigma-field and a nondegenerate observation process such that the corresponding nonlinear filtering process is not uniquely ergodic. This settles in the negative a conjecture of the author in the ergodic theory of nonlinear filters arising from an erroneous proof in the classic paper of H. Kunita (1971), wherein an exchange of intersection and supremum of sigma-fields is taken for granted.

0 citations0 reviewsNo code linkedOpen access
preprint2010arXiv

A complete solution to Blackwell's unique ergodicity problem for hidden Markov chains

We develop necessary and sufficient conditions for uniqueness of the invariant measure of the filtering process associated to an ergodic hidden Markov model in a finite or countable state space. These results provide a complete solution to a problem posed by Blackwell (1957), and subsume earlier partial results due to Kaijser, Kochman and Reeds. The proofs of our main results are based on the stability theory of nonlinear filters.

0 citations0 reviewsNo code linkedOpen access
preprint2009arXiv

On the minimal penalty for Markov order estimation

We show that large-scale typicality of Markov sample paths implies that the likelihood ratio statistic satisfies a law of iterated logarithm uniformly to the same scale. As a consequence, the penalized likelihood Markov order estimator is strongly consistent for penalties growing as slowly as log log n when an upper bound is imposed on the order which may grow as rapidly as log n. Our method of proof, using techniques from empirical process theory, does not rely on the explicit expression for the maximum likelihood estimator in the Markov case and could therefore be applicable in other settings.

0 citations0 reviewsNo code linkedOpen access
preprint2009arXiv

When do nonlinear filters achieve maximal accuracy?

The nonlinear filter for an ergodic signal observed in white noise is said to achieve maximal accuracy if the stationary filtering error vanishes as the signal to noise ratio diverges. We give a general characterization of the maximal accuracy property in terms of various systems theoretic notions. When the signal state space is a finite set explicit necessary and sufficient conditions are obtained, while the linear Gaussian case reduces to a classic result of Kwakernaak and Sivan (1972).

0 citations0 reviewsNo code linkedOpen access