BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

Dan Crisan

Dan Crisan appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
math.PRComputationmath.NANumerical Analysisphysics.flu-dynmath.APMachine Learningmath.OCmath.STStatistics TheoryApplicationsArtificial Intelligencemath-phmath.DSmath.MPMethodologyphysics.ao-phphysics.geo-ph

Catalog footprint

What is connected

26works
18topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

26 published item(s)

preprint2022arXiv

A Lagged Particle Filter for Stable Filtering of certain High-Dimensional State-Space Models

We consider the problem of high-dimensional filtering of state-space models (SSMs) at discrete times. This problem is particularly challenging as analytical solutions are typically not available and many numerical approximation methods can have a cost that scales exponentially with the dimension of the hidden state. Inspired by lag-approximation methods for the smoothing problem, we introduce a lagged approximation of the smoothing distribution that is necessarily biased. For certain classes of SSMs, particularly those that forget the initial condition exponentially fast in time, the bias of our approximation is shown to be uniformly controlled in the dimension and exponentially small in time. We develop a sequential Monte Carlo (SMC) method to recursively estimate expectations with respect to our biased filtering distributions. Moreover, we prove for a class of class of SSMs that can contain dependencies amongst coordinates that as the dimension $d\rightarrow\infty$ the cost to achieve a stable mean square error in estimation, for classes of expectations, is of $\mathcal{O}(Nd^2)$ per-unit time, where $N$ is the number of simulated samples in the SMC algorithm. Our methodology is implemented on several challenging high-dimensional examples including the conservative shallow-water model.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

An application of the splitting-up method for the computation of a neural network representation for the solution for the filtering equations

The filtering equations govern the evolution of the conditional distribution of a signal process given partial, and possibly noisy, observations arriving sequentially in time. Their numerical approximation plays a central role in many real-life applications, including numerical weather prediction, finance and engineering. One of the classical approaches to approximate the solution of the filtering equations is to use a PDE inspired method, called the splitting-up method, initiated by Gyongy, Krylov, LeGland, among other contributors. This method, and other PDE based approaches, have particular applicability for solving low-dimensional problems. In this work we combine this method with a neural network representation. The new methodology is used to produce an approximation of the unnormalised conditional distribution of the signal process. We further develop a recursive normalisation procedure to recover the normalised conditional distribution of the signal process. The new scheme can be iterated over multiple time steps whilst keeping its asymptotic unbiasedness property intact. We test the neural network approximations with numerical approximation results for the Kalman and Benes filter.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Parallel sequential Monte Carlo for stochastic gradient-free nonconvex optimization

We introduce and analyze a parallel sequential Monte Carlo methodology for the numerical solution of optimization problems that involve the minimization of a cost function that consists of the sum of many individual components. The proposed scheme is a stochastic zeroth order optimization algorithm which demands only the capability to evaluate small subsets of components of the cost function. It can be depicted as a bank of samplers that generate particle approximations of several sequences of probability measures. These measures are constructed in such a way that they have associated probability density functions whose global maxima coincide with the global minima of the original cost function. The algorithm selects the best performing sampler and uses it to approximate a global minimum of the cost function. We prove analytically that the resulting estimator converges to a global minimum of the cost function almost surely and provide explicit convergence rates in terms of the number of generated Monte Carlo samples and the dimension of the search space. We show, by way of numerical examples, that the algorithm can tackle cost functions with multiple minima or with broad "flat" regions which are hard to minimize using gradient-based techniques.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Solution properties of the incompressible Euler system with rough path advection

The present paper aims to establish the local well-posedness of Euler's fluid equations on geometric rough paths. In particular, we consider the Euler equations for the incompressible flow of an ideal fluid whose Lagrangian transport velocity possesses an additional rough-in-time, divergence-free vector field. In recent work, we have demonstrated that this system can be derived from Clebsch and Hamilton-Pontryagin variational principles that possess a perturbative geometric rough path Lie-advection constraint. In this paper, we prove the local well-posedness of the system in $L^2$-Sobolev spaces $H^m$ with integer regularity $m\ge \lfloor d/2\rfloor+2$ and establish a Beale-Kato-Majda (BKM) blow-up criterion in terms of the $L^1_tL^\infty_x$-norm of the vorticity. In dimension two, we show that the $L^p$-norms of the vorticity are conserved, which yields global well-posedness and a Wong-Zakai approximation theorem for the stochastic version of the equation.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

A 4D-Var Method with Flow-Dependent Background Covariances for the Shallow-Water Equations

The 4D-Var method for filtering partially observed nonlinear chaotic dynamical systems consists of finding the maximum a-posteriori (MAP) estimator of the initial condition of the system given observations over a time window, and propagating it forward to the current time via the model dynamics. This method forms the basis of most currently operational weather forecasting systems. In practice the optimization becomes infeasible if the time window is too long due to the non-convexity of the cost function, the effect of model errors, and the limited precision of the ODE solvers. Hence the window has to be kept sufficiently short, and the observations in the previous windows can be taken into account via a Gaussian background (prior) distribution. The choice of the background covariance matrix is an important question that has received much attention in the literature. In this paper, we define the background covariances in a principled manner, based on observations in the previous $b$ assimilation windows, for a parameter $b\ge 1$. The method is at most $b$ times more computationally expensive than using fixed background covariances, requires little tuning, and greatly improves the accuracy of 4D-Var. As a concrete example, we focus on the shallow-water equations. The proposed method is compared against state-of-the-art approaches in data assimilation and is shown to perform favourably on simulated data. We also illustrate our approach on data from the recent tsunami of 2011 in Fukushima, Japan.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Bayesian Inference for Fluid Dynamics: A Case Study for the Stochastic Rotating Shallow Water Model

In this work, we use a tempering-based adaptive particle filter to infer from a partially observed stochastic rotating shallow water (SRSW) model which has been derived using the Stochastic Advection by Lie Transport (SALT) approach. The methodology we present here validates the applicability of tempering and sample regeneration via a Metropolis-Hastings algorithm to high-dimensional models used in stochastic fluid dynamics. The methodology is first tested on the Lorenz '63 model with both full and partial observations. Then we discuss the efficiency of the particle filter the SALT-SRSW model.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Local well-posedness for the great lake equation with transport noise

This work is a continuation of the authors' work for the stochastic 2D Euler equation driven by transport type noise. Here we lift the incompressibility constraint. Instead we assume a weighted incompressibility condition. This condition is inspired by a physical model for a fluid in a basin with a free upper surface and a spatially varying bottom topography. Moreover, we assume a different form of the vorticity to stream function operator that generalizes the standard Biot-Savart operator which appears in the Euler equation. These two properties are exhibited in the physical model called the great lake equation. For this reason we refer to the model analysed in this paper as the stochastic great lake equation. The new vorticity to stream function operator generalizes the curl operator and it is shown to have good regularity properties. We also show that the initial smoothness of the solution is preserved. The arguments are based on constructing a family of viscous solutions which is proved to be relatively compact and to converge to a truncated version of the original equation. Finally, we show that the truncation can be removed up to a positive stopping time.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Log-Normalization Constant Estimation using the Ensemble Kalman-Bucy Filter with Application to High-Dimensional Models

In this article we consider the estimation of the log-normalization constant associated to a class of continuous-time filtering models. In particular, we consider ensemble Kalman-Bucy filter based estimates based upon several nonlinear Kalman-Bucy diffusions. Based upon new conditional bias results for the mean of the afore-mentioned methods, we analyze the empirical log-scale normalization constants in terms of their $\mathbb{L}_n-$errors and conditional bias. Depending on the type of nonlinear Kalman-Bucy diffusion, we show that these are of order $(\sqrt{t/N}) + t/N$ or $1/\sqrt{N}$ ($\mathbb{L}_n-$errors) and of order $[t+\sqrt{t}]/N$ or $1/N$ (conditional bias), where $t$ is the time horizon and $N$ is the ensemble size. Finally, we use these results for online static parameter estimation for above filtering models and implement the methodology for both linear and nonlinear models.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Pathwise approximations for the solution of the non-linear filtering problem

We consider high order approximations of the solution of the stochastic filtering problem, derive their pathwise representation in the spirit of the earlier work of Clark and Davis and prove their robustness property. In particular, we show that the high order discretised filtering functionals can be represented by Lipschitz continuous functions defined on the observation path space. This property is important from the practical point of view as it is in fact the pathwise version of the filtering functional that is sought in numerical applications. Moreover, the pathwise viewpoint will be a stepping stone into the rigorous development of machine learning methods for the filtering problem. This work is a continuation of a recent work by two of the authors where a discretisation of the solution of the filtering problem of arbitrary order has been established. We expand the previous work by showing that robust approximations can be derived from the discretisations therein.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Variational principles for fluid dynamics on rough paths

In this paper, we introduce a new framework for parametrization schemes (PS) in GFD. Using the theory of controlled rough paths, we derive a class of rough geophysical fluid dynamics (RGFD) models as critical points of rough action functionals. These RGFD models characterize Lagrangian trajectories in fluid dynamics as geometric rough paths (GRP) on the manifold of diffeomorphic maps. Three constrained variational approaches are formulated for the derivation of these models. The first is the Clebsch formulation, in which the constraints are imposed as rough advection laws. The second is the Hamilton-Pontryagin formulation, in which the constraints are imposed as right-invariant rough vector fields. The third is the Euler--Poincaré formulation in which the variations are constrained. These variational principles lead directly to the Lie--Poisson Hamiltonian formulation of fluid dynamics on geometric rough paths. The GRP framework preserves the geometric structure of fluid dynamics obtained by using Lie group reduction to pass from Lagrangian to Eulerian variational principles, thereby yielding a rough formulation of the Kelvin circulation theorem. The rough-path variational approach includes non-Markovian perturbations of the Lagrangian fluid trajectories. In particular, memory effects can be introduced through this formulation through a judicious choice of the rough path (e.g. a realization of a fractional Brownian motion). In the special case when the rough path is a realization of a semimartingale, we recover the SGFD models in Holm (2015). However, by eliminating the need for stochastic variational tools, we retain a pathwise interpretation of the Lagrangian trajectories. In contrast, the Lagrangian trajectories in the stochastic framework are described by stochastic integrals which do not have a pathwise interpretation. Thus, the rough path formulation restores this property.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

A Particle Filter for Stochastic Advection by Lie Transport (SALT): A case study for the damped and forced incompressible 2D Euler equation

In this work, we combine a stochastic model reduction with a particle filter augmented with tempering and jittering, and apply the combined algorithm to a damped and forced incompressible 2D Euler dynamics defined on a simply connected bounded domain. We show that using the combined algorithm, we are able to assimilate data from a reference system state (the ``truth") modelled by a highly resolved numerical solution of the flow that has roughly $3.1\times10^6$ degrees of freedom, into a stochastic system having two orders of magnitude less degrees of freedom, which is able to approximate the true state reasonably accurately for $5$ large scale eddy turnover times, using modest computational hardware. The model reduction is performed through the introduction of a stochastic advection by Lie transport (SALT) model as the signal on a coarser resolution. The SALT approach was introduced as a general theory using a geometric mechanics framework from Holm, Proc. Roy. Soc. A (2015). This work follows on the numerical implementation for SALT presented by Cotter et al, SIAM Multiscale Model. Sim. (2019) for the flow in consideration. The model reduction is substantial: The reduced SALT model has $4.9\times 10^4$ degrees of freedom. Results from reliability tests on the assimilated system are also presented.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Modelling uncertainty using stochastic transport noise in a 2-layer quasi-geostrophic model

The stochastic variational approach for geophysical fluid dynamics was introduced by Holm (Proc Roy Soc A, 2015) as a framework for deriving stochastic parameterisations for unresolved scales. This paper applies the variational stochastic parameterisation in a two-layer quasi-geostrophic model for a beta-plane channel flow configuration. We present a new method for estimating the stochastic forcing (used in the parameterisation) to approximate unresolved components using data from the high resolution deterministic simulation, and describe a procedure for computing physically-consistent initial conditions for the stochastic model. We also quantify uncertainty of coarse grid simulations relative to the fine grid ones in homogeneous (teamed with small-scale vortices) and heterogeneous (featuring horizontally elongated large-scale jets) flows, and analyse how the spread of stochastic solutions depends on different parameters of the model. The parameterisation is tested by comparing it with the true eddy-resolving solution that has reached some statistical equilibrium and the deterministic solution modelled on a low-resolution grid. The results show that the proposed parameterisation significantly depends on the resolution of the stochastic model and gives good ensemble performance for both homogeneous and heterogeneous flows, and the parameterisation lays solid foundations for data assimilation.

0 citations0 reviewsNo code linkedOpen access
preprint2019arXiv

Data assimilation for a quasi-geostrophic model with circulation-preserving stochastic transport noise

This paper contains the latest installment of the authors' project on developing ensemble based data assimilation methodology for high dimensional fluid dynamics models. The algorithm presented here is a particle filter that combines model reduction, tempering, jittering, and nudging. The methodology is tested on a two-layer quasi-geostrophic model for a $β$-plane channel flow with $O(10^6)$ degrees of freedom out of which only a minute fraction are noisily observed. The model is reduced by following the stochastic variational approach for geophysical fluid dynamics introduced in Holm (Proc Roy Soc A, 2015) as a framework for deriving stochastic parametrisations for unresolved scales. The reduction is substantial: the computations are done only for $O(10^4)$ degrees of freedom. We introduce a stochastic time-stepping scheme for the two-layer model and prove its consistency in time. Then, we analyze the effect of the different procedures (tempering combined with jittering and nudging) on the performance of the data assimilation procedure using the reduced model, as well as how the dimension of the observational data (the number of "weather stations") and the data assimilation step affect the accuracy and uncertainty of the results.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Particle-kernel estimation of the filter density in state-space models

Sequential Monte Carlo (SMC) methods, also known as particle filters, are simulation-based recursive algorithms for the approximation of the a posteriori probability measures generated by state-space dynamical models. At any given time $t$, a SMC method produces a set of samples over the state space of the system of interest (often termed "particles") that is used to build a discrete and random approximation of the posterior probability distribution of the state variables, conditional on a sequence of available observations. One potential application of the methodology is the estimation of the densities associated to the sequence of a posteriori distributions. While practitioners have rather freely applied such density approximations in the past, the issue has received less attention from a theoretical perspective. In this paper, we address the problem of constructing kernel-based estimates of the posterior probability density function and its derivatives, and obtain asymptotic convergence results for the estimation errors. In particular, we find convergence rates for the approximation errors that hold uniformly on the state space and guarantee that the error vanishes almost surely as the number of particles in the filter grows. Based on this uniform convergence result, we first show how to build continuous measures that converge almost surely (with known rate) toward the posterior measure and then address a few applications. The latter include maximum a posteriori estimation of the system state using the approximate derivatives of the posterior density and the approximation of functionals of it, for example, Shannon's entropy. This manuscript is identical to the published paper, including a gap in the proof of Theorem 4.2. The Theorem itself is correct. We provide an {\em erratum} at the end of this document with a complete proof and a brief discussion.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Uniform convergence over time of a nested particle filtering scheme for recursive parameter estimation in state--space Markov models

We analyse the performance of a recursive Monte Carlo method for the Bayesian estimation of the static parameters of a discrete--time state--space Markov model. The algorithm employs two layers of particle filters to approximate the posterior probability distribution of the model parameters. In particular, the first layer yields an empirical distribution of samples on the parameter space, while the filters in the second layer are auxiliary devices to approximate the (analytically intractable) likelihood of the parameters. This approach relates the this algorithm to the recent sequential Monte Carlo square (SMC$^2$) method, which provides a {\em non-recursive} solution to the same problem. In this paper, we investigate the approximation, via the proposed scheme, of integrals of real bounded functions with respect to the posterior distribution of the system parameters. Under assumptions related to the compactness of the parameter support and the stability and continuity of the sequence of posterior distributions for the state--space model, we prove that the $L_p$ norms of the approximation errors vanish asymptotically (as the number of Monte Carlo samples generated by the algorithm increases) and uniformly over time. We also prove that, under the same assumptions, the proposed scheme can asymptotically identify the parameter values for a class of models. We conclude the paper with a numerical example that illustrates the uniform convergence results by exploring the accuracy and stability of the proposed algorithm operating with long sequences of observations.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

A Probabilistic approach to classical solutions of the master equation for large population equilibria

We analyze a class of nonlinear partial differential equations (PDEs) defined on $\mathbb{R}^d \times \mathcal{P}_2(\mathbb{R}^d),$ where $\mathcal{P}_2(\mathbb{R}^d)$ is the Wasserstein space of probability measures on $\mathbb{R}^d$ with a finite second-order moment. We show that such equations admit a classical solutions for sufficiently small time intervals. Under additional constraints, we prove that their solution can be extended to arbitrary large intervals. These nonlinear PDEs arise in the recent developments in the theory of large population stochastic control. More precisely they are the so-called master equations corresponding to asymptotic equilibria for a large population of controlled players with mean-field interaction and subject to minimization constraints. The results in the paper are deduced by exploiting this connection. In particular, we study the differentiability with respect to the initial condition of the flow generated by a forward-backward stochastic system of McKean-Vlasov type. As a byproduct, we prove that the decoupling field generated by the forward-backward system is a classical solution of the corresponding master equation. Finally, we give several applications to mean-field games and to the control of McKean-Vlasov diffusion processes.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

A simple scheme for the parallelization of particle filters and its application to the tracking of complex stochastic systems

We investigate the use of possibly the simplest scheme for the parallelisation of the standard particle filter, that consists in splitting the computational budget into $M$ fully independent particle filters with $N$ particles each, and then obtaining the desired estimators by averaging over the $M$ independent outcomes of the filters. This approach minimises the parallelisation overhead yet displays highly desirable theoretical properties. Under very mild assumptions, we analyse the mean square error (MSE) of the estimators of 1-dimensional statistics of the optimal filtering distribution and show explicitly the effect of parallelisation scheme on the convergence rate. Specifically, we study the decomposition of the MSE into variance and bias components, to show that the former decays as $\frac{1}{MN}$, i.e., linearly with the total number of particles, while the latter converges towards $0$ as $\frac{1}{N^2}$. Parallelisation, therefore, has the obvious advantage of dividing the running times while preserving the (asymptotic) performance of the particle filter. Following this lead, we propose a time-error index to compare schemes with different degrees of parallelisation. Finally, we provide two numerical examples. The first one deals with the tracking of a Lorenz 63 chaotic system with dynamical noise and partial (noisy) observations, while the second example involves a dynamical network of modified FitzHugh-Nagumo (FH-N) stochastic nodes. The latter is a large dimensional system ($\approx3,000$ state variables in our computer experiments) designed to numerically reproduce typical electrical phenomena observed in the atria of the human heart. In both examples, we show how the proposed parallelisation scheme attains the same approximation accuracy as a centralised particle filter with only a small fraction of the running time, using a standard multicore computer.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

A central limit type theorem for Gaussian mixture approximations to the nonlinear filtering problem

Approximating the solution of the nonlinear filtering problem with Gaussian mixtures has been a very popular method since the 1970s. However, the vast majority of such approximations are introduced in an ad-hoc manner without theoretical grounding. This work is a continuation of [4, 5], where we described a rigorous Gaussian mixture approximation to the solution of the filtering problem. We deduce here a refined estimate of the rate of convergence of the approximation. We do this by proving a central limit type theorem for the error process. We also find the optimal variances of the Gaussian measures are of order $1/\sqrt{n}$. This implies, in particular, that the mean square error of the approximation as defined in [4, 5] is of order $1/n$.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

A Stable Particle Filter in High-Dimensions

We consider the numerical approximation of the filtering problem in high dimensions, that is, when the hidden state lies in $\mathbb{R}^d$ with $d$ large. For low dimensional problems, one of the most popular numerical procedures for consistent inference is the class of approximations termed particle filters or sequential Monte Carlo methods. However, in high dimensions, standard particle filters (e.g. the bootstrap particle filter) can have a cost that is exponential in $d$ for the algorithm to be stable in an appropriate sense. We develop a new particle filter, called the \emph{space-time particle filter}, for a specific family of state-space models in discrete time. This new class of particle filters provide consistent Monte Carlo estimates for any fixed $d$, as do standard particle filters. Moreover, we expect that the state-space particle filter will scale much better with $d$ than the standard filter. We illustrate this analytically for a model of a simple i.i.d. structure and one of a Markovian structure in the $d$-dimensional space-direction, when we show that the algorithm exhibits certain stability properties as $d$ increases at a cost $\mathcal{O}(nNd^2)$, where $n$ is the time parameter and $N$ is the number of Monte Carlo samples, that are fixed and independent of $d$. Similar results are expected to hold, under a more general structure than the i.i.d.~one. independently of the dimension. Our theoretical results are also supported by numerical simulations on practical models of complex structures. The results suggest that it is indeed possible to tackle some high dimensional filtering problems using the space-time particle filter that standard particle filters cannot handle.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Runge-Kutta schemes for backward stochastic differential equations

We study the convergence of a class of Runge-Kutta type schemes for backward stochastic differential equations (BSDEs) in a Markovian framework. The schemes belonging to the class under consideration benefit from a certain stability property. As a consequence, the overall rate of the convergence of these schemes is controlled by their local truncation error. The schemes are categorized by the number of intermediate stages implemented between consecutive partition time instances. We show that the order of the schemes matches the number $p$ of intermediate stages for $p\le3$. Moreover, we show that the so-called order barrier occurs at $p=3$, that is, that it is not possible to construct schemes of order $p$ with $p$ stages, when $p>3$. The analysis is done under sufficient regularity on the final condition and on the coefficients of the BSDE.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

The filtering equations revisited

The problem of nonlinear filtering has engendered a surprising number of mathematical techniques for its treatment. A notable example is the change-of--probability-measure method originally introduced by Kallianpur and Striebel to derive the filtering equations and the Bayes-like formula that bears their names. More recent work, however, has generally preferred other methods. In this paper, we reconsider the change-of-measure approach to the derivation of the filtering equations and show that many of the technical conditions present in previous work can be relaxed. The filtering equations are established for general Markov signal processes that can be described by a martingale-problem formulation. Two specific applications are treated.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Generalised Particle Filters with Gaussian Mixtures

Stochastic filtering is defined as the estimation of a partially observed dynamical system. A massive scientific and computational effort is dedicated to the development of numerical methods for approximating the solution of the filtering problem. Approximating the solution of the filtering problem with Gaussian mixtures has been a very popular method since the 1970s (see [1],[2],[46],[49]). Despite nearly fifty years of development, the existing work is based on the success of the numerical implementation and is not theoretically justified. This paper fills this gap and contains a rigorous analysis of a new Gaussian mixture approximation to the solution of the filtering problem. We deduce the L^2-convergence rate for the approximating system and show some numerical example to test the new algorithm.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Kusuoka-Stroock gradient bounds for the solution of the filtering equation

We obtain sharp gradient bounds for perturbed diffusion semigroups. In contrast with existing results, the perturbation is here random and the bounds obtained are pathwise. Our approach builds on the classical work of Kusuoka and Stroock [7],[9],[10],[11], and extends their program developed for the heat semi-group to solutions of stochastic partial differential equations. The work is motivated by and applied to nonlinear filtering. The analysis allows us to derive pathwise gradient bounds for the un-normalised conditional distribution of a partially observed signal. It uses a pathwise representation of the perturbed semigroup in the spirit of classical work by Ocone [14]. The estimates we derive have sharp small time asymptotics.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

On the Stability of Sequential Monte Carlo Methods in High Dimensions

We investigate the stability of a Sequential Monte Carlo (SMC) method applied to the problem of sampling from a target distribution on $\mathbb{R}^d$ for large $d$. It is well known that using a single importance sampling step one produces an approximation for the target that deteriorates as the dimension $d$ increases, unless the number of Monte Carlo samples $N$ increases at an exponential rate in $d$. We show that this degeneracy can be avoided by introducing a sequence of artificial targets, starting from a `simple' density and moving to the one of interest, using an SMC method to sample from the sequence. Using this class of SMC methods with a fixed number of samples, one can produce an approximation for which the effective sample size (ESS) converges to a random variable $\varepsilon_N$ as $d\rightarrow\infty$ with $1<\varepsilon_{N}<N$. The convergence is achieved with a computational cost proportional to $Nd^2$. If $\varepsilon_N\ll N$, we can raise its value by introducing a number of resampling steps, say $m$ (where $m$ is independent of $d$). In this case, ESS converges to a random variable $\varepsilon_{N,m}$ as $d\rightarrow\infty$ and $\lim_{m\to\infty}\varepsilon_{N,m}=N$. Also, we show that the Monte Carlo error for estimating a fixed dimensional marginal expectation is of order $\frac{1}{\sqrt{N}}$ uniformly in $d$. The results imply that, in high dimensions, SMC algorithms can efficiently control the variability of the importance sampling weights and estimate fixed dimensional marginals at a cost which is less than exponential in $d$ and indicate that, in high dimensions, resampling leads to a reduction in the Monte Carlo error and increase in the ESS.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

Error Bounds and Normalizing Constants for Sequential Monte Carlo in High Dimensions

In a recent paper Beskos et al (2011), the Sequential Monte Carlo (SMC) sampler introduced in Del Moral et al (2006), Neal (2001) has been shown to be asymptotically stable in the dimension of the state space d at a cost that is only polynomial in d, when N the number of Monte Carlo samples, is fixed. More precisely, it has been established that the effective sample size (ESS) of the ensuing (approximate) sample and the Monte Carlo error of fixed dimensional marginals will converge as $d$ grows, with a computational cost of $\mathcal{O}(Nd^2)$. In the present work, further results on SMC methods in high dimensions are provided as $d\to\infty$ and with $N$ fixed. We deduce an explicit bound on the Monte-Carlo error for estimates derived using the SMC sampler and the exact asymptotic relative $\mathbb{L}_2$-error of the estimate of the normalizing constant. We also establish marginal propagation of chaos properties of the algorithm. The accuracy in high-dimensions of some approximate SMC-based filtering schemes is also discussed.

0 citations0 reviewsNo code linkedOpen access
preprint2010arXiv

Second order discretization of Backward SDEs

In [5] the authors suggested a new algorithm for the numerical approximation of a BSDE by merging the cubature method with the first order discretization developed by [3] and [16]. Though the algorithm presented in [5] compared satisfactorily with other methods it lacked the higher order nature of the cubature method due to the use of the low order discretization. In this paper we introduce a second order discretization of the BSDE in the spirit of higher order implicit-explicit schemes for forward SDEs and predictor corrector methods.

0 citations0 reviewsNo code linkedOpen access