BZPEERReading, trust and collaboration for research
Menu

Discover

GraphFollow connections around a paper, topic or saved view.

Workspaces

HomePick up where your research flow left off.InboxHandle requests, replies and notifications from one place.CollectionsCurate reading lists, evidence sets and shareable dossiers.ResearchSee your private provenance graph, trail and imports.CollaborationMove from discovery into focused discussion rooms.PublishDraft, preview and publish full-text research articles.

Network

ExpertsFind specialists worth following or asking for help.CommunitiesJoin research circles organized around shared work.PartnersSee external organizations active around the same topics.

Opportunities

ListingsBrowse roles, calls and collaborations with clearer fit signals.

Account

Log inReturn to your reading and collaboration workspace.Create accountStart saving work, following people and joining teams.
Log inCreate account

Researcher profile

Dan Crisan

Dan Crisan contributes to research discovery and scholarly infrastructure.

ResearcherAffiliation not importedOpen to collaborate
math.PRmath.NANumerical Analysisphysics.flu-dynComputationmath.APMachine LearningApplicationsArtificial Intelligencemath-phmath.DSmath.MPmath.OCmath.STMethodologyphysics.ao-phphysics.geo-phStatistics Theory

Trust snapshot

Quick read

Trust 21 - EmergingVerification L1Unclaimed author
13works
0followers
18topics
4close collaborators

Actions

Decide how to stay connected

Follow researcher0

Identity and collaboration

How to connect with this researcher

Claiming links this public author record to a researcher profile and unlocks direct collaboration workflows.

Log in to claim

Direct collaboration

Open a focused conversation when the fit is right

Claim this author entity first to unlock direct invitations.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

13 published item(s)

preprint2022arXiv

A Lagged Particle Filter for Stable Filtering of certain High-Dimensional State-Space Models

We consider the problem of high-dimensional filtering of state-space models (SSMs) at discrete times. This problem is particularly challenging as analytical solutions are typically not available and many numerical approximation methods can have a cost that scales exponentially with the dimension of the hidden state. Inspired by lag-approximation methods for the smoothing problem, we introduce a lagged approximation of the smoothing distribution that is necessarily biased. For certain classes of SSMs, particularly those that forget the initial condition exponentially fast in time, the bias of our approximation is shown to be uniformly controlled in the dimension and exponentially small in time. We develop a sequential Monte Carlo (SMC) method to recursively estimate expectations with respect to our biased filtering distributions. Moreover, we prove for a class of class of SSMs that can contain dependencies amongst coordinates that as the dimension $d\rightarrow\infty$ the cost to achieve a stable mean square error in estimation, for classes of expectations, is of $\mathcal{O}(Nd^2)$ per-unit time, where $N$ is the number of simulated samples in the SMC algorithm. Our methodology is implemented on several challenging high-dimensional examples including the conservative shallow-water model.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

An application of the splitting-up method for the computation of a neural network representation for the solution for the filtering equations

The filtering equations govern the evolution of the conditional distribution of a signal process given partial, and possibly noisy, observations arriving sequentially in time. Their numerical approximation plays a central role in many real-life applications, including numerical weather prediction, finance and engineering. One of the classical approaches to approximate the solution of the filtering equations is to use a PDE inspired method, called the splitting-up method, initiated by Gyongy, Krylov, LeGland, among other contributors. This method, and other PDE based approaches, have particular applicability for solving low-dimensional problems. In this work we combine this method with a neural network representation. The new methodology is used to produce an approximation of the unnormalised conditional distribution of the signal process. We further develop a recursive normalisation procedure to recover the normalised conditional distribution of the signal process. The new scheme can be iterated over multiple time steps whilst keeping its asymptotic unbiasedness property intact. We test the neural network approximations with numerical approximation results for the Kalman and Benes filter.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Parallel sequential Monte Carlo for stochastic gradient-free nonconvex optimization

We introduce and analyze a parallel sequential Monte Carlo methodology for the numerical solution of optimization problems that involve the minimization of a cost function that consists of the sum of many individual components. The proposed scheme is a stochastic zeroth order optimization algorithm which demands only the capability to evaluate small subsets of components of the cost function. It can be depicted as a bank of samplers that generate particle approximations of several sequences of probability measures. These measures are constructed in such a way that they have associated probability density functions whose global maxima coincide with the global minima of the original cost function. The algorithm selects the best performing sampler and uses it to approximate a global minimum of the cost function. We prove analytically that the resulting estimator converges to a global minimum of the cost function almost surely and provide explicit convergence rates in terms of the number of generated Monte Carlo samples and the dimension of the search space. We show, by way of numerical examples, that the algorithm can tackle cost functions with multiple minima or with broad "flat" regions which are hard to minimize using gradient-based techniques.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Solution properties of the incompressible Euler system with rough path advection

The present paper aims to establish the local well-posedness of Euler's fluid equations on geometric rough paths. In particular, we consider the Euler equations for the incompressible flow of an ideal fluid whose Lagrangian transport velocity possesses an additional rough-in-time, divergence-free vector field. In recent work, we have demonstrated that this system can be derived from Clebsch and Hamilton-Pontryagin variational principles that possess a perturbative geometric rough path Lie-advection constraint. In this paper, we prove the local well-posedness of the system in $L^2$-Sobolev spaces $H^m$ with integer regularity $m\ge \lfloor d/2\rfloor+2$ and establish a Beale-Kato-Majda (BKM) blow-up criterion in terms of the $L^1_tL^\infty_x$-norm of the vorticity. In dimension two, we show that the $L^p$-norms of the vorticity are conserved, which yields global well-posedness and a Wong-Zakai approximation theorem for the stochastic version of the equation.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

A 4D-Var Method with Flow-Dependent Background Covariances for the Shallow-Water Equations

The 4D-Var method for filtering partially observed nonlinear chaotic dynamical systems consists of finding the maximum a-posteriori (MAP) estimator of the initial condition of the system given observations over a time window, and propagating it forward to the current time via the model dynamics. This method forms the basis of most currently operational weather forecasting systems. In practice the optimization becomes infeasible if the time window is too long due to the non-convexity of the cost function, the effect of model errors, and the limited precision of the ODE solvers. Hence the window has to be kept sufficiently short, and the observations in the previous windows can be taken into account via a Gaussian background (prior) distribution. The choice of the background covariance matrix is an important question that has received much attention in the literature. In this paper, we define the background covariances in a principled manner, based on observations in the previous $b$ assimilation windows, for a parameter $b\ge 1$. The method is at most $b$ times more computationally expensive than using fixed background covariances, requires little tuning, and greatly improves the accuracy of 4D-Var. As a concrete example, we focus on the shallow-water equations. The proposed method is compared against state-of-the-art approaches in data assimilation and is shown to perform favourably on simulated data. We also illustrate our approach on data from the recent tsunami of 2011 in Fukushima, Japan.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Bayesian Inference for Fluid Dynamics: A Case Study for the Stochastic Rotating Shallow Water Model

In this work, we use a tempering-based adaptive particle filter to infer from a partially observed stochastic rotating shallow water (SRSW) model which has been derived using the Stochastic Advection by Lie Transport (SALT) approach. The methodology we present here validates the applicability of tempering and sample regeneration via a Metropolis-Hastings algorithm to high-dimensional models used in stochastic fluid dynamics. The methodology is first tested on the Lorenz '63 model with both full and partial observations. Then we discuss the efficiency of the particle filter the SALT-SRSW model.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Local well-posedness for the great lake equation with transport noise

This work is a continuation of the authors' work for the stochastic 2D Euler equation driven by transport type noise. Here we lift the incompressibility constraint. Instead we assume a weighted incompressibility condition. This condition is inspired by a physical model for a fluid in a basin with a free upper surface and a spatially varying bottom topography. Moreover, we assume a different form of the vorticity to stream function operator that generalizes the standard Biot-Savart operator which appears in the Euler equation. These two properties are exhibited in the physical model called the great lake equation. For this reason we refer to the model analysed in this paper as the stochastic great lake equation. The new vorticity to stream function operator generalizes the curl operator and it is shown to have good regularity properties. We also show that the initial smoothness of the solution is preserved. The arguments are based on constructing a family of viscous solutions which is proved to be relatively compact and to converge to a truncated version of the original equation. Finally, we show that the truncation can be removed up to a positive stopping time.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Log-Normalization Constant Estimation using the Ensemble Kalman-Bucy Filter with Application to High-Dimensional Models

In this article we consider the estimation of the log-normalization constant associated to a class of continuous-time filtering models. In particular, we consider ensemble Kalman-Bucy filter based estimates based upon several nonlinear Kalman-Bucy diffusions. Based upon new conditional bias results for the mean of the afore-mentioned methods, we analyze the empirical log-scale normalization constants in terms of their $\mathbb{L}_n-$errors and conditional bias. Depending on the type of nonlinear Kalman-Bucy diffusion, we show that these are of order $(\sqrt{t/N}) + t/N$ or $1/\sqrt{N}$ ($\mathbb{L}_n-$errors) and of order $[t+\sqrt{t}]/N$ or $1/N$ (conditional bias), where $t$ is the time horizon and $N$ is the ensemble size. Finally, we use these results for online static parameter estimation for above filtering models and implement the methodology for both linear and nonlinear models.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Pathwise approximations for the solution of the non-linear filtering problem

We consider high order approximations of the solution of the stochastic filtering problem, derive their pathwise representation in the spirit of the earlier work of Clark and Davis and prove their robustness property. In particular, we show that the high order discretised filtering functionals can be represented by Lipschitz continuous functions defined on the observation path space. This property is important from the practical point of view as it is in fact the pathwise version of the filtering functional that is sought in numerical applications. Moreover, the pathwise viewpoint will be a stepping stone into the rigorous development of machine learning methods for the filtering problem. This work is a continuation of a recent work by two of the authors where a discretisation of the solution of the filtering problem of arbitrary order has been established. We expand the previous work by showing that robust approximations can be derived from the discretisations therein.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Variational principles for fluid dynamics on rough paths

In this paper, we introduce a new framework for parametrization schemes (PS) in GFD. Using the theory of controlled rough paths, we derive a class of rough geophysical fluid dynamics (RGFD) models as critical points of rough action functionals. These RGFD models characterize Lagrangian trajectories in fluid dynamics as geometric rough paths (GRP) on the manifold of diffeomorphic maps. Three constrained variational approaches are formulated for the derivation of these models. The first is the Clebsch formulation, in which the constraints are imposed as rough advection laws. The second is the Hamilton-Pontryagin formulation, in which the constraints are imposed as right-invariant rough vector fields. The third is the Euler--Poincaré formulation in which the variations are constrained. These variational principles lead directly to the Lie--Poisson Hamiltonian formulation of fluid dynamics on geometric rough paths. The GRP framework preserves the geometric structure of fluid dynamics obtained by using Lie group reduction to pass from Lagrangian to Eulerian variational principles, thereby yielding a rough formulation of the Kelvin circulation theorem. The rough-path variational approach includes non-Markovian perturbations of the Lagrangian fluid trajectories. In particular, memory effects can be introduced through this formulation through a judicious choice of the rough path (e.g. a realization of a fractional Brownian motion). In the special case when the rough path is a realization of a semimartingale, we recover the SGFD models in Holm (2015). However, by eliminating the need for stochastic variational tools, we retain a pathwise interpretation of the Lagrangian trajectories. In contrast, the Lagrangian trajectories in the stochastic framework are described by stochastic integrals which do not have a pathwise interpretation. Thus, the rough path formulation restores this property.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

A Particle Filter for Stochastic Advection by Lie Transport (SALT): A case study for the damped and forced incompressible 2D Euler equation

In this work, we combine a stochastic model reduction with a particle filter augmented with tempering and jittering, and apply the combined algorithm to a damped and forced incompressible 2D Euler dynamics defined on a simply connected bounded domain. We show that using the combined algorithm, we are able to assimilate data from a reference system state (the ``truth") modelled by a highly resolved numerical solution of the flow that has roughly $3.1\times10^6$ degrees of freedom, into a stochastic system having two orders of magnitude less degrees of freedom, which is able to approximate the true state reasonably accurately for $5$ large scale eddy turnover times, using modest computational hardware. The model reduction is performed through the introduction of a stochastic advection by Lie transport (SALT) model as the signal on a coarser resolution. The SALT approach was introduced as a general theory using a geometric mechanics framework from Holm, Proc. Roy. Soc. A (2015). This work follows on the numerical implementation for SALT presented by Cotter et al, SIAM Multiscale Model. Sim. (2019) for the flow in consideration. The model reduction is substantial: The reduced SALT model has $4.9\times 10^4$ degrees of freedom. Results from reliability tests on the assimilated system are also presented.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Modelling uncertainty using stochastic transport noise in a 2-layer quasi-geostrophic model

The stochastic variational approach for geophysical fluid dynamics was introduced by Holm (Proc Roy Soc A, 2015) as a framework for deriving stochastic parameterisations for unresolved scales. This paper applies the variational stochastic parameterisation in a two-layer quasi-geostrophic model for a beta-plane channel flow configuration. We present a new method for estimating the stochastic forcing (used in the parameterisation) to approximate unresolved components using data from the high resolution deterministic simulation, and describe a procedure for computing physically-consistent initial conditions for the stochastic model. We also quantify uncertainty of coarse grid simulations relative to the fine grid ones in homogeneous (teamed with small-scale vortices) and heterogeneous (featuring horizontally elongated large-scale jets) flows, and analyse how the spread of stochastic solutions depends on different parameters of the model. The parameterisation is tested by comparing it with the true eddy-resolving solution that has reached some statistical equilibrium and the deterministic solution modelled on a low-resolution grid. The results show that the proposed parameterisation significantly depends on the resolution of the stochastic model and gives good ensemble performance for both homogeneous and heterogeneous flows, and the parameterisation lays solid foundations for data assimilation.

0 citations0 reviewsNo code linkedOpen access
preprint2019arXiv

Data assimilation for a quasi-geostrophic model with circulation-preserving stochastic transport noise

This paper contains the latest installment of the authors' project on developing ensemble based data assimilation methodology for high dimensional fluid dynamics models. The algorithm presented here is a particle filter that combines model reduction, tempering, jittering, and nudging. The methodology is tested on a two-layer quasi-geostrophic model for a $β$-plane channel flow with $O(10^6)$ degrees of freedom out of which only a minute fraction are noisily observed. The model is reduced by following the stochastic variational approach for geophysical fluid dynamics introduced in Holm (Proc Roy Soc A, 2015) as a framework for deriving stochastic parametrisations for unresolved scales. The reduction is substantial: the computations are done only for $O(10^4)$ degrees of freedom. We introduce a stochastic time-stepping scheme for the two-layer model and prove its consistency in time. Then, we analyze the effect of the different procedures (tempering combined with jittering and nudging) on the performance of the data assimilation procedure using the reduced model, as well as how the dimension of the observational data (the number of "weather stations") and the data assimilation step affect the accuracy and uncertainty of the results.

0 citations0 reviewsNo code linkedOpen access