BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

James-Michael Leahy

James-Michael Leahy appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
math.PRmath.APmath.DSphysics.flu-dynArtificial IntelligenceMachine Learningmath-phmath.MPmath.NAmath.OC

Catalog footprint

What is connected

8works
10topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

8 published item(s)

preprint2022arXiv

Convergence of Policy Gradient for Entropy Regularized MDPs with Neural Network Approximation in the Mean-Field Regime

We study the global convergence of policy gradient for infinite-horizon, continuous state and action space, and entropy-regularized Markov decision processes (MDPs). We consider a softmax policy with (one-hidden layer) neural network approximation in a mean-field regime. Additional entropic regularization in the associated mean-field probability measure is added, and the corresponding gradient flow is studied in the 2-Wasserstein metric. We show that the objective function is increasing along the gradient flow. Further, we prove that if the regularization in terms of the mean-field measure is sufficient, the gradient flow converges exponentially fast to the unique stationary solution, which is the unique maximizer of the regularized MDP objective. Lastly, we study the sensitivity of the value function along the gradient flow with respect to regularization parameters and the initial condition. Our results rely on the careful analysis of the non-linear Fokker-Planck-Kolmogorov equation and extend the pioneering work of Mei et al. 2020 and Agarwal et al. 2020, which quantify the global convergence rate of policy gradient for entropy-regularized MDPs in the tabular setting.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Solution properties of the incompressible Euler system with rough path advection

The present paper aims to establish the local well-posedness of Euler's fluid equations on geometric rough paths. In particular, we consider the Euler equations for the incompressible flow of an ideal fluid whose Lagrangian transport velocity possesses an additional rough-in-time, divergence-free vector field. In recent work, we have demonstrated that this system can be derived from Clebsch and Hamilton-Pontryagin variational principles that possess a perturbative geometric rough path Lie-advection constraint. In this paper, we prove the local well-posedness of the system in $L^2$-Sobolev spaces $H^m$ with integer regularity $m\ge \lfloor d/2\rfloor+2$ and establish a Beale-Kato-Majda (BKM) blow-up criterion in terms of the $L^1_tL^\infty_x$-norm of the vorticity. In dimension two, we show that the $L^p$-norms of the vorticity are conserved, which yields global well-posedness and a Wong-Zakai approximation theorem for the stochastic version of the equation.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Variational principles for fluid dynamics on rough paths

In this paper, we introduce a new framework for parametrization schemes (PS) in GFD. Using the theory of controlled rough paths, we derive a class of rough geophysical fluid dynamics (RGFD) models as critical points of rough action functionals. These RGFD models characterize Lagrangian trajectories in fluid dynamics as geometric rough paths (GRP) on the manifold of diffeomorphic maps. Three constrained variational approaches are formulated for the derivation of these models. The first is the Clebsch formulation, in which the constraints are imposed as rough advection laws. The second is the Hamilton-Pontryagin formulation, in which the constraints are imposed as right-invariant rough vector fields. The third is the Euler--Poincaré formulation in which the variations are constrained. These variational principles lead directly to the Lie--Poisson Hamiltonian formulation of fluid dynamics on geometric rough paths. The GRP framework preserves the geometric structure of fluid dynamics obtained by using Lie group reduction to pass from Lagrangian to Eulerian variational principles, thereby yielding a rough formulation of the Kelvin circulation theorem. The rough-path variational approach includes non-Markovian perturbations of the Lagrangian fluid trajectories. In particular, memory effects can be introduced through this formulation through a judicious choice of the rough path (e.g. a realization of a fractional Brownian motion). In the special case when the rough path is a realization of a semimartingale, we recover the SGFD models in Holm (2015). However, by eliminating the need for stochastic variational tools, we retain a pathwise interpretation of the Lagrangian trajectories. In contrast, the Lagrangian trajectories in the stochastic framework are described by stochastic integrals which do not have a pathwise interpretation. Thus, the rough path formulation restores this property.

0 citations0 reviewsNo code linkedOpen access
preprint2019arXiv

Lagrangian averaged stochastic advection by Lie transport for fluids

We formulate a class of stochastic partial differential equations based on Kelvin's circulation theorem for ideal fluids. In these models, the velocity field is randomly transported by white-noise vector fields, as well as by its own average over realizations of this noise. We call these systems the Lagrangian averaged stochastic advection by Lie transport (LA SALT) equations. These equations are nonlinear and non-local, in both physical and probability space. Before taking this average, the equations recover the Stochastic Advection by Lie Transport (SALT) fluid equations introduced by Holm (2015). Remarkably, the introduction of the non-locality in probability space in the form of momentum transported by its own mean velocity gives rise to a closed equation for the expectation field which comprises Navier--Stokes equations with Lie--Laplacian "dissipation". As such, this form of non-locality provides a regularization mechanism. The formalism we develop is closely connected to the stochastic Weber velocity framework of Constantin and Iyer (2008) in the case when the noise correlates are taken to be the constant basis vectors in $\mathbb{R}^3$ and, thus, the Lie--Laplacian reduces to the usual Laplacian. We extend this class of equations to allow for advected quantities to be present and affect the flow through exchange of kinetic and potential energies. The statistics of the solutions for the LA SALT fluid equations are found to be changing dynamically due to an array of intricate correlations among the physical variables. The statistical properties of the LA SALT physical variables propagate as local evolutionary equations which when spatially integrated become dynamical equations for the variances of the fluctuations. Essentially, the LA SALT theory is a non-equilibrium stochastic linear response theory for fluctuations in SALT fluids with advected quantities.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

On Degenerate Linear Stochastic Evolution Equations Driven by Jump Processes

We prove the existence and uniqueness of solutions of degenerate linear stochastic evolution equations driven by jump processes in a Hilbert scale using the variational framework of stochastic evolution equations and the method of vanishing viscosity. As an application of this result, we derive the existence and uniqueness of solutions of degenerate parabolic linear stochastic integro-differential equations (SIDEs) in the Sobolev scale. The SIDEs that we consider arise in the theory of non-linear filtering as the equations governing the conditional density of a degenerate jump-diffusion signal given a jump-diffusion observation, possibly with correlated noise.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

On Classical Solutions of Linear Stochastic Integro-Differential Equations

We prove the existence of classical solutions to parabolic linear stochastic integro-differential equations with adapted coefficients using Feynman-Kac transformations, conditioning, and the interlacing of space-inverses of stochastic flows associated with the equations. The equations are forward and the derivation of existence does not use the "general theory" of SPDEs. Uniqueness is proved in the class of classical solutions with polynomial growth.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

On Some Properties of Space Inverses of Stochastic Flows

We derive moment estimates and a strong limit theorem for space inverses of stochastic flows generated by jump SDEs with adapted coefficients in weighted Hölder norms using the Sobolev embedding theorem and the change of variable formula. As an application of some basic properties of flows of continuous SDEs, we derive the existence and uniqueness of classical solutions of linear parabolic second order SPDEs by partitioning the time interval and passing to the limit. The methods we use allow us to improve on previously known results in the continuous case and to derive new ones in the jump case.

0 citations0 reviewsNo code linkedOpen access