BZPEERReading, trust and collaboration for research
Menu

Discover

GraphFollow connections around a paper, topic or saved view.

Workspaces

HomePick up where your research flow left off.InboxHandle requests, replies and notifications from one place.CollectionsCurate reading lists, evidence sets and shareable dossiers.ResearchSee your private provenance graph, trail and imports.CollaborationMove from discovery into focused discussion rooms.PublishDraft, preview and publish full-text research articles.

Network

ExpertsFind specialists worth following or asking for help.CommunitiesJoin research circles organized around shared work.PartnersSee external organizations active around the same topics.

Opportunities

ListingsBrowse roles, calls and collaborations with clearer fit signals.

Account

Log inReturn to your reading and collaboration workspace.Create accountStart saving work, following people and joining teams.
Log inCreate account

Researcher profile

James-Michael Leahy

James-Michael Leahy contributes to research discovery and scholarly infrastructure.

ResearcherAffiliation not importedOpen to collaborate
math.PRmath.APphysics.flu-dynArtificial IntelligenceMachine Learningmath-phmath.DSmath.MPmath.OC

Trust snapshot

Quick read

Trust 17 - UnverifiedVerification L1Unclaimed author
4works
0followers
9topics
4close collaborators

Actions

Decide how to stay connected

Follow researcher0

Identity and collaboration

How to connect with this researcher

Claiming links this public author record to a researcher profile and unlocks direct collaboration workflows.

Log in to claim

Direct collaboration

Open a focused conversation when the fit is right

Claim this author entity first to unlock direct invitations.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

4 published item(s)

preprint2022arXiv

Convergence of Policy Gradient for Entropy Regularized MDPs with Neural Network Approximation in the Mean-Field Regime

We study the global convergence of policy gradient for infinite-horizon, continuous state and action space, and entropy-regularized Markov decision processes (MDPs). We consider a softmax policy with (one-hidden layer) neural network approximation in a mean-field regime. Additional entropic regularization in the associated mean-field probability measure is added, and the corresponding gradient flow is studied in the 2-Wasserstein metric. We show that the objective function is increasing along the gradient flow. Further, we prove that if the regularization in terms of the mean-field measure is sufficient, the gradient flow converges exponentially fast to the unique stationary solution, which is the unique maximizer of the regularized MDP objective. Lastly, we study the sensitivity of the value function along the gradient flow with respect to regularization parameters and the initial condition. Our results rely on the careful analysis of the non-linear Fokker-Planck-Kolmogorov equation and extend the pioneering work of Mei et al. 2020 and Agarwal et al. 2020, which quantify the global convergence rate of policy gradient for entropy-regularized MDPs in the tabular setting.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Solution properties of the incompressible Euler system with rough path advection

The present paper aims to establish the local well-posedness of Euler's fluid equations on geometric rough paths. In particular, we consider the Euler equations for the incompressible flow of an ideal fluid whose Lagrangian transport velocity possesses an additional rough-in-time, divergence-free vector field. In recent work, we have demonstrated that this system can be derived from Clebsch and Hamilton-Pontryagin variational principles that possess a perturbative geometric rough path Lie-advection constraint. In this paper, we prove the local well-posedness of the system in $L^2$-Sobolev spaces $H^m$ with integer regularity $m\ge \lfloor d/2\rfloor+2$ and establish a Beale-Kato-Majda (BKM) blow-up criterion in terms of the $L^1_tL^\infty_x$-norm of the vorticity. In dimension two, we show that the $L^p$-norms of the vorticity are conserved, which yields global well-posedness and a Wong-Zakai approximation theorem for the stochastic version of the equation.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Variational principles for fluid dynamics on rough paths

In this paper, we introduce a new framework for parametrization schemes (PS) in GFD. Using the theory of controlled rough paths, we derive a class of rough geophysical fluid dynamics (RGFD) models as critical points of rough action functionals. These RGFD models characterize Lagrangian trajectories in fluid dynamics as geometric rough paths (GRP) on the manifold of diffeomorphic maps. Three constrained variational approaches are formulated for the derivation of these models. The first is the Clebsch formulation, in which the constraints are imposed as rough advection laws. The second is the Hamilton-Pontryagin formulation, in which the constraints are imposed as right-invariant rough vector fields. The third is the Euler--Poincaré formulation in which the variations are constrained. These variational principles lead directly to the Lie--Poisson Hamiltonian formulation of fluid dynamics on geometric rough paths. The GRP framework preserves the geometric structure of fluid dynamics obtained by using Lie group reduction to pass from Lagrangian to Eulerian variational principles, thereby yielding a rough formulation of the Kelvin circulation theorem. The rough-path variational approach includes non-Markovian perturbations of the Lagrangian fluid trajectories. In particular, memory effects can be introduced through this formulation through a judicious choice of the rough path (e.g. a realization of a fractional Brownian motion). In the special case when the rough path is a realization of a semimartingale, we recover the SGFD models in Holm (2015). However, by eliminating the need for stochastic variational tools, we retain a pathwise interpretation of the Lagrangian trajectories. In contrast, the Lagrangian trajectories in the stochastic framework are described by stochastic integrals which do not have a pathwise interpretation. Thus, the rough path formulation restores this property.

0 citations0 reviewsNo code linkedOpen access
preprint2019arXiv

Lagrangian averaged stochastic advection by Lie transport for fluids

We formulate a class of stochastic partial differential equations based on Kelvin's circulation theorem for ideal fluids. In these models, the velocity field is randomly transported by white-noise vector fields, as well as by its own average over realizations of this noise. We call these systems the Lagrangian averaged stochastic advection by Lie transport (LA SALT) equations. These equations are nonlinear and non-local, in both physical and probability space. Before taking this average, the equations recover the Stochastic Advection by Lie Transport (SALT) fluid equations introduced by Holm (2015). Remarkably, the introduction of the non-locality in probability space in the form of momentum transported by its own mean velocity gives rise to a closed equation for the expectation field which comprises Navier--Stokes equations with Lie--Laplacian "dissipation". As such, this form of non-locality provides a regularization mechanism. The formalism we develop is closely connected to the stochastic Weber velocity framework of Constantin and Iyer (2008) in the case when the noise correlates are taken to be the constant basis vectors in $\mathbb{R}^3$ and, thus, the Lie--Laplacian reduces to the usual Laplacian. We extend this class of equations to allow for advected quantities to be present and affect the flow through exchange of kinetic and potential energies. The statistics of the solutions for the LA SALT fluid equations are found to be changing dynamically due to an array of intricate correlations among the physical variables. The statistical properties of the LA SALT physical variables propagate as local evolutionary equations which when spatially integrated become dynamical equations for the variances of the fluctuations. Essentially, the LA SALT theory is a non-equilibrium stochastic linear response theory for fluctuations in SALT fluids with advected quantities.

0 citations0 reviewsNo code linkedOpen access