Source author record

Kaj Nyström

Explore this author’s publications, collaborators and research topics. This catalog record has not been claimed by its author.

ResearcherUnclaimed source record

math.AP math.PR math.OC Machine Learning math.CA math.MG q-fin.PR

Catalog footprint

Research overview

16works

7topics

4close collaborators

Actions

Is this your work?

Open graph Browse papers

preprint2022arXiv

Asymptotic mean value formulas, nonlocal space-time parabolic operators and anomalous tug-of-war games

The fractional heat operator $(\partial_t-Δ_x)^s$ and Continuous Time Random Walks (CTRWs) are interesting and sophisticated mathematical models that can describe complex anomalous systems. In this paper, we prove asymptotic mean value representation formulas for functions with respect to $(\partial_t-Δ_x)^s$ and we introduce new nonlocal, nonlinear parabolic operators related to a tug-of-war which accounts for waiting times and space-time couplings. These nonlocal, nonlinear parabolic operators and equations can be seen as nonlocal versions of the evolutionary infinity Laplace operator.

preprint2022arXiv

Deep learning, stochastic gradient descent and diffusion maps

Stochastic gradient descent (SGD) is widely used in deep learning due to its computational efficiency, but a complete understanding of why SGD performs so well remains a major challenge. It has been observed empirically that most eigenvalues of the Hessian of the loss functions on the loss landscape of over-parametrized deep neural networks are close to zero, while only a small number of eigenvalues are large. Zero eigenvalues indicate zero diffusion along the corresponding directions. This indicates that the process of minima selection mainly happens in the relatively low-dimensional subspace corresponding to the top eigenvalues of the Hessian. Although the parameter space is very high-dimensional, these findings seems to indicate that the SGD dynamics may mainly live on a low-dimensional manifold. In this paper, we pursue a truly data driven approach to the problem of getting a potentially deeper understanding of the high-dimensional parameter surface, and in particular, of the landscape traced out by SGD by analyzing the data generated through SGD, or any other optimizer for that matter, in order to possibly discover (local) low-dimensional representations of the optimization landscape. As our vehicle for the exploration, we use diffusion maps introduced by R. Coifman and coauthors.

preprint2022arXiv

On regularity and existence of weak solutions to nonlinear Kolmogorov-Fokker-Planck type equations with rough coefficients

We consider nonlinear Kolmogorov-Fokker-Planck type equations of the form \begin{equation}\label{abeqn} (\partial_t+X\cdot\nabla_Y)u=\nabla_X\cdot(A(\nabla_X u,X,Y,t)). \end{equation} The function $A=A(ξ,X,Y,t):\R^m\times\R^m\times\R^m\times\R\to\R^m$ is assumed to be continuous with respect to $ξ$ , and measurable with respect to $X,Y$ and $t$ . $A=A(ξ,X,Y,t)$ is allowed to be nonlinear but with linear growth. We establish higher integrability and local boundedness of weak sub-solutions, weak Harnack and Harnack inequalities, and H{ö}lder continuity with quantitative estimates. In addition we establish existence and uniqueness of weak solutions to a Dirichlet problem in certain bounded $X$ , $Y$ and $t$ dependent domains.

preprint2022arXiv

Square function estimates for the evolutionary p-Laplace equation

We prove novel (local) square function/Carleson measure estimates for non-negative solutions to the evolutionary $p$ -Laplace equation in the complement of parabolic Ahlfors-David regular sets. In the case of the heat equation, the Laplace equation as well as the $p$ -Laplace equation, the corresponding square function estimates have proven fundamental in symmetry and inverse/free boundary type problems, and in particular in the study of (parabolic) uniform rectifiability. Though the implications of the square function estimates are less clear for the evolutionary $p$ -Laplace equation, mainly due its lack of homogeneity, we give some initial applications to parabolic uniform rectifiability, boundary behaviour and Fatou type theorems for $\nabla_Xu$ .

preprint2021arXiv

On Big Pieces approximations of parabolic hypersurfaces

Let $Σ$ be a closed subset of $\mathbb{R}^ {n+1}$ which is parabolic Ahlfors-David regular and assume that $Σ$ satisfies a 2-sided corkscrew condition. Assume, in addition, that $Σ$ is either time-forwards Ahlfors-David regular, time-backwards Ahlfors-David regular, or parabolic uniform rectifiable. We then first prove that $Σ$ satisfies a {\it weak synchronized two cube condition}. Based on this we are able to revisit the argument in \cite{NS} and prove that $Σ$ contains {\it uniform big pieces of Lip(1,1/2) graphs}. When $Σ$ is parabolic uniformly rectifiable the construction can be refined and in this case we prove that $Σ$ contains {\it uniform big pieces of regular parabolic Lip(1,1/2) graphs}. Similar results hold if $Ω\subset\mathbb R^{n+1}$ is a connected component of $\mathbb R^{n+1}\setminusΣ$ and in this context we also give a parabolic counterpart of the main result in \cite{AHMNT} by proving that if $Ω$ is a one-sided parabolic chord arc domain, and if $Σ$ is parabolic uniformly rectifiable, then $Ω$ is in fact a parabolic chord arc domain. Our results give a flexible parabolic version of the classical (elliptic) result of G. David and D. Jerison concerning the existence of uniform big pieces of Lipschitz graphs for sets satisfying a two disc condition.

preprint2020arXiv

Coronizations and big pieces in metric spaces

We prove that coronizations with respect to arbitrary d-regular sets (not necessarily graphs) imply big pieces squared of these (approximating) sets. This is known (and due to David and Semmes in the case of sufficiently large co-dimension, and to Azzam and Schul in general) in the (classical) setting of Euclidean spaces with Hausdorff measure of integer dimension, where the approximating sets are Lipschitz graphs. Our result is a far reaching generalization of these results and we prove that coronizations imply big pieces squared is a generic property. In particular, our result applies, when suitably interpreted, in metric spaces having a fixed positive (perhaps non-integer) dimension, equipped with a Borel regular measure and with arbitrary approximating sets. As a novel application we highlight how to utilize this general setting in the context of parabolic uniform rectifiability.

preprint2020arXiv

Neural ODEs as the Deep Limit of ResNets with constant weights

In this paper we prove that, in the deep limit, the stochastic gradient descent on a ResNet type deep neural network, where each layer shares the same weight matrix, converges to the stochastic gradient descent for a Neural ODE and that the corresponding value/loss functions converge. Our result gives, in the context of minimization by stochastic gradient descent, a theoretical foundation for considering Neural ODEs as the deep limit of ResNets. Our proof is based on certain decay estimates for associated Fokker-Planck equations.

preprint2016arXiv

$L^2$ Solvability of boundary value problems for divergence form parabolic equations with complex coefficients

We consider parabolic operators of the form $$\partial_t+\mathcal{L},\ \mathcal{L}=-\mbox{div}\, A(X,t)\nabla,$$ in $\mathbb R_+^{n+2}:=\{(X,t)=(x,x_{n+1},t)\in \mathbb R^{n}\times \mathbb R\times \mathbb R:\ x_{n+1}>0\}$ , $n\geq 1$ . We assume that $A$ is a $(n+1)\times (n+1)$ -dimensional matrix which is bounded, measurable, uniformly elliptic and complex, and we assume, in addition, that the entries of A are independent of the spatial coordinate $x_{n+1}$ as well as of the time coordinate $t$ . For such operators we prove that the boundedness and invertibility of the corresponding layer potential operators are stable on $L^2(\mathbb R^{n+1},\mathbb C)=L^2(\partial\mathbb R^{n+2}_+,\mathbb C)$ under complex, $L^\infty$ perturbations of the coefficient matrix. Subsequently, using this general result, we establish solvability of the Dirichlet, Neumann and Regularity problems for $\partial_t+\mathcal{L}$ , by way of layer potentials and with data in $L^2$ , assuming that the coefficient matrix is a small complex perturbation of either a constant matrix or of a real and symmetric matrix.

preprint2015arXiv

Boundary behavior of solutions to the parabolic p-Laplace equation

We establish boundary estimates for non-negative solutions to the p-parabolic equation in the degenerate range $p>2$ . Our main results include new parabolic intrinsic Harnack chains in cylindrical NTA-domains together with sharp boundary decay estimates. If the underlying domain is $C^{1,1}$ -regular, we establish a relatively complete theory of the boundary behavior, including boundary Harnack principles and Hölder continuity of the ratios of two solutions, as well as fine properties of associated boundary measures. There is an intrinsic waiting time phenomena present which plays a fundamental role throughout the paper. In particular, conditions on these waiting times rule out well-known examples of explicit solutions violating the boundary Harnack principle.

preprint2015arXiv

Reflected BSDE of Wiener-Poisson type in Time-dependent Domains

In this paper we study multi-dimensional reflected backward stochastic differential equations driven by Wiener-Poisson type processes. We prove existence and uniqueness of solutions, with reflection in the inward spatial normal direction, in the setting of certain time-dependent domains.

preprint2014arXiv

A framework for the modeling of order book dynamics based on event sizes

We propose a modeling framework for the dynamics of a reduced form order book in event time and based on event sizes. Our framework for the order book is influenced by [9], but compared to [9] we allow the best bid ask spread to be larger than one tick. Based on the modeling assumption that the best bid as well as the best ask price can only move by at most one tick (up or down), when an event occurs, we show that the dynamics of this simplified order book is completely described by a non-linear transformation of two processes (X, Y ). A key challenge in the modeling is the empirical fact that the high frequency order flow is strongly autocorrelated, a fact we have to deal with in the modeling of (X, Y ). The core of our framework is a semi linear regression type model for (X, Y ), influence by more classical ARMA and AR models, and one key degree of freedom is the potentially non-linear basis functions used in the regression. We use results from the theory of random iterative function systems to understand issues concerning stationarity and ergodicity in our models. We show how to rapidly calibrate the model by inverting block Toeplitz matrices in an efficient way. All components are worked through and explain in an application and the predictability of the model for order flows and price moves are analyzed in the context of a high frequency dataset.

preprint2014arXiv

Cauchy integrals for the p-Laplace equation in planar Lipschitz domains

We construct solutions to p-Laplace type equations in unbounded Lipschitz domains in the plane with prescribed boundary data in appropriate fractional Sobolev spaces. Our approach builds on a Cauchy integral representation formula for solutions.

preprint2014arXiv

Optimal Switching Problems under Partial Information

In this paper we formulate and study an optimal switching problem under partial information. In our model the agent/manager/investor attempts to maximize the expected reward by switching between different states/investments. However, he is not fully aware of his environment and only an observation process, which contains partial information about the environment/underlying, is accessible. It is based on the partial information carried by this observation process that all decisions must be made. We propose a probabilistic numerical algorithm based on dynamic programming, regression Monte Carlo methods, and stochastic filtering theory to compute the value function. In this paper, the approximation of the value function and the corresponding convergence result are obtained when the underlying and observation processes satisfy the linear Kalman-Bucy setting. A numerical example is included to show some specific features of partial information.

preprint2014arXiv

Tug-of-war, market manipulation and option pricing

We develop an option pricing model based on a tug-of-war game. This two-player zero-sum stochastic differential game is formulated in the context of a multi-dimensional financial market. The issuer and the holder try to manipulate asset price processes in order to minimize and maximize the expected discounted reward. We prove that the game has a value and that the value function is the unique viscosity solution to a terminal value problem for a parabolic partial differential equation involving the non-linear and completely degenerate infinity Laplace operator.

preprint2013arXiv

Systems of variational inequalities for non-local operators related to optimal switching problems: Existence and uniqueness

In this paper we study a system of variational inequalities where the operator is non-local, possibly degenerate and of second order. A special case of this type of problem occurs in the context of optimal switching problems when the dynamics of the underlying state variables is described by an N-dimensional Levy process. We establish a general comparison principle for viscosity sub- and supersolutions to the system under mild regularity, growth and structural assumptions on the data. Using the comparison principle we then prove the existence of a unique viscosity solution to the system by Perron's method. Our main contribution is that we establish existence and uniqueness of viscosity solutions, in the setting of Levy processes and non-local operators, with no sign assumption on the switching costs and allowing them to depend on x as well as t.

preprint2010arXiv

The Skorohod oblique reflection problem in time-dependent domains

The deterministic Skorohod problem plays an important role in the construction and analysis of diffusion processes with reflection. In the form studied here, the multidimensional Skorohod problem was introduced, in time-independent domains, by H. Tanaka [61] and further investigated by P.-L. Lions and A.-S. Sznitman [42] in their celebrated article. Subsequent results of several researchers have resulted in a large literature on the Skorohod problem in time-independent domains. In this article we conduct a thorough study of the multidimensional Skorohod problem in time-dependent domains. In particular, we prove the existence of càdlàg solutions $(x,λ)$ to the Skorohod problem, with oblique reflection, for $(D,Γ,w)$ assuming, in particular, that $D$ is a time-dependent domain (Theorem 1.2). In addition, we prove that if $w$ is continuous, then $x$ is continuous as well (Theorem 1.3). Subsequently, we use the established existence results to construct solutions to stochastic differential equations with oblique reflection (Theorem 1.9) in time-dependent domains. In the process of proving these results we establish a number of estimates for solutions to the Skorohod problem with bounded jumps and, in addition, several results concerning the convergence of sequences of solutions to Skorohod problems in the setting of time-dependent domains.

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Kaj Nyström

Research overview

Is this your work?

16 publications

Asymptotic mean value formulas, nonlocal space-time parabolic operators and anomalous tug-of-war games

Deep learning, stochastic gradient descent and diffusion maps

On regularity and existence of weak solutions to nonlinear Kolmogorov-Fokker-Planck type equations with rough coefficients

Square function estimates for the evolutionary p-Laplace equation

On Big Pieces approximations of parabolic hypersurfaces

Coronizations and big pieces in metric spaces

Neural ODEs as the Deep Limit of ResNets with constant weights

$L^2$ Solvability of boundary value problems for divergence form parabolic equations with complex coefficients

Boundary behavior of solutions to the parabolic p-Laplace equation

Reflected BSDE of Wiener-Poisson type in Time-dependent Domains

A framework for the modeling of order book dynamics based on event sizes

Cauchy integrals for the p-Laplace equation in planar Lipschitz domains

Optimal Switching Problems under Partial Information

Tug-of-war, market manipulation and option pricing

Systems of variational inequalities for non-local operators related to optimal switching problems: Existence and uniqueness

The Skorohod oblique reflection problem in time-dependent domains

See the researcher in context

Building this map preview

Kaj Nyström

Research overview

Is this your work?

16 publications

Asymptotic mean value formulas, nonlocal space-time parabolic operators and anomalous tug-of-war games

Deep learning, stochastic gradient descent and diffusion maps

On regularity and existence of weak solutions to nonlinear Kolmogorov-Fokker-Planck type equations with rough coefficients

Square function estimates for the evolutionary p-Laplace equation

On Big Pieces approximations of parabolic hypersurfaces

Coronizations and big pieces in metric spaces

Neural ODEs as the Deep Limit of ResNets with constant weights

L2L^2L2 Solvability of boundary value problems for divergence form parabolic equations with complex coefficients

Boundary behavior of solutions to the parabolic p-Laplace equation

Reflected BSDE of Wiener-Poisson type in Time-dependent Domains

A framework for the modeling of order book dynamics based on event sizes

Cauchy integrals for the p-Laplace equation in planar Lipschitz domains

Optimal Switching Problems under Partial Information

Tug-of-war, market manipulation and option pricing

Systems of variational inequalities for non-local operators related to optimal switching problems: Existence and uniqueness

The Skorohod oblique reflection problem in time-dependent domains

See the researcher in context

Building this map preview

$L^2$ Solvability of boundary value problems for divergence form parabolic equations with complex coefficients