BZPEERReading, trust and collaboration for research
Menu

Discover

GraphFollow connections around a paper, topic or saved view.

Workspaces

HomePick up where your research flow left off.InboxHandle requests, replies and notifications from one place.CollectionsCurate reading lists, evidence sets and shareable dossiers.ResearchSee your private provenance graph, trail and imports.CollaborationMove from discovery into focused discussion rooms.PublishDraft, preview and publish full-text research articles.

Network

ExpertsFind specialists worth following or asking for help.CommunitiesJoin research circles organized around shared work.PartnersSee external organizations active around the same topics.

Opportunities

ListingsBrowse roles, calls and collaborations with clearer fit signals.

Account

Log inReturn to your reading and collaboration workspace.Create accountStart saving work, following people and joining teams.
Log inCreate account

Researcher profile

Kaj Nyström

Kaj Nyström contributes to research discovery and scholarly infrastructure.

ResearcherAffiliation not importedOpen to collaborate
math.APMachine Learningmath.CAmath.MGmath.PR

Trust snapshot

Quick read

Trust 21 - EmergingVerification L1Unclaimed author
9works
0followers
5topics
4close collaborators

Actions

Decide how to stay connected

Follow researcher0

Identity and collaboration

How to connect with this researcher

Claiming links this public author record to a researcher profile and unlocks direct collaboration workflows.

Log in to claim

Direct collaboration

Open a focused conversation when the fit is right

Claim this author entity first to unlock direct invitations.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

9 published item(s)

preprint2022arXiv

Asymptotic mean value formulas, nonlocal space-time parabolic operators and anomalous tug-of-war games

The fractional heat operator $(\partial_t-Δ_x)^s$ and Continuous Time Random Walks (CTRWs) are interesting and sophisticated mathematical models that can describe complex anomalous systems. In this paper, we prove asymptotic mean value representation formulas for functions with respect to $(\partial_t-Δ_x)^s$ and we introduce new nonlocal, nonlinear parabolic operators related to a tug-of-war which accounts for waiting times and space-time couplings. These nonlocal, nonlinear parabolic operators and equations can be seen as nonlocal versions of the evolutionary infinity Laplace operator.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Deep learning, stochastic gradient descent and diffusion maps

Stochastic gradient descent (SGD) is widely used in deep learning due to its computational efficiency, but a complete understanding of why SGD performs so well remains a major challenge. It has been observed empirically that most eigenvalues of the Hessian of the loss functions on the loss landscape of over-parametrized deep neural networks are close to zero, while only a small number of eigenvalues are large. Zero eigenvalues indicate zero diffusion along the corresponding directions. This indicates that the process of minima selection mainly happens in the relatively low-dimensional subspace corresponding to the top eigenvalues of the Hessian. Although the parameter space is very high-dimensional, these findings seems to indicate that the SGD dynamics may mainly live on a low-dimensional manifold. In this paper, we pursue a truly data driven approach to the problem of getting a potentially deeper understanding of the high-dimensional parameter surface, and in particular, of the landscape traced out by SGD by analyzing the data generated through SGD, or any other optimizer for that matter, in order to possibly discover (local) low-dimensional representations of the optimization landscape. As our vehicle for the exploration, we use diffusion maps introduced by R. Coifman and coauthors.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

On regularity and existence of weak solutions to nonlinear Kolmogorov-Fokker-Planck type equations with rough coefficients

We consider nonlinear Kolmogorov-Fokker-Planck type equations of the form \begin{equation}\label{abeqn} (\partial_t+X\cdot\nabla_Y)u=\nabla_X\cdot(A(\nabla_X u,X,Y,t)). \end{equation} The function $A=A(ξ,X,Y,t):\R^m\times\R^m\times\R^m\times\R\to\R^m$ is assumed to be continuous with respect to $ξ$, and measurable with respect to $X,Y$ and $t$. $A=A(ξ,X,Y,t)$ is allowed to be nonlinear but with linear growth. We establish higher integrability and local boundedness of weak sub-solutions, weak Harnack and Harnack inequalities, and H{ö}lder continuity with quantitative estimates. In addition we establish existence and uniqueness of weak solutions to a Dirichlet problem in certain bounded $X$, $Y$ and $t$ dependent domains.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Square function estimates for the evolutionary p-Laplace equation

We prove novel (local) square function/Carleson measure estimates for non-negative solutions to the evolutionary $p$-Laplace equation in the complement of parabolic Ahlfors-David regular sets. In the case of the heat equation, the Laplace equation as well as the $p$-Laplace equation, the corresponding square function estimates have proven fundamental in symmetry and inverse/free boundary type problems, and in particular in the study of (parabolic) uniform rectifiability. Though the implications of the square function estimates are less clear for the evolutionary $p$-Laplace equation, mainly due its lack of homogeneity, we give some initial applications to parabolic uniform rectifiability, boundary behaviour and Fatou type theorems for $\nabla_Xu$.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

On Big Pieces approximations of parabolic hypersurfaces

Let $Σ$ be a closed subset of $\mathbb{R}^ {n+1}$ which is parabolic Ahlfors-David regular and assume that $Σ$ satisfies a 2-sided corkscrew condition. Assume, in addition, that $Σ$ is either time-forwards Ahlfors-David regular, time-backwards Ahlfors-David regular, or parabolic uniform rectifiable. We then first prove that $Σ$ satisfies a {\it weak synchronized two cube condition}. Based on this we are able to revisit the argument in \cite{NS} and prove that $Σ$ contains {\it uniform big pieces of Lip(1,1/2) graphs}. When $Σ$ is parabolic uniformly rectifiable the construction can be refined and in this case we prove that $Σ$ contains {\it uniform big pieces of regular parabolic Lip(1,1/2) graphs}. Similar results hold if $Ω\subset\mathbb R^{n+1}$ is a connected component of $\mathbb R^{n+1}\setminusΣ$ and in this context we also give a parabolic counterpart of the main result in \cite{AHMNT} by proving that if $Ω$ is a one-sided parabolic chord arc domain, and if $Σ$ is parabolic uniformly rectifiable, then $Ω$ is in fact a parabolic chord arc domain. Our results give a flexible parabolic version of the classical (elliptic) result of G. David and D. Jerison concerning the existence of uniform big pieces of Lipschitz graphs for sets satisfying a two disc condition.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Coronizations and big pieces in metric spaces

We prove that coronizations with respect to arbitrary d-regular sets (not necessarily graphs) imply big pieces squared of these (approximating) sets. This is known (and due to David and Semmes in the case of sufficiently large co-dimension, and to Azzam and Schul in general) in the (classical) setting of Euclidean spaces with Hausdorff measure of integer dimension, where the approximating sets are Lipschitz graphs. Our result is a far reaching generalization of these results and we prove that coronizations imply big pieces squared is a generic property. In particular, our result applies, when suitably interpreted, in metric spaces having a fixed positive (perhaps non-integer) dimension, equipped with a Borel regular measure and with arbitrary approximating sets. As a novel application we highlight how to utilize this general setting in the context of parabolic uniform rectifiability.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Neural ODEs as the Deep Limit of ResNets with constant weights

In this paper we prove that, in the deep limit, the stochastic gradient descent on a ResNet type deep neural network, where each layer shares the same weight matrix, converges to the stochastic gradient descent for a Neural ODE and that the corresponding value/loss functions converge. Our result gives, in the context of minimization by stochastic gradient descent, a theoretical foundation for considering Neural ODEs as the deep limit of ResNets. Our proof is based on certain decay estimates for associated Fokker-Planck equations.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Boundary behavior of solutions to the parabolic p-Laplace equation

We establish boundary estimates for non-negative solutions to the p-parabolic equation in the degenerate range $p>2$. Our main results include new parabolic intrinsic Harnack chains in cylindrical NTA-domains together with sharp boundary decay estimates. If the underlying domain is $C^{1,1}$-regular, we establish a relatively complete theory of the boundary behavior, including boundary Harnack principles and Hölder continuity of the ratios of two solutions, as well as fine properties of associated boundary measures. There is an intrinsic waiting time phenomena present which plays a fundamental role throughout the paper. In particular, conditions on these waiting times rule out well-known examples of explicit solutions violating the boundary Harnack principle.

0 citations0 reviewsNo code linkedOpen access
preprint2010arXiv

The Skorohod oblique reflection problem in time-dependent domains

The deterministic Skorohod problem plays an important role in the construction and analysis of diffusion processes with reflection. In the form studied here, the multidimensional Skorohod problem was introduced, in time-independent domains, by H. Tanaka [61] and further investigated by P.-L. Lions and A.-S. Sznitman [42] in their celebrated article. Subsequent results of several researchers have resulted in a large literature on the Skorohod problem in time-independent domains. In this article we conduct a thorough study of the multidimensional Skorohod problem in time-dependent domains. In particular, we prove the existence of càdlàg solutions $(x,λ)$ to the Skorohod problem, with oblique reflection, for $(D,Γ,w)$ assuming, in particular, that $D$ is a time-dependent domain (Theorem 1.2). In addition, we prove that if $w$ is continuous, then $x$ is continuous as well (Theorem 1.3). Subsequently, we use the established existence results to construct solutions to stochastic differential equations with oblique reflection (Theorem 1.9) in time-dependent domains. In the process of proving these results we establish a number of estimates for solutions to the Skorohod problem with bounded jumps and, in addition, several results concerning the convergence of sequences of solutions to Skorohod problems in the setting of time-dependent domains.

0 citations0 reviewsNo code linkedOpen access