BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

Dimitrios Giannakis

Dimitrios Giannakis appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
physics.data-anmath.DSmath.STphysics.ao-phStatistics TheoryMachine Learningmath.NAphysics.comp-phmath.DGmath.FAMethodologynlin.CDNumerical Analysisquant-ph

Catalog footprint

What is connected

17works
14topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

17 published item(s)

preprint2023arXiv

On harmonic Hilbert spaces on compact abelian groups

Harmonic Hilbert spaces on locally compact abelian groups are reproducing kernel Hilbert spaces (RKHSs) of continuous functions constructed by Fourier transform of weighted $L^2$ spaces on the dual group. It is known that for suitably chosen subadditive weights, every such space is a Banach algebra with respect to pointwise multiplication of functions. In this paper, we study RKHSs associated with subconvolutive functions on the dual group. Sufficient conditions are established for these spaces to be symmetric Banach $^*$-algebras with respect to pointwise multiplication and complex conjugation of functions (here referred to as RKHAs). In addition, we study aspects of the spectra and state spaces of RKHAs. Sufficient conditions are established for an RKHA on a compact abelian group $G$ to have the same spectrum as the $C^*$-algebra of continuous functions on $G$. We also consider one-parameter families of RKHSs associated with semigroups of self-adjoint Markov operators on $L^2(G)$, and show that in this setting subconvolutivity is a necessary and sufficient condition for these spaces to have RKHA structure. Finally, we establish embedding relationships between RKHAs and a class of Fourier--Wermer algebras that includes spaces of dominating mixed smoothness used in high-dimensional function approximation.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Graph-theoretic algorithms for Kolmogorov operators: Approximating solutions and their gradients in elliptic and parabolic problems on manifolds

We employ kernel-based approaches that use samples from a probability distribution to approximate a Kolmogorov operator on a manifold. The self-tuning variable-bandwidth kernel method [Berry & Harlim, Appl. Comput. Harmon. Anal., 40(1):68--96, 2016] computes a large, sparse matrix that approximates the differential operator. Here, we use the eigendecomposition of the discretization to (i) invert the operator, solving a differential equation, and (ii) represent gradient vector fields on the manifold. These methods only require samples from the underlying distribution and, therefore, can be applied in high dimensions or on geometrically complex manifolds when spatial discretizations are not available. We also employ an efficient $k$-$d$ tree algorithm to compute the sparse kernel matrix, which is a computational bottleneck.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Quantum Mechanics for Closure of Dynamical Systems

We propose a scheme for data-driven parameterization of unresolved dimensions of dynamical systems based on the mathematical framework of quantum mechanics and Koopman operator theory. Given a system in which some components of the state are unknown, this method involves defining a surrogate system in a time-dependent quantum state which determines the fluxes from the unresolved degrees of freedom at each timestep. The quantum state is a density operator on a finite-dimensional Hilbert space of classical observables and evolves over time under an action induced by the Koopman operator. The quantum state also updates with new values of the resolved variables according to a quantum Bayes' law, implemented via an operator-valued feature map. Kernel methods are utilized to learn data-driven basis functions and represent quantum states, observables, and evolution operators as matrices. The resulting computational schemes are automatically positivity-preserving, aiding in the physical consistency of the parameterized system. We analyze the results of two different modalities of this methodology applied to the Lorenz 63 and Lorenz 96 multiscale systems, and show how this approach preserves important statistical and qualitative properties of the underlying chaotic systems.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Kernel-based Prediction of Non-Markovian Time Series

A nonparametric method to predict non-Markovian time series of partially observed dynamics is developed. The prediction problem we consider is a supervised learning task of finding a regression function that takes a delay embedded observable to the observable at a future time. When delay embedding theory is applicable, the proposed regression function is a consistent estimator of the flow map induced by the delay embedding. Furthermore, the corresponding Mori-Zwanzig equation governing the evolution of the observable simplifies to only a Markovian term, represented by the regression function. We realize this supervised learning task with a class of kernel-based linear estimators, the kernel analog forecast (KAF), which are consistent in the limit of large data. In a scenario with a high-dimensional covariate space, we employ a Markovian kernel smoothing method which is computationally cheaper than the Nyström projection method for realizing KAF. In addition to the guaranteed theoretical convergence, we numerically demonstrate the effectiveness of this approach on higher-dimensional problems where the relevant kernel features are difficult to capture with the Nyström method. Given noisy training data, we propose a nonparametric smoother as a de-noising method. Numerically, we show that the proposed smoother is more accurate than EnKF and 4Dvar in de-noising signals corrupted by independent (but not necessarily identically distributed) noise, even if the smoother is constructed using a data set corrupted by white noise. We show skillful prediction using the KAF constructed from the denoised data.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Spectral analysis of climate dynamics with operator-theoretic approaches

The Earth's climate system is a classical example of a multiscale, multiphysics dynamical system with an extremely large number of active degrees of freedom, exhibiting variability on scales ranging from micrometers and seconds in cloud microphysics, to thousands of kilometers and centuries in ocean dynamics. Yet, despite this dynamical complexity, climate dynamics is known to exhibit coherent modes of variability. A primary example is the El Niño Southern Oscillation (ENSO), the dominant mode of interannual (3-5 yr) variability in the climate system. The objective and robust characterization of this and other important phenomena presents a long-standing challenge in Earth system science, the resolution of which would lead to improved scientific understanding and prediction of climate dynamics, as well as assessment of their impacts on human and natural systems. Here, we show that the spectral theory of dynamical systems, combined with techniques from data science, provides an effective means for extracting coherent modes of climate variability from high-dimensional model and observational data, requiring no frequency prefiltering, but recovering multiple timescales and their interactions. Lifecycle composites of ENSO are shown to improve upon results from conventional indices in terms of dynamical consistency and physical interpretability. In addition, the role of combination modes between ENSO and the annual cycle in ENSO diversity is elucidated.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

An information-geometric approach to feature extraction and moment reconstruction in dynamical systems

We propose a dimension reduction framework for feature extraction and moment reconstruction in dynamical systems that operates on spaces of probability measures induced by observables of the system rather than directly in the original data space of the observables themselves as in more conventional methods. Our approach is based on the fact that orbits of a dynamical system induce probability measures over the measurable space defined by (partial) observations of the system. We equip the space of these probability measures with a divergence, i.e., a distance between probability distributions, and use this divergence to define a kernel integral operator. The eigenfunctions of this operator create an orthonormal basis of functions that capture different timescales of the dynamical system. One of our main results shows that the evolution of the moments of the dynamics-dependent probability measures can be related to a time-averaging operator on the original dynamical system. Using this result, we show that the moments can be expanded in the eigenfunction basis, thus opening up the avenue for nonparametric forecasting of the moments. If the collection of probability measures is itself a manifold, we can in addition equip the statistical manifold with the Riemannian metric and use techniques from information geometry. We present applications to ergodic dynamical systems on the 2-torus and the Lorenz 63 system, and show on a real-world example that a small number of eigenvectors is sufficient to reconstruct the moments (here the first four moments) of an atmospheric time series, i.e., the realtime multivariate Madden-Julian oscillation index.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Bridging data science and dynamical systems theory

This short review describes mathematical techniques for statistical analysis and prediction in dynamical systems. Two problems are discussed, namely (i) the supervised learning problem of forecasting the time evolution of an observable under potentially incomplete observations at forecast initialization; and (ii) the unsupervised learning problem of identification of observables of the system with a coherent dynamical evolution. We discuss how ideas from from operator-theoretic ergodic theory combined with statistical learning theory provide an effective route to address these problems, leading to methods well-adapted to handle nonlinear dynamics, with convergence guarantees as the amount of training data increases.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Operator-theoretic framework for forecasting nonlinear time series with kernel analog techniques

Kernel analog forecasting (KAF), alternatively known as kernel principal component regression, is a kernel method used for nonparametric statistical forecasting of dynamically generated time series data. This paper synthesizes descriptions of kernel methods and Koopman operator theory in order to provide a single consistent account of KAF. The framework presented here illuminates the property of the KAF method that, under measure-preserving and ergodic dynamics, it consistently approximates the conditional expectation of observables that are acted upon by the Koopman operator of the dynamical system and are conditioned on the observed data at forecast initialization. More precisely, KAF yields optimal predictions, in the sense of minimal root mean square error with respect to the invariant measure, in the asymptotic limit of large data. The presented framework facilitates, moreover, the analysis of generalization error and quantification of uncertainty. Extensions of KAF to the construction of conditional variance and conditional probability functions, as well as to non-symmetric kernels, are also shown. Illustrations of various aspects of KAF are provided with applications to simple examples, namely a periodic flow on the circle and the chaotic Lorenz 63 system.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Spectral exterior calculus

A spectral approach to building the exterior calculus in manifold learning problems is developed. The spectral approach is shown to converge to the true exterior calculus in the limit of large data. Simultaneously, the spectral approach decouples the memory requirements from the amount of data points and ambient space dimension. To achieve this, the exterior calculus is reformulated entirely in terms of the eigenvalues and eigenfunctions of the Laplacian operator on functions. The exterior derivatives of these eigenfunctions (and their wedge products) are shown to form a frame (a type of spanning set) for appropriate $L^2$ spaces of $k$-forms, as well as higher-order Sobolev spaces. Formulas are derived to express the Laplace-de Rham operators on forms in terms of the eigenfunctions and eigenvalues of the Laplacian on functions. By representing the Laplace-de Rham operators in this frame, spectral convergence results are obtained via Galerkin approximation techniques. Numerical examples demonstrate accurate recovery of eigenvalues and eigenforms of the Laplace-de Rham operator on 1-forms. The correct Betti numbers are obtained from the kernel of this operator approximated from data sampled on several orientable and non-orientable manifolds, and the eigenforms are visualized via their corresponding vector fields. These vector fields form a natural orthonormal basis for the space of square-integrable vector fields, and are ordered by a Dirichlet energy functional which measures oscillatory behavior. The spectral framework also shows promising results on a non-smooth example (the Lorenz 63 attractor), suggesting that a spectral formulation of exterior calculus may be feasible in spaces with no differentiable structure.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Analog Forecasting with Dynamics-Adapted Kernels

Analog forecasting is a nonparametric technique introduced by Lorenz in 1969 which predicts the evolution of states of a dynamical system (or observables defined on the states) by following the evolution of the sample in a historical record of observations which most closely resembles the current initial data. Here, we introduce a suite of forecasting methods which improve traditional analog forecasting by combining ideas from kernel methods developed in harmonic analysis and machine learning and state-space reconstruction for dynamical systems. A key ingredient of our approach is to replace single-analog forecasting with weighted ensembles of analogs constructed using local similarity kernels. The kernels used here employ a number of dynamics-dependent features designed to improve forecast skill, including Takens' delay-coordinate maps (to recover information in the initial data lost through partial observations) and a directional dependence on the dynamical vector field generating the data. Mathematically, our approach is closely related to kernel methods for out-of-sample extension of functions, and we discuss alternative strategies based on the Nyström method and the multiscale Laplacian pyramids technique. We illustrate these techniques in applications to forecasting in a low-order deterministic model for atmospheric dynamics with chaotic metastability, and interannual-scale forecasting in the North Pacific sector of a comprehensive climate model. We find that forecasts based on kernel-weighted ensembles have significantly higher skill than the conventional approach following a single analog.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Indo-Pacific variability on seasonal to multidecadal timescales. Part II: Multiscale atmosphere-ocean linkages

The coupled atmosphere-ocean variability of the Indo-Pacific on interannual to multidecadal timescales is investigated in a millennial control run of CCSM4 and in observations using a family of modes recovered in Part~I of this work from unprocessed SST data through nonlinear Laplacian spectral analysis (NLSA). It is found that ENSO and combination modes of ENSO with the annual cycle exhibit a seasonally synchronized southward shift of equatorial surface zonal winds and thermocline adjustment consistent with terminating El Nino and La Nina events. The surface wind patterns associated with these modes also generate teleconnections between the Pacific and Indian Oceans, leading to a pattern of SST anomalies characteristic of the Indian Ocean dipole. Fundamental and combination modes representing the tropospheric biennial oscillation (TBO) in CCSM4 are also found to be consistent with mechanisms for seasonally synchronized biennial variability of the Asian-Australian monsoon and Walker circulation. On longer timescales, the leading multidecadal pattern recovered by NLSA from Indo-Pacific SST data in CCSM4, referred to as west Pacific multidecadal mode (WPMM), is found to significantly modulate ENSO and TBO activity with periods of negative SST anomalies in the western tropical Pacific favoring stronger ENSO and TBO variability. Physically, this behavior is attributed to the fact that cold WPMM phases feature anomalous decadal westerlies in the tropical central Pacific and easterlies in the tropical Indian Ocean, as well as an anomalously deep thermocline in the eastern Pacific cold tongue. Moreover, despite the relatively low SST variance explained by this mode, the WPMM is found to correlate significantly with decadal precipitation over Australia in CCSM4.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Data-driven prediction strategies for low-frequency patterns of North Pacific climate variability

The North Pacific exhibits patterns of low-frequency variability on the intra-annual to decadal time scales, which manifest themselves in both model data and the observational record, and prediction of such low-frequency modes of variability is of great interest to the community. While parametric models, such as stationary and non-stationary autoregressive models, possibly including external factors, may perform well in a data-fitting setting, they may perform poorly in a prediction setting. Ensemble analog forecasting, which relies on the historical record to provide estimates of the future based on past trajectories of those states similar to the initial state of interest, provides a promising, nonparametric approach to forecasting that makes no assumptions on the underlying dynamics or its statistics. We apply such forecasting to low-frequency modes of variability for the North Pacific sea surface temperature and sea ice concentration fields extracted through Nonlinear Laplacian Spectral Analysis. We find such methods may outperform parametric methods and simple persistence with increased predictive skill.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Nonparametric forecasting of low-dimensional dynamical systems

This letter presents a non-parametric modeling approach for forecasting stochastic dynamical systems on low-dimensional manifolds. The key idea is to represent the discrete shift maps on a smooth basis which can be obtained by the diffusion maps algorithm. In the limit of large data, this approach converges to a Galerkin projection of the semigroup solution to the underlying dynamics on a basis adapted to the invariant measure. This approach allows one to quantify uncertainties (in fact, evolve the probability distribution) for non-trivial dynamical systems with equation-free modeling. We verify our approach on various examples, ranging from an inhomogeneous anisotropic stochastic differential equation on a torus, the chaotic Lorenz three-dimensional model, and the Niño-3.4 data set which is used as a proxy of the El-Niño Southern Oscillation.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Dynamics-Adapted Cone Kernels

We present a family of kernels for analysis of data generated by dynamical systems. These so-called cone kernels feature an explicit dependence on the dynamical vector field operating in the phase-space manifold, estimated empirically through finite-differences of time-ordered data samples. In particular, cone kernels assign strong affinity to pairs of samples whose relative displacement vector lies within a narrow cone aligned with the dynamical vector field. As a result, in a suitable asymptotic limit, the associated diffusion operator generates diffusions along the dynamical flow, and is invariant under a weakly restrictive class of transformations of the data, which includes conformal transformations. Moreover, the corresponding Dirichlet form is governed by the directional derivative of functions along the dynamical vector field. The latter feature is metric-independent. The diffusion eigenfunctions obtained via cone kernels are therefore adapted to the dynamics in that they vary predominantly in directions transverse to the flow. We demonstrate the utility of cone kernels in nonlinear flows on the 2-torus and North Pacific sea surface temperature data generated by a comprehensive climate model.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Nonlinear Laplacian spectral analysis: Capturing intermittent and low-frequency spatiotemporal patterns in high-dimensional data

We present a technique for spatiotemporal data analysis called nonlinear Laplacian spectral analysis (NLSA), which generalizes singular spectrum analysis (SSA) to take into account the nonlinear manifold structure of complex data sets. The key principle underlying NLSA is that the functions used to represent temporal patterns should exhibit a degree of smoothness on the nonlinear data manifold M; a constraint absent from classical SSA. NLSA enforces such a notion of smoothness by requiring that temporal patterns belong in low-dimensional Hilbert spaces V_l spanned by the leading l Laplace-Beltrami eigenfunctions on M. These eigenfunctions can be evaluated efficiently in high ambient-space dimensions using sparse graph-theoretic algorithms. Moreover, they provide orthonormal bases to expand a family of linear maps, whose singular value decomposition leads to sets of spatiotemporal patterns at progressively finer resolution on the data manifold. The Riemannian measure of M and an adaptive graph kernel width enhances the capability of NLSA to detect important nonlinear processes, including intermittency and rare events. The minimum dimension of V_l required to capture these features while avoiding overfitting is estimated here using spectral entropy criteria.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

The Symmetries of Image Formation by Scattering. I. Theoretical Framework

We perceive the world through images formed by scattering. The ability to interpret scattering data mathematically has opened to our scrutiny the constituents of matter, the building blocks of life, and the remotest corners of the universe. Here, we deduce for the first time the fundamental symmetries underlying image formation. Intriguingly, these are similar to those of the anisotropic "Taub universe"' of general relativity, with eigenfunctions closely related to spinning tops in quantum mechanics. This opens the possibility to apply the powerful arsenal of tools developed in two major branches of physics to new problems. We augment these tools with graph-theoretic means to recover the three-dimensional structure of objects from random snapshots of unknown orientation at four orders of magnitude higher complexity than previously demonstrated. Our theoretical framework offers a potential link to recent observations on face perception in higher primates. In a later paper, we demonstrate the recovery of structure and dynamics from ultralow-signal random sightings of systems with no orientational or timing information.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

The symmetries of image formation by scattering. II. Applications

We show that the symmetries of image formation by scattering enable graph-theoretic manifold-embedding techniques to extract structural and timing information from simulated and experimental snapshots at extremely low signal. The approach constitutes a physically-based, computationally efficient, and noise-robust route to analyzing the large and varied datasets generated by existing and emerging methods for studying structure and dynamics by scattering. We demonstrate three-dimensional structure recovery from X-ray diffraction and cryo-electron microscope image snapshots of unknown orientation, the latter at 12 times lower dose than currently in use. We also show that ultra-low-signal, random sightings of dynamically evolving systems can be sequenced into high quality movies to reveal their evolution. Our approach offers a route to recovering timing information in time-resolved experiments, and extracting 3D movies from two-dimensional random sightings of dynamic systems.

0 citations0 reviewsNo code linkedOpen access