BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

Igor Mezić

Igor Mezić appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
math.DSnlin.CDmath.SPMachine Learningphysics.flu-dynBiomoleculesData Structures and Algorithmsmath.NAmath.OCNumerical Analysisphysics.chem-phphysics.comp-ph

Catalog footprint

What is connected

18works
12topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

18 published item(s)

preprint2022arXiv

Algorithmic (Semi-)Conjugacy via Koopman Operator Theory

Iterative algorithms are of utmost importance in decision and control. With an ever growing number of algorithms being developed, distributed, and proprietarized, there is a similarly growing need for methods that can provide classification and comparison. By viewing iterative algorithms as discrete-time dynamical systems, we leverage Koopman operator theory to identify (semi-)conjugacies between algorithms using their spectral properties. This provides a general framework with which to classify and compare algorithms.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Robust Approximation of the Stochastic Koopman Operator

We analyze the performance of Dynamic Mode Decomposition (DMD)-based approximations of the stochastic Koopman operator for random dynamical systems where either the dynamics or observables are affected by noise. For many DMD algorithms, the presence of noise can introduce a bias in the DMD operator, leading to poor approximations of the dynamics. In particular, methods using time delayed observables, such as Hankel DMD, are biased when the dynamics are random. We introduce a new, robust DMD algorithm that can approximate the stochastic Koopman operator despite the presence of noise. We then demonstrate how this algorithm can be applied to time delayed observables, which allows us to generate a Krylov subspace from a single observable. This allows us to compute a realization of the stochastic Koopman operator using a single observable measured over a single trajectory. We test the performance of the algorithms over several examples.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Applications of Koopman Mode Analysis to Neural Networks

We consider the training process of a neural network as a dynamical system acting on the high-dimensional weight space. Each epoch is an application of the map induced by the optimization algorithm and the loss function. Using this induced map, we can apply observables on the weight space and measure their evolution. The evolution of the observables are given by the Koopman operator associated with the induced dynamical system. We use the spectrum and modes of the Koopman operator to realize the above objectives. Our methods can help to, a priori, determine the network depth; determine if we have a bad initialization of the network weights, allowing a restart before training too long; speeding up the training time. Additionally, our methods help enable noise rejection and improve robustness. We show how the Koopman spectrum can be used to determine the number of layers required for the architecture. Additionally, we show how we can elucidate the convergence versus non-convergence of the training process by monitoring the spectrum, in particular, how the existence of eigenvalues clustering around 1 determines when to terminate the learning process. We also show how using Koopman modes we can selectively prune the network to speed up the training procedure. Finally, we show that incorporating loss functions based on negative Sobolev norms can allow for the reconstruction of a multi-scale signal polluted by very large amounts of noise.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

From unsteady to quasi-steady dynamics in the streamwise-oscillating cylinder wake

The flow around a cylinder oscillating in the streamwise direction with a frequency, $f_f$, much lower than the shedding frequency, $f_s$, has been relatively less studied than the case when these frequencies have the same order of magnitude, or the transverse oscillation configuration. In this study, Particle Image Velocimetry and Koopman Mode Decomposition are used to investigate the streamwise-oscillating cylinder wake for forcing frequencies $f_f/f_s \sim 0.04-0.2$ and mean Reynolds number, $Re_0 = 900$. The amplitude of oscillation is such that the instantaneous Reynolds number remains above the critical value for vortex shedding at all times. Characterization of the wake reveals a range of phenomena associated with the interaction of the two frequencies, including modulation of both the amplitude and frequency of the wake structure by the forcing. Koopman analysis reveals a frequency spreading of Koopman modes. A scaling parameter and associated transformation are developed to relate the unsteady, or forced, dynamics of a system to that of a quasi-steady, or unforced, system. For the streamwise-oscillating cylinder, it is shown that this transformation leads to a Koopman Mode Decomposition similar to that of the unforced system.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

On Learning Hamiltonian Systems from Data

Concise, accurate descriptions of physical systems through their conserved quantities abound in the natural sciences. In data science, however, current research often focuses on regression problems, without routinely incorporating additional assumptions about the system that generated the data. Here, we propose to explore a particular type of underlying structure in the data: Hamiltonian systems, where an "energy" is conserved. Given a collection of observations of such a Hamiltonian system over time, we extract phase space coordinates and a Hamiltonian function of them that acts as the generator of the system dynamics. The approach employs an autoencoder neural network component to estimate the transformation from observations to the phase space of a Hamiltonian system. An additional neural network component is used to approximate the Hamiltonian function on this constructed space, and the two components are trained jointly. As an alternative approach, we also demonstrate the use of Gaussian processes for the estimation of such a Hamiltonian. After two illustrative examples, we extract an underlying phase space as well as the generating Hamiltonian from a collection of movies of a pendulum. The approach is fully data-driven, and does not assume a particular form of the Hamiltonian function.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Optimal construction of Koopman eigenfunctions for prediction and control

This work presents a novel data-driven framework for constructing eigenfunctions of the Koopman operator geared toward prediction and control. The method leverages the richness of the spectrum of the Koopman operator away from attractors to construct a rich set of eigenfunctions such that the state (or any other observable quantity of interest) is in the span of these eigenfunctions and hence predictable in a linear fashion. The eigenfunction construction is optimization-based with no dictionary selection required. Once a predictor for the uncontrolled part of the system is obtained in this way, the incorporation of control is done through a multi-step prediction error minimization, carried out by a simple linear least-squares regression. The predictor so obtained is in the form of a linear controlled dynamical system and can be readily applied within the Koopman model predictive control framework of [12] to control nonlinear dynamical systems using linear model predictive control tools. The method is entirely data-driven and based purely on convex optimization, with no reliance on neural networks or other non-convex machine learning tools. The novel eigenfunction construction method is also analyzed theoretically, proving rigorously that the family of eigenfunctions obtained is rich enough to span the space of all continuous functions. In addition, the method is extended to construct generalized eigenfunctions that also give rise Koopman invariant subspaces and hence can be used for linear prediction. Detailed numerical examples with code available online demonstrate the approach, both for prediction and feedback control.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Predicting the Critical Number of Layers for Hierarchical Support Vector Regression

Hierarchical support vector regression (HSVR) models a function from data as a linear combination of SVR models at a range of scales, starting at a coarse scale and moving to finer scales as the hierarchy continues. In the original formulation of HSVR, there were no rules for choosing the depth of the model. In this paper, we observe in a number of models a phase transition in the training error -- the error remains relatively constant as layers are added, until a critical scale is passed, at which point the training error drops close to zero and remains nearly constant for added layers. We introduce a method to predict this critical scale a priori with the prediction based on the support of either a Fourier transform of the data or the Dynamic Mode Decomposition (DMD) spectrum. This allows us to determine the required number of layers prior to training any models.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

An operator-theoretic viewpoint to non-smooth dynamical systems: Koopman analysis of a hybrid pendulum

We apply an operator-theoretic viewpoint to a class of non-smooth dynamical systems that are exposed to event-triggered state resets. The considered benchmark problem is that of a pendulum which receives a downward kick under certain fixed angles. The pendulum is modeled as a hybrid automaton and is analyzed from both a geometric perspective and the formalism carried out by Koopman operator theory. A connection is drawn between these two interpretations of a dynamical system by means of establishing a link between the spectral properties of the Koopman operator and the geometric properties in the state-space.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Koopman principle eigenfunctions and linearization of diffeomorphisms

This paper considers a nonlinear dynamical system on a complex, finite dimensional Banach space which has an asymptotically stable, hyperbolic fixed point. We investigate the connection between the so-called principle eigenfunctions of the Koopman operator and the existence of a topological conjugacy between the nonlinear dynamics and its linearization in the neighborhood of the fixed point. The principle eigenfunctions generate an algebra of observables for the linear dynamics --- called the principle algebra --- which can be used to generate a sequence of approximate conjugacy maps in the same manner as it is done in normal form theory. Each element of the principle algebra has an expansion into eigenfunctions of the Koopman operator and composing an eigenfunction with one of the approximate topological conjugacies gives an approximate eigenfunction of the Koopman operator associated with the nonlinear dynamical system. When the limit of the approximate conjugacies exists and attention is restricted to real Banach spaces, a simple application of the Stone-Weierstrass theorem shows that both the principle algebra and the pull-back algebra --- defined by composing the principle algebra with the topological conjugacy --- are uniformly dense in either the space of continuous functions or the maximal ideal of continuous functions vanishing at the fixed point. The point is that, a priori, it is difficult to know which space of observables to use for dissipative nonlinear dynamical systems whose elements have spectral expansions into eigenfunctions. These results say that any continuous observable is arbitrarily close to one that has such an expansion.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Mesochronic classification of trajectories in incompressible 3D vector fields over finite times

The mesochronic velocity is the average of the velocity field along trajectories generated by the same velocity field over a time interval of finite duration. In this paper we classify initial conditions of trajectories evolving in incompressible vector fields according to the character of motion of material around the trajectory. In particular, we provide calculations that can be used to determine the number of expanding directions and the presence of rotation from the characteristic polynomial of the Jacobian matrix of mesochronic velocity. In doing so, we show that (a) the mesochronic velocity can be used to characterize dynamical deformation of three-dimensional volumes, (b) the resulting mesochronic analysis is a finite-time extension of the Okubo--Weiss--Chong analysis of incompressible velocity fields, (c) the two-dimensional mesochronic analysis from Mezic et al. \emph{A New Mixing Diagnostic and Gulf Oil Spill Movement}, Science 330, (2010), 486-489, extends to three-dimensional state spaces. Theoretical considerations are further supported by numerical computations performed for a dynamical system arising in fluid mechanics, the unsteady Arnold--Beltrami--Childress (ABC) flow.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

On the correspondence between Koopman mode decomposition, resolvent mode decomposition, and invariant solutions of the Navier-Stokes equations

The relationship between Koopman mode decomposition, resolvent mode decomposition and exact invariant solutions of the Navier-Stokes equations is clarified. The correspondence rests upon the invariance of the system operators under symmetry operations such as spatial translation. The usual interpretation of the Koopman operator is generalised to permit combinations of such operations, in addition to translation in time. This invariance is related to the spectrum of a spatio-temporal Koopman operator, which has a travelling wave interpretation. The relationship leads to a generalisation of dynamic mode decomposition, in which symmetry operations are applied to restrict the dynamic modes to span a subspace subject to those symmetries. The resolvent is interpreted as the mapping between the Koopman modes of the Reynolds stress divergence and the velocity field. It is shown that the singular vectors of the resolvent (the resolvent modes) are the optimal basis in which to express the velocity field Koopman modes where the latter are not a priori known.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Programmable Potentials: Approximate N-body potentials from coarse-level logic

This paper gives a systematic method for constructing an N-body potential, approximating the true potential, that accurately captures meso-scale behavior of the chemical or biological system using pairwise potentials coming from experimental data or ab initio methods. The meso-scale behavior is translated into logic rules for the dynamics. Each pairwise potential has an associated logic function that is constructed using the logic rules, a class of elementary logic functions, and AND, OR, and NOT gates. The effect of each logic function is to turn its associated potential on and off. The N-body potential is constructed as linear combination of the pairwise potentials, where the "coefficients" of the potentials are smoothed versions of the associated logic functions. These potentials allow a potentially low-dimensional description of complex processes while still accurately capturing the relevant physics at the meso-scale. We present the proposed formalism to construct coarse-grained potential models for three examples: an inhibitor molecular system, bond breaking in chemical reactions, and DNA transcription from biology. The method can potentially be used in reverse for design of molecular processes by specifying properties of molecules that can carry them out.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Construction of eigenfunctions for scalar-type operators via Laplace averages with connections to the Koopman operator

This paper extends Yosida's mean ergodic theorem in order to compute projections onto non-unitary eigenspaces for spectral operators of scalar-type on locally convex linear topological spaces. For spectral operators with dominating point spectrum, the projections take the form of Laplace averages, which are a generalization of the Fourier averages used when the spectrum is unitary. Inverse iteration and Laplace averages project onto eigenspaces of spectral operators with minimal point spectrum. Two classes of dynamical systems --- attracting fixed points in $\mathbb{C}^{d}$ and attracting limit cycles in $\mathbb{R}^{2}$ --- and their respective spaces of observables are given for which the associated composition operator is spectral. It is shown that the natural spaces of observables are completions with an $\ell^{2}$ polynomial norm of a space of polynomials over a normed unital commutative ring. These spaces are generalizations of the Hardy spaces $H^{2}(\mathbb{D})$ and $H^{2}(\mathbb{D}^{d})$. Elements of the ring are observables defined on the attractor --- the fixed point or the limit cycle, in our examples. Furthermore, we are able to provide a (semi)global spectral theorem for the composition operators associated with a large class of dissipative nonlinear dynamical systems; any sufficiently smooth dynamical system topologically conjugate to either of the two cases above admits an observable space on which the associated Koopman operator is spectral. It is conjectured that this is generically true for systems where the basin of attraction can be properly "coordinatized".

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Data Fusion via Intrinsic Dynamic Variables: An Application of Data-Driven Koopman Spectral Analysis

We demonstrate that numerically computed approximations of Koopman eigenfunctions and eigenvalues create a natural framework for data fusion in applications governed by nonlinear evolution laws. This is possible because the eigenvalues of the Koopman operator are invariant to invertible transformations of the system state, so that the values of the Koopman eigenfunctions serve as a set of intrinsic coordinates that can be used to map between different observations (e.g., measurements obtained through different sets of sensors) of the same fundamental behavior. The measurements we wish to merge can also be nonlinear, but must be "rich enough" to allow (an effective approximation of) the state to be reconstructed from a single set of measurements. This approach requires independently obtained sets of data that capture the evolution of the heterogeneous measurements and a single pair of "joint" measurements taken at one instance in time. Computational approximations of eigenfunctions and their corresponding eigenvalues from data are accomplished using Extended Dynamic Mode Decomposition. We illustrate this approach on measurements of spatio-temporal oscillations of the FitzHugh-Nagumo PDE, and show how to fuse point measurements with principal component measurements, after which either set of measurements can be used to estimate the other set.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Ergodic theory and visualization. II. Harmonic mesochronic plots visualize (quasi)periodic sets

We present a new method of analysis of measure-preserving dynamical systems, based on frequency analysis and ergodic theory, which extends our earlier work [1]. Our method employs the novel concept of harmonic time average [2], and is realized as a computational algorithms for visualization of periodic and quasi-periodic sets or arbitrary periodicity in the phase space. Besides identifying all periodic sets, our method is useful in detecting chaotic phase space regions with a good precision. The range of method's applicability is illustrated using well-known Chirikov standard map, while its full potential is presented by studying higher-dimensional measure-preserving systems, in particular Froeschlé map and extended standard map.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Applied Koopmanism

A majority of methods from dynamical systems analysis, especially those in applied settings, rely on Poincaré's geometric picture that focuses on "dynamics of states". While this picture has fueled our field for a century, it has shown difficulties in handling high-dimensional, ill-described, and uncertain systems, which are more and more common in engineered systems design and analysis of "big data" measurements. This overview article presents an alternative framework for dynamical systems, based on the "dynamics of observables" picture. The central object is the Koopman operator: an infinite-dimensional, linear operator that is nonetheless capable of capturing the full nonlinear dynamics. The first goal of this paper is to make it clear how methods that appeared in different papers and contexts all relate to each other through spectral properties of the Koopman operator. The second goal is to present these methods in a concise manner in an effort to make the framework accessible to researchers who would like to apply them, but also, expand and improve them. Finally, we aim to provide a road map through the literature where each of the topics was described in detail. We describe three main concepts: Koopman mode analysis, Koopman eigenquotients, and continuous indicators of ergodicity. For each concept we provide a summary of theoretical concepts required to define and study them, numerical methods that have been developed for their analysis, and, when possible, applications that made use of them. The Koopman framework is showing potential for crossing over from academic and theoretical use to industrial practice. Therefore, the paper highlights its strengths, in applied and numerical contexts. Additionally, we point out areas where an additional research push is needed before the approach is adopted as an off-the-shelf framework for analysis and design.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Geometry of the ergodic quotient reveals coherent structures in flows

Dynamical systems that exhibit diverse behaviors can rarely be completely understood using a single approach. However, by identifying coherent structures in their state spaces, i.e., regions of uniform and simpler behavior, we could hope to study each of the structures separately and then form the understanding of the system as a whole. The method we present in this paper uses trajectory averages of scalar functions on the state space to: (a) identify invariant sets in the state space, (b) form coherent structures by aggregating invariant sets that are similar across multiple spatial scales. First, we construct the ergodic quotient, the object obtained by mapping trajectories to the space of trajectory averages of a function basis on the state space. Second, we endow the ergodic quotient with a metric structure that successfully captures how similar the invariant sets are in the state space. Finally, we parametrize the ergodic quotient using intrinsic diffusion modes on it. By segmenting the ergodic quotient based on the diffusion modes, we extract coherent features in the state space of the dynamical system. The algorithm is validated by analyzing the Arnold-Beltrami-Childress flow, which was the test-bed for alternative approaches: the Ulam's approximation of the transfer operator and the computation of Lagrangian Coherent Structures. Furthermore, we explain how the method extends the Poincaré map analysis for periodic flows. As a demonstration, we apply the method to a periodically-driven three-dimensional Hill's vortex flow, discovering unknown coherent structures in its state space. In the end, we discuss differences between the ergodic quotient and alternatives, propose a generalization to analysis of (quasi-)periodic structures, and lay out future research directions.

0 citations0 reviewsNo code linkedOpen access
preprint2010arXiv

Ergodic Theory and Visualization I: Mesochronic Plots for Visualization of Ergodic Partition and Invariant Sets

We present a computational study of a visualization method for invariant sets based on ergodic partition theory, first proposed in [1,2]. The algorithms for computation of the time averages of observables on phase space are developed and used to provide an approximation of the ergodic partition of the phase space. We term the graphical representation of this approximation - based on time averages of observables - a Mesochronic Plot (from Greek: \textit{meso} - mean, \textit{chronos} - time}. The method is useful for identifying low-dimensional projections (e.g. two-dimensional slices) of invariant structures in phase spaces of dimensionality bigger than two. We also introduce the concept of the ergodic quotient space, obtained by assigning a point to every ergodic set, and provide an embedding method whose graphical representation we call the Mesochronic Scatter Plot (MSP). We use the Chirikov standard map as a well-known and dynamically rich example in order to illustrate the implementation of our methods. In addition, we expose applications to other higher dimensional maps such as the Froéschle map for which we utilize our methods to analyze merging of resonances and, the three-dimensional Extended standard map for which we study the conjecture on its ergodicity [3]. We extend the study in our next paper [4] by investigating the visualization of periodic sets using harmonic time averages. Both of these methods are related to eigenspace structure of the Koopman operator.

0 citations0 reviewsNo code linkedOpen access