BZPEERReading, trust and collaboration for research
Menu

Discover

GraphFollow connections around a paper, topic or saved view.

Workspaces

HomePick up where your research flow left off.InboxHandle requests, replies and notifications from one place.CollectionsCurate reading lists, evidence sets and shareable dossiers.ResearchSee your private provenance graph, trail and imports.CollaborationMove from discovery into focused discussion rooms.PublishDraft, preview and publish full-text research articles.

Network

ExpertsFind specialists worth following or asking for help.CommunitiesJoin research circles organized around shared work.PartnersSee external organizations active around the same topics.

Opportunities

ListingsBrowse roles, calls and collaborations with clearer fit signals.

Account

Log inReturn to your reading and collaboration workspace.Create accountStart saving work, following people and joining teams.
Log inCreate account

Researcher profile

Igor Mezić

Igor Mezić contributes to research discovery and scholarly infrastructure.

ResearcherAffiliation not importedOpen to collaborate
math.DSMachine LearningData Structures and Algorithmsmath.NAmath.OCmath.SPnlin.CDNumerical Analysisphysics.comp-phphysics.flu-dyn

Trust snapshot

Quick read

Trust 21 - EmergingVerification L1Unclaimed author
8works
0followers
10topics
4close collaborators

Actions

Decide how to stay connected

Follow researcher0

Identity and collaboration

How to connect with this researcher

Claiming links this public author record to a researcher profile and unlocks direct collaboration workflows.

Log in to claim

Direct collaboration

Open a focused conversation when the fit is right

Claim this author entity first to unlock direct invitations.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

8 published item(s)

preprint2022arXiv

Algorithmic (Semi-)Conjugacy via Koopman Operator Theory

Iterative algorithms are of utmost importance in decision and control. With an ever growing number of algorithms being developed, distributed, and proprietarized, there is a similarly growing need for methods that can provide classification and comparison. By viewing iterative algorithms as discrete-time dynamical systems, we leverage Koopman operator theory to identify (semi-)conjugacies between algorithms using their spectral properties. This provides a general framework with which to classify and compare algorithms.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Robust Approximation of the Stochastic Koopman Operator

We analyze the performance of Dynamic Mode Decomposition (DMD)-based approximations of the stochastic Koopman operator for random dynamical systems where either the dynamics or observables are affected by noise. For many DMD algorithms, the presence of noise can introduce a bias in the DMD operator, leading to poor approximations of the dynamics. In particular, methods using time delayed observables, such as Hankel DMD, are biased when the dynamics are random. We introduce a new, robust DMD algorithm that can approximate the stochastic Koopman operator despite the presence of noise. We then demonstrate how this algorithm can be applied to time delayed observables, which allows us to generate a Krylov subspace from a single observable. This allows us to compute a realization of the stochastic Koopman operator using a single observable measured over a single trajectory. We test the performance of the algorithms over several examples.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Applications of Koopman Mode Analysis to Neural Networks

We consider the training process of a neural network as a dynamical system acting on the high-dimensional weight space. Each epoch is an application of the map induced by the optimization algorithm and the loss function. Using this induced map, we can apply observables on the weight space and measure their evolution. The evolution of the observables are given by the Koopman operator associated with the induced dynamical system. We use the spectrum and modes of the Koopman operator to realize the above objectives. Our methods can help to, a priori, determine the network depth; determine if we have a bad initialization of the network weights, allowing a restart before training too long; speeding up the training time. Additionally, our methods help enable noise rejection and improve robustness. We show how the Koopman spectrum can be used to determine the number of layers required for the architecture. Additionally, we show how we can elucidate the convergence versus non-convergence of the training process by monitoring the spectrum, in particular, how the existence of eigenvalues clustering around 1 determines when to terminate the learning process. We also show how using Koopman modes we can selectively prune the network to speed up the training procedure. Finally, we show that incorporating loss functions based on negative Sobolev norms can allow for the reconstruction of a multi-scale signal polluted by very large amounts of noise.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

From unsteady to quasi-steady dynamics in the streamwise-oscillating cylinder wake

The flow around a cylinder oscillating in the streamwise direction with a frequency, $f_f$, much lower than the shedding frequency, $f_s$, has been relatively less studied than the case when these frequencies have the same order of magnitude, or the transverse oscillation configuration. In this study, Particle Image Velocimetry and Koopman Mode Decomposition are used to investigate the streamwise-oscillating cylinder wake for forcing frequencies $f_f/f_s \sim 0.04-0.2$ and mean Reynolds number, $Re_0 = 900$. The amplitude of oscillation is such that the instantaneous Reynolds number remains above the critical value for vortex shedding at all times. Characterization of the wake reveals a range of phenomena associated with the interaction of the two frequencies, including modulation of both the amplitude and frequency of the wake structure by the forcing. Koopman analysis reveals a frequency spreading of Koopman modes. A scaling parameter and associated transformation are developed to relate the unsteady, or forced, dynamics of a system to that of a quasi-steady, or unforced, system. For the streamwise-oscillating cylinder, it is shown that this transformation leads to a Koopman Mode Decomposition similar to that of the unforced system.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

On Learning Hamiltonian Systems from Data

Concise, accurate descriptions of physical systems through their conserved quantities abound in the natural sciences. In data science, however, current research often focuses on regression problems, without routinely incorporating additional assumptions about the system that generated the data. Here, we propose to explore a particular type of underlying structure in the data: Hamiltonian systems, where an "energy" is conserved. Given a collection of observations of such a Hamiltonian system over time, we extract phase space coordinates and a Hamiltonian function of them that acts as the generator of the system dynamics. The approach employs an autoencoder neural network component to estimate the transformation from observations to the phase space of a Hamiltonian system. An additional neural network component is used to approximate the Hamiltonian function on this constructed space, and the two components are trained jointly. As an alternative approach, we also demonstrate the use of Gaussian processes for the estimation of such a Hamiltonian. After two illustrative examples, we extract an underlying phase space as well as the generating Hamiltonian from a collection of movies of a pendulum. The approach is fully data-driven, and does not assume a particular form of the Hamiltonian function.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Optimal construction of Koopman eigenfunctions for prediction and control

This work presents a novel data-driven framework for constructing eigenfunctions of the Koopman operator geared toward prediction and control. The method leverages the richness of the spectrum of the Koopman operator away from attractors to construct a rich set of eigenfunctions such that the state (or any other observable quantity of interest) is in the span of these eigenfunctions and hence predictable in a linear fashion. The eigenfunction construction is optimization-based with no dictionary selection required. Once a predictor for the uncontrolled part of the system is obtained in this way, the incorporation of control is done through a multi-step prediction error minimization, carried out by a simple linear least-squares regression. The predictor so obtained is in the form of a linear controlled dynamical system and can be readily applied within the Koopman model predictive control framework of [12] to control nonlinear dynamical systems using linear model predictive control tools. The method is entirely data-driven and based purely on convex optimization, with no reliance on neural networks or other non-convex machine learning tools. The novel eigenfunction construction method is also analyzed theoretically, proving rigorously that the family of eigenfunctions obtained is rich enough to span the space of all continuous functions. In addition, the method is extended to construct generalized eigenfunctions that also give rise Koopman invariant subspaces and hence can be used for linear prediction. Detailed numerical examples with code available online demonstrate the approach, both for prediction and feedback control.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Predicting the Critical Number of Layers for Hierarchical Support Vector Regression

Hierarchical support vector regression (HSVR) models a function from data as a linear combination of SVR models at a range of scales, starting at a coarse scale and moving to finer scales as the hierarchy continues. In the original formulation of HSVR, there were no rules for choosing the depth of the model. In this paper, we observe in a number of models a phase transition in the training error -- the error remains relatively constant as layers are added, until a critical scale is passed, at which point the training error drops close to zero and remains nearly constant for added layers. We introduce a method to predict this critical scale a priori with the prediction based on the support of either a Fourier transform of the data or the Dynamic Mode Decomposition (DMD) spectrum. This allows us to determine the required number of layers prior to training any models.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Mesochronic classification of trajectories in incompressible 3D vector fields over finite times

The mesochronic velocity is the average of the velocity field along trajectories generated by the same velocity field over a time interval of finite duration. In this paper we classify initial conditions of trajectories evolving in incompressible vector fields according to the character of motion of material around the trajectory. In particular, we provide calculations that can be used to determine the number of expanding directions and the presence of rotation from the characteristic polynomial of the Jacobian matrix of mesochronic velocity. In doing so, we show that (a) the mesochronic velocity can be used to characterize dynamical deformation of three-dimensional volumes, (b) the resulting mesochronic analysis is a finite-time extension of the Okubo--Weiss--Chong analysis of incompressible velocity fields, (c) the two-dimensional mesochronic analysis from Mezic et al. \emph{A New Mixing Diagnostic and Gulf Oil Spill Movement}, Science 330, (2010), 486-489, extends to three-dimensional state spaces. Theoretical considerations are further supported by numerical computations performed for a dynamical system arising in fluid mechanics, the unsteady Arnold--Beltrami--Childress (ABC) flow.

0 citations0 reviewsNo code linkedOpen access