BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

Ryan Mohr

Ryan Mohr appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
math.DSMachine LearningBiomoleculesData Structures and Algorithmseess.SYmath.NAmath.SPNumerical Analysisphysics.chem-phSystems and Control

Catalog footprint

What is connected

8works
10topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

8 published item(s)

preprint2022arXiv

Algorithmic (Semi-)Conjugacy via Koopman Operator Theory

Iterative algorithms are of utmost importance in decision and control. With an ever growing number of algorithms being developed, distributed, and proprietarized, there is a similarly growing need for methods that can provide classification and comparison. By viewing iterative algorithms as discrete-time dynamical systems, we leverage Koopman operator theory to identify (semi-)conjugacies between algorithms using their spectral properties. This provides a general framework with which to classify and compare algorithms.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

An Operator Theoretic View on Pruning Deep Neural Networks

The discovery of sparse subnetworks that are able to perform as well as full models has found broad applied and theoretical interest. While many pruning methods have been developed to this end, the naïve approach of removing parameters based on their magnitude has been found to be as robust as more complex, state-of-the-art algorithms. The lack of theory behind magnitude pruning's success, especially pre-convergence, and its relation to other pruning methods, such as gradient based pruning, are outstanding open questions in the field that are in need of being addressed. We make use of recent advances in dynamical systems theory, namely Koopman operator theory, to define a new class of theoretically motivated pruning algorithms. We show that these algorithms can be equivalent to magnitude and gradient based pruning, unifying these seemingly disparate methods, and find that they can be used to shed light on magnitude pruning's performance during the early part of training.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Applications of Koopman Mode Analysis to Neural Networks

We consider the training process of a neural network as a dynamical system acting on the high-dimensional weight space. Each epoch is an application of the map induced by the optimization algorithm and the loss function. Using this induced map, we can apply observables on the weight space and measure their evolution. The evolution of the observables are given by the Koopman operator associated with the induced dynamical system. We use the spectrum and modes of the Koopman operator to realize the above objectives. Our methods can help to, a priori, determine the network depth; determine if we have a bad initialization of the network weights, allowing a restart before training too long; speeding up the training time. Additionally, our methods help enable noise rejection and improve robustness. We show how the Koopman spectrum can be used to determine the number of layers required for the architecture. Additionally, we show how we can elucidate the convergence versus non-convergence of the training process by monitoring the spectrum, in particular, how the existence of eigenvalues clustering around 1 determines when to terminate the learning process. We also show how using Koopman modes we can selectively prune the network to speed up the training procedure. Finally, we show that incorporating loss functions based on negative Sobolev norms can allow for the reconstruction of a multi-scale signal polluted by very large amounts of noise.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Extended Dynamic Mode Decomposition with Learned Koopman Eigenfunctions for Prediction and Control

This paper presents a novel learning framework to construct Koopman eigenfunctions for unknown, nonlinear dynamics using data gathered from experiments. The learning framework can extract spectral information from the full nonlinear dynamics by learning the eigenvalues and eigenfunctions of the associated Koopman operator. We then exploit the learned Koopman eigenfunctions to learn a lifted linear state-space model. To the best of our knowledge, our method is the first to utilize Koopman eigenfunctions as lifting functions for EDMD-based methods. We demonstrate the performance of the framework in state prediction and closed loop trajectory tracking of a simulated cart pole system. Our method is able to significantly improve the controller performance while relying on linear control methods to do nonlinear control.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Predicting the Critical Number of Layers for Hierarchical Support Vector Regression

Hierarchical support vector regression (HSVR) models a function from data as a linear combination of SVR models at a range of scales, starting at a coarse scale and moving to finer scales as the hierarchy continues. In the original formulation of HSVR, there were no rules for choosing the depth of the model. In this paper, we observe in a number of models a phase transition in the training error -- the error remains relatively constant as layers are added, until a critical scale is passed, at which point the training error drops close to zero and remains nearly constant for added layers. We introduce a method to predict this critical scale a priori with the prediction based on the support of either a Fourier transform of the data or the Dynamic Mode Decomposition (DMD) spectrum. This allows us to determine the required number of layers prior to training any models.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Koopman principle eigenfunctions and linearization of diffeomorphisms

This paper considers a nonlinear dynamical system on a complex, finite dimensional Banach space which has an asymptotically stable, hyperbolic fixed point. We investigate the connection between the so-called principle eigenfunctions of the Koopman operator and the existence of a topological conjugacy between the nonlinear dynamics and its linearization in the neighborhood of the fixed point. The principle eigenfunctions generate an algebra of observables for the linear dynamics --- called the principle algebra --- which can be used to generate a sequence of approximate conjugacy maps in the same manner as it is done in normal form theory. Each element of the principle algebra has an expansion into eigenfunctions of the Koopman operator and composing an eigenfunction with one of the approximate topological conjugacies gives an approximate eigenfunction of the Koopman operator associated with the nonlinear dynamical system. When the limit of the approximate conjugacies exists and attention is restricted to real Banach spaces, a simple application of the Stone-Weierstrass theorem shows that both the principle algebra and the pull-back algebra --- defined by composing the principle algebra with the topological conjugacy --- are uniformly dense in either the space of continuous functions or the maximal ideal of continuous functions vanishing at the fixed point. The point is that, a priori, it is difficult to know which space of observables to use for dissipative nonlinear dynamical systems whose elements have spectral expansions into eigenfunctions. These results say that any continuous observable is arbitrarily close to one that has such an expansion.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Programmable Potentials: Approximate N-body potentials from coarse-level logic

This paper gives a systematic method for constructing an N-body potential, approximating the true potential, that accurately captures meso-scale behavior of the chemical or biological system using pairwise potentials coming from experimental data or ab initio methods. The meso-scale behavior is translated into logic rules for the dynamics. Each pairwise potential has an associated logic function that is constructed using the logic rules, a class of elementary logic functions, and AND, OR, and NOT gates. The effect of each logic function is to turn its associated potential on and off. The N-body potential is constructed as linear combination of the pairwise potentials, where the "coefficients" of the potentials are smoothed versions of the associated logic functions. These potentials allow a potentially low-dimensional description of complex processes while still accurately capturing the relevant physics at the meso-scale. We present the proposed formalism to construct coarse-grained potential models for three examples: an inhibitor molecular system, bond breaking in chemical reactions, and DNA transcription from biology. The method can potentially be used in reverse for design of molecular processes by specifying properties of molecules that can carry them out.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Construction of eigenfunctions for scalar-type operators via Laplace averages with connections to the Koopman operator

This paper extends Yosida's mean ergodic theorem in order to compute projections onto non-unitary eigenspaces for spectral operators of scalar-type on locally convex linear topological spaces. For spectral operators with dominating point spectrum, the projections take the form of Laplace averages, which are a generalization of the Fourier averages used when the spectrum is unitary. Inverse iteration and Laplace averages project onto eigenspaces of spectral operators with minimal point spectrum. Two classes of dynamical systems --- attracting fixed points in $\mathbb{C}^{d}$ and attracting limit cycles in $\mathbb{R}^{2}$ --- and their respective spaces of observables are given for which the associated composition operator is spectral. It is shown that the natural spaces of observables are completions with an $\ell^{2}$ polynomial norm of a space of polynomials over a normed unital commutative ring. These spaces are generalizations of the Hardy spaces $H^{2}(\mathbb{D})$ and $H^{2}(\mathbb{D}^{d})$. Elements of the ring are observables defined on the attractor --- the fixed point or the limit cycle, in our examples. Furthermore, we are able to provide a (semi)global spectral theorem for the composition operators associated with a large class of dissipative nonlinear dynamical systems; any sufficiently smooth dynamical system topologically conjugate to either of the two cases above admits an observable space on which the associated Koopman operator is spectral. It is conjectured that this is generically true for systems where the basin of attraction can be properly "coordinatized".

0 citations0 reviewsNo code linkedOpen access