BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

Umesh Vaidya

Umesh Vaidya appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
math.OCeess.SYSystems and Controlmath.DSMachine Learningmath.CAmath.FARobotics

Catalog footprint

What is connected

14works
8topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

14 published item(s)

preprint2022arXiv

Data-Driven Optimal Control via Linear Transfer Operators: A Convex Approach

This paper is concerned with data-driven optimal control of nonlinear systems. We present a convex formulation to the optimal control problem (OCP) with a discounted cost function. We consider OCP with both positive and negative discount factor. The convex approach relies on lifting nonlinear system dynamics in the space of densities using the linear Perron-Frobenius (P-F) operator. This lifting leads to an infinite-dimensional convex optimization formulation of the optimal control problem. The data-driven approximation of the optimization problem relies on the approximation of the Koopman operator using the polynomial basis function. We write the approximate finite-dimensional optimization problem as a polynomial optimization which is then solved efficiently using a sum-of-squares-based optimization framework. Simulation results are presented to demonstrate the efficacy of the developed data-driven optimal control framework.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Data-Driven Stochastic Optimal Control using Linear Transfer Operators

We provide a data-driven framework for optimal control of a continuous-time stochastic dynamical system. The proposed framework relies on the linear operator theory involving linear Perron-Frobenius (P-F) and Koopman operators. Our first results involving the P-F operator provide a convex formulation to the optimal control problem in the dual space of densities. This convex formulation of the stochastic optimal control problem leads to an infinite-dimensional convex program. The finite-dimensional approximation of the convex program is obtained using a data-driven approximation of the P-F operator. Our second results demonstrate the use of the Koopman operator, which is dual to the P-F operator, for the stochastic optimal control design. We show that the Hamilton Jacobi Bellman (HJB) equation can be expressed using the Koopman operator. We provide an iterative procedure along the lines of a popular policy iteration algorithm based on the data-driven approximation of the Koopman operator for solving the HJB equation. The two formulations, namely the convex formulation involving P-F operator and Koopman based formulation using HJB equation, can be viewed as dual to each other where the duality follows due to the dual nature of P-F and Koopman operators. Finally, we present several numerical examples to demonstrate the efficacy of the developed framework.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Koopman-based Policy Iteration for Robust Optimal Control

Classically, the optimal control problem in the presence of an adversary is formulated as a two-player zero-sum differential game or an $H_\infty$ control problem. The solution to these problems can be obtained by solving the Hamilton-Jacobi-Issac equation (HJIE). We provide a novel Koopman-based expression of the HJIE, where the solutions can be obtained through the approximation of the Koopman operator itself. In particular, we developed a data-driven and model based policy iteration algorithm for approximating the optimal value function using a finite-dimensional approximation of the Koopman operator and generator.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Reciprocity of Algorithms Solving Distributed Consensus-Based Optimization and Distributed Resource Allocation

This paper aims at proposing a procedure to derive distributed algorithms for distributed consensus-based optimization by using distributed algorithms for network resource allocation and vice versa over switching networks with/without synchronous protocol. It is shown that first-order gradient distributed consensus-based optimization algorithms can be used for finding an optimal solution of distributed resource allocation with synchronous protocol under weaker assumptions than those given in the literature for non-switching (static) networks. It is shown that first-order gradient distributed resource allocation algorithms can be utilized for finding an optimal solution of distributed consensus-based optimization. The results presented here can be applied to time-varying and random directed networks with or without synchronous protocol with arbitrary initialization. As a result, several algorithms can now be used to derive distributed algorithms for both consensus-based optimization and resource allocation, that can overcome limitations of the existing results. While the focus of this paper is on the first-order gradient algorithms, it is to be noted that the results also work with second-order gradient algorithms.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

A Fast Saddle-Point Dynamical System Approach to Robust Deep Learning

Recent focus on robustness to adversarial attacks for deep neural networks produced a large variety of algorithms for training robust models. Most of the effective algorithms involve solving the min-max optimization problem for training robust models (min step) under worst-case attacks (max step). However, they often suffer from high computational cost from running several inner maximization iterations (to find an optimal attack) inside every outer minimization iteration. Therefore, it becomes difficult to readily apply such algorithms for moderate to large size real world data sets. To alleviate this, we explore the effectiveness of iterative descent-ascent algorithms where the maximization and minimization steps are executed in an alternate fashion to simultaneously obtain the worst-case attack and the corresponding robust model. Specifically, we propose a novel discrete-time dynamical system-based algorithm that aims to find the saddle point of a min-max optimization problem in the presence of uncertainties. Under the assumptions that the cost function is convex and uncertainties enter concavely in the robust learning problem, we analytically show that our algorithm converges asymptotically to the robust optimal solution under a general adversarial budget constraints as induced by $\ell_p$ norm, for $1\leq p\leq \infty$. Based on our proposed analysis, we devise a fast robust training algorithm for deep neural networks. Although such training involves highly non-convex robust optimization problems, empirical results show that the algorithm can achieve significant robustness compared to other state-of-the-art robust models on benchmark data sets.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

On Few Shot Learning of Dynamical Systems: A Koopman Operator Theoretic Approach

In this paper, we propose a novel algorithm for learning the Koopman operator of a dynamical system from a \textit{small} amount of training data. In many applications of data-driven modeling, e.g. biological network modeling, cybersecurity, modeling the Internet of Things, or smart grid monitoring, it is impossible to obtain regularly sampled time-series data with a sufficiently high sampling frequency. In such situations the existing Dynamic Mode Decomposition (DMD) or Extended Dynamic Mode Decomposition (EDMD) algorithms for Koopman operator computation often leads to a low fidelity approximate Koopman operator. To this end, this paper proposes an algorithm which can compute the Koopman operator efficiently when the training data-set is sparsely sampled across time. In particular, the proposed algorithm enriches the small training data-set by appending artificial data points, which are treated as noisy observations. The larger, albeit noisy data-set is then used to compute the Koopman operator, using techniques from Robust Optimization. The efficacy of the proposed algorithm is also demonstrated on three different dynamical systems, namely a linear network of oscillators, a nonlinear system and a dynamical system governed by a Partial Differential Equation (PDE).

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

A convex data-driven approach for nonlinear control synthesis

We consider a class of nonlinear control synthesis problems where the underlying mathematical models are not explicitly known. We propose a data-driven approach to stabilize the systems when only sample trajectories of the dynamics are accessible. Our method is founded on the density function based almost everywhere stability certificate that is dual to the Lyapunov function for dynamic systems. Unlike Lyapunov based methods, density functions lead to a convex formulation for a joint search of the control strategy and the stability certificate. This type of convex problem can be solved efficiently by invoking the machinery of the sum of squares (SOS). For the data-driven part, we exploit the fact that the duality results in the stability theory of the dynamical system can be understood using linear Perron-Frobenius and Koopman operators. This connection allows us to use data-driven methods developed to approximate these operators combined with the SOS techniques for the convex formulation of control synthesis. The efficacy of the proposed approach is demonstrated through several examples.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Data-Driven Approach for Uncertainty Propagation and Reachability Analysis in Dynamical Systems

In this paper, we propose a data-driven approach for uncertainty propagation and reachability analysis in a dynamical system. The proposed approach relies on the linear lifting of a nonlinear system using linear Perron-Frobenius (P-F) and Koopman operators. The uncertainty can be characterized in terms of the moments of a probability density function. We demonstrate how the P-F and Koopman operators are used for propagating the moments. Time-series data is used for the finite-dimensional approximation of the linear operators, thereby enabling data-driven approach for moment propagation. Simulation results are presented to demonstrate the effectiveness of the proposed method.

0 citations0 reviewsNo code linkedOpen access
preprint2018arXiv

On Robust Computation of Koopman Operator and Prediction in Random Dynamical Systems

In the paper, we consider the problem of robust approximation of transfer Koopman and Perron-Frobenius (P-F) operators from noisy time series data. In most applications, the time-series data obtained from simulation or experiment is corrupted with either measurement or process noise or both. The existing results show the applicability of algorithms developed for the finite dimensional approximation of deterministic system to a random uncertain case. However, these results hold true only in asymptotic and under the assumption of infinite data set. In practice the data set is finite, and hence it is important to develop algorithms that explicitly account for the presence of uncertainty in data-set. We propose a robust optimization-based framework for the robust approximation of the transfer operators, where the uncertainty in data-set is treated as deterministic norm bounded uncertainty. The robust optimization leads to a min-max type optimization problem for the approximation of transfer operators. This robust optimization problem is shown to be equivalent to regularized least square problem. This equivalence between robust optimization problem and regularized least square problem allows us to comment on various interesting properties of the obtained solution using robust optimization. In particular, the robust optimization formulation captures inherent tradeoffs between the quality of approximation and complexity of approximation. These tradeoffs are necessary to balance for the proposed application of transfer operators, for the design of optimal predictor. Simulation results demonstrate that our proposed robust approximation algorithm performs better than the Extended Dynamic Mode Decomposition (EDMD) and DMD algorithms for a system with process and measurement noise.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Limitations for nonlinear stabilization over uncertain channels

We study the problem of mean-square exponential incremental stabilization of nonlinear systems over uncertain communication channels. We show the ability to stabilize a system over such channels is fundamentally limited and the channel uncertainty must provide a minimal Quality of Service (QoS) to support stabilization. The smallest QoS necessary for stabilization is shown as a function of the positive Lyapunov exponents of uncontrolled nonlinear systems. The positive Lyapunov exponent is a measure of dynamical complexity and captures the rate of exponential divergence of nearby system trajectories. One of the main highlights of our results is the role played by nonequilibrium dynamics to determine the limitation for incremental stabilization over networks with uncertainty.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Mean sqaure synchronization in large scale nonlinear networks with uncertain links

In this paper, we study the problem of synchronization with stochastic interaction among network components. The network components dynamics is nonlinear and modeled in Lure form with linear stochastic interaction among network components. To study this problem we first prove the stochastic version of Positive Real Lemma (PRL). The stochastic PRL result is then used to provide sufficient condition for synchronization of stochastic network system. The sufficiency condition for synchronization, is a function of nominal (mean) coupling Laplacian eigenvalues and the statistics of link uncertainty in the form of coefficient of dispersion (CoD). Contrary to the existing literature on network synchronization, our results indicate that both the largest and the second smallest eigenvalue of the mean Laplacian play an important role in synchronization of stochastic networks. Robust control-based small-gain interpretation is provided for the derived sufficiency condition which allow us to define the margin of synchronization. The margin of synchronization is used to understand the important tradeoff between the component dynamics, network topology, and uncertainty characteristics. For a special class of network system connected over torus topology we provide an analytical expression for the tradeoff between the number of neighbors and the dimension of the torus. Similarly, by exploiting the identical nature of component dynamics computationally efficient sufficient condition independent of network size is provided for general class of network system. Simulation results for network of coupled oscillators with stochastic link uncertainty are presented to verify the developed theoretical framework.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Actuator and sensor placement in linear advection PDE with building system applications

We study the problem of actuator and sensor placement in a linear advection partial differential equation (PDE). The problem is motivated by its application to actuator and sensor placement in building systems for the control and detection of a scalar quantity such as temperature and contaminants. We propose a gramian based approach to the problem of actuator and sensor placement. The special structure of the advection PDE is exploited to provide an explicit formula for the controllability and observability gramian in the form of a multiplication operator. The explicit formula for the gramian, as a function of actuator and sensor location, is used to provide test criteria for the suitability of a given sensor and actuator location. Furthermore, the solution obtained using gramian based criteria is interpreted in terms of the flow of the advective vector field. In particular, the almost everywhere stability property of the advective vector field is shown to play a crucial role in deciding the location of actuators and sensors. Simulation results are performed to support the main results of this paper.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Existence of invariant tori in three dimensional maps with degeneracy

We prove a KAM-type result for the persistence of two-dimensional invariant tori in perturbations of integrable action-angle-angle maps with degeneracy, satisfying the intersection property. Such degenerate action-angle-angle maps arise upon generic perturbation of three-dimensional volume-preserving vector fields, which are invariant under volume-preserving action of $S^1$ when there is no motion in the group action direction for the unperturbed map. This situation is analogous to degeneracy in Hamiltonian systems. The degenerate nature of the map and the unequal number of action and angle variables make the persistence proof non-standard. The persistence of the invariant tori as predicted by our result has implications for the existence of barriers to transport in three-dimensional incompressible fluid flows. Simulation results indicating existence of two-dimensional tori in a perturbation of swirling Hill's spherical vortex flow are presented.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Stabilization of linear time varying system over uncertain channels

In this paper, we study the problem of control of discrete-time linear time varying systems over uncertain channels. The uncertainty in the channels is modeled as a stochastic random variable. We use exponential mean square stability of the closed-loop system as a stability criterion. We show that fundamental limitations arise for the mean square exponential stabilization for the closed-loop system expressed in terms of statistics of channel uncertainty and the positive Lyapunov exponent of the open-loop uncontrolled system. Our results generalize the existing results known in the case of linear time invariant systems, where Lyapunov exponents are shown to emerge as the generalization of eigenvalues from linear time invariant systems to linear time varying systems. Simulation results are presented to verify the main results of this paper.

0 citations0 reviewsNo code linkedOpen access