BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

Peter E. Caines

Peter E. Caines appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
math.OCSystems and Controlmath.DSeess.SYMachine Learningmath.APmath.DGmath.PRSocial and Information Networks

Catalog footprint

What is connected

13works
9topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

13 published item(s)

preprint2022arXiv

A Class of Hybrid LQG Mean Field Games with State-Invariant Switching and Stopping Strategies

A novel framework is presented that combines Mean Field Game (MFG) theory and Hybrid Optimal Control (HOC) theory to obtain a unique $ε$-Nash equilibrium for a non-cooperative game with switching and stopping times. We consider the case where there exists one major agent with a significant influence on the system together with a large number of minor agents constituting two subpopulations, each agent with individually asymptotically negligible effect on the whole system. Each agent has stochastic linear dynamics with quadratic costs, and the agents are coupled in their dynamics and costs by the average state of minor agents (i.e. the empirical mean field). It is shown that for a class of Hybrid LQG MFGs, the optimal switching and stopping times are state-invariant and only depend on the dynamical parameters of each agent. Accordingly, a hybrid systems formulation of the game is presented via the indexing by discrete events: (i) the switching of the major agent between alternative dynamics or (ii) the termination of the agents' trajectories in one or both of the subpopulations of minor agents. Optimal switchings and stopping time strategies together with best response control actions for, respectively, the major agent and all minor agents are established with respect to their individual cost criteria by an application of Hybrid LQG MFG theory.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Transmission Neural Networks: From Virus Spread Models to Neural Networks

This work connects models for virus spread on networks with their equivalent neural network representations. Based on this connection, we propose a new neural network architecture, called Transmission Neural Networks (TransNNs) where activation functions are primarily associated with links and are allowed to have different activation levels. Furthermore, this connection leads to the discovery and the derivation of three new activation functions with tunable or trainable parameters. Moreover, we prove that TransNNs with a single hidden layer and a fixed non-zero bias term are universal function approximators. Finally, we present new fundamental derivations of continuous time epidemic network models based on TransNNs.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

$ε$-Nash Equilibria for Major Minor LQG Mean Field Games with Partial Observations of All Agents

The partially observed major minor LQG and nonlinear mean field game (PO MM LQG MFG) systems where it is assumed the major agent's state is partially observed by each minor agent, and the major agent completely observes its own state have been analysed in the literature. In this paper, PO MM LQG MFG problems with general information patterns are studied where (i) the major agent has partial observations of its own state, and (ii) each minor agent has partial observations of its own state and the major agent's state. The assumption of partial observations by all agents leads to a new situation involving the recursive estimation by each minor agent of the major agent's estimate of its own state. For a general case of indefinite LQG MFG systems, the existence of $ε$-Nash equilibria together with the individual agents' control laws yielding the equilibria are established via the Separation Principle.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Convex Analysis for LQG Systems with Applications to Major Minor LQG Mean-Field Game Systems

We develop a convex analysis approach for solving LQG optimal control problems and apply it to major-minor (MM) LQG mean-field game (MFG) systems. The approach retrieves the best response strategies for the major agent and all minor agents that attain an $ε$-Nash equilibrium. An important and distinctive advantage to this approach is that unlike the classical approach in the literature, we are able to avoid imposing assumptions on the evolution of the mean-field. In particular, this provides a tool for dealing with complex and non-standard systems.

0 citations0 reviewsNo code linkedOpen access
preprint2019arXiv

Optimal and Approximate Solutions to Linear Quadratic Regulation of a Class of Graphon Dynamical Systems

In this paper we study the linear quadratic regulation (LQR) problem for dynamical systems coupled over large-scale networks and obtain locally computable low-complexity solutions. The underlying large or even infinite networks are represented by graphons and the couplings appear in both the dynamics and the quadratic cost. The optimal solution is obtained first for graphon dynamical systems for the special case where the graphons are exactly characterized by finite spectral summands. The complexity of generating these control solutions involves solving d+1 scalar Riccati equations where d is the number of non-zero eigenvalues in the spectral representation. Based on this, we provide a suboptimal low-complexity solution for problems with general graphon couplings via spectral approximations and analyze the performance under the approximate control. Finally, a numerical example is given to illustrate the explicit solution and demonstrate the simplicity of the solution.

0 citations0 reviewsNo code linkedOpen access
preprint2019arXiv

Spectral Representations of Graphons in Very Large Network Systems Control

Graphon-based control has recently been proposed and developed to solve control problems for dynamical systems on networks which are very large or growing without bound (see Gao and Caines, CDC 2017, CDC 2018). In this paper, spectral representations, eigenfunctions and approximations of graphons, and their applications to graphon-based control are studied. First, spectral properties of graphons are presented and then approximations based on Fourier approximated eigenfunctions are analyzed. Within this framework, two classes of graphons with simple spectral representations are given. Applications to graphon-based control analysis are next presented; in particular, the controllability of systems distributed over very large networks is expressed in terms of the properties of the corresponding graphon dynamical systems. Moreover, spectral analysis based upon real-world network data is presented, which demonstrates that low-dimensional spectral approximations of networks are possible. Finally, an initial, exploratory investigation of the utility of the spectral analysis methodology in graphon systems control to study the control of epidemic spread is presented.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

On the Control of Affine Systems with Safety Constraints: Relaxed In-Block Controllability

We consider affine systems defined on polytopes and study the cases where the systems are not in-block controllable with respect to the given polytopes. That are the cases in which we cannot fully control the affine systems within the interior of a given polytope, representing the intersection of given safety constraints. Instead, we introduce in this paper the notion of relaxed in-block controllability (RIBC), which can be useful for the cases where one can distinguish between soft and hard safety constraints. In particular, we study whether all the states in the interior of a given polytope, formed by the intersection of soft safety constraints, are mutually accessible through the interior of a given bigger polytope, formed by the intersection of hard safety constraints, by applying uniformly bounded control inputs. By exploring the geometry of the problem, we provide necessary conditions for RIBC. We then show when these conditions are also sufficient. Several illustrative examples are also given to clarify the main results.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

On the Hybrid Minimum Principle On Lie Groups and the Exponential Gradient HMP Algorithm

This paper provides a geometrical derivation of the Hybrid Minimum Principle (HMP) for autonomous hybrid systems whose state manifolds constitute Lie groups $(G,\star)$ which are left invariant under the controlled dynamics of the system, and whose switching manifolds are defined as smooth embedded time invariant submanifolds of $G$. The analysis is expressed in terms of extremal (i.e. optimal) trajectories on the cotangent bundle of the state manifold $G$. The Hybrid Maximum Principle (HMP) algorithm introduced in \cite{Shaikh} is extended to the so-called Exponential Gradient algorithm. The convergence analysis for the algorithm is based upon the LaSalle Invariance Principle and simulation results illustrate their efficacy.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

ε-Nash Mean Field Game Theory for Nonlinear Stochastic Dynamical Systems with Major and Minor Agents

This paper studies a large population dynamic game involving nonlinear stochastic dynamical systems with agents of the following mixed types: (i) a major agent, and (ii) a population of $N$ minor agents where $N$ is very large. The major and minor (MM) agents are coupled via both: (i) their individual nonlinear stochastic dynamics, and (ii) their individual finite time horizon nonlinear cost functions. This problem is approached by the so-called $ε$-Nash Mean Field Game ($ε$-NMFG) theory. A distinct feature of the mixed agent MFG problem is that even asymptotically (as the population size $N$ approaches infinity) the noise process of the major agent causes random fluctuation of the mean field behaviour of the minor agents. To deal with this, the overall asymptotic ($N \rightarrow \infty$) mean field game problem is decomposed into: (i) two non-standard stochastic optimal control problems with random coefficient processes which yield forward adapted stochastic best response control processes determined from the solution of (backward in time) stochastic Hamilton-Jacobi-Bellman (SHJB) equations, and (ii) two stochastic coefficient McKean-Vlasov (SMV) equations which characterize the state of the major agent and the measure determining the mean field behaviour of the minor agents. Existence and uniqueness of the solution to the Stochastic Mean Field Game (SMFG) system (SHJB and SMV equations) is established by a fixed point argument in the Wasserstein space of random probability measures. In the case that minor agents are coupled to the major agent only through their cost functions, the $ε_N$-Nash equilibrium property of the SMFG best responses is shown for a finite $N$ population system where $ε_N=O(1/\sqrt N)$.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Mean Field Stochastic Adaptive Control

For noncooperative games the mean field (MF) methodology provides decentralized strategies which yield Nash equilibria for large population systems in the asymptotic limit of an infinite (mass) population. The MF control laws use only the local information of each agent on its own state and own dynamical parameters, while the mass effect is calculated offline using the distribution function of (i) the population's dynamical parameters, and (ii) the population's cost function parameters, for the infinite population case. These laws yield approximate equilibria when applied in the finite population. In this paper, these a priori information conditions are relaxed, and incrementally the cases are considered where, first, the agents estimate their own dynamical parameters, and, second, estimate the distribution parameter in (i) and (ii) above. An MF stochastic adaptive control (SAC) law in which each agent observes a random subset of the population of agents is specified, where the ratio of the cardinality of the observed set to that of the number of agents decays to zero as the population size tends to infinity. Each agent estimates its own dynamical parameters via the recursive weighted least squares (RWLS) algorithm and the distribution of the population's dynamical parameters via maximum likelihood estimation (MLE). Under reasonable conditions on the population dynamical parameter distribution, the MF-SAC Law applied by each agent results in (i) the strong consistency of the self parameter estimates and the strong consistency of the population distribution function parameters; (ii) the long run average stability of all agent systems; (iii) a (strong) e-Nash equilibrium for the population of agents; and (iv) the a.s. equality of the long run average cost and the non-adaptive cost in the population limit.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

On the Optimal Control of Impulsive Hybrid Systems On Riemannian Manifolds

This paper provides a geometrical derivation of the Hybrid Minimum Principle (HMP) for autonomous impulsive hybrid systems on Riemannian manifolds, i.e. systems where the manifold valued component of the hybrid state trajectory may have a jump discontinuity when the discrete component changes value. The analysis is expressed in terms of extremal trajectories on the cotangent bundle of the manifold state space. In the case of autonomous hybrid systems, switching manifolds are defined as smooth embedded submanifolds of the state manifold and the jump function is defined as a smooth map on the switching manifold. The HMP results are obtained in the case of time invariant switching manifolds and state jumps on Riemannian manifolds.

0 citations0 reviewsNo code linkedOpen access