BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

Nuno C. Martins

Nuno C. Martins appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
math.OCSystems and ControlApplicationseess.SYmath.DSeess.SPInformation Theorymath.ITRobotics

Catalog footprint

What is connected

17works
9topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

17 published item(s)

preprint2022arXiv

Epidemic Population Games And Evolutionary Dynamics

We propose a system theoretic approach to select and stabilize the endemic equilibrium of an SIRS epidemic model in which the decisions of a population of strategically interacting agents determine the transmission rate. Specifically, the population's agents recurrently revise their choices out of a set of strategies that impact to varying levels the transmission rate. A payoff vector quantifying the incentives provided by a planner for each strategy, after deducting the strategies' intrinsic costs, influences the revision process. An evolutionary dynamics model captures the population's preferences in the revision process by specifying as a function of the payoff vector the rates at which the agents' choices flow toward strategies with higher payoffs. Our main result is a dynamic payoff mechanism that is guaranteed to steer the epidemic variables (via incentives to the population) to the endemic equilibrium with the smallest infectious fraction, subject to cost constraints. We use a Lyapunov function not only to establish convergence but also to obtain an (anytime) upper bound for the peak size of the population's infectious portion.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Epidemic Population Games With Nonnegligible Disease Death Rate

A recent article that combines normalized epidemic compartmental models and population games put forth a system theoretic approach to capture the coupling between a population's strategic behavior and the course of an epidemic. It introduced a payoff mechanism that governs the population's strategic choices via incentives, leading to the lowest endemic proportion of infectious individuals subject to cost constraints. Under the assumption that the disease death rate is approximately zero, it uses a Lyapunov function to prove convergence and formulate a quasi-convex program to compute an upper bound for the peak size of the population's infectious fraction. In this article, we generalize these results to the case in which the disease death rate is nonnegligible. This generalization brings on additional coupling terms in the normalized compartmental model, leading to a more intricate Lyapunov function and payoff mechanism. Moreover, the associated upper bound can no longer be determined exactly, but it can be computed with arbitrary accuracy by solving a set of convex programs.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Population Games With Erlang Clocks: Convergence to Nash Equilibria For Pairwise Comparison Dynamics

The prevailing methodology for analyzing population games and evolutionary dynamics in the large population limit assumes that a Poisson process (or clock) inherent to each agent determines when the agent can revise its strategy. Hence, such an approach presupposes exponentially distributed inter-revision intervals, and is inadequate for cases where each strategy entails a sequence of sub-tasks (sub-strategies) that must be completed before a new revision time occurs. This article proposes a methodology for such cases under the premise that a sub-strategy's duration is exponentially-distributed, leading to Erlang distributed inter-revision intervals. We assume that a so-called pairwise-comparison protocol captures the agents' revision preferences to render our analysis concrete. The presence of sub-strategies brings on additional dynamics that is incompatible with existing models and results. Our main contributions are twofold, both derived for a deterministic approximation valid for large populations. We prove convergence of the population's state to the Nash equilibrium set when a potential game generates a payoff for the strategies. We use system-theoretic passivity to determine conditions under which this convergence is guaranteed for contractive games.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Channels, Remote Estimation and Queueing Systems With A Utilization-Dependent Component: A Unifying Survey Of Recent Results

In this article, we survey the main models, techniques, concepts, and results centered on the design and performance evaluation of engineered systems that rely on a utilization-dependent component (UDC) whose operation may depend on its usage history or assigned workload. Specifically, we report on research themes concentrating on the characterization of the capacity of channels and the design with performance guarantees of remote estimation and queueing systems. Causes for the dependency of a UDC on past utilization include the use of replenishable energy sources to power the transmission of information among the sub-components of a networked system, and the assistance of a human operator for servicing a queue. Our analysis unveils the similarity of the UDC models typically adopted in each of the research themes, and it reveals the differences in the objectives and technical approaches employed. We also identify new challenges and future research directions inspired by the cross-pollination among the central concepts, techniques, and problem formulations of the research themes discussed.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Stabilizing a Queue Subject to Action-Dependent Server Performance

We consider a discrete-time system comprising a first-come-first-served queue, a non-preemptive server, and a scheduler that governs the assignment of tasks in the queue to the server. The server has an availability state that indicates, at each instant, whether the server is busy working on a task or is available. In the latter case, if the queue is nonempty, then a task-assignment control policy implemented by the scheduler either assigns a new task to the server or allows it to rest. The server also has an integer-valued activity state that is non-increasing during rest periods, and is non-decreasing otherwise. An instantaneous service rate function ascribes to each possible value of the activity state a probability that the server can complete a task in one time step. For a typical instantaneous service rate function, the completion probability decreases (server performance worsens) as the activity state increases. The scheduler policy has access to the queue size and the entire state of the server. In this article, we study the problem of designing scheduler policies that stabilize the queue. We show that stability, whenever viable, can be achieved by a simple policy that bases its decisions on the availability state, a threshold applied to the activity state, and a flag that indicates when the queue is empty. The supremum of the service rates achievable by stabilizing policies can be determined by a finite search. Our results remain valid even when the instantaneous service rate function is not monotonic.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Payoff Dynamics Model and Evolutionary Dynamics Model: Feedback and Convergence to Equilibria

This tutorial article puts forth a framework to analyze the noncooperative strategic interactions among the members of a large population of bounded rationality agents. Our approach hinges on, unifies and generalizes existing methods and models predicated in evolutionary and population games. It does so by adopting a system-theoretic formalism that is well-suited for a broad engineering audience familiar with the basic tenets of nonlinear dynamical systems, Lyapunov stability, storage functions, and passivity. The framework is pertinent for engineering applications in which a large number of agents have the authority to select and repeatedly revise their strategies. A mechanism that is inherent to the problem at hand or is designed and implemented by a coordinator ascribes a payoff to each possible strategy. Typically, the agents will prioritize switching to strategies whose payoff is either higher than the current one or exceeds the population average. The article puts forth a systematic methodology to characterize the stability of the dynamical system that results from the feedback interaction between the payoff mechanism and the revision process. This is important because the set of stable equilibria is an accurate predictor of the population's long-term behavior. The article includes rigorous proofs and examples of application of the stability results, which also extend the state of the art because, unlike previously published work, they allow for a rather general class of dynamical payoff mechanisms. The new results and concepts proposed here are thoroughly compared to previous work, methods and applications of evolutionary and population games.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Queueing Subject To Action-Dependent Server Performance: Utilization Rate Reduction

We consider a discrete-time system comprising a first-come-first-served queue, a non-preemptive server, and a stationary non-work-conserving scheduler. New tasks enter the queue according to a Bernoulli process with a pre-specified arrival rate. At each instant, the server is either busy working on a task or is available. When the server is available, the scheduler either assigns a new task to the server or allows it to remain available (to rest). In addition to the aforementioned availability state, we assume that the server has an integer-valued activity state. The activity state is non-decreasing during work periods, and is non-increasing otherwise. In a typical application of our framework, the server performance (understood as task completion probability) worsens as the activity state increases. In this article, we build on and transcend recent stabilizability results obtained for the same framework. Specifically, we establish methods to design scheduling policies that not only stabilize the queue but also reduce the utilization rate - understood as the infinite-horizon time-averaged portion of time the server is working. This article has a main theorem leading to two key results: (i) We put forth a tractable method to determine, using a finite-dimensional linear program (LP), the infimum of all utilization rates that can be achieved by scheduling policies that are stabilizing, for a given arrival rate. (ii) We propose a design method, also based on finite-dimensional LPs, to obtain stabilizing scheduling policies that can attain a utilization rate arbitrarily close to the aforementioned infimum. We also establish structural and distributional convergence properties, which are used throughout the article, and are significant in their own right.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Optimal Remote Estimation Over Use-Dependent Packet-Drop Channels - Extended Version

Consider a discrete-time remote estimation system formed by an encoder, a transmission policy, a channel, and a remote estimator. The encoder assesses a random process that the remote estimator seeks to estimate based on information sent to it by the encoder via the channel. The channel is affected by Bernoulli drops. The instantaneous probability of a drop is governed by a finite state machine (FSM). The state of the FSM is denoted as the channel state. At each time step, the encoder decides whether to attempt a transmission through the packet-drop link. The sequence of encoder decisions is the input to the FSM. This paper seeks to design an encoder, transmission policy and remote estimator that minimize a finite-horizon mean squared error cost. We present two structural results. The first result in which we assume that the process to be estimated is white and Gaussian, we show that there is an optimal transmission policy governed by a threshold on the estimation error. The second result characterizes optimal symmetric transmission policies for the case when the measured process is the state of a scalar linear time-invariant plant driven by white Gaussian noise. Use-dependent packet-drop channels can be used to quantify the effect of transmission on channel quality when the encoder is powered by energy harvesting. An application to a mixed initiative system in which a human operator performs visual search tasks is also presented.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Optimal Remote State Estimation for Self-Propelled Particle Models

We investigate the design of a remote state estimation system for a self-propelled particle (SPP). Our framework consists of a sensing unit that accesses the full state of the SPP and an estimator that is remotely located from the sensing unit. The sensing unit must pay a cost when it chooses to transmit information on the state of the SPP to the estimator; and the estimator computes the best estimate of the state of the SPP based on received information. In this paper, we provide methods to design transmission policies and estimation rules for the sensing unit and estimator, respectively, that are optimal for a given cost functional that combines state estimation distortion and communication costs. We consider two notions of optimality: joint optimality and person-by-person optimality. Our main results show the existence of a jointly optimal solution and describe an iterative procedure to find a person-by-person optimal solution. In addition, we explain how the remote estimation scheme can be applied to tracking of animal movements over a costly communication link. We also provide experimental results to show the effectiveness of the scheme.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

A Class of LTI Distributed Observers for LTI Plants: Necessary and Sufficient Conditions for Stabilizability

Consider that an autonomous linear time-invariant (LTI) plant is given and that a network of LTI observers assesses its output vector. The dissemination of information within the network is dictated by a pre-specified directed graph in which each vertex represents an observer. Each observer computes its own state estimate using only the portion of the output vector accessible to it and the state estimates of other observers that are transmitted to it by its neighbors, according to the graph. This paper proposes an update rule that is a natural generalization of consensus, and for which we determine necessary and sufficient conditions for the existence of parameters for the update rule that lead to asymptotic omniscience of the state of the plant at all observers. The conditions reduce to certain detectability requirements that imply that if omniscience is not possible under the proposed scheme then it is not viable under any other scheme that is subject to the same communication graph, including nonlinear and time-varying ones.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

A Receding Horizon Strategy for Systems with Interval-Wise Energy Constraints

We propose a receding horizon control strategy that readily handles systems that exhibit interval-wise total energy constraints on the input control sequence. The approach is based on a variable optimization horizon length and contractive final state constraint sets. The optimization horizon, which recedes by N steps every N steps, is the key to accommodate the interval-wise total energy constraints. The varying optimization horizon along with the contractive constraints are used to achieve analytic asymptotic stability of the system under the proposed scheme. The strategy is demonstrated by simulation examples.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

An Augmented Observer for the Distributed Estimation Problem for LTI Systems

This paper studies a network of observers for a distributed estimation problem, where each observer assesses a portion of output of a given LTI system. The goal of each observer is to compute a state estimate that asymptotically converges to the state of the LTI system. We consider there is a sparsity constraint that restricts interconnections between observers. We provide a sufficient condition for the existence of parameters for the observers which achieve the convergence of the state estimates to the state of the LTI system. In particular, this condition can be written in terms of the eigenvalues of the Laplacian matrix of the underlying communication graph and the spectral radius of the dynamic matrix of the LTI system.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Control Design for Markov Chains under Safety Constraints: A Convex Approach

This paper focuses on the design of time-invariant memoryless control policies for fully observed controlled Markov chains, with a finite state space. Safety constraints are imposed through a pre-selected set of forbidden states. A state is qualified as safe if it is not a forbidden state and the probability of it transitioning to a forbidden state is zero. The main objective is to obtain control policies whose closed loop generates the maximal set of safe recurrent states, which may include multiple recurrent classes. A design method is proposed that relies on a finitely parametrized convex program inspired on entropy maximization principles. A numerical example is provided and the adoption of additional constraints is discussed.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Memoryless Control Design for Persistent Surveillance under Safety Constraints

This paper deals with the design of time-invariant memoryless control policies for robots that move in a finite two- dimensional lattice and are tasked with persistent surveillance of an area in which there are forbidden regions. We model each robot as a controlled Markov chain whose state comprises its position in the lattice and the direction of motion. The goal is to find the minimum number of robots and an associated time-invariant memoryless control policy that guarantees that the largest number of states are persistently surveilled without ever visiting a forbidden state. We propose a design method that relies on a finitely parametrized convex program inspired by entropy maximization principles. Numerical examples are provided.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Stabilizability and Norm-Optimal Control Design subject to Sparsity Constraints

Consider that a linear time-invariant (LTI) plant is given and that we wish to design a stabilizing controller for it. Admissible controllers are LTI and must comply with a pre-selected sparsity pattern. The sparsity pattern is assumed to be quadratically invariant (QI) with respect to the plant, which, from prior results, guarantees that there is a convex parametrization of all admissible stabilizing controllers provided that an initial admissible stable stabilizing controller is provided. This paper addresses the previously unsolved problem of determining necessary and sufficient conditions for the existence of an admissible stabilizing controller. The main idea is to cast the existence of such a controller as the feasibility of an exact model-matching problem with stability restrictions, which can be tackled using existing methods. Furthermore, we show that, when it exists, the solution of the model-matching problem can be used to compute an admissible stabilizing controller. This method also leads to a convex parametrization that may be viewed as an extension of Youla's classical approach so as to incorporate sparsity constraints. Applications of this parametrization on the design of norm-optimal controllers via convex methods are also explored. An illustrative example is provided, and a special case is discussed for which the exact model matching problem has a unique and easily computable solution.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

On the Nearest Quadratically Invariant Information Constraint

Quadratic invariance is a condition which has been shown to allow for optimal decentralized control problems to be cast as convex optimization problems. The condition relates the constraints that the decentralization imposes on the controller to the structure of the plant. In this paper, we consider the problem of finding the closest subset and superset of the decentralization constraint which are quadratically invariant when the original problem is not. We show that this can itself be cast as a convex problem for the case where the controller is subject to delay constraints between subsystems, but that this fails when we only consider sparsity constraints on the controller. For that case, we develop an algorithm that finds the closest superset in a fixed number of steps, and discuss methods of finding a close subset.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

Optimal Sensor Placement for Intruder Detection

We consider the centralized detection of an intruder, whose location is modeled as uniform across a specified set of points, using an optimally placed team of sensors. These sensors make conditionally independent observations. The local detectors at the sensors are also assumed to be identical, with detection probability $(P_{_{D}})$ and false alarm probability $(P_{_{F}})$. We formulate the problem as an N-ary hypothesis testing problem, jointly optimizing the sensor placement and detection policies at the fusion center. We prove that uniform sensor placement is never strictly optimal when the number of sensors $(M)$ equals the number of placement points $(N)$. We prove that for $N_{2} > N_{1} > M$, where $N_{1},N_{2}$ are number of placement points, the framework utilizing $M$ sensors and $N_{1}$ placement points has the same optimal placement structure as the one utilizing $M$ sensors and $N_{2}$ placement points. For $M\leq 5$ and for fixed $P_{_{D}}$, increasing $P_{_{F}}$ leads to optimal placements that are higher in the majorization-based placement scale. Similarly for $M\leq 5$ and for fixed $P_{_{F}}$, increasing $P_{_{D}}$ leads to optimal placements that are higher in the majorization-based placement scale. For $M>5$, this result does not necessarily hold and we provide a simple counterexample. It is conjectured that the set of optimal placements for a given $(M,N)$ can always be placed on a majorization-based placement scale.

0 citations0 reviewsNo code linkedOpen access