BZPEERReading, trust and collaboration for research
Menu

Discover

GraphFollow connections around a paper, topic or saved view.

Workspaces

HomePick up where your research flow left off.InboxHandle requests, replies and notifications from one place.CollectionsCurate reading lists, evidence sets and shareable dossiers.ResearchSee your private provenance graph, trail and imports.CollaborationMove from discovery into focused discussion rooms.PublishDraft, preview and publish full-text research articles.

Network

ExpertsFind specialists worth following or asking for help.CommunitiesJoin research circles organized around shared work.PartnersSee external organizations active around the same topics.

Opportunities

ListingsBrowse roles, calls and collaborations with clearer fit signals.

Account

Log inReturn to your reading and collaboration workspace.Create accountStart saving work, following people and joining teams.
Log inCreate account

Researcher profile

Roy S. Smith

Roy S. Smith contributes to research discovery and scholarly infrastructure.

ResearcherAffiliation not importedOpen to collaborate
eess.SYSystems and Controlmath.OCeess.SPMachine Learning

Trust snapshot

Quick read

Trust 21 - EmergingVerification L1Unclaimed author
14works
0followers
5topics
4close collaborators

Actions

Decide how to stay connected

Follow researcher0

Identity and collaboration

How to connect with this researcher

Claiming links this public author record to a researcher profile and unlocks direct collaboration workflows.

Log in to claim

Direct collaboration

Open a focused conversation when the fit is right

Claim this author entity first to unlock direct invitations.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

14 published item(s)

preprint2022arXiv

An explicit dual control approach for constrained reference tracking of uncertain linear systems

A finite horizon optimal tracking problem is considered for linear dynamical systems subject to parametric uncertainties in the state-space matrices and exogenous disturbances. A suboptimal solution is proposed using a model predictive control (MPC) based explicit dual control approach which enables active uncertainty learning. A novel algorithm for the design of robustly invariant online terminal sets and terminal controllers is presented. Set membership identification is used to update the parameter uncertainty online. A predicted worst-case cost is used in the MPC optimization problem to model the dual effect of the control input. The cost-to-go is estimated using contractivity of the proposed terminal set and the remaining time horizon, so that the optimizer can estimate future benefits of exploration. The proposed dual control algorithm ensures robust constraint satisfaction and recursive feasibility, and navigates the exploration-exploitation trade-off using a robust performance metric.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Physics-informed linear regression is competitive with two Machine Learning methods in residential building MPC

Because physics-based building models are difficult to obtain as each building is individual, there is an increasing interest in generating models suitable for building MPC directly from measurement data. Machine learning methods have been widely applied to this problem and validated mostly in simulation; there are, however, few studies on a direct comparison of different models or validation in real buildings to be found in the literature. Methods that are indeed validated in application often lead to computationally complex non-convex optimization problems. Here we compare physics-informed Autoregressive-Moving-Average with Exogenous Inputs (ARMAX) models to Machine Learning models based on Random Forests and Input Convex Neural Networks and the resulting convex MPC schemes in experiments on a practical building application with the goal of minimizing energy consumption while maintaining occupant comfort, and in a numerical case study. We demonstrate that Predictive Control in general leads to savings between 26% and 49% of heating and cooling energy, compared to the building's baseline hysteresis controller. Moreover, we show that all model types lead to satisfactory control performance in terms of constraint satisfaction and energy reduction. However, we also see that the physics-informed ARMAX models have a lower computational burden, and a superior sample efficiency compared to the Machine Learning based models. Moreover, even if abundant training data is available, the ARMAX models have a significantly lower prediction error than the Machine Learning models, which indicates that the encoded physics-based prior of the former cannot independently be found by the latter.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Regret Analysis of Online Gradient Descent-based Iterative Learning Control with Model Mismatch

In Iterative Learning Control (ILC), a sequence of feedforward control actions is generated at each iteration on the basis of partial model knowledge and past measurements with the goal of steering the system toward a desired reference trajectory. This is framed here as an online learning task, where the decision-maker takes sequential decisions by solving a sequence of optimization problems having only partial knowledge of the cost functions. Having established this connection, the performance of an online gradient-descent based scheme using inexact gradient information is analyzed in the setting of dynamic and static regret, standard measures in online learning. Fundamental limitations of the scheme and its integration with adaptation mechanisms are further investigated, followed by numerical simulations on a benchmark ILC problem.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Robust MPC with data-driven demand forecasting for frequency regulation with heat pumps

With the increased amount of volatile renewable energy sources connected to the electricity grid, and the phase-out of fossil fuel based power plants, there is an increased need for frequency regulation. On the demand side, frequency regulation services can be offered by buildings or districts that are equipped with electric heating or cooling systems, by exploiting their thermal inertia. Existing approaches for tapping into this potential typically rely on dynamic building models, which in practice can be challenging to obtain and maintain. As a result, practical implementations of such systems are scarce. Moreover, actively controlling buildings requires extensive control infrastructure and may cause privacy concerns in district energy systems. Motivated by this, we exploit the thermal inertia of buffer storage for reserves, reducing the building models to demand forecasts here. By combining a control scheme based on Robust Model Predictive Control, with affine policies, and heating demand forecasting based on Artificial Neural Networks with online correction methods, we offer frequency regulation reserves and maintain user comfort with a system comprising a heat pump and buffer storage. While the robust approach ensures occupant comfort, the use of affine policies reduces the effect of disturbance uncertainty on the system state. In a first-of-its-kind experiment with a real district-like building energy system, we demonstrate that the scheme is able to offer reserves in a variety of conditions and track a regulation signal while meeting the heating demand of the connected buildings. 13.4% of the consumed electricity is flexible. In additional numerical studies, we demonstrate that using affine policies significantly decreases the cost function and increases the amount of offered reserves and we investigate the suboptimality in comparison to an omniscient control system.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Scalable Power System Line Upgrade Planning With Policy Constraints: A "Branch and Benders" Approach

The integration of more renewable energy sources into the power system is presenting system operators with various challenges. At the distribution system level, voltage magnitudes that violate operating limits near large photovoltaic installations have been observed. While these issues can be partially mitigated with more advanced control, hardware upgrades are required at some point. This work presents a scalable, optimization-based approach for deciding which lines in a network to upgrade. Compared to existing approaches, it explicitly takes the operating policy of the system into account and provides both reasonable solutions in short computation times as well as globally optimal solutions when run to completion. Compared to earlier work on the same topic, an extended computational approach is taken that can simultaneously optimize for many load scenarios across arbitrary configurations of machines and CPU cores per machine in a scalable manner by using the Benders decomposition. In addition to the theory, numerical experiments are presented along with a discussion of the scaling properties of the Benders-based approach, giving potential users a better basis to decide whether their problem is big enough for the approach to make sense.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Scalable tube model predictive control of uncertain linear systems using ellipsoidal sets

This work proposes a novel robust model predictive control (MPC) algorithm for linear systems affected by dynamic model uncertainty and exogenous disturbances. The uncertainty is modeled using a linear fractional perturbation structure with a time-varying perturbation matrix, enabling the algorithm to be applied to a large model class. The MPC controller constructs a state tube as a sequence of parameterized ellipsoidal sets to bound the state trajectories of the system. The proposed approach results in a semidefinite program to be solved online, whose size scales linearly with the order of the system. The design of the state tube is formulated as an offline optimization problem, which offers flexibility to impose desirable features such as robust invariance on the terminal set. This contrasts with most existing tube MPC strategies using polytopic sets in the state tube, which are difficult to design and whose complexity grows combinatorially with the system order. The algorithm guarantees constraint satisfaction, recursive feasibility, and stability of the closed loop. The advantages of the algorithm are demonstrated using two simulation studies.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

The Existence and Uniqueness of Solutions for Kernel-Based System Identification

The notion of reproducing kernel Hilbert space (RKHS) has emerged in system identification during the past decade. In the resulting framework, the impulse response estimation problem is formulated as a regularized optimization defined on an infinite-dimensional RKHS consisting of stable impulse responses. The consequent estimation problem is well-defined under the central assumption that the convolution operators restricted to the RKHS are continuous linear functionals. Moreover, according to this assumption, the representer theorem hold, and therefore, the impulse response can be estimated by solving a finite-dimensional program. Thus, the continuity feature plays a significant role in kernel-based system identification. This paper shows that this central assumption is guaranteed to be satisfied in considerably general situations, namely when the kernel is an integrable function and the input signal is bounded. Furthermore, the strong convexity of the optimization problem and the continuity property of the convolution operators imply that the kernel-based system identification admits a unique solution. Consequently, it follows that kernel-based system identification is a well-defined approach.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Active exploration in adaptive model predictive control

A dual adaptive model predictive control (MPC) algorithm is presented for linear, time-invariant systems subject to bounded disturbances and parametric uncertainty in the state-space matrices. Online set-membership identification is performed to reduce the uncertainty and thus control affects both the informativity of identification and the system's performance. The main contribution of the paper is to include this dual effect in the MPC optimization problem using a predicted worst-case cost in the objective function. This allows the controller to perform active exploration, that is, the control input reduces the uncertainty in the regions of the parameter space that have most influence on the performance. Additionally, the MPC algorithm ensures robust constraint satisfaction of state and input constraints. Advantages of the proposed algorithm are shown by comparing it to a passive adaptive MPC algorithm from the literature.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Cascade Control: Data-Driven Tuning Approach Based on Bayesian Optimization

Cascaded controller tuning is a multi-step iterative procedure that needs to be performed routinely upon maintenance and modification of mechanical systems. An automated data-driven method for cascaded controller tuning based on Bayesian optimization is proposed. The method is tested on a linear axis drive, modeled using a combination of first principles model and system identification. A custom cost function based on performance indicators derived from system data at different candidate configurations of controller parameters is modeled by a Gaussian process. It is further optimized by minimization of an acquisition function which serves as a sampling criterion to determine the subsequent candidate configuration for experimental trial and improvement of the cost model iteratively, until a minimum according to a termination criterion is found. This results in a data-efficient procedure that can be easily adapted to varying loads or mechanical modifications of the system. The method is further compared to several classical methods for auto-tuning, and demonstrates higher performance according to the defined data-driven performance indicators. The influence of the training data on a cost prior on the number of iterations required to reach optimum is studied, demonstrating the efficiency of the Bayesian optimization tuning method.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Convex Nonparametric Formulation for Identification of Gradient Flows

In this paper, we develop a nonparametric system identification method for the nonlinear gradient-flow dynamics. In these systems, the vector field is the gradient field of a potential energy function. This fundamental fact about the dynamics of system plays the role of a structural prior knowledge as well as a constraint in the proposed identification method. While the nature of the identification problem is an estimation in the space of functions, we derive an equivalent finite dimensional formulation, which is a convex optimization in form of a quadratic program. This gives scalability of the problem and provides the opportunity for utilizing recently developed large-scale optimization solvers. The central idea in the proposed method is representing the energy function as a difference of two convex functions and estimating these convex functions jointly. Based on necessary and sufficient conditions for function convexity, the identification problem is formulated, and then, the existence, uniqueness and smoothness of the solution is addressed. We also illustrate the method numerically for a demonstrative example.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Distributed Control Design for Heterogeneous Interconnected Systems

This paper presents scalable controller synthesis methods for heterogeneous and partially heterogeneous systems. First, heterogeneous systems composed of different subsystems that are interconnected over a directed graph are considered. Techniques from robust and gain-scheduled controller synthesis are employed, in particular the full-block S-procedure, to deal with the decentralized system part in a nominal condition and with the interconnection part in a multiplier condition. Under some structural assumptions, we can decompose the synthesis conditions into conditions that are the size of the individual subsystems. To solve these decomposed synthesis conditions that are coupled only over neighboring subsystems, we propose a distributed method based on the alternating direction method of multipliers. It only requires nearest-neighbor communication and no central coordination is needed. Then, a new classification of systems is introduced that consists of groups of homogeneous subsystems with different interconnection types. This classification includes heterogeneous systems as the most general and homogeneous systems as the most specific case. Based on this classification, we show how the interconnected system model and the decomposed synthesis conditions can be formulated in a more compact way. The computational scalability of the presented methods with respect to a growing number of subsystems and interconnections is analyzed, and the results are demonstrated in numerical examples.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Graph-theoretic optimization for edge consensus

We consider network structures that optimize the $\mathcal{H}_2$ norm of weighted, time scaled consensus networks, under a minimal representation of such consensus networks described by the edge Laplacian. We show that a greedy algorithm can be used to find the minimum-$\mathcal{H}_2$ norm spanning tree, as well as how to choose edges to optimize the $\mathcal{H}_2$ norm when edges are added back to a spanning tree. In the case of edge consensus with a measurement model considering all edges in the graph, we show that adding edges between slow nodes in the graph provides the smallest increase in the $\mathcal{H}_2$ norm.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Nonlinear System Identification with Prior Knowledge of the Region of Attraction

We consider the problem of nonlinear system identification when prior knowledge is available on the region of attraction (ROA) of an equilibrium point. We propose an identification method in the form of an optimization problem, minimizing the fitting error and guaranteeing the desired stability property. The problem is approached by joint identification the dynamics and a Lyapunov function verifying the stability property. In this setting, the hypothesis set is a reproducing kernel Hilbert space, and with respect to each point of the given subset of the ROA, the Lie derivative inequality of the Lyapunov function imposes a constraint. The problem is a non-convex infinite-dimensional optimization with infinite number of constraints. To obtain a tractable formulation, only a suitably designed finite subset of the constraints are considered. The resulting problem admits a solution in form of a linear combination of the sections of the kernel and its derivatives. An equivalent optimization problem with a quadratic cost function subject to linear and bilinear constraints is derived. A suitable change of variable gives a convex reformulation of the problem. To reduce the number of hyperparameters, the optimization problem is adapted to the case of diagonal kernels. The method is demonstrate by means of an example.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Performance-Driven Cascade Controller Tuning with Bayesian Optimization

We propose a performance-based autotuning method for cascade control systems, where the parameters of a linear axis drive motion controller from two control loops are tuned jointly. Using Bayesian optimization as all parameters are tuned simultaneously, the method is guaranteed to converge asymptotically to the global optimum of the cost. The data-efficiency and performance of the method are studied numerically for several training configurations and compared numerically to those achieved with classical tuning methods and to the exhaustive evaluation of the cost. On the real system, the tracking performance and robustness against disturbances are compared experimentally to nominal tuning. The numerical study and the experimental data both demonstrate that the proposed automated tuning method is efficient in terms of required tuning iterations, robust to disturbances, and results in improved tracking.

0 citations0 reviewsNo code linkedOpen access