BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

Steven Low

Steven Low appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
Systems and Controlmath.OCeess.SYMachine LearningArtificial IntelligenceComputer Science and Game TheoryEmerging Technologies

Catalog footprint

What is connected

14works
7topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

14 published item(s)

preprint2022arXiv

Equipping Black-Box Policies with Model-Based Advice for Stable Nonlinear Control

Machine-learned black-box policies are ubiquitous for nonlinear control problems. Meanwhile, crude model information is often available for these problems from, e.g., linear approximations of nonlinear dynamics. We study the problem of equipping a black-box control policy with model-based advice for nonlinear control on a single trajectory. We first show a general negative result that a naive convex combination of a black-box policy and a linear model-based policy can lead to instability, even if the two policies are both stabilizing. We then propose an adaptive $λ$-confident policy, with a coefficient $λ$ indicating the confidence in a black-box policy, and prove its stability. With bounded nonlinearity, in addition, we show that the adaptive $λ$-confident policy achieves a bounded competitive ratio when a black-box policy is near-optimal. Finally, we propose an online learning approach to implement the adaptive $λ$-confident policy and verify its efficacy in case studies about the CartPole problem and a real-world electric vehicle (EV) charging problem with data bias due to COVID-19.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Reinforcement Learning for Selective Key Applications in Power Systems: Recent Advances and Future Challenges

With large-scale integration of renewable generation and distributed energy resources, modern power systems are confronted with new operational challenges, such as growing complexity, increasing uncertainty, and aggravating volatility. Meanwhile, more and more data are becoming available owing to the widespread deployment of smart meters, smart sensors, and upgraded communication networks. As a result, data-driven control techniques, especially reinforcement learning (RL), have attracted surging attention in recent years. This paper provides a comprehensive review of various RL techniques and how they can be applied to decision-making and control in power systems. In particular, we select three key applications, i.e., frequency regulation, voltage control, and energy management, as examples to illustrate RL-based models and solutions. We then present the critical issues in the application of RL, i.e., safety, robustness, scalability, and data. Several potential future directions are discussed as well.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Combining Model-Based and Model-Free Methods for Nonlinear Control: A Provably Convergent Policy Gradient Approach

Model-free learning-based control methods have seen great success recently. However, such methods typically suffer from poor sample complexity and limited convergence guarantees. This is in sharp contrast to classical model-based control, which has a rich theory but typically requires strong modeling assumptions. In this paper, we combine the two approaches to achieve the best of both worlds. We consider a dynamical system with both linear and non-linear components and develop a novel approach to use the linear model to define a warm start for a model-free, policy gradient method. We show this hybrid approach outperforms the model-based controller while avoiding the convergence issues associated with model-free approaches via both numerical experiments and theoretical analyses, in which we derive sufficient conditions on the non-linear component such that our approach is guaranteed to converge to the (nearly) global optimal controller.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Learning Optimal Power Flow: Worst-Case Guarantees for Neural Networks

This paper introduces for the first time a framework to obtain provable worst-case guarantees for neural network performance, using learning for optimal power flow (OPF) problems as a guiding example. Neural networks have the potential to substantially reduce the computing time of OPF solutions. However, the lack of guarantees for their worst-case performance remains a major barrier for their adoption in practice. This work aims to remove this barrier. We formulate mixed-integer linear programs to obtain worst-case guarantees for neural network predictions related to (i) maximum constraint violations, (ii) maximum distances between predicted and optimal decision variables, and (iii) maximum sub-optimality. We demonstrate our methods on a range of PGLib-OPF networks up to 300 buses. We show that the worst-case guarantees can be up to one order of magnitude larger than the empirical lower bounds calculated with conventional methods. More importantly, we show that the worst-case predictions appear at the boundaries of the training input domain, and we demonstrate how we can systematically reduce the worst-case guarantees by training on a larger input domain than the domain they are evaluated on.

0 citations0 reviewsNo code linkedOpen access
preprint2018arXiv

Reverse and Forward Engineering of Local Voltage Control in Distribution Networks

The increasing penetration of renewable and distributed energy resources in distribution networks calls for real-time and distributed voltage control. In this paper we investigate local Volt/VAR control with a general class of control functions, and show that the power system dynamics with non-incremental local voltage control can be seen as distributed algorithm for solving a well-defined optimization problem (reverse engineering). The reverse engineering further reveals a fundamental limitation of the non-incremental voltage control: the convergence condition is restrictive and prevents better voltage regulation at equilibrium. This motivates us to design two incremental local voltage control schemes based on the subgradient and pseudo-gradient algorithms respectively for solving the same optimization problem (forward engineering). The new control schemes decouple the dynamical property from the equilibrium property, and have much less restrictive convergence conditions. This work presents another step towards developing a new foundation -- network dynamics as optimization algorithms -- for distributed realtime control and optimization of future power networks.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Event Detection and Localization in Distribution Grids with Phasor Measurement Units

The recent introduction of synchrophasor technology into power distribution systems has given impetus to various monitoring, diagnostic, and control applications, such as system identification and event detection, which are crucial for restoring service, preventing outages, and managing equipment health. Drawing on the existing framework for inferring topology and admittances of a power network from voltage and current phasor measurements, this paper proposes an online algorithm for event detection and localization in unbalanced three-phase distribution systems. Using a convex relaxation and a matrix partitioning technique, the proposed algorithm is capable of identifying topology changes and attributing them to specific categories of events. The performance of this algorithm is evaluated on a standard test distribution feeder with synthesized loads, and it is shown that a tripped line can be detected and localized in an accurate and timely fashion, highlighting its potential for real-world applications.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

A differential analysis of the power flow equations

The AC power flow equations are fundamental in all aspects of power systems planning and operations. They are routinely solved using Newton-Raphson like methods. However, there is little theoretical understanding of when these algorithms are guaranteed to find a solution of the power flow equations or how long they may take to converge. Further, it is known that in general these equations have multiple solutions and can exhibit chaotic behavior. In this paper, we show that the power flow equations can be solved efficiently provided that the solution lies in a certain set. We introduce a family of convex domains, characterized by Linear Matrix Inequalities, in the space of voltages such that there is at most one power flow solution in each of these domains. Further, if a solution exists in one of these domains, it can be found efficiently, and if one does not exist, a certificate of non-existence can also be obtained efficiently. The approach is based on the theory of monotone operators and related algorithms for solving variational inequalities involving monotone operators. We validate our approach on IEEE test networks and show that practical power flow solutions lie within an appropriately chosen convex domain.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Convexity of Energy-Like Functions: Theoretical Results and Applications to Power System Operations

Power systems are undergoing unprecedented transformations with the incorporation of larger amounts of renewable energy sources, distributed generation and demand response. All these changes, while potentially making power grids more responsive, efficient and resilient, also pose significant implementation challenges. In particular, operating the new power grid will require new tools and algorithms capable of predicting if the current state of the system is operationally safe. In this paper we study and generalize the so-called energy function as a tool to design algorithms to test if a high-voltage power transmission system is within the allowed operational limits. In the past the energy function technique was utilized primarily to access the power system transient stability. In this manuscript, we take a new look at energy functions and focus on an aspect that has previously received little attention: Convexity. We characterize the domain of voltage magnitudes and phases within which the energy function is convex. We show that the domain of the energy function convexity is sufficiently large to include most operationally relevant and practically interesting cases. We show how the energy function convexity can be used to analyze power flow equations, e.g. to certify solution uniqueness or non-existence within the domain of convexity. This and other useful features of the generalized energy function are described and illustrated on IEEE 14 and 118 bus models.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Distributed Algorithm for Optimal Power Flow on Unbalanced Multiphase Distribution Networks

The optimal power flow (OPF) problem is funda- mental in power distribution networks control and operation that underlies many important applications such as volt/var control and demand response, etc.. Large-scale highly volatile renewable penetration in the distribution networks calls for real-time feed- back control, and hence the need for distributed solutions for the OPF problem. Distribution networks are inherently unbalanced and most of the existing distributed solutions for balanced networks do not apply. In this paper we propose a solution for unbalanced distribution networks. Our distributed algorithm is based on alternating direction method of multiplier (ADMM). Unlike existing approaches that require to solve semidefinite programming problems in each ADMM macro-iteration, we exploit the problem structures and decompose the OPF problem in such a way that the subproblems in each ADMM macro- iteration reduce to either a closed form solution or eigen-decomposition of a 6x6 hermitian matrix, which significantly reduce the convergence time. We present simulations on IEEE 13, 34, 37 and 123 bus unbalanced distribution networks to illustrate the scalability and optimality of the proposed algorithm.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Solving the power flow equations: a monotone operator approach

The AC power flow equations underlie all operational aspects of power systems. They are solved routinely in operational practice using the Newton-Raphson method and its variants. These methods work well given a good initial "guess" for the solution, which is always available in normal system operations. However, with the increase in levels of intermittent generation, the assumption of a good initial guess always being available is no longer valid. In this paper, we solve this problem using the theory of monotone operators. We show that it is possible to compute (using an offline optimization) a "monotonicity domain" in the space of voltage phasors. Given this domain, there is a simple efficient algorithm that will either find a solution in the domain, or provably certify that no solutions exist in it. We validate the approach on several IEEE test cases and demonstrate that the offline optimization can be performed tractably and the computed "monotonicity domain" includes all practically relevant power flow solutions.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Decentralized Primary Frequency Control in Power Networks

We augment existing generator-side primary frequency control with load-side control that are local, ubiquitous, and continuous. The mechanisms on both the generator and the load sides are decentralized in that their control decisions are functions of locally measurable frequency deviations. These local algorithms interact over the network through nonlinear power flows. We design the local frequency feedback control so that any equilibrium point of the closed-loop system is the solution to an optimization problem that minimizes the total generation cost and user disutility subject to power balance across entire network. With Lyapunov method we derive a sufficient condition ensuring an equilibrium point of the closed-loop system is asymptotically stable. Simulation demonstrates improvement in both the transient and steady-state performance over the traditional control only on the generators, even when the total control capacity remains the same.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

The Role of a Market Maker in Networked Cournot Competition

We study the role of a market maker (or market operator) in a transmission constrained electricity market. We model the market as a one-shot networked Cournot competition where generators supply quantity bids and load serving entities provide downward sloping inverse demand functions. This mimics the operation of a spot market in a deregulated market structure. In this paper, we focus on possible mechanisms employed by the market maker to balance demand and supply. In particular, we consider three candidate objective functions that the market maker optimizes - social welfare, residual social welfare, and consumer surplus. We characterize the existence of Generalized Nash Equilibrium (GNE) in this setting and demonstrate that market outcomes at equilibrium can be very different under the candidate objective functions.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Design and Stability of Load-Side Primary Frequency Control in Power Systems

We present a systematic method to design ubiquitous continuous fast-acting distributed load control for primary frequency regulation in power networks, by formulating an optimal load control (OLC) problem where the objective is to minimize the aggregate cost of tracking an operating point subject to power balance over the network. We prove that the swing dynamics and the branch power flows, coupled with frequency-based load control, serve as a distributed primal-dual algorithm to solve OLC. We establish the global asymptotic stability of a multimachine network under such type of load-side primary frequency control. These results imply that the local frequency deviations at each bus convey exactly the right information about the global power imbalance for the loads to make individual decisions that turn out to be globally optimal. Simulations confirm that the proposed algorithm can rebalance power and resynchronize bus frequencies after a disturbance with significantly improved transient performance.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

Optimal Inverter VAR Control in Distribution Systems with High PV Penetration

The intent of the study detailed in this paper is to demonstrate the benefits of inverter var control on a fast timescale to mitigate rapid and large voltage fluctuations due to the high penetration of photovoltaic generation and the resulting reverse power flow. Our approach is to formulate the volt/var control as a radial optimal power flow (OPF) problem to minimize line losses and energy consumption, subject to constraints on voltage magnitudes. An efficient solution to the radial OPF problem is presented and used to study the structure of optimal inverter var injection and the net benefits, taking into account the additional cost of inverter losses when operating at non-unity power factor. This paper will illustrate how, depending on the circuit topology and its loading condition, the inverter's optimal reactive power injection is not necessarily monotone with respect to their real power output. The results are demonstrated on a distribution feeder on the Southern California Edison system that has a very light load and a 5 MW photovoltaic (PV) system installed away from the substation.

0 citations0 reviewsNo code linkedOpen access