Source author record

Huai-Ning Wu

Huai-Ning Wu appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Systems and Control Machine Learning math.OC math.AP

Catalog footprint

What is connected

3works

4topics

4close collaborators

Actions

Connect this record

Open graph Browse works

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

preprint2014arXiv

Distributed Consensus Observers Based H-infinity Control of Dissipative PDE Systems Using Sensor Networks

This paper considers the problem of finite dimensional output feedback H-infinity control for a class of nonlinear spatially distributed processes (SDPs) described by highly dissipative partial differential equations (PDEs), whose state is observed by a sensor network (SN) with a given topology. A highly dissipative PDE system typically involves a spatial differential operator with eigenspectrum that can be partitioned into a finite-dimensional slow one and an infinite-dimensional stable fast complement. Motivated by this fact, the modal decomposition and singular perturbation techniques are initially applied to the PDE system to derive a finite dimensional ordinary differential equation model, which accurately captures the dynamics of the slow modes of the PDE system. Subsequently, based on the slow system and the topology of the SN, a set of finite dimensional distributed consensus observers are constructed to estimate the state of the slow system. Then, a centralized control scheme, which only uses the available estimates from a specified group of SN nodes, is proposed for the PDE system. An H-infinity control design method is developed in terms of bilinear matrix inequality (BMI), such that the original closed-loop PDE system is exponentially stable and a prescribed level of disturbance attenuation is satisfied for the slow system. Furthermore, a suboptimal H-infinity controller is also provided to make the attenuation level as small as possible, which can be obtained via a local optimization algorithm that treats the BMI as double linear matrix inequality. Finally, the proposed method is applied to the control of one dimensional Kuramoto-Sivashinsky equation (KSE) system.

preprint2014arXiv

Off-policy reinforcement learning for $ H_\infty $ control design

The $H_\infty$ control design problem is considered for nonlinear systems with unknown internal system model. It is known that the nonlinear $ H_\infty $ control problem can be transformed into solving the so-called Hamilton-Jacobi-Isaacs (HJI) equation, which is a nonlinear partial differential equation that is generally impossible to be solved analytically. Even worse, model-based approaches cannot be used for approximately solving HJI equation, when the accurate system model is unavailable or costly to obtain in practice. To overcome these difficulties, an off-policy reinforcement leaning (RL) method is introduced to learn the solution of HJI equation from real system data instead of mathematical system model, and its convergence is proved. In the off-policy RL method, the system data can be generated with arbitrary policies rather than the evaluating policy, which is extremely important and promising for practical systems. For implementation purpose, a neural network (NN) based actor-critic structure is employed and a least-square NN weight update algorithm is derived based on the method of weighted residuals. Finally, the developed NN-based off-policy RL method is tested on a linear F16 aircraft plant, and further applied to a rotational/translational actuator system.

preprint2013arXiv

Data-based approximate policy iteration for nonlinear continuous-time optimal control design

This paper addresses the model-free nonlinear optimal problem with generalized cost functional, and a data-based reinforcement learning technique is developed. It is known that the nonlinear optimal control problem relies on the solution of the Hamilton-Jacobi-Bellman (HJB) equation, which is a nonlinear partial differential equation that is generally impossible to be solved analytically. Even worse, most of practical systems are too complicated to establish their accurate mathematical model. To overcome these difficulties, we propose a data-based approximate policy iteration (API) method by using real system data rather than system model. Firstly, a model-free policy iteration algorithm is derived for constrained optimal control problem and its convergence is proved, which can learn the solution of HJB equation and optimal control policy without requiring any knowledge of system mathematical model. The implementation of the algorithm is based on the thought of actor-critic structure, where actor and critic neural networks (NNs) are employed to approximate the control policy and cost function, respectively. To update the weights of actor and critic NNs, a least-square approach is developed based on the method of weighted residuals. The whole data-based API method includes two parts, where the first part is implemented online to collect real system information, and the second part is conducting offline policy iteration to learn the solution of HJB equation and the control policy. Then, the data-based API algorithm is simplified for solving unconstrained optimal control problem of nonlinear and linear systems. Finally, we test the efficiency of the data-based API control design method on a simple nonlinear system, and further apply it to a rotational/translational actuator system. The simulation results demonstrate the effectiveness of the proposed method.