Source author record

Michel Verhaegen

Michel Verhaegen appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

21works
11topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

21 published item(s)

preprint2022arXiv

Data-enabled predictive control with instrumental variables: the direct equivalence with subspace predictive control

Direct data-driven control has attracted substantial interest since it enables optimization-based control without the need for a parametric model. This paper presents a new Instrumental Variable~(IV) approach to Data-enabled Predictive Control (DeePC) that results in favorable noise mitigation properties, and demonstrates the direct equivalence between DeePC and Subspace Predictive Control (SPC). The methodology relies on the derivation of the characteristic equation in DeePC along the lines of subspace identification algorithms. A particular choice of IVs is presented that is uncorrelated with future noise, but at the same time highly correlated with the data matrix. A simulation study demonstrates the improved performance of the proposed algorithm in the presence of process and measurement noise.

preprint2022arXiv

Structured Sensing Matrix Design for In-sector Compressed mmWave Channel Estimation

Fast millimeter wave (mmWave) channel estimation techniques based on compressed sensing (CS) suffer from low signal-to-noise ratio (SNR) in the channel measurements, due to the use of wide beams. To address this problem, we develop an in-sector CS-based mmWave channel estimation technique that focuses energy on a sector in the angle domain. Specifically, we construct a new class of structured CS matrices to estimate the channel within the sector of interest. To this end, we first determine an optimal sampling pattern when the number of measurements is equal to the sector dimension and then use its subsampled version in the sub-Nyquist regime. Our approach results in low aliasing artifacts in the sector of interest and better channel estimates than benchmark algorithms.

preprint2020arXiv

Convex combination of alternating projection and Douglas-Rachford operators for phase retrieval

We present the convergence analysis of convex combination of the alternating projection and Douglas-Rachford operators for solving the phase retrieval problem. New convergence criteria for iterations generated by the algorithm are established by applying various schemes of numerical analysis and exploring both physical and mathematical characteristics of the phase retrieval problem. Numerical results demonstrate the advantages of the algorithm over the other widely known projection methods in practically relevant simulations.

preprint2016arXiv

Gray Box Identification of State-Space Models Using Difference of Convex Programming

Gray-box identification is prevalent in modeling physical and networked systems. However, due to the non-convex nature of the gray-box identification problem, good initial parameter estimates are crucial for a successful application. In this paper, a new identification method is proposed by exploiting the low-rank and structured Hankel matrix of impulse response. This identification problem is recasted into a difference-of-convex programming problem, which is then solved by the sequential convex programming approach with the associated initialization obtained by nuclear-norm optimization. The presented method aims to achieve the maximum impulse-response fitting while not requiring additional (non-convex) conditions to secure non-singularity of the similarity transformation relating the given state-space matrices to the gray-box parameterized ones. This overcomes a persistent shortcoming in a number of recent contributions on this topic, and the new method can be applied for the structured state-space realization even if the involved system parameters are unidentifiable. The method can be used both for directly estimating the gray-box parameters and for providing initial parameter estimates for further iterative search in a conventional gray-box identification setup.

preprint2016arXiv

Mean and variance of the LQG cost function

Linear Quadratic Gaussian (LQG) systems are well-understood and methods to minimize the expected cost are readily available. Less is known about the statistical properties of the resulting cost function. The contribution of this paper is a set of analytic expressions for the mean and variance of the LQG cost function. These expressions are derived using two different methods, one using solutions to Lyapunov equations and the other using only matrix exponentials. Both the discounted and the non-discounted cost function are considered, as well as the finite-time and the infinite-time cost function. The derived expressions are successfully applied to an example system to reduce the probability of the cost exceeding a given threshold.

preprint2016arXiv

N2SID: Nuclear Norm Subspace Identification

The identification of multivariable state space models in innovation form is solved in a subspace identification framework using convex nuclear norm optimization. The convex optimization approach allows to include constraints on the unknown matrices in the data-equation characterizing subspace identification methods, such as the lower triangular block-Toeplitz of weighting matrices constructed from the Markov parameters of the unknown observer. The classical use of instrumental variables to remove the influence of the innovation term on the data equation in subspace identification is avoided. The avoidance of the instrumental variable projection step has the potential to improve the accuracy of the estimated model predictions, especially for short data length sequences. This is illustrated using a data set from the DaSIy library. An efficient implementation in the framework of the Alternating Direction Method of Multipliers (ADMM) is presented that is used in the validation study.

preprint2016arXiv

Online Optimization with Costly and Noisy Measurements using Random Fourier Expansions

This paper analyzes DONE, an online optimization algorithm that iteratively minimizes an unknown function based on costly and noisy measurements. The algorithm maintains a surrogate of the unknown function in the form of a random Fourier expansion (RFE). The surrogate is updated whenever a new measurement is available, and then used to determine the next measurement point. The algorithm is comparable to Bayesian optimization algorithms, but its computational complexity per iteration does not depend on the number of measurements. We derive several theoretical results that provide insight on how the hyper-parameters of the algorithm should be chosen. The algorithm is compared to a Bayesian optimization algorithm for a benchmark problem and three applications, namely, optical coherence tomography, optical beam-forming network tuning, and robot arm control. It is found that the DONE algorithm is significantly faster than Bayesian optimization in the discussed problems, while achieving a similar or better performance.

preprint2016arXiv

Robust Air Data Sensor Fault Diagnosis With Enhanced Fault Sensitivity Using Moving Horizon Estimation

This paper investigates robust fault diagnosis of multiple air data sensor faults in the presence of winds. The trade-off between robustness to winds and sensitivity to faults is challenging due to simultaneous influence of winds and latent faults on monitored sensors. Different from conventional residual generators that do not consider any constraints, we propose a constrained residual generator using moving horizon estimation. The main contribution is improved fault sensitivity by exploiting known bounds on winds in residual generation. By analyzing the Karush-Kuhn-Tucker conditions of the formulated moving horizon estimation problem, it is shown that this improvement is attributed to active inequality constraints caused by faults. When the weighting matrices in the moving horizon estimation problem are tuned to increase robustness to winds, its fault sensitivity does not simply decrease as one would expect in conventional unconstrained residual generators. Instead, its fault sensitivity increases when the fault is large enough to activate some inequality constraints. This fault sensitivity improvement is not restricted to this particular application, but can be achieved by any general moving horizon estimation based residual generator. A high-fidelity Airbus simulator is used to illustrate the advantage of our proposed approach in terms of fault sensitivity.

preprint2016arXiv

Sparse solution of the Lyapunov equation for large-scale interconnected systems

We consider the problem of computing an approximate banded solution of the continuous-time Lyapunov equation $\underline{A}\underline{X}+\underline{X}\underline{A}^{T}=\underline{P}$, where the coefficient matrices $\underline{A}$ and $\underline{P}$ are large, symmetric banded matrices. The (sparsity) pattern of $\underline{A}$ describes the interconnection structure of a large-scale interconnected system. Recently, it has been shown that the entries of the solution $\underline{X}$ are spatially localized or decaying away from a banded pattern. We show that the decay of the entries of $\underline{X}$ is faster if the condition number of $\underline{A}$ is smaller. By exploiting the decay of entries of $\underline{X}$, we develop two computationally efficient methods for approximating $\underline{X}$ by a banded matrix. For a well-conditioned and sparse banded $\underline{A}$, the computational and memory complexities of the methods scale linearly with the state dimension. We perform extensive numerical experiments that confirm this, and that demonstrate the effectiveness of the developed methods. The methods proposed in this paper can be generalized to (sparsity) patterns of $\underline{A}$ and $\underline{P}$ that are more general than banded matrices. The results of this paper open the possibility for developing computationally efficient methods for approximating the solution of the large-scale Riccati equation by a sparse matrix.

preprint2015arXiv

Data-Driven Robust Receding Horizon Fault Estimation

This paper presents a data-driven receding horizon fault estimation method for additive actuator and sensor faults in unknown linear time-invariant systems, with enhanced robustness to stochastic identification errors. State-of-the-art methods construct fault estimators with identified state-space models or Markov parameters, but they do not compensate for identification errors. Motivated by this limitation, we first propose a receding horizon fault estimator parameterized by predictor Markov parameters. This estimator provides (asymptotically) unbiased fault estimates as long as the subsystem from faults to outputs has no unstable transmission zeros. When the identified Markov parameters are used to construct the above fault estimator, zero-mean stochastic identification errors appear as model uncertainty multiplied with unknown fault signals and online system inputs/outputs (I/O). Based on this fault estimation error analysis, we formulate a mixed-norm problem for the offline robust design that regards online I/O data as unknown. An alternative online mixed-norm problem is also proposed that can further reduce estimation errors when the online I/O data have large amplitudes, at the cost of increased computational burden. Based on a geometrical interpretation of the two proposed mixed-norm problems, systematic methods to tune the user-defined parameters therein are given to achieve desired performance trade-offs. Simulation examples illustrate the benefits of our proposed methods compared to recent literature.

preprint2015arXiv

Direct identification of fault estimation filter for sensor faults

We propose a systematic method to directly identify a sensor fault estimation filter from plant input/output data collected under fault-free condition. This problem is challenging, especially when omitting the step of building an explicit state-space plant model in data-driven design, because the inverse of the underlying plant dynamics is required and needs to be stable. We show that it is possible to address this problem by relying on a system-inversion-based fault estimation filter that is parameterized using identified Markov parameters. Our novel data-driven approach improves estimation performance by avoiding the propagation of model reduction errors originating from identification of the state-space plant model into the designed filter. Furthermore, it allows additional design freedom to stabilize the obtained filter under the same stabilizability condition as the existing model-based system inversion. This crucial property enables its application to sensor faults in unstable plants, where existing data-driven filter designs could not be applied so far due to the lack of such stability guarantees (even after stabilizing the closed-loop system). A numerical simulation example of sensor faults in an unstable aircraft system illustrates the effectiveness of the proposed new method.

preprint2015arXiv

Identification of Structured LTI MIMO State-Space Models

The identification of structured state-space model has been intensively studied for a long time but still has not been adequately addressed. The main challenge is that the involved estimation problem is a non-convex (or bilinear) optimization problem. This paper is devoted to developing an identification method which aims to find the global optimal solution under mild computational burden. Key to the developed identification algorithm is to transform a bilinear estimation to a rank constrained optimization problem and further a difference of convex programming (DCP) problem. The initial condition for the DCP problem is obtained by solving its convex part of the optimization problem which happens to be a nuclear norm regularized optimization problem. Since the nuclear norm regularized optimization is the closest convex form of the low-rank constrained estimation problem, the obtained initial condition is always of high quality which provides the DCP problem a good starting point. The DCP problem is then solved by the sequential convex programming method. Finally, numerical examples are included to show the effectiveness of the developed identification algorithm.

preprint2014arXiv

Distributed System Identification with ADMM

This paper presents identification of both network connected systems as well as distributed systems governed by PDEs in the framework of distributed optimization via the Alternating Direction Method of Multipliers. This approach opens first the possibility to identify distributed models in a global manner using all available data sequences and second the possibility for a distributed implementation. The latter will make the application to large scale complex systems possible. In addition to outlining a new large scale identification method, illustrations are shown for identifying both network connected systems and discretized PDEs.

preprint2014arXiv

Fast & Furious focal-plane wavefront sensing

We present two complementary algorithms suitable for using focal-plane measurements to control a wavefront corrector with an extremely high spatial resolution. The algorithms use linear approximations to iteratively minimize the aberrations seen by the focal-plane camera. The first algorithm, Fast & Furious (FF), uses a weak-aberration assumption and pupil symmetries to achieve fast wavefront reconstruction. The second algorithm, an extension to FF, can deal with an arbitrary pupil shape; it uses a Gerchberg-Saxton style error reduction to determine the pupil amplitudes. Simulations and experimental results are shown for a spatial light modulator controlling the wavefront with a resolution of 170 x 170 pixels. The algorithms increase the Strehl ratio from ~0.75 to 0.98-0.99, and the intensity of the scattered light is reduced throughout the whole recorded image of 320 x 320 pixels. The remaining wavefront rms error is estimated to be ~0.15 rad with FF and ~0.10 rad with FF-GS.

preprint2014arXiv

Focal-plane wavefront sensing with high-order adaptive optics systems

We investigate methods to calibrate the non-common path aberrations at an adaptive optics system having a wavefront-correcting device working at an extremely high resolution (larger than 150x150). We use focal-plane images collected successively, the corresponding phase-diversity information and numerically efficient algorithms to calculate the required wavefront updates. The wavefront correction is applied iteratively until the algorithms converge. Different approaches are studied. In addition of the standard Gerchberg-Saxton algorithm, we test the extension of the Fast & Furious algorithm that uses three images and creates an estimate of the pupil amplitudes. We also test recently proposed phase-retrieval methods based on convex optimisation. The results indicate that in the framework we consider, the calibration task is easiest with algorithms similar to the Fast & Furious.

preprint2014arXiv

Nuclear Norm Subspace Identification (N2SID) for short data batches

Subspace identification is revisited in the scope of nuclear norm minimization methods. It is shown that essential structural knowledge about the unknown data matrices in the data equation that relates Hankel matrices constructed from input and output data can be used in the first step of the numerical solution presented. The structural knowledge comprises the low rank property of a matrix that is the product of the extended observability matrix and the state sequence and the Toeplitz structure of the matrix of Markov parameters (of the system in innovation form). The new subspace identification method is referred to as the N2SID (twice the N of Nuclear Norm and SID for Subspace IDentification) method. In addition to include key structural knowledge in the solution it integrates the subspace calculation with minimization of a classical prediction error cost function. The nuclear norm relaxation enables us to perform such integration while preserving convexity. The advantages of N2SID are demonstrated in a numerical open- and closed-loop simulation study. Here a comparison is made with another widely used SID method, i.e. N4SID. The comparison focusses on the identification with short data batches, i.e. where the number of measurements is a small multiple of the system order.

preprint2014arXiv

Sparse approximate inverses of Gramians and impulse response matrices of large-scale interconnected systems

In this paper we show that inverses of well-conditioned, finite-time Gramians and impulse response matrices of large-scale interconnected systems described by sparse state-space models, can be approximated by sparse matrices. The approximation methodology established in this paper opens the door to the development of novel methods for distributed estimation, identification and control of large-scale interconnected systems. The novel estimators (controllers) compute local estimates (control actions) simply as linear combinations of inputs and outputs (states) of local subsystems. The size of these local data sets essentially depends on the condition number of the finite-time observability (controllability) Gramian. Furthermore, the developed theory shows that the sparsity patterns of the system matrices of the distributed estimators (controllers) are primarily determined by the sparsity patterns of state-space matrices of large-scale systems. The computational and memory complexity of the approximation algorithms are $O(N)$, where $N$ is the number of local subsystems of the interconnected system. Consequently, the proposed approximation methodology is computationally feasible for interconnected systems with an extremely large number of local subsystems.

preprint2014arXiv

Subspace identification of large-scale interconnected systems

We propose a decentralized subspace algorithm for identification of large-scale, interconnected systems that are described by sparse (multi) banded state-space matrices. First, we prove that the state of a local subsystem can be approximated by a linear combination of inputs and outputs of the local subsystems that are in its neighborhood. Furthermore, we prove that for interconnected systems with well-conditioned, finite-time observability Gramians (or observability matrices), the size of this neighborhood is relatively small. On the basis of these results, we develop a subspace identification algorithm that identifies a state-space model of a local subsystem from the local input-output data. Consequently, the developed algorithm is computationally feasible for interconnected systems with a large number of local subsystems. Numerical results confirm the effectiveness of the new identification algorithm.

preprint2013arXiv

Nonlinear Compressive Particle Filtering

Many systems for which compressive sensing is used today are dynamical. The common approach is to neglect the dynamics and see the problem as a sequence of independent problems. This approach has two disadvantages. Firstly, the temporal dependency in the state could be used to improve the accuracy of the state estimates. Secondly, having an estimate for the state and its support could be used to reduce the computational load of the subsequent step. In the linear Gaussian setting, compressive sensing was recently combined with the Kalman filter to mitigate above disadvantages. In the nonlinear dynamical case, compressive sensing can not be used and, if the state dimension is high, the particle filter would perform poorly. In this paper we combine one of the most novel developments in compressive sensing, nonlinear compressive sensing, with the particle filter. We show that the marriage of the two is essential and that neither the particle filter or nonlinear compressive sensing alone gives a satisfying solution.

preprint2013arXiv

Quadratic Basis Pursuit

In many compressive sensing problems today, the relationship between the measurements and the unknowns could be nonlinear. Traditional treatment of such nonlinear relationships have been to approximate the nonlinearity via a linear model and the subsequent un-modeled dynamics as noise. The ability to more accurately characterize nonlinear models has the potential to improve the results in both existing compressive sensing applications and those where a linear approximation does not suffice, e.g., phase retrieval. In this paper, we extend the classical compressive sensing framework to a second-order Taylor expansion of the nonlinearity. Using a lifting technique and a method we call quadratic basis pursuit, we show that the sparse signal can be recovered exactly when the sampling rate is sufficiently high. We further present efficient numerical algorithms to recover sparse signals in second-order nonlinear systems, which are considerably more difficult to solve than their linear counterparts in sparse optimization.

preprint2012arXiv

Extremely fast focal-plane wavefront sensing for extreme adaptive optics

We present a promising approach to the extremely fast sensing and correction of small wavefront errors in adaptive optics systems. As our algorithm's computational complexity is roughly proportional to the number of actuators, it is particularly suitable to systems with 10,000 to 100,000 actuators. Our approach is based on sequential phase diversity and simple relations between the point-spread function and the wavefront error in the case of small aberrations. The particular choice of phase diversity, introduced by the deformable mirror itself, minimizes the wavefront error as well as the computational complexity. The method is well suited for high-contrast astronomical imaging of point sources such as the direct detection and characterization of exoplanets around stars, and it works even in the presence of a coronagraph that suppresses the diffraction pattern. The accompanying paper in these proceedings by Korkiakoski et al. describes the performance of the algorithm using numerical simulations and laboratory tests.