Source author record

Koen Tiels

Koen Tiels appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

7works
7topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

7 published item(s)

preprint2022arXiv

Decoupling multivariate functions using a nonparametric filtered tensor decomposition

Multivariate functions emerge naturally in a wide variety of data-driven models. Popular choices are expressions in the form of basis expansions or neural networks. While highly effective, the resulting functions tend to be hard to interpret, in part because of the large number of required parameters. Decoupling techniques aim at providing an alternative representation of the nonlinearity. The so-called decoupled form is often a more efficient parameterisation of the relationship while being highly structured, favouring interpretability. In this work two new algorithms, based on filtered tensor decompositions of first order derivative information are introduced. The method returns nonparametric estimates of smooth decoupled functions. Direct applications are found in, i.a. the fields of nonlinear system identification and machine learning.

preprint2020arXiv

A nonlinear model of vortex-induced forces on an oscillating cylinder in a fluid flow

A nonlinear model relating the imposed motion of a circular cylinder, submerged in a fluid flow, to the transverse force coefficient is presented. The nonlinear fluid system, featuring vortex shedding patterns, limit cycle oscillations and synchronisation, is studied both for swept sine and multisine excitation. A nonparametric nonlinear distortion analysis (FAST) is used to distinguish odd from even nonlinear behaviour. The information which is obtained from the nonlinear analysis is explicitly used in constructing a nonlinear model of the polynomial nonlinear state-space (PNLSS) type. The latter results in a reduction of the number of parameters and an increased accuracy compared to the generic modelling approach where typically no such information of the nonlinearity is used. The obtained model is able to accurately simulate time series of the transverse force coefficient over a wide range of the frequency-amplitude plane of imposed cylinder motion.

preprint2020arXiv

Beyond exploding and vanishing gradients: analysing RNN training using attractors and smoothness

The exploding and vanishing gradient problem has been the major conceptual principle behind most architecture and training improvements in recurrent neural networks (RNNs) during the last decade. In this paper, we argue that this principle, while powerful, might need some refinement to explain recent developments. We refine the concept of exploding gradients by reformulating the problem in terms of the cost function smoothness, which gives insight into higher-order derivatives and the existence of regions with many close local minima. We also clarify the distinction between vanishing gradients and the need for the RNN to learn attractors to fully use its expressive power. Through the lens of these refinements, we shed new light on recent developments in the RNN field, namely stable RNN and unitary (or orthogonal) RNNs.

preprint2020arXiv

On the smoothness of nonlinear system identification

We shed new light on the \textit{smoothness} of optimization problems arising in prediction error parameter estimation of linear and nonlinear systems. We show that for regions of the parameter space where the model is not contractive, the Lipschitz constant and $β$-smoothness of the objective function might blow up exponentially with the simulation length, making it hard to numerically find minima within those regions or, even, to escape from them. In addition to providing theoretical understanding of this problem, this paper also proposes the use of multiple shooting as a viable solution. The proposed method minimizes the error between a prediction model and the observed values. Rather than running the prediction model over the entire dataset, multiple shooting splits the data into smaller subsets and runs the prediction model over each subset, making the simulation length a design parameter and making it possible to solve problems that would be infeasible using a standard approach. The equivalence to the original problem is obtained by including constraints in the optimization. The new method is illustrated by estimating the parameters of nonlinear systems with chaotic or unstable behavior, as well as neural networks. We also present a comparative analysis of the proposed method with multi-step-ahead prediction error minimization.

preprint2020arXiv

Retrieving highly structured models starting from black-box nonlinear state-space models using polynomial decoupling

Nonlinear state-space modelling is a very powerful black-box modelling approach. However powerful, the resulting models tend to be complex, described by a large number of parameters. In many cases interpretability is preferred over complexity, making too complex models unfit or undesired. In this work, the complexity of such models is reduced by retrieving a more structured, parsimonious model from the data, without exploiting physical knowledge. Essential to the method is a translation of all multivariate nonlinear functions, typically found in nonlinear state-space models, into sets of univariate nonlinear functions. The latter is computed from a tensor decomposition. It is shown that typically an excess of degrees of freedom are used in the description of the nonlinear system whereas reduced representations can be found. The method yields highly structured state-space models where the nonlinearity is contained in as little as a single univariate function, with limited loss of performance. Results are illustrated on simulations and experiments for: the forced Duffing oscillator, the forced Van der Pol oscillator, a Bouc-Wen hysteretic system, and a Li-Ion battery model.

preprint2016arXiv

Initial estimates for Wiener-Hammerstein models using phase-coupled multisines

Block-oriented models are often used to model nonlinear systems. These models consist of linear dynamic (L) and nonlinear static (N) sub-blocks. This paper addresses the generation of initial estimates for a Wiener-Hammerstein model (LNL cascade). While it is easy to measure the product of the two linear blocks using a Gaussian excitation and linear identification methods, it is difficult to split the global dynamics over the individual blocks. This paper first proposes a well-designed multisine excitation with pairwise coupled random phases. Next, a modified best linear approximation is estimated on a shifted frequency grid. It is shown that this procedure creates a shift of the input dynamics with a known frequency offset, while the output dynamics do not shift. The resulting transfer function, which has complex coefficients due to the frequency shift, is estimated with a modified frequency domain estimation method. The identified poles and zeros can be assigned to either the input or output dynamics. Once this is done, it is shown in the literature that the remaining initialization problem can be solved much easier than the original one. The method is illustrated on experimental data obtained from the Wiener-Hammerstein benchmark system.

preprint2016arXiv

Wiener system identification with generalized orthonormal basis functions

Many nonlinear systems can be described by a Wiener-Schetzen model. In this model, the linear dynamics are formulated in terms of orthonormal basis functions (OBFs). The nonlinearity is modeled by a multivariate polynomial. In general, an infinite number of OBFs is needed for an exact representation of the system. This paper considers the approximation of a Wiener system with finite-order infinite impulse response dynamics and a polynomial nonlinearity. We propose to use a limited number of generalized OBFs (GOBFs). The pole locations, needed to construct the GOBFs, are estimated via the best linear approximation of the system. The coefficients of the multivariate polynomial are determined with a linear regression. This paper provides a convergence analysis for the proposed identification scheme. It is shown that the estimated output converges in probability to the exact output. Fast convergence rates, in the order $O_p({N_F}^{-n_{rep}/2})$, can be achieved, with $N_F$ the number of excited frequencies and $n_{rep}$ the number of repetitions of the GOBFs.