Source author record

Bernd R. Noack

Bernd R. Noack appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

22works
11topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

22 published item(s)

preprint2022arXiv

A fast converging particle swarm optimization through targeted, position-mutated, elitism (PSO-TPME)

We dramatically improve convergence speed and global exploration capabilities of particle swarm optimization (PSO) through a targeted position-mutated elitism (PSO-TPME). The three key innovations address particle classification, elitism, and mutation in the cognitive and social model. PSO-TPME is benchmarked against five popular PSO variants for multi-dimensional functions, which are extensively adopted in the optimization field, In particular, the convergence accuracy, convergence speed, and the capability to find global minima is investigated. The statistical error is assessed by numerous repetitions. The simulations demonstrate that proposed PSO variant outperforms the other variants in terms of convergence rate and accuracy by orders of magnitude.

preprint2022arXiv

Trajectory-optimized cluster-based network model for the sphere wake

We propose a novel trajectory-optimized Cluster-based Network Model (tCNM) for nonlinear model order reduction from time-resolved data following Li et al. ["Cluster-based network model, " J. Fluid Mech. 906, A21 (2021)] and improving the accuracy for a given number of centroids. The starting point is k-means++ clustering which minimizes the representation error of the snapshots by their closest centroids. The dynamics is presented by 'flights' between the centroids. The proposed trajectory-optimized clustering aims to reduce the kinematic representation error further by shifting the centroids closer to the snapshot trajectory and refining state propagation with trajectory support points. Thus, curved trajectories are better resolved. The resulting tCNM is demonstrated for the sphere wake for three flow regimes, including the periodic, quasi-periodic, and chaotic dynamics. The representation error of tCNM is 5 times smaller as compared to the approximation by the closest centroid. Thus, the error at the same level as Proper Orthogonal Decomposition (POD) of same order. Yet, tCNM has distinct advantages over POD modeling: it is human interpretable by representing dynamics by a handful of coherent structures and their transitions; it shows robust dynamics by design, i.e., stable long-time behavior; and its development is fully automatable, i.e., it does not require tuneable auxiliary closure and other models.

preprint2022arXiv

xMLC -- A Toolkit for Machine Learning Control

xMLC is the second book of this `Machine Learning Tools in Fluid Mechanics' Series and focuses on Machine Learning Control (MLC). The objectives of this book are two-fold: First, provide an introduction to MLC for students, researchers, and newcomers on the field; and second, share an open-source code, xMLC, to automatically learn open- and closed-loop control laws directly in the plant with only a few executable commands. This presented MLC algorithm is based on genetic programming and highlights the learning principles (exploration and exploitation). The need of balance between these two principles is illustrated with an extensive parametric study where the explorative and exploitative forces are gradually integrated in the optimization process. The provided software xMLC is an implementation of MLC. It builds on OpenMLC (Duriez et al., 2017) but replaces tree-based genetic programming but the linear genetic programming framework (Brameier and Banzhaf, 2006). The latter representation is preferred for its easier implementation of multiple-input multiple-output control laws and of the genetic operators (mutation and crossover). The handling of the software is facilitated by a step by step guide that shall help new practitioners to use the code within few minutes. We also provide detailed advice in using the code for other solvers and for experiments. The code is open-source and a GitHub version is available for future updates, options and add-ons.

preprint2021arXiv

Cluster-based hierarchical network model of the fluidic pinball -- Cartographing transient and post-transient, multi-frequency, multi-attractor behaviour

We propose a self-supervised cluster-based hierarchical reduced-order modelling methodology to model and analyse the complex dynamics arising from a sequence of bifurcations for a two-dimensional incompressible flow of the unforced fluidic pinball. The hierarchy is guided by a triple decomposition separating a slowly varying base flow, dominant shedding and secondary flow structures. All these flow components are kinematically resolved by a hierarchy of clusters, starting with the base flow in the first layer, resolving the vortex shedding in the second layer and distilling the secondary flow structures in the third layer. The transition dynamics between these clusters is described by a directed network, called the cluster-based hierarchical network model (HiCNM) in the sequel. Three consecutive Reynolds number regimes for different dynamics are considered: (i) periodic shedding at $Re=80$, (ii) quasi-periodic shedding at $Re=105$, and (iii) chaotic shedding at $Re=130$, involving three unstable fixed points, three limit cycles, two quasi-periodic attractors and a chaotic attractor. The HiCNM enables identifying the transient and post-transient dynamics between multiple invariant sets in a self-supervised manner. Both the global trends and the local structures during the transition are well resolved by a moderate number of hierarchical clusters. The proposed reduced-order modelling provides a visual representation of transient and post-transient, multi-frequency, multi-attractor behaviour and may automate the identification and analysis of complex dynamics with multiple scales and multiple invariant sets.

preprint2021arXiv

Stabilization of the fluidic pinball with gradient-enriched machine learning control

We stabilize the flow past a cluster of three rotating cylinders, the fluidic pinball, with automated gradient-enriched machine learning algorithms. The control laws command the rotation speed of each cylinder in an open- and closed-loop manner. These laws are optimized with respect to the average distance from the target steady solution in three successively richer search spaces. First, stabilization is pursued with steady symmetric forcing. Second, we allow for asymmetric steady forcing. And third, we determine an optimal feedback controller employing nine velocity probes downstream. As expected, the control performance increases with every generalization of the search space. Surprisingly, both open- and closed-loop optimal controllers include an asymmetric forcing, which surpasses symmetric forcing. Intriguingly, the best performance is achieved by a combination of phasor control and asymmetric steady forcing. We hypothesize that asymmetric forcing is typical for pitchfork bifurcated dynamics of nominally symmetric configurations. Key enablers are automated machine learning algorithms augmented with gradient search: explorative gradient method for the open-loop parameter optimization and a gradient-enriched machine learning control (gMLC) for the feedback optimization. gMLC learns the control law significantly faster than previously employed genetic programming control. The gMLC source code is freely available online.

preprint2020arXiv

Artificial intelligence control of a turbulent jet

An artificial intelligence (AI) control system is developed to maximize the mixing rate of a turbulent jet. This system comprises six independently operated unsteady minijet actuators, two hot-wire sensors placed in the jet, and genetic programming for the unsupervised learning of a near-optimal control law. The ansatz of this law includes multi-frequency open-loop forcing, sensor-feedback and nonlinear combinations thereof. Mixing performance is quantified by the decay rate of the centreline mean velocity of jet. Intriguingly, the learning process of AI control discovers the classical forcings, i.e. axisymmetric, helical and flapping achievable from conventional control techniques, one by one in the order of increased performance, and finally converges to a hitherto unexplored forcing. Careful examination of the control landscape unveils typical control laws, generated in the learning process, and their evolutions. The best AI forcing produces a complex turbulent flow structure that is characterized by periodically generated mushroom structures, helical motion and oscillating jet column, all enhancing the mixing rate and vastly outperforming others. Being never reported before, this flow structure is examined in various aspects, including the velocity spectra, mean and fluctuating velocity fields and their downstream evolution, and flow visualization images in three orthogonal planes, all compared with other classical flow structures. Along with the knowledge of the minijet-produced flow and its effect on the initial condition of the main jet, these aspects cast valuable insight into the physics behind the highly effective mixing of this newly found flow structure. The results point to the great potential of AI in conquering the vast opportunity space of control laws for many actuators and sensors and in optimizing turbulence.

preprint2020arXiv

Towards human-interpretable, automated learning of feedback control for the mixing layer

We propose an automated analysis of the flow control behaviour from an ensemble of control laws and associated time-resolved flow snapshots. The input may be the rich data base of machine learning control (MLC) optimizing a feedback law for a cost function in the plant. The proposed methodology provides (1) insights into control landscape which maps control laws to performance including extrema and ridge-lines, (2) a catalogue of representative flow states and their contribution to cost function for investigated control laws and (3) a visualization of the dynamics. Key enablers are classification and feature extraction methods of machine learning. The analysis is successfully applied to the stabilization of a mixing layer with sensor-based feedback driving an upstream actuator. The fluctuation energy is reduced by 26\%. The control replaces unforced Kelvin-Helmholtz vortices with subsequent vortex pairing by higher-frequency Kelvin-Helmholtz structures of lower energy. These efforts target a human interpretable, fully automated analysis of MLC identifying qualitatively different actuation regimes, distilling corresponding coherent structures, and developing a digital twin of the plant.

preprint2016arXiv

Cluster-based control of nonlinear dynamics

The ability to manipulate and control fluid flows is of great importance in many scientific and engineering applications. Here, a cluster-based control framework is proposed to determine optimal control laws with respect to a cost function for unsteady flows. The proposed methodology frames high-dimensional, nonlinear dynamics into low-dimensional, probabilistic, linear dynamics which considerably simplifies the optimal control problem while preserving nonlinear actuation mechanisms. The data-driven approach builds upon a state space discretization using a clustering algorithm which groups kinematically similar flow states into a low number of clusters. The temporal evolution of the probability distribution on this set of clusters is then described by a Markov model. The Markov model can be used as predictor for the ergodic probability distribution for a particular control law. This probability distribution approximates the long-term behavior of the original system on which basis the optimal control law is determined. The approach is applied to a separating flow dominated by the Kelvin-Helmholtz shedding.

preprint2016arXiv

Prediction of Dynamical Systems by Symbolic Regression

We study the modeling and prediction of dynamical systems based on conventional models derived from measurements. Such algorithms are highly desirable in situations where the underlying dynamics are hard to model from physical principles or simplified models need to be found. We focus on symbolic regression methods as a part of machine learning. These algorithms are capable of learning an analytically tractable model from data, a highly valuable property. Symbolic regression methods can be considered as generalized regression methods. We investigate two particular algorithms, the so-called fast function extraction which is a generalized linear regression algorithm, and genetic programming which is a very general method. Both are able to combine functions in a certain way such that a good model for the prediction of the temporal evolution of a dynamical system can be identified. We illustrate the algorithms by finding a prediction for the evolution of a harmonic oscillator based on measurements, by detecting an arriving front in an excitable system, and as a real-world application, the prediction of solar power production based on energy production observations at a given site together with the weather forecast.

preprint2015arXiv

Closed-loop separation control over a sharp edge ramp using Genetic Programming

We experimentally perform open and closed-loop control of a separating turbulent boundary layer downstream from a sharp edge ramp. The turbulent boundary layer just above the separation point has a Reynolds number $Re_θ\approx 3\,500$ based on momentum thickness. The goal of the control is to mitigate separation and early re-attachment. The forcing employs a spanwise array of active vortex generators. The flow state is monitored with skin-friction sensors downstream of the actuators. The feedback control law is obtained using model-free genetic programming control (GPC) (Gautier et al. 2015). The resulting flow is assessed using the momentum coefficient, pressure distribution and skin friction over the ramp and stereo PIV. The PIV yields vector field statistics, e.g. shear layer growth, the backflow area and vortex region. GPC is benchmarked against the best periodic forcing. While open-loop control achieves separation reduction by locking-on the shedding mode, GPC gives rise to similar benefits by accelerating the shear layer growth. Moreover, GPC uses less actuation energy.

preprint2015arXiv

Feedback Control of Turbulent Shear Flows by Genetic Programming

Turbulent shear flows have triggered fundamental research in nonlinear dynamics, like transition scenarios, pattern formation and dynamical modeling. In particular, the control of nonlinear dynamics is subject of research since decades. In this publication, actuated turbulent shear flows serve as test-bed for a nonlinear feedback control strategy which can optimize an arbitrary cost function in an automatic self-learning manner. This is facilitated by genetic programming providing an analytically treatable control law. Unlike control based on PID laws or neural networks, no structure of the control law needs to be specified in advance. The strategy is first applied to low-dimensional dynamical systems featuring aspects of turbulence and for which linear control methods fail. This includes stabilizing an unstable fixed point of a nonlinearly coupled oscillator model and maximizing mixing, i.e.\ the Lyapunov exponent, for forced Lorenz equations. For the first time, we demonstrate the applicability of genetic programming control to four shear flow experiments with strong nonlinearities and intrinsically noisy measurements. These experiments comprise mixing enhancement in a turbulent shear layer, the reduction of the recirculation zone behind a backward facing step, and the optimized reattachment of separating boundary layers. Genetic programming control has outperformed tested optimized state-of-the-art control and has even found novel actuation mechanisms.

preprint2015arXiv

Optimal Nonlinear Eddy Viscosity in Galerkin Models of Turbulent Flows

We propose a variational approach to identification of an optimal nonlinear eddy viscosity as a subscale turbulence representation for POD models. The ansatz for the eddy viscosity is given in terms of an arbitrary function of the resolved fluctuation energy. This function is found as a minimizer of a cost functional measuring the difference between the target data coming from a resolved direct or large-eddy simulation of the flow and its reconstruction based on the POD model. The optimization is performed with a data-assimilation approach generalizing the 4D-VAR method. POD models with optimal eddy viscosities are presented for a 2D incompressible mixing layer at $Re=500$ (based on the initial vorticity thickness and the velocity of the high-speed stream) and a 3D Ahmed body wake at $Re=300,000$ (based on the body height and the free-stream velocity). The variational optimization formulation elucidates a number of interesting physical insights concerning the eddy-viscosity ansatz used. The 20-dimensional model of the mixing-layer reveals a negative eddy-viscosity regime at low fluctuation levels which improves the transient times towards the attractor. The 100-dimensional wake model yields more accurate energy distributions as compared to the nonlinear modal eddy-viscosity benchmark {proposed recently} by Östh et al. (2014). Our methodology can be applied to construct quite arbitrary closure relations and, more generally, constitutive relations optimizing statistical properties of a broad class of reduced-order models.

preprint2014arXiv

Acceleration feature points of unsteady shear flows

In this paper, we propose a novel framework to extract features such as vortex cores and saddle points in two-dimensional unsteady flows. This feature extraction strategy generalizes critical points of snapshot topology in a Galilean-invariant manner, allows to prioritize features according to their strength and longevity, enables to track the temporal evolution of features, is robust against noise and has no subjective parameters. These characteristics are realized via several constitutive elements. First, acceleration is employed as a feature identifier following Goto and Vassilicos (2006), thus ensuring Galilean invariance. Second, the acceleration magnitude is used as basis for a mathematically well-developed scalar field topology. The minima of this field are called acceleration feature points, a superset of the acceleration zeros. These points are discriminated into vortices and saddle points depending the spectral properties of the velocity Jacobian. Third, all operations are based on discrete topology for the scalar field with combinatorial algorithms. This parameter-free foundation allows (1) to use persistence as a physically meaningful importance measure to prioritize feature points, (2) ensures robustness since no differentiation and interpolation need to be performed with the data, and (3) enables a natural and robust tracking algorithm for the temporal feature evolution. In particular, we can track vortex merging events in an unsupervised manner. Data based analyses are presented for an incompressible periodic cylinder wake, an incompressible planar mixing layer and a weakly compressible planar jet. They demonstrate the power of the tracking approach, which provides a spatiotemporal hierarchy of the minima.

preprint2014arXiv

Closed-loop control of an experimental mixing layer using machine learning control

A novel framework for closed-loop control of turbulent flows is tested in an experimental mixing layer flow. This framework, called Machine Learning Control (MLC), provides a model-free method of searching for the best function, to be used as a control law in closed-loop flow control. MLC is based on genetic programming, a function optimization method of machine learning. In this article, MLC is benchmarked against classical open-loop actuation of the mixing layer. Results show that this method is capable of producing sensor-based control laws which can rival or surpass the best open-loop forcing, and be robust to changing flow conditions. Additionally, MLC can detect non-linear mechanisms present in the controlled plant, and exploit them to find a better type of actuation than the best periodic forcing.

preprint2014arXiv

Closed-Loop Turbulence Control Using Machine Learning

We propose a general model-free strategy for feedback control design of turbulent flows. This strategy called 'machine learning control' (MLC) is capable of exploiting nonlinear mechanisms in a systematic unsupervised manner. It relies on an evolutionary algorithm that is used to evolve an ensemble of feedback control laws until minimization of a targeted cost function. This methodology can be applied to any non-linear multiple-input multiple-output (MIMO) system to derive an optimal closed-loop control law. MLC is successfully applied to the stabilization of nonlinearly coupled oscillators exhibiting frequency cross-talk, to the maximization of the largest Lyapunov exponent of a forced Lorenz system, and to the mixing enhancement in an experimental mixing layer flow. We foresee numerous potential applications to most nonlinear MIMO control problems, particularly in experiments.

preprint2014arXiv

Cluster-based reduced-order modelling of a mixing layer

We propose a novel cluster-based reduced-order modelling (CROM) strategy of unsteady flows. CROM combines the cluster analysis pioneered in Gunzburger's group (Burkardt et al. 2006) and and transition matrix models introduced in fluid dynamics in Eckhardt's group (Schneider et al. 2007). CROM constitutes a potential alternative to POD models and generalises the Ulam-Galerkin method classically used in dynamical systems to determine a finite-rank approximation of the Perron-Frobenius operator. The proposed strategy processes a time-resolved sequence of flow snapshots in two steps. First, the snapshot data are clustered into a small number of representative states, called centroids, in the state space. These centroids partition the state space in complementary non-overlapping regions (centroidal Voronoi cells). Departing from the standard algorithm, the probabilities of the clusters are determined, and the states are sorted by analysis of the transition matrix. Secondly, the transitions between the states are dynamically modelled using a Markov process. Physical mechanisms are then distilled by a refined analysis of the Markov process, e.g. using finite-time Lyapunov exponent and entropic methods. This CROM framework is applied to the Lorenz attractor (as illustrative example), to velocity fields of the spatially evolving incompressible mixing layer and the three-dimensional turbulent wake of a bluff body. For these examples, CROM is shown to identify non-trivial quasi-attractors and transition processes in an unsupervised manner. CROM has numerous potential applications for the systematic identification of physical mechanisms of complex dynamics, for comparison of flow evolution models, for the identification of precursors to desirable and undesirable events, and for flow control applications exploiting nonlinear actuation dynamics.

preprint2014arXiv

Control Volume Analysis, Entropy Balance and the Entropy Production in Flow Systems

This chapter concerns "control volume analysis", the standard engineering tool for the analysis of flow systems, and its application to entropy balance calculations. Firstly, the principles of control volume analysis are enunciated and applied to flows of conserved quantities (e.g. mass, momentum, energy) through a control volume, giving integral (Reynolds transport theorem) and differential forms of the conservation equations. Several definitions of steady state are discussed. The concept of "entropy" is then established using Jaynes' maximum entropy method, both in general and in equilibrium thermodynamics. The thermodynamic entropy then gives the "entropy production" concept. Equations for the entropy production are then derived for simple, integral and infinitesimal flow systems. Some technical aspects are examined, including discrete and continuum representations of volume elements, the effect of radiation, and the analysis of systems subdivided into compartments. A Reynolds decomposition of the entropy production equation then reveals an "entropy production closure problem" in fluctuating dissipative systems: even at steady state, the entropy production based on mean flow rates and gradients is not necessarily in balance with the outward entropy fluxes based on mean quantities. Finally, a direct analysis of an infinitesimal element by Jaynes' maximum entropy method yields a theoretical framework with which to predict the steady state of a flow system. This is cast in terms of a "minimum flux potential" principle, which reduces, in different circumstances, to maximum or minimum entropy production (MaxEP or MinEP) principles. It is hoped that this chapter inspires others to attain a deeper understanding and higher technical rigour in the calculation and extremisation of the entropy production in flow systems of all types.

preprint2014arXiv

On the need for a nonlinear subscale turbulence term in POD models as exemplified for a high Reynolds number flow over an Ahmed body

We investigate a hierarchy of eddy-viscosity terms in POD Galerkin models to account for a large fraction of unresolved fluctuation energy. These Galerkin methods are applied to Large Eddy Simulation data for a flow around the vehicle-like bluff body call Ahmed body. This flow has three challenges for any reduced-order model: a high Reynolds number, coherent structures with broadband frequency dynamics, and meta-stable asymmetric base flow states. The Galerkin models are found to be most accurate with modal eddy viscosities as proposed by Rempfer & Fasel (1994). Robustness of the model solution with respect to initial conditions, eddy viscosity values and model order is only achieved for state-dependent eddy viscosities as proposed by Noack, Morzynski & Tadmor (2011). Only the POD system with state-dependent modal eddy viscosities can address all challenges of the flow characteristics. All parameters are analytically derived from the Navier-Stokes based balance equations with the available data. We arrive at simple general guidelines for robust and accurate POD models which can be expected to hold for a large class of turbulent flows.

preprint2013arXiv

An Optimal Model Identification For Oscillatory Dynamics With a Stable Limit Cycle

We propose a general framework for parameter-free identification of a class of dynamical systems. Here, the propagator is approximated in terms of an arbitrary function of the state, in contrast to a polynomial or Galerkin expansion used in traditional approaches. The proposed formulation relies on variational data assimilation using measurement data combined with assumptions on the smoothness of the propagator. This approach is illustrated using a generalized dynamic model describing oscillatory transients from an unstable fixed point to a stable limit cycle and arising in nonlinear stability analysis as an example. This 3-state model comprises an evolution equation for the dominant oscillation and an algebraic manifold for the low- and high-frequency components in an autonomous descriptor system. The proposed optimal model identification technique employs mode amplitudes of the transient vortex shedding in a cylinder wake flow as example measurements. The reconstruction obtained with our technique features distinct and systematic improvements over the well-known mean-field (Landau) model of the Hopf bifurcation. The computational aspect of the identification method is thoroughly validated showing that good reconstructions can also be obtained in the absence of of accurate initial approximations.

preprint2013arXiv

Attractor Control Using Machine Learning

We propose a general strategy for feedback control design of complex dynamical systems exploiting the nonlinear mechanisms in a systematic unsupervised manner. These dynamical systems can have a state space of arbitrary dimension with finite number of actuators (multiple inputs) and sensors (multiple outputs). The control law maps outputs into inputs and is optimized with respect to a cost function, containing physics via the dynamical or statistical properties of the attractor to be controlled. Thus, we are capable of exploiting nonlinear mechanisms, e.g. chaos or frequency cross-talk, serving the control objective. This optimization is based on genetic programming, a branch of machine learning. This machine learning control is successfully applied to the stabilization of nonlinearly coupled oscillators and maximization of Lyapunov exponent of a forced Lorenz system. We foresee potential applications to most nonlinear multiple inputs/multiple outputs control problems, particulary in experiments.

preprint2013arXiv

On long-term boundedness of Galerkin models

We investigate linear-quadratic dynamical systems with energy preserving quadratic terms. These systems arise for instance as Galerkin systems of incompressible flows. A criterion is presented to ensure long-term boundedness of the system dynamics. If the criterion is violated, a globally stable attractor cannot exist for an effective nonlinearity. Thus, the criterion represents a minimum requirement for a physically justified Galerkin model of viscous fluid flows. The criterion is exemplified e.g. for Galerkin systems of two-dimensional cylinder wake flow models in the transient and the post-transient regime, the Lorenz system, and for physical design of a Trefethen-Reddy Galerkin system. There are numerous potential applications of the criterion, for instance system reduction and control of strongly nonlinear dynamical systems.