Source author record

Kristian Gustavsson

Kristian Gustavsson appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

physics.flu-dyn eess.SY Machine Learning nlin.CD Systems and Control Artificial Intelligence cond-mat.stat-mech

Catalog footprint

What is connected

6works

7topics

4close collaborators

Actions

Connect this record

Open graph Browse works

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

preprint2021arXiv

Optimal control of point-to-point navigation in turbulent time-dependent flows using Reinforcement Learning

We present theoretical and numerical results concerning the problem to find the path that minimizes the time to navigate between two given points in a complex fluid under realistic navigation constraints. We contrast deterministic Optimal Navigation (ON) control with stochastic policies obtained by Reinforcement Learning (RL) algorithms. We show that Actor-Critic RL algorithms are able to find quasi-optimal solutions in the presence of either time-independent or chaotically evolving flow configurations. For our application, ON solutions develop unstable behavior within the typical duration of the navigation process, and are therefore not useful in practice. We first explore navigation of turbulent flow using a constant propulsion speed. Based on a discretized phase-space, the propulsion direction is adjusted with the aim to minimize the time spent to reach the target. Further, we explore a case where additional control is obtained by allowing the engine to power off. Exploiting advection of the underlying flow, allows the target to be reached with less energy consumption. In this case, we optimize a linear combination between the total navigation time and the total time the engine is switched off. Our approach can be generalized to other setups, for example, navigation under imperfect environmental forecast or with different models for the moving vessel.

preprint2019arXiv

Importance of fluid inertia for the orientation of spheroids settling in turbulent flow

How non-spherical particles orient as they settle in a flow has important practical implications in a number of scientific and engineering problems. In a quiescent fluid, a slowly settling particle orients so that it settles with its broad side first. This is an effect of the torque due to convective inertia of the fluid set in motion by the settling particle, which maximises the drag experienced by the particle. Turbulent flows tend to randomise the particle orientation. Recently the settling of non-spherical particles in turbulence was analysed neglecting the effect of convective fluid inertia, but taking into account the effect of the turbulent fluid-velocity gradients on the particle orientation. These studies reached the opposite conclusion, namely that a rod settles preferentially with its tip first, wheras a disk settles with its edge first, therefore minimizing the drag on the particle. Here, we consider both effects, the convective inertial torque as well as the torque due to fluctuating velocity gradients, and ask under which circumstances either one or the other dominate. To this end we estimate the ratio of the magnitudes of the two torques. Our estimates suggest that the fluid-inertia torque prevails in high-Reynolds number flows. In this case non-spherical particles are expected to settle with a maximal drag. But when the Reynolds number is small then the torque due to fluid-velocity gradients may dominate, causing the particle to settle with its broad side first.

preprint2019arXiv

Zermelo's problem: Optimal point-to-point navigation in 2D turbulent flows using Reinforcement Learning

To find the path that minimizes the time to navigate between two given points in a fluid flow is known as Zermelo's problem. Here, we investigate it by using a Reinforcement Learning (RL) approach for the case of a vessel which has a slip velocity with fixed intensity, Vs , but variable direction and navigating in a 2D turbulent sea. We show that an Actor-Critic RL algorithm is able to find quasi-optimal solutions for both time-independent and chaotically evolving flow configurations. For the frozen case, we also compared the results with strategies obtained analytically from continuous Optimal Navigation (ON) protocols. We show that for our application, ON solutions are unstable for the typical duration of the navigation process, and are therefore not useful in practice. On the other hand, RL solutions are much more robust with respect to small changes in the initial conditions and to external noise, even when V s is much smaller than the maximum flow velocity. Furthermore, we show how the RL approach is able to take advantage of the flow properties in order to reach the target, especially when the steering speed is small.

preprint2016arXiv

Preferential sampling of helicity by isotropic helicoids

We present a theoretical and numerical study on the motion of isotropic helicoids in complex flows. These are particles whose motion is invariant under rotations but not under mirror reflections of the particle. This is the simplest, yet unexplored, extension of the much studied case of small spherical particles. We show that heavy isotropic helicoids, due to the coupling between translational and rotational degrees of freedom, preferentially sample different helical regions in laminar or chaotic advecting flows. This opens the way to control and engineer particles able to track complex flow structures with potential applications to microfluidics and turbulence.

preprint2015arXiv

Analysis of the Correlation Dimension for Inertial Particles

We obtain an implicit equation for the correlation dimension which describes clustering of inertial particles in a complex flow onto a fractal measure. Our general equation involves a propagator of a nonlinear stochastic process in which the velocity gradient of the fluid appears as additive noise. When the long-time limit of the propagator is considered our equation reduces to an existing large-deviation formalism, from which it is difficult to extract concrete results. In the short-time limit, however, our equation reduces to a solvability condition on a partial differential equation. We show how this approach leads to a perturbative expansion of the correlation dimension, for which the coefficients can be obtained exactly and in principle to any order. We derive the perturbation series for the correlation dimension of inertial particles suspended in three-dimensional spatially smooth random flows with white-noise time correlations, obtaining the first 33 non-zero coefficients exactly.

preprint2009arXiv

Correlation Dimension of Inertial Particles in Random Flows

We obtain an implicit equation for the correlation dimension of dynamical systems in terms of an integral over a propagator. We illustrate the utility of this approach by evaluating the correlation dimension for inertial particles suspended in a random flow. In the limit where the correlation time of the flow field approaches zero, taking the short-time limit of the propagator enables the correlation dimension to be determined from the solution of a partial differential equation. We develop the solution as a power series in a dimensionless parameter which represents the strength of inertial effects.