Researcher profile

Kristian Gustavsson

Kristian Gustavsson contributes to research discovery and scholarly infrastructure.

ResearcherAffiliation not importedOpen to collaborate

Trust snapshot

Quick read

Trust 15 - UnverifiedVerification L1Unclaimed author
3works
0followers
6topics
4close collaborators

Actions

Decide how to stay connected

Follow researcher0

Identity and collaboration

How to connect with this researcher

Claiming links this public author record to a researcher profile and unlocks direct collaboration workflows.

Log in to claim

Direct collaboration

Open a focused conversation when the fit is right

Claim this author entity first to unlock direct invitations.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

3 published item(s)

preprint2021arXiv

Optimal control of point-to-point navigation in turbulent time-dependent flows using Reinforcement Learning

We present theoretical and numerical results concerning the problem to find the path that minimizes the time to navigate between two given points in a complex fluid under realistic navigation constraints. We contrast deterministic Optimal Navigation (ON) control with stochastic policies obtained by Reinforcement Learning (RL) algorithms. We show that Actor-Critic RL algorithms are able to find quasi-optimal solutions in the presence of either time-independent or chaotically evolving flow configurations. For our application, ON solutions develop unstable behavior within the typical duration of the navigation process, and are therefore not useful in practice. We first explore navigation of turbulent flow using a constant propulsion speed. Based on a discretized phase-space, the propulsion direction is adjusted with the aim to minimize the time spent to reach the target. Further, we explore a case where additional control is obtained by allowing the engine to power off. Exploiting advection of the underlying flow, allows the target to be reached with less energy consumption. In this case, we optimize a linear combination between the total navigation time and the total time the engine is switched off. Our approach can be generalized to other setups, for example, navigation under imperfect environmental forecast or with different models for the moving vessel.

preprint2019arXiv

Importance of fluid inertia for the orientation of spheroids settling in turbulent flow

How non-spherical particles orient as they settle in a flow has important practical implications in a number of scientific and engineering problems. In a quiescent fluid, a slowly settling particle orients so that it settles with its broad side first. This is an effect of the torque due to convective inertia of the fluid set in motion by the settling particle, which maximises the drag experienced by the particle. Turbulent flows tend to randomise the particle orientation. Recently the settling of non-spherical particles in turbulence was analysed neglecting the effect of convective fluid inertia, but taking into account the effect of the turbulent fluid-velocity gradients on the particle orientation. These studies reached the opposite conclusion, namely that a rod settles preferentially with its tip first, wheras a disk settles with its edge first, therefore minimizing the drag on the particle. Here, we consider both effects, the convective inertial torque as well as the torque due to fluctuating velocity gradients, and ask under which circumstances either one or the other dominate. To this end we estimate the ratio of the magnitudes of the two torques. Our estimates suggest that the fluid-inertia torque prevails in high-Reynolds number flows. In this case non-spherical particles are expected to settle with a maximal drag. But when the Reynolds number is small then the torque due to fluid-velocity gradients may dominate, causing the particle to settle with its broad side first.

preprint2019arXiv

Zermelo's problem: Optimal point-to-point navigation in 2D turbulent flows using Reinforcement Learning

To find the path that minimizes the time to navigate between two given points in a fluid flow is known as Zermelo's problem. Here, we investigate it by using a Reinforcement Learning (RL) approach for the case of a vessel which has a slip velocity with fixed intensity, Vs , but variable direction and navigating in a 2D turbulent sea. We show that an Actor-Critic RL algorithm is able to find quasi-optimal solutions for both time-independent and chaotically evolving flow configurations. For the frozen case, we also compared the results with strategies obtained analytically from continuous Optimal Navigation (ON) protocols. We show that for our application, ON solutions are unstable for the typical duration of the navigation process, and are therefore not useful in practice. On the other hand, RL solutions are much more robust with respect to small changes in the initial conditions and to external noise, even when V s is much smaller than the maximum flow velocity. Furthermore, we show how the RL approach is able to take advantage of the flow properties in order to reach the target, especially when the steering speed is small.