Source author record

Stephen Chung

Stephen Chung appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Artificial Intelligence Machine Learning physics.flu-dyn

Catalog footprint

What is connected

2works

3topics

4close collaborators

Actions

Connect this record

Open graph Browse works

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

preprint2022arXiv

Ferrofluid drop impacts and Rosensweig peak formation in a non-uniform magnetic field

Vertical drop impacts of ferrofluids onto glass slides in a non-uniform magnetic field have been studied using high-speed photography. Outcomes have been classified based on the motion of the fluid-surface contact lines, and formation of peaks (Rosensweig instabilities) which affect the height of the spreading drop. The largest peaks are nucleated at the edge of a spreading drop, similarly to crown-rim instabilities in drop impacts with conventional fluids, and remain there for an extended time. Impact Weber numbers ranged from 18.0 to 489, and the vertical component of the B-field was varied between 0 and 0.37 T at the surface by changing the vertical position of a simple disc magnet placed below the surface. The falling drop was aligned with the vertical cylindrical axis of the 25 mm diameter magnet, and the impacts produced Rosensweig instabilities without splashing. At high magnetic field strengths a stationary ring of ferrofluid forms approximately above the outer edge of the magnet.

preprint2020arXiv

Reinforcement Learning with Feedback-modulated TD-STDP

Spiking neuron networks have been used successfully to solve simple reinforcement learning tasks with continuous action set applying learning rules based on spike-timing-dependent plasticity (STDP). However, most of these models cannot be applied to reinforcement learning tasks with discrete action set since they assume that the selected action is a deterministic function of firing rate of neurons, which is continuous. In this paper, we propose a new STDP-based learning rule for spiking neuron networks which contains feedback modulation. We show that the STDP-based learning rule can be used to solve reinforcement learning tasks with discrete action set at a speed similar to standard reinforcement learning algorithms when applied to the CartPole and LunarLander tasks. Moreover, we demonstrate that the agent is unable to solve these tasks if feedback modulation is omitted from the learning rule. We conclude that feedback modulation allows better credit assignment when only the units contributing to the executed action and TD error participate in learning.