BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

Gregory Lawrence

Gregory Lawrence appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
Artificial IntelligenceMachine Learningphysics.flu-dynSystems and Control

Catalog footprint

What is connected

3works
4topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

3 published item(s)

preprint2014arXiv

The effect of Prandtl number on mixing in low Reynolds number Kelvin-Helmholtz billows

The effect of Prandtl number on the evolution of Kelvin-Helmholtz (KH) billows and the amount of mixing they generate is studied through direct numerical simulation (DNS). The results indicate that the time evolution of the rate of mixing through different stages of the life-cycle of KH flow is significantly influenced by the Prandtl number. As the Prandtl number increases, the final amount of mixing increases for Reynolds that are too low to support active three-dimensional motions. This trend is the opposite in sufficiently high Reynolds number KH flows that can overcome viscous effects, and develop significant three-dimensional instabilities. While the mixing generated in the two-dimensional flows, uniform in the span-wise direction, is not significantly dependent on the Prandtl number, the turbulent mixing induced by three-dimensional motions is a function of the Prandtl number. The turbulent mixing efficiency near the end of the turbulence decay phase approaches 0.2, the commonly observed value in the ocean. A smooth transition in mixing is observed by increasing the buoyancy Reynolds number.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Efficient Gradient Estimation for Motor Control Learning

The task of estimating the gradient of a function in the presence of noise is central to several forms of reinforcement learning, including policy search methods. We present two techniques for reducing gradient estimation errors in the presence of observable input noise applied to the control signal. The first method extends the idea of a reinforcement baseline by fitting a local linear model to the function whose gradient is being estimated; we show how to find the linear model that minimizes the variance of the gradient estimate, and how to estimate the model from data. The second method improves this further by discounting components of the gradient vector that have high variance. These methods are applied to the problem of motor control learning, where actuator noise has a significant influence on behavior. In particular, we apply the techniques to learn locally optimal controllers for a dart-throwing task using a simulated three-link arm; we demonstrate that proposed methods significantly improve the reward function gradient estimate and, consequently, the learning curve, over existing methods.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Improving Gradient Estimation by Incorporating Sensor Data

An efficient policy search algorithm should estimate the local gradient of the objective function, with respect to the policy parameters, from as few trials as possible. Whereas most policy search methods estimate this gradient by observing the rewards obtained during policy trials, we show, both theoretically and empirically, that taking into account the sensor data as well gives better gradient estimates and hence faster learning. The reason is that rewards obtained during policy execution vary from trial to trial due to noise in the environment; sensor data, which correlates with the noise, can be used to partially correct for this variation, resulting in an estimatorwith lower variance.

0 citations0 reviewsNo code linkedOpen access