Source author record

Qi Gong

Qi Gong appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

4works
6topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

4 published item(s)

preprint2022arXiv

An Actor Critic Method for Free Terminal Time Optimal Control

Optimal control problems with free terminal time present many challenges including nonsmooth and discontinuous control laws, irregular value functions, many local optima, and the curse of dimensionality. To overcome these issues, we propose an adaptation of the model-based actor-critic paradigm from the field of Reinforcement Learning via an exponential transformation to learn an approximate feedback control and value function pair. We demonstrate the algorithm's effectiveness on prototypical examples featuring each of the main pathological issues present in problems of this type.

preprint2019arXiv

A new scalable algorithm for computational optimal control under uncertainty

We address the design and synthesis of optimal control strategies for high-dimensional stochastic dynamical systems. Such systems may be deterministic nonlinear systems evolving from random initial states, or systems driven by random parameters or processes. The objective is to provide a validated new computational capability for optimal control which will be achieved more efficiently than current state-of-the-art methods. The new framework utilizes direct single or multi-shooting discretization, and is based on efficient vectorized gradient computation with adaptable memory management. The algorithm is demonstrated to be scalable to high-dimensional nonlinear control systems with random initial condition and unknown parameters.

preprint2016arXiv

A Stochastic Model of Order Book Dynamics using Bouncing Geometric Brownian Motions

We consider a limit order book, where buyers and sellers register to trade a security at specific prices. The largest price buyers on the book are willing to offer is called the market bid price, and the smallest price sellers on the book are willing to accept is called the market ask price. Market ask price is always greater than market bid price, and these prices move upwards and downwards due to new arrivals, market trades, and cancellations. We model these two price processes as "bouncing geometric Brownian motions (GBMs)", which are defined as exponentials of two mutually reflected Brownian motions. We then modify these bouncing GBMs to construct a discrete time stochastic process of trading times and trading prices, which is parameterized by a positive parameter $δ$. Under this model, it is shown that the inter-trading times are inverse Gaussian distributed, and the logarithmic returns between consecutive trading times follow a normal inverse Gaussian distribution. Our main results show that the logarithmic trading price process is a renewal reward process, and under a suitable scaling, this process converges to a standard Brownian motion as $δ\to 0$. We also prove that the modified ask and bid processes approach the original bouncing GBMs as $δ\to0$. Finally, we derive a simple and effective prediction formula for trading prices, and illustrate the effectiveness of the prediction formula with an example using real stock price data.

preprint2014arXiv

Diffusion Models for Double-ended Queues with Renewal Arrival Processes

We study a double-ended queue where buyers and sellers arrive to conduct trades. When there is a pair of buyer and seller in the system, they immediately transact a trade and leave. Thus there cannot be non-zero number of buyers and sellers simultaneously in the system. We assume that sellers and buyers arrive at the system according to independent renewal processes, and they would leave the system after independent exponential patience times. We establish fluid and diffusion approximations for the queue length process under a suitable asymptotic regime. The fluid limit is the solution of an ordinary differential equation, and the diffusion limit is a time-inhomogeneous asymmetric Ornstein-Uhlenbeck process (O-U process). A heavy traffic analysis is also developed, and the diffusion limit in the stronger heavy traffic regime is a time-homogeneous asymmetric O-U process. The limiting distributions of both diffusion limits are obtained. We also show the interchange of the heavy traffic and steady state limits.