BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

Subhamay Saha

Subhamay Saha appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
math.OCmath.PRmath.AP

Catalog footprint

What is connected

11works
3topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

11 published item(s)

preprint2022arXiv

Semimartingle Representation of a class of Semi-Markov Dynamics

We consider a class of semi-Markov processes (SMP) such that the embedded discrete time Markov chain may be non-homogeneous. The corresponding augmented processes are represented as semi-martingales using stochastic integral equation involving a Poisson random measure. The existence and uniqueness of the equation are established. Subsequently, we show that the solution is indeed a SMP with desired transition rate. Finally, we derive the law of the bivariate process obtained from two solutions of the equation having two different initial conditions.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Risk-sensitive Semi-Markov Decision Problems with Discounted Cost and General Utilities

In this article we consider risk-sensitive control of semi-Markov processes with a discrete state space. We consider general utility functions and discounted cost in the optimization criteria. We consider random finite horizon and infinite horizon problems. Using a state augmentation technique we characterise the value functions and also prescribe optimal controls.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Continuous-time Zero-Sum Stochastic Game with Stopping and Control

We consider a zero-sum stochastic game for continuous-time Markov chain with countable state space and unbounded transition and pay-off rates. The additional feature of the game is that the controllers together with taking actions are also allowed to stop the process. Under suitable hypothesis we show that the game has a value and it is the unique solution of certain dynamic programming inequalities with bilateral constraints. In the process we also prescribe a saddle point equilibrium.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

A note on non-existence of diffusion limits for serve-the-longest-queue when the buffers are equal in size

We consider the serve-the-longest-queue discipline for a multiclass queue with buffers of equal size, operating under (i) the conventional and (ii) the Halfin-Whitt heavy traffic regimes, and show that while the queue length process' scaling limits are fully determined by the first and second order data in case (i), they depend on finer properties in case (ii). The proof of the latter relies on the construction of a {\it deterministic} arrival pattern.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

On viscosity solution of HJB equations with state constraints and reflection control

Motivated by a control problem of a certain queueing network we consider a control problem where the dynamics is constrained in the nonnegative orthant $\mathbb{R}_+$ of the $d$-dimensional Euclidean space and controlled by the reflections at the faces/boundaries. We define a discounted value function associated to this problem and show that the value function is a viscosity solution to a certain HJB equation in $\mathbb{R}_+$ with nonlinear Neumann type boundary condition. Under certain conditions, we also characterize this value function as the unique solution to this HJB equation.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

An $ε$-Nash equilibrium with high probability for strategic customers in heavy traffic

A multiclass queue with many servers is considered, where customers make a join-or-leave decision upon arrival based on queue length information, without knowing the scheduling policy or the state of other queues. A game theoretic formulation is proposed and analyzed, that takes advantage of a phenomenon unique to heavy traffic regimes, namely Reiman's snaphshot principle, by which waiting times are predicted with high precision by the information available upon arrival. The payoff considered is given as a random variable, which depends on the customer's decision, accounting for waiting time in the queue and penalty for leaving. The notion of an equilibrium is only meaningful in an asymptotic framework, which is taken here to be the Halfin-Whitt heavy traffic regime. The main result is the identification of an $ε$-Nash equilibrium with probability approaching 1. On way to proving this result, new diffusion limit results for systems with finite buffers are obtained.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Central Limit Results for Jump-Diffusions with Mean Field Interaction and a Common Factor

A system of $N$ weakly interacting particles whose dynamics is given in terms of jump-diffusions with a common factor is considered. The common factor is described through another jump-diffusion and the coefficients of the evolution equation for each particle depend, in addition to its own state value, on the empirical measure of the states of the $N$ particles and the common factor. A Central Limit Theorem, as $N \to \infty$, is established. The limit law is described in terms of a certain Gaussian mixture. An application to models in Mathematical Finance of self-excited correlated defaults is described.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Construction of Asymptotically Optimal Control for a Stochastic Network from a Free Boundary Problem

An asymptotic framework for optimal control of multiclass stochastic processing networks, using formal diffusion approximations under suitable temporal and spatial scaling, by Brownian control problems (BCP) and their equivalent workload formulations (EWF), has been developed by Harrison (1988). This framework has been implemented in many works for constructing asymptotically optimal control policies for a broad range of stochastic network models. To date all asymptotic optimality results for such networks correspond to settings where the solution of the EWF is a reflected Brownian motion in the positive orthant with normal reflections. In this work we consider a well studied stochastic network which is perhaps the simplest example of a model with more than one dimensional workload process. In the regime considered here, the singular control problem corresponding to the EWF does not have a simple form explicit solution, however by considering an associated free boundary problem one can give a representation for an optimal controlled process as a two dimensional reflected Brownian motion in a Lipschitz domain whose boundary is determined by the solution of the free boundary problem. Using the form of the optimal solution we propose a sequence of control policies, given in terms of suitable thresholds, for the scaled stochastic network control problems and prove that this sequence of policies is asymptotically optimal. As suggested by the solution of the EWF, the policy we propose requires a server to idle under certain conditions which are specified in terms of the thresholds determined from the free boundary.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Optimal Control of Markov Processes with Age-Dependent Transition Rates

We study optimal control of Markov processes with age-dependent transition rates. The control policy is chosen continuously over time based on the state of the process and its age. We study infinite horizon discounted cost and infinite horizon average cost problems. Our approach is via the construction of an equivalent semi-Markov decision process. We characterize the value function and optimal controls for both discounted and average cost cases.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Risk-sensitive control of continuous time Markov chains

We study risk-sensitive control of continuous time Markov chains taking values in discrete state space. We study both finite and infinite horizon problems. In the finite horizon problem we characterise the value function via HJB equation and obtain an optimal Markov control. We do the same for infinite horizon discounted cost case. In the infinite horizon average cost case we establish the existence of an optimal stationary control under certain Lyapunov condition. We also develop a policy iteration algorithm for finding an optimal control.

0 citations0 reviewsNo code linkedOpen access