BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

Tejas Bodas

Tejas Bodas appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
Computer Science and Game TheoryMachine Learning

Catalog footprint

What is connected

3works
2topics
3close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

3 published item(s)

preprint2016arXiv

On Threshold Routing in a Service System with Highest-Bidder-First and FIFO Services

In this paper, we consider a two server system serving heterogeneous customers. One of the server has a FIFO scheduling policy and charges a fixed admission price to each customer. The second queue follows the highest-bidder-first (HBF) policy where an arriving customer bids for its position in the queue. Customers make an individually optimal choice of the server and for such system, we characterize the equilibrium routing of customers. We specifically show that this routing is characterized by two thresholds.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Reinforcement Learning algorithms for regret minimization in structured Markov Decision Processes

A recent goal in the Reinforcement Learning (RL) framework is to choose a sequence of actions or a policy to maximize the reward collected or minimize the regret incurred in a finite time horizon. For several RL problems in operation research and optimal control, the optimal policy of the underlying Markov Decision Process (MDP) is characterized by a known structure. The current state of the art algorithms do not utilize this known structure of the optimal policy while minimizing regret. In this work, we develop new RL algorithms that exploit the structure of the optimal policy to minimize regret. Numerical experiments on MDPs with structured optimal policies show that our algorithms have better performance, are easy to implement, have a smaller run-time and require less number of random number generations.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Revenue Maximization in Service Systems with Heterogeneous Customers

In this paper, we consider revenue maximization problem for a two server system in the presence of heterogeneous customers. We assume that the customers differ in their cost for unit delay and this is modeled as a continuous random variable with a distribution $F.$ We also assume that each server charges an admission price to each customer that decide to join its queue. We first consider the monopoly problem where both the servers belong to a single operator. The heterogeneity of the customer makes the analysis of the problem difficult. The difficulty lies in the inability to characterize the equilibrium queue arrival rates as a function of the admission prices. We provide an equivalent formulation with the queue arrival rates as the optimization variable simplifying the analysis for revenue rate maximization for the monopoly. We then consider the duopoly problem where each server competes with the other server to maximize its revenue rate. For the duopoly problem, the interest is to obtain the set of admission prices satisfying the Nash equilibrium conditions. While the problem is in general difficult to analyze, we consider the special case when the two servers are identical. For such a duopoly system, we obtain the necessary condition for existence of symmetric Nash equilibrium of the admission prices. The knowledge of the distribution $F$ characterizing the heterogeneity of the customers is necessary to solve the monopoly and the duopoly problem. However, for most practical scenarios, the functional form of $F$ may not be known to the system operator and in such cases, the revenue maximizing prices cannot be determined. In the last part of the paper, we provide a simple method to estimate the distribution $F$ by suitably varying the admission prices. We illustrate the method with some numerical examples.

0 citations0 reviewsNo code linkedOpen access