BZPEERReading, trust and collaboration for research
Menu

Discover

GraphFollow connections around a paper, topic or saved view.

Workspaces

HomePick up where your research flow left off.InboxHandle requests, replies and notifications from one place.CollectionsCurate reading lists, evidence sets and shareable dossiers.ResearchSee your private provenance graph, trail and imports.CollaborationMove from discovery into focused discussion rooms.PublishDraft, preview and publish full-text research articles.

Network

ExpertsFind specialists worth following or asking for help.CommunitiesJoin research circles organized around shared work.PartnersSee external organizations active around the same topics.

Opportunities

ListingsBrowse roles, calls and collaborations with clearer fit signals.

Account

Log inReturn to your reading and collaboration workspace.Create accountStart saving work, following people and joining teams.
Log inCreate account

Researcher profile

J. Michael Steele

J. Michael Steele contributes to research discovery and scholarly infrastructure.

ResearcherAffiliation not importedOpen to collaborate
math.PRmath.OCmath.CO

Trust snapshot

Quick read

Trust 21 - Emerging
11works
0followers
3topics
4close collaborators

Actions

Decide how to stay connected

Follow researcher0

Research graph

See the researcher in context

Open full explorer

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

11 published item(s)

preprint2015arXiv

A central limit theorem for temporally non-homogenous Markov chains with applications to dynamic programming

We prove a central limit theorem for a class of additive processes that arise naturally in the theory of finite horizon Markov decision problems. The main theorem generalizes a classic result of Dobrushin (1956) for temporally non-homogeneous Markov chains, and the principal innovation is that here the summands are permitted to depend on both the current state and a bounded number of future states of the chain. We show through several examples that this added flexibility gives one a direct path to asymptotic normality of the optimal total reward of finite horizon Markov decision problems. The same examples also explain why such results are not easily obtained by alternative Markovian techniques such as enlargement of the state space.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Beardwood-Halton-Hammersley Theorem for Stationary Ergodic Sequences: a Counterexample

We construct a stationary ergodic process $X_1, X_2, \ldots $ such that each $X_t$ has the uniform distribution on the unit square and the length $L_n$ of the shortest path through the points $X_1, X_2, \ldots,X_n$ is not asymptotic to a constant times the square root of $n$. In other words, we show that the Beardwood, Halton and Hammersley theorem does not extend from the case of independent uniformly distributed random variables to the case of stationary ergodic sequences with uniform marginal distributions.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Optimal Online Selection of a Monotone Subsequence: a Central Limit Theorem

Consider a sequence of $n$ independent random variables with a common continuous distribution $F$, and consider the task of choosing an increasing subsequence where the observations are revealed sequentially and where an observation must be accepted or rejected when it is first revealed. There is a unique selection policy $π_n^*$ that is optimal in the sense that it maximizes the expected value of $L_n(π_n^*)$, the number of selected observations. We investigate the distribution of $L_n(π_n^*)$; in particular, we obtain a central limit theorem for $L_n(π_n^*)$ and a detailed understanding of its mean and variance for large $n$. Our results and methods are complementary to the work of Bruss and Delbaen (2004) where an analogous central limit theorem is found for monotone increasing selections from a finite sequence with cardinality $N$ where $N$ is a Poisson random variable that is independent of the sequence.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Quickest Online Selection of an Increasing Subsequence of Specified Size

Given a sequence of independent random variables with a common continuous distribution, we consider the online decision problem where one seeks to minimize the expected value of the time that is needed to complete the selection of a monotone increasing subsequence of a prespecified length $n$. This problem is dual to some online decision problems that have been considered earlier, and this dual problem has some notable advantages. In particular, the recursions and equations of optimality lead with relative ease to asymptotic formulas for mean and variance of the minimal selection time.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Sequential Selection of a Monotone Subsequence from a Random Permutation

We find a two term asymptotic expansion for the optimal expected value of a sequentially selected monotone subsequence from a random permutation of length n. A striking feature of this expansion is that tells us that the expected value of optimal selection from a random permutation is quantifiably larger than optimal sequential selection from an independent sequences of uniformly distributed random variables; specifically, it is larger by at least (1/6)log n +O(1).

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

The Bruss-Robertson Inequality: Elaborations, Extensions, and Applications

The Bruss-Robertson inequality gives a bound on the maximal number of elements of a random sample whose sum is less than a specified value, and the extension of that inequality which is given here neither requires the independence of the summands nor requires the equality of their marginal distributions. A review is also given of the applications of the Bruss-Robertson inequality, especially the applications to problems of combinatorial optimization such as the sequential knapsack problem and the sequential monotone subsequence selection problem.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Twitter event networks and the Superstar model

Condensation phenomenon is often observed in social networks such as Twitter where one "superstar" vertex gains a positive fraction of the edges, while the remaining empirical degree distribution still exhibits a power law tail. We formulate a mathematically tractable model for this phenomenon that provides a better fit to empirical data than the standard preferential attachment model across an array of networks observed in Twitter. Using embeddings in an equivalent continuous time version of the process, and adapting techniques from the stable age-distribution theory of branching processes, we prove limit results for the proportion of edges that condense around the superstar, the degree distribution of the remaining vertices, maximal nonsuperstar degree asymptotics and height of these random trees in the large network limit.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Optimal On-Line Selection of an Alternating Subsequence: A Central Limit Theorem

We analyze the optimal policy for the sequential selection of an alternating subsequence from a sequence of $n$ independent observations from a continuous distribution $F$, and we prove a central limit theorem for the number of selections made by that policy. The proof exploits the backward recursion of dynamic programming and assembles a detailed understanding of the associated value functions and selection rules.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

A Systematic Martingale Construction with Applications to Permutation Inequalities

We illustrate a process that constructs martingales from raw material that arises naturally from the theory of sampling without replacement.The usefulness of the new martingales is illustrated by the development of maximal inequalities for permuted sequences of real numbers. Some of these inequalities are new and some are variations of classical inequalities like those introduced by A. Garsia in the study of rearrangement of orthogonal series.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

On-Line Selection of Alternating Subsequences from a Random Sample

We consider sequential selection of an alternating subsequence from a sequence of independent, identically distributed, continuous random variables, and we determine the exact asymptotic behavior of an optimal sequentially selected subsequence. Moreover, we find (in a sense we make precise) that a person who is constrained to make sequential selections does only about 12% worse than a person who can make selections with full knowledge of the random sequence.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

Optimal Sequential Selection of a Unimodal Subsequence of a Random Sequence

We consider the problem of selecting sequentially a unimodal subsequence from a sequence of independent identically distributed random variables, and we find that a person doing optimal sequential selection does within a factor of the square root of two as well as a prophet who knows all of the random observations in advance of any selections. Our analysis applies in fact to selections of subsequences that have d+1 monotone blocks, and, by including the case d=0, our analysis also covers monotone subsequences.

0 citations0 reviewsNo code linkedOpen access