Source author record

Maria Chikina

Explore this author’s publications, collaborators and research topics. This catalog record has not been claimed by its author.

ResearcherUnclaimed source record

Catalog footprint

Research overview

4works
4topics
2close collaborators

Published work

4 publications

preprint2022arXiv

The paradoxical nature of easily improvable evidence

Established frameworks to understand problems with reproducibility in science begin with the relationship between our understanding of the prior probability of a claim and the statistical certainty that should be demanded of it, and explore the ways in which independent investigations, biases in study design and publication bias interact with these considerations. We propose a complementary perspective; namely, that to improve reproducibility in science, our interpretation of the persuasiveness of evidence (e.g., statistical significance thresholds) should be responsive to our understanding of the effort that would be required to improve that evidence. We will quantify this notion in some formal settings. Indeed, we will demonstrate that even simplistic models of evidence publication can exhibit an improvable evidence paradox, where the publication of easily improvable evidence in favor of a claim can best seen as evidence the claim is false.

preprint2017arXiv

Assessing significance in a Markov chain without mixing

We present a new statistical test to detect that a presented state of a reversible Markov chain was not chosen from a stationary distribution. In particular, given a value function for the states of the Markov chain, we would like to demonstrate rigorously that the presented state is an outlier with respect to the values, by establishing a pp-value for observations we make about the state under the null hypothesis that it was chosen uniformly at random. A simple heuristic used in practice is to sample ranks of states from long random trajectories on the Markov chain, and compare these to the rank of the presented state; if the presented state is a 0.1%0.1\%-outlier compared to the sampled ranks (i.e., its rank is in the bottom 0.1%0.1\% of sampled ranks) then this should correspond to a pp-value of 0.0010.001. This test is not rigorous, however, without good bounds on the mixing time of the Markov chain, as one must argue that the observed states on the trajectory approximate the stationary distribution. Our test is the following: given the presented state in the Markov chain, take a random walk from the presented state for any number of steps. We prove that observing that the presented state is an ε\varepsilon-outlier on the walk is significant at p=2εp=\sqrt {2\varepsilon}, under the null hypothesis that the state was chosen from a stationary distribution. Our result assumes nothing about the structure of the Markov chain beyond reversibility, and we construct examples to show that significance at p≈εp\approx\sqrt \varepsilon is essentially best possible in general. We illustrate the use of our test with a potential application to the rigorous detection of gerrymandering in Congressional districtings.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.