Source author record

Jason Long

Explore this author’s publications, collaborators and research topics. This catalog record has not been claimed by its author.

ResearcherUnclaimed source record

math.CO Artificial Intelligence Machine Learning Computational Complexity cs.CY math.GR math.OC math.PR math.RT

Catalog footprint

Research overview

11works

9topics

4close collaborators

Actions

Is this your work?

Open graph Browse papers

preprint2023arXiv

A Survey on the Robustness of Feature Importance and Counterfactual Explanations

There exist several methods that aim to address the crucial task of understanding the behaviour of AI/ML models. Arguably, the most popular among them are local explanations that focus on investigating model behaviour for individual instances. Several methods have been proposed for local analysis, but relatively lesser effort has gone into understanding if the explanations are robust and accurately reflect the behaviour of underlying models. In this work, we present a survey of the works that analysed the robustness of two classes of local explanations (feature importance and counterfactual explanations) that are popularly used in analysing AI/ML models in finance. The survey aims to unify existing definitions of robustness, introduces a taxonomy to classify different robustness approaches, and discusses some interesting results. Finally, the survey introduces some pointers about extending current robustness analysis approaches so as to identify reliable explainability methods.

preprint2022arXiv

Counterfactual Shapley Additive Explanations

Feature attributions are a common paradigm for model explanations due to their simplicity in assigning a single numeric score for each input feature to a model. In the actionable recourse setting, wherein the goal of the explanations is to improve outcomes for model consumers, it is often unclear how feature attributions should be correctly used. With this work, we aim to strengthen and clarify the link between actionable recourse and feature attributions. Concretely, we propose a variant of SHAP, Counterfactual SHAP (CF-SHAP), that incorporates counterfactual information to produce a background dataset for use within the marginal (a.k.a. interventional) Shapley value framework. We motivate the need within the actionable recourse setting for careful consideration of background datasets when using Shapley values for feature attributions with numerous synthetic examples. Moreover, we demonstrate the efficacy of CF-SHAP by proposing and justifying a quantitative score for feature attributions, counterfactual-ability, showing that as measured by this metric, CF-SHAP is superior to existing methods when evaluated on public datasets using tree ensembles.

preprint2022arXiv

Optimal Admission Control for Multiclass Queues with Time-Varying Arrival Rates via State Abstraction

We consider a novel queuing problem where the decision-maker must choose to accept or reject randomly arriving tasks into a no buffer queue which are processed by $N$ identical servers. Each task has a price, which is a positive real number, and a class. Each class of task has a different price distribution and service rate, and arrives according to an inhomogenous Poisson process. The objective is to decide which tasks to accept so that the total price of tasks processed is maximised over a finite horizon. We formulate the problem as a discrete time Markov Decision Process (MDP) with a hybrid state space. We show that the optimal value function has a specific structure, which enables us to solve the hybrid MDP exactly. Moreover, we prove that as the time step is reduced, the discrete time solution approaches the optimal solution to the original continuous time problem. To improve the scalability of our approach to a greater number of task classes, we present an approximation based on state abstraction. We validate our approach on synthetic data, as well as a real financial fraud data set, which is the motivating application for this work.

preprint2022arXiv

Reductive MDPs: A Perspective Beyond Temporal Horizons

Solving general Markov decision processes (MDPs) is a computationally hard problem. Solving finite-horizon MDPs, on the other hand, is highly tractable with well known polynomial-time algorithms. What drives this extreme disparity, and do problems exist that lie between these diametrically opposed complexities? In this paper we identify and analyse a sub-class of stochastic shortest path problems (SSPs) for general state-action spaces whose dynamics satisfy a particular drift condition. This construction generalises the traditional, temporal notion of a horizon via decreasing reachability: a property called reductivity. It is shown that optimal policies can be recovered in polynomial-time for reductive SSPs -- via an extension of backwards induction -- with an efficient analogue in reductive MDPs. The practical considerations of the proposed approach are discussed, and numerical verification provided on a canonical optimal liquidation problem.

preprint2022arXiv

Robust Counterfactual Explanations for Tree-Based Ensembles

Counterfactual explanations inform ways to achieve a desired outcome from a machine learning model. However, such explanations are not robust to certain real-world changes in the underlying model (e.g., retraining the model, changing hyperparameters, etc.), questioning their reliability in several applications, e.g., credit lending. In this work, we propose a novel strategy -- that we call RobX -- to generate robust counterfactuals for tree-based ensembles, e.g., XGBoost. Tree-based ensembles pose additional challenges in robust counterfactual generation, e.g., they have a non-smooth and non-differentiable objective function, and they can change a lot in the parameter space under retraining on very similar data. We first introduce a novel metric -- that we call Counterfactual Stability -- that attempts to quantify how robust a counterfactual is going to be to model changes under retraining, and comes with desirable theoretical properties. Our proposed strategy RobX works with any counterfactual generation method (base method) and searches for robust counterfactuals by iteratively refining the counterfactual generated by the base method using our metric Counterfactual Stability. We compare the performance of RobX with popular counterfactual generation methods (for tree-based ensembles) across benchmark datasets. The results demonstrate that our strategy generates counterfactuals that are significantly more robust (nearly 100% validity after actual model changes) and also realistic (in terms of local outlier factor) over existing state-of-the-art methods.

preprint2022arXiv

Simplicial homeomorphs and trace-bounded hypergraphs

Our first main result is a uniform bound, in every dimension $k \in \mathbb N$ , on the topological Turán numbers of $k$ -dimensional simplicial complexes: for each $k \in \mathbb N$ , there is a $λ_k \ge k^{-2k^2}$ such that for any $k$ -complex $\mathcal{S}$ , every $k$ -complex on $n \ge n_0(\mathcal{S})$ vertices with at least $n^{k+1 - λ_k}$ facets contains a homeomorphic copy of $\mathcal{S}$ . This was previously known only in dimensions one and two, both by highly dimension-specific arguments: the existence of $λ_1$ is a result of Mader from 1967, and the existence of $λ_2$ was suggested by Linial in 2006 and recently proved by Keevash-Long-Narayanan-Scott. We deduce this geometric fact from a purely combinatorial result about trace-bounded hypergraphs, where an $r$ -partite $r$ -graph $H$ with partite classes $V_1, V_2, \dots, V_r$ is said to be $d$ -trace-bounded if for each $2 \le i \le r$ , all the vertices of $V_i$ have degree at most $d$ in the trace of $H$ on $V_1 \cup V_2 \cup \dots \cup V_i$ . Our second main result is the following estimate for the Turán numbers of degenerate trace-bounded hypergraphs: for all $r \ge 2$ and $d\in\mathbb N$ , there is an $α_{r,d} \ge (5rd)^{1-r}$ such that for any $d$ -trace-bounded $r$ -partite $r$ -graph $H$ , every $r$ -graph on $n \ge n_0(H)$ vertices with at least $n^{r - α_{r,d}}$ edges contains a copy of $H$ . This strengthens a result of Conlon-Fox-Sudakov from 2009 who showed that such a bound holds for $r$ -partite $r$ -graphs $H$ satisfying the stronger hypothesis that the vertex-degrees in all but one of its partite classes are bounded (in $H$ , as opposed to in its traces).

preprint2021arXiv

Partial associativity and rough approximate groups

Suppose that a binary operation $\circ$ on a finite set $X$ is injective in each variable separately and also associative. It is easy to prove that $(X,\circ)$ must be a group. In this paper we examine what happens if one knows only that a positive proportion of the triples $(x,y,z)\in X^3$ satisfy the equation $x\circ(y\circ z)=(x\circ y)\circ z$ . Other results in additive combinatorics would lead one to expect that there must be an underlying "group-like" structure that is responsible for the large number of associative triples. We prove that this is indeed the case: there must be a proportional-sized subset of the multiplication table that approximately agrees with part of the multiplication table of a metric group. We also present an example that suggests that our result cannot be strengthened to yield a dense subset that agrees with part of the multiplication table of a group.

preprint2021arXiv

Sylow branching coefficients and a conjecture of Malle and Navarro

We prove that a finite group $G$ has a normal Sylow $p$ -subgroup $P$ if, and only if, every irreducible character of $G$ appearing in the permutation character $({\bf 1}_P)^G$ with multiplicity coprime to $p$ has degree coprime to $p$ . This confirms a prediction by Malle and Navarro from 2012. Our proof of the above result depends on a reduction to simple groups and ultimately on a combinatorial analysis of the properties of Sylow branching coefficients for symmetric groups.

preprint2020arXiv

A universal exponent for homeomorphs

We prove a uniform bound on the topological Turán number of an arbitrary two-dimensional simplicial complex $S$ : any $n$ -vertex two-dimensional complex with at least $C_S n^{3-1/5}$ facets contains a homeomorphic copy of $S$ , where $C_S > 0$ is an absolute constant depending on $S$ alone. This result, a two-dimensional analogue of a classical result of Mader for one-dimensional complexes, sheds some light on an old problem of Linial from 2006.

preprint2020arXiv

The Brown-Erdős-Sós Conjecture for hypergraphs of large uniformity

We prove the well-known Brown-Erdős-Sós Conjecture for hypergraphs of large uniformity in the following form: any dense linear $r$ -graph $G$ has $k$ edges spanning at most $(r-2)k+3$ vertices, provided the uniformity $r$ of $G$ is large enough given the linear density of $G$ , and the number of vertices of $G$ is large enough given $r$ and $k$ .

preprint2018arXiv

Partition problems in high dimensional boxes

Alon, Bohman, Holzman and Kleitman proved that any partition of a $d$ -dimensional discrete box into proper sub-boxes must consist of at least $2^d$ sub-boxes. Recently, Leader, Milićević and Tan considered the question of how many odd-sized proper boxes are needed to partition a $d$ -dimensional box of odd size, and they asked whether the trivial construction consisting of $3^d$ boxes is best possible. We show that approximately $2.93^d$ boxes are enough, and consider some natural generalisations.

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Jason Long

Research overview

Is this your work?

11 publications

A Survey on the Robustness of Feature Importance and Counterfactual Explanations

Counterfactual Shapley Additive Explanations

Optimal Admission Control for Multiclass Queues with Time-Varying Arrival Rates via State Abstraction

Reductive MDPs: A Perspective Beyond Temporal Horizons

Robust Counterfactual Explanations for Tree-Based Ensembles

Simplicial homeomorphs and trace-bounded hypergraphs

Partial associativity and rough approximate groups

Sylow branching coefficients and a conjecture of Malle and Navarro

A universal exponent for homeomorphs

The Brown-Erdős-Sós Conjecture for hypergraphs of large uniformity

Partition problems in high dimensional boxes

See the researcher in context

Building this map preview