Source author record

Hongwei Shang

Hongwei Shang appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Applications Artificial Intelligence Computation and Language Methodology

Catalog footprint

What is connected

3works

4topics

4close collaborators

Actions

Connect this record

Open graph Browse works

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

preprint2026arXiv

Submodular Evaluation Subset Selection in Automatic Prompt Optimization

Automatic prompt optimization reduces manual prompt engineering, but relies on task performance measured on a small, often randomly sampled evaluation subset as its main source of feedback signal. Despite this, how to select that evaluation subset is usually treated as an implementation detail. We study evaluation subset selection for prompt optimization from a principled perspective and propose SESS, a submodular evaluation subset selection method. We frame selection as maximizing an objective set function and show that, under mild conditions, it is monotone and submodular, enabling greedy selection with theoretical guarantees. Across GSM8K, MATH, and GPQA-Diamond, submodularly selected evaluation subsets can yield better optimized prompts than random or heuristic baselines.

preprint2016arXiv

A Framework for Network AB Testing

A/B testing, also known as controlled experiment, bucket testing or splitting testing, has been widely used for evaluating a new feature, service or product in the data-driven decision processes of online websites. The goal of A/B testing is to estimate or test the difference between the treatment effects of the old and new variations. It is a well-studied two-sample comparison problem if each user's response is influenced by her treatment only. However, in many applications of A/B testing, especially those in HIVE of Yahoo and other social networks of Microsoft, Facebook, LinkedIn, Twitter and Google, users in the social networks influence their friends via underlying social interactions, and the conventional A/B testing methods fail to work. This paper considers the network A/B testing problem and provide a general framework consisting of five steps: data sampling, probabilistic model, parameter inference, computing average treatment effect and hypothesis test. The framework performs well for network A/B testing in simulation studies.

preprint2014arXiv

A class of goodness-of-fit tests for spatial extremes models based on max-stable processes

Parametric max-stable processes are increasingly used to model spatial extremes. Starting from the fact that the dependence structure of a max-stable process is completely characterized by an extreme-value copula, a class of goodness-of-fit tests is proposed based on the comparison between a nonparametric and a parametric estimator of the corresponding unknown multivariate Pickands dependence function. Because of the high-dimensional setting under consideration, these functional estimators are only compared at a specific set of points at which they coincide, up to a multiplicative constant, with estimators of the extremal coefficients. The nonparametric estimators of the Pickands dependence function used in this work are those recently studied by Gudendorf and Segers. The parametric estimators rely on the use of the {\em pairwise pseudo-likelihood} which extends the concept of pairwise (composite) likelihood to a rank-based context. Approximate $p$-values for the resulting margin-free tests are obtained by means of a {\em one- or two-level parametric bootstrap}. Conditions for the asymptotic validity of these resampling procedures are given based on the work of Genest and Rémillard. The finite-sample performance of the tests is investigated in dimension 10 under the Smith, Schlather and geometric Gaussian models. An application of the tests to rainfall data is finally presented.