Source author record

Jinglai Shen

Jinglai Shen appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

math.ST Statistics Theory math.OC math.CA Methodology

Catalog footprint

What is connected

6works

5topics

4close collaborators

Actions

Connect this record

Open graph Browse works

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

preprint2020arXiv

Column Partition based Distributed Algorithms for Coupled Convex Sparse Optimization: Dual and Exact Regularization Approaches

This paper develops column partition based distributed schemes for a class of large-scale convex sparse optimization problems, e.g., basis pursuit (BP), LASSO, basis pursuit denosing (BPDN), and their extensions, e.g., fused LASSO. We are particularly interested in the cases where the number of (scalar) decision variables is much larger than the number of (scalar) measurements, and each agent has limited memory or computing capacity such that it only knows a small number of columns of a measurement matrix. These problems in consideration are densely coupled and cannot be formulated as separable convex programs using column partition. To overcome this difficulty, we consider their dual problems which are separable or locally coupled. Once a dual solution is attained, it is shown that a primal solution can be found from the dual of corresponding regularized BP-like problems under suitable exact regularization conditions. A wide range of existing distributed schemes can be exploited to solve the obtained dual problems. This yields two-stage column partition based distributed schemes for LASSO-like and BPDN-like problems; the overall convergence of these schemes is established using sensitivity analysis techniques. Numerical results illustrate the effectiveness of the proposed schemes.

preprint2020arXiv

Exact Support and Vector Recovery of Constrained Sparse Vectors via Constrained Matching Pursuit

Matching pursuit, especially its orthogonal version (OMP) and variations, is a greedy algorithm widely used in signal processing, compressed sensing, and sparse modeling. Inspired by constrained sparse signal recovery, this paper proposes a constrained matching pursuit algorithm and develops conditions for exact support and vector recovery on constraint sets via this algorithm. We show that exact recovery via constrained matching pursuit not only depends on a measurement matrix but also critically relies on a constraint set. We thus identify an important class of constraint sets, called coordinate projection admissible set, or simply CP admissible sets; analytic and geometric properties of these sets are established. We study exact vector recovery on convex, CP admissible cones for a fixed support. We provide sufficient exact recovery conditions for a general support as well as necessary and sufficient recovery conditions when a support has small size. As a byproduct, we construct a nontrivial counterexample to a renowned necessary condition of exact recovery via the OMP for a support of size three. Moreover, using the properties of convex CP admissible sets and convex optimization techniques, we establish sufficient conditions for uniform exact recovery on convex CP admissible sets in terms of the restricted isometry-like constant and the restricted orthogonality-like constant.

preprint2015arXiv

Uniform Lipschitz Property of Nonnegative Derivative Constrained B-Splines and Applications to Shape Constrained Estimation

Inspired by shape constrained estimation under general nonnegative derivative constraints, this paper considers the B-spline approximation of constrained functions and studies the asymptotic performance of the constrained B-spline estimator. By invoking a deep result in B-spline theory (known as de Boor's conjecture) first proved by A. Shardin as well as other new analytic techniques, we establish a critical uniform Lipschitz property of the B-spline estimator subject to arbitrary nonnegative derivative constraints under the $\ell_\infty$-norm with possibly non-equally spaced design points and knots. This property leads to important asymptotic analysis results of the B-spline estimator, e.g., the uniform convergence and consistency on the entire interval under consideration. The results developed in this paper not only recover the well-studied monotone and convex approximation and estimation as special cases, but also treat general nonnegative derivative constraints in a unified framework and open the door for the constrained B-spline approximation and estimation subject to a broader class of shape constraints.

preprint2013arXiv

Minimax Optimal Estimation of Convex Functions in the Supreme Norm

Estimation of convex functions finds broad applications in engineering and science, while convex shape constraint gives rise to numerous challenges in asymptotic performance analysis. This paper is devoted to minimax optimal estimation of univariate convex functions from the Hölder class in the framework of shape constrained nonparametric estimation. Particularly, the paper establishes the optimal rate of convergence in two steps for the minimax sup-norm risk of convex functions with the Hölder order between one and two. In the first step, by applying information theoretical results on probability measure distance, we establish the minimax lower bound under the supreme norm by constructing a novel family of piecewise quadratic convex functions in the Hölder class. In the second step, we develop a penalized convex spline estimator and establish the minimax upper bound under the supreme norm. Due to the convex shape constraint, the optimality conditions of penalized convex splines are characterized by nonsmooth complementarity conditions. By exploiting complementarity methods, a critical uniform Lipschitz property of optimal spline coefficients in the infinity norm is established. This property, along with asymptotic estimation techniques, leads to uniform bounds for bias and stochastic errors on the entire interval of interest. This further yields the optimal rate of convergence by choosing the suitable number of knots and penalty value. The present paper provides the first rigorous justification of the optimal minimax risk for convex estimation under the supreme norm.

preprint2013arXiv

Smoothing splines with varying smoothing parameter

This paper considers the development of spatially adaptive smoothing splines for the estimation of a regression function with non-homogeneous smoothness across the domain. Two challenging issues that arise in this context are the evaluation of the equivalent kernel and the determination of a local penalty. The roughness penalty is a function of the design points in order to accommodate local behavior of the regression function. It is shown that the spatially adaptive smoothing spline estimator is approximately a kernel estimator. The resulting equivalent kernel is spatially dependent. The equivalent kernels for traditional smoothing splines are a special case of this general solution. With the aid of the Green's function for a two-point boundary value problem, the explicit forms of the asymptotic mean and variance are obtained for any interior point. Thus, the optimal roughness penalty function is obtained by approximately minimizing the asymptotic integrated mean square error. Simulation results and an application illustrate the performance of the proposed estimator.

preprint2012arXiv

Uniform Convergence and Rate Adaptive Estimation of a Convex Function

This paper addresses the problem of estimating a convex regression function under both the sup-norm risk and the pointwise risk using B-splines. The presence of the convex constraint complicates various issues in asymptotic analysis, particularly uniform convergence analysis. To overcome this difficulty, we establish the uniform Lipschitz property of optimal spline coefficients in the $\ell_\infty$-norm by exploiting piecewise linear and polyhedral theory. Based upon this property, it is shown that this estimator attains optimal rates of convergence on the entire interval of interest over the Hölder class under both the risks. In addition, adaptive estimates are constructed under both the sup-norm risk and the pointwise risk when the exponent of the Hölder class is between one and two. These estimates achieve a maximal risk within a constant factor of the minimax risk over the Hölder class.