Source author record

Jiawang Nie

Jiawang Nie appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

36works
6topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

36 published item(s)

preprint2026arXiv

Lagrange multiplier expressions for matrix polynomial optimization and tight relaxations

This paper studies matrix constrained polynomial optimization. We investigate how to get explicit expressions for Lagrange multiplier matrices from the first order optimality conditions. The existence of these expressions can be shown under the nondegeneracy condition. Using Lagrange multiplier matrix expressions, we propose a strengthened Moment-SOS hierarchy for solving matrix polynomial optimization. Under some general assumptions, we show that this strengthened hierarchy is tight, or equivalently, it has finite convergence. We also study how to detect tightness and how to extract optimizers. Numerical experiments are provided to show the efficiency of the strengthened hierarchy.

preprint2026arXiv

Log-Polynomial Optimization

We study an optimization problem in which the objective is given as a sum of logarithmic-polynomial functions. This formulation is motivated by statistical estimation principles such as maximum likelihood estimation, and by loss functions including cross-entropy and Kullback-Leibler divergence. We propose a hierarchy of moment relaxations based on the truncated $K$-moment problems to solve log-polynomial optimization. We provide sufficient conditions for the hierarchy to be tight and introduce a numerical method to extract the global optimizers when the tightness is achieved. In addition, we modify relaxations with optimality conditions to better fit log-polynomial optimization with convenient Lagrange multipliers expressions. Various applications and numerical experiments are presented to show the efficiency of our method.

preprint2024arXiv

Diagonal Gaussian Mixture Models and Higher Order Tensor Decompositions

This paper studies how to recover parameters in diagonal Gaussian mixture models using tensors. High-order moments of the Gaussian mixture model are estimated from samples. They form incomplete symmetric tensors generated by hidden parameters in the model. We propose to use generating polynomials to compute incomplete symmetric tensor approximations. The obtained decomposition is utilized to recover parameters in the model. We prove that our recovered parameters are accurate when the estimated moments are accurate. Using high-order moments enables our algorithm to learn Gaussian mixtures with more components. For a given model dimension and order, we provide an upper bound of the number of components in the Gaussian mixture model that our algorithm can compute.

preprint2022arXiv

Algebraic Degrees of Generalized Nash Equilibrium Problems

This paper studies algebraic degree of generalized Nash equilibrium problems (GNEPs) given by polynomials. Their generalized Nash equilibria (GNEs), as well as their KKT or Fritz-John points, are algebraic functions in the coefficients of defining polynomials. We study the degrees of these algebraic functions, which also counts the numbers of complex KKT or Fritz-John points. Under some genericity assumptions, we show that a GNEP has only finitely many complex Fritz-John points and every Fritz-John point is a KKT point. We also give formulae for algebraic degrees of GNEPs, which count the numbers of complex Fritz-John points for generic cases.

preprint2022arXiv

Generalized truncated moment problems with unbounded sets

This paper studies generalized truncated moment problems with unbounded sets. First, we study geometric properties of the truncated moment cone and its dual cone of nonnegative polynomials. By the technique of homogenization, we give a convergent hierarchy of Moment-SOS relaxations for approximating these cones. With them, we give a Moment-SOS method for solving generalized truncated moment problems with unbounded sets. Finitely atomic representing measures, or certificates for their nonexistence, can be obtained by the proposed method. Numerical experiments and applications are also given.

preprint2022arXiv

Higher Order Correlation Analysis for Multi-View Learning

Multi-view learning is frequently used in data science. The pairwise correlation maximization is a classical approach for exploring the consensus of multiple views. Since the pairwise correlation is inherent for two views, the extensions to more views can be diversified and the intrinsic interconnections among views are generally lost. To address this issue, we propose to maximize higher order correlations. This can be formulated as a low rank approximation problem with the higher order correlation tensor of multi-view data. We use the generating polynomial method to solve the low rank approximation problem. Numerical results on real multi-view data demonstrate that this method consistently outperforms prior existing methods.

preprint2022arXiv

Low Rank Tensor Decompositions and Approximations

There exist linear relations among tensor entries of low rank tensors. These linear relations can be expressed by multi-linear polynomials, which are called generating polynomials. We use generating polynomials to compute tensor rank decompositions and low rank tensor approximations. We prove that this gives a quasi-optimal low rank tensor approximation if the given tensor is sufficiently close to a low rank one.

preprint2021arXiv

Efficient evaluation of noncommutative polynomials using tensor and noncommutative Waring decompositions

This paper analyses a Waring type decomposition of a noncommuting (NC) polynomial $p$ with respect to the goal of evaluating $p$ efficiently on tuples of matrices. Such a decomposition can reduce the number of matrix multiplications needed to evaluate a noncommutative polynomial and is valuable when a single polynomial must be evaluated on many matrix tuples. In pursuit of this goal we examine a noncommutative analog of the classical Waring problem and various related decompositions. For example, we consider a "Waring decomposition" in which each product of linear terms is actually a power of a single linear NC polynomial or more generally a power of a homogeneous NC polynomial. We describe how NC polynomials compare to commutative ones with regard to these decompositions, describe a method for computing the NC decompositions and compare the effect of various decompositions on the speed of evaluation of generic NC polynomials.

preprint2020arXiv

Hermitian Tensor Decompositions

Hermitian tensors are generalizations of Hermitian matrices, but they have very different properties. Every complex Hermitian tensor is a sum of complex Hermitian rank-1 tensors. However, this is not true for the real case. We study basic properties for Hermitian tensors such as Hermitian decompositions and Hermitian ranks. For canonical basis tensors, we determine their Hermitian ranks and decompositions. For real Hermitian tensors, we give a full characterization for them to have Hermitian decompositions over the real field. In addition to traditional flattening, Hermitian tensors specially have Hermitian and Kronecker flattenings, which may give different lower bounds for Hermitian ranks. We also study other topics such as eigenvalues, positive semidefiniteness, sum of squares representations, and separability.

preprint2020arXiv

Symmetric Tensor Decompositions On Varieties

This paper discusses the problem of symmetric tensor decomposition on a given variety $X$: decomposing a symmetric tensor into the sum of tensor powers of vectors contained in $X$. In this paper, we first study geometric and algebraic properties of such decomposable tensors, which are crucial to the practical computations of such decompositions. For a given tensor, we also develop a criterion for the existence of a symmetric decomposition on $X$. Secondly and most importantly, we propose a method for computing symmetric tensor decompositions on an arbitrary $X$. As a specific application, Vandermonde decompositions for nonsymmetric tensors can be computed by the proposed algorithm.

preprint2020arXiv

The Gauss-Seidel Method for Generalized Nash Equilibrium Problems of Polynomials

This paper concerns the generalized Nash equilibrium problem of polynomials (GNEPP). We apply the Gauss-Seidel method and Lasserre type Moment-SOS relaxations to solve GNEPPs. The convergence of the Gauss-Seidel method is known for some special GNEPPs, such as generalized potential games (GPGs). We give a sufficient condition for GPGs and propose a numerical certificate, based on Putinar's Positivstellensatz. Numerical examples for both convex and nonconvex GNEPPs are given for demonstrating the efficiency of the proposed method.

preprint2018arXiv

A Matrix Positivstellensatz with lifting polynomials

Given the projections of two semialgebraic sets defined by polynomial matrix inequalities, it is in general difficult to determine whether one is contained in the other. To address this issue we propose a new matrix Positivstellensatz that uses lifting polynomials. Under the classical archimedean condition and some mild natural assumptions, we prove that such a containment holds if and only if the proposed matrix Positivstellensatz is satisfied. The corresponding certificate can be searched for by solving a semidefinite program. An important application is to certify when a spectrahedrop (i.e., the projection of a spectrahedron) is contained in another one.

preprint2016arXiv

Bilevel Polynomial Programs and Semidefinite Relaxation Methods

A bilevel program is an optimization problem whose constraints involve another optimization problem. This paper studies bilevel polynomial programs (BPPs), i.e., all the functions are polynomials. We reformulate BPPs equivalently as semi-infinite polynomial programs (SIPPs), using Fritz John conditions and Jacobian representations. Combining the exchange technique and Lasserre type semidefinite relaxations, we propose numerical methods for solving both simple and general BPPs. For simple BPPs, we prove the convergence to global optimal solutions. Numerical experiments are presented to show the efficiency of proposed algorithms.

preprint2016arXiv

Positive Maps and Separable Matrices

A linear map between real symmetric matrix spaces is positive if all positive semidefinite matrices are mapped to positive semidefinite ones. A real symmetric matrix is separable if it can be written as a summation of Kronecker products of positive semidefinite matrices. This paper studies how to check if a linear map is positive or not and how to check if a matrix is separable or not. We propose numerical algorithms, based on Lasserre type semidefinite relaxations, for solving such questions. To check the positivity of a linear map, we construct a hierarchy of semidefinite relaxations for minimizing the associated bi-quadratic forms over the unit spheres. We show that the positivity can be detected by solving a finite number of such semidefinite relaxations. To check the separability of a matrix, we construct a hierarchy of semidefinite relaxations. If it is not separable, we can get a mathematical certificate for that; if it is, we can get a decomposition for the separability.

preprint2016arXiv

Symmetric Tensor Nuclear Norms

This paper studies nuclear norms of symmetric tensors. As recently shown by Friedland and Lim, the nuclear norm of a symmetric tensor can be achieved at a symmetric decomposition. We discuss how to compute symmetric tensor nuclear norms, depending on the tensor order and the ground field. Lasserre relaxations are proposed for the computation. The theoretical properties of the relaxations are studied. For symmetric tensors, we can compute their nuclear norms, as well as the nuclear decompositions. The proposed methods can be extended to nonsymmetric tensors.

preprint2015arXiv

Generating Polynomials and Symmetric Tensor Decompositions

This paper studies symmetric tensor decompositions. For symmetric tensors, there exist linear relations of recursive patterns among their entries. Such a relation can be represented by a polynomial, which is called a generating polynomial. The homogenization of a generating polynomial belongs to the apolar ideal of the tensor. A symmetric tensor decomposition can be determined by a set of generating polynomials, which can be represented by a matrix. We call it a generating matrix. Generally, a symmetric tensor decomposition can be determined by a generating matrix satisfying certain conditions. We characterize the sets of such generating matrices and investigate their properties (e.g., the existence, dimensions, nondefectiveness). Using these properties, we propose methods for computing symmetric tensor decompositions. Extensive examples are shown to demonstrate the efficiency of proposed methods.

preprint2015arXiv

Real Eigenvalues of nonsymmetric tensors

This paper discusses the computation of real Z-eigenvalues and H-eigenvalues of nonsymmetric tensors. A general nonsymmetric tensor has finitely many Z-eigenvalues, while there may be infinitely many ones for special tensors. In the contrast, every nonsymmetric tensor has finitely many H-eigenvalues. We propose Lasserre type semidefinite relaxation methods for computing such eigenvalues. For every nonsymmetric tensor that has finitely many real Z-eigenvalues, we can compute all of them; each of them can be computed by solving a finite sequence of semidefinite relaxations. For every nonsymmetric tensor, we can compute all its real H-eigenvalues; each of them can be computed by solving a finite sequence of semidefinite relaxations. Various examples are demonstrated.

preprint2014arXiv

All Real Eigenvalues of Symmetric Tensors

This paper studies how to compute all real eigenvalues of a symmetric tensor. As is well known, the largest or smallest eigenvalue can be found by solving a polynomial optimization problem, while the other middle eigenvalues can not. We propose a new approach for computing all real eigenvalues sequentially, from the largest to the smallest. It uses Jacobian SDP relaxations in polynomial optimization. We show that each eigenvalue can be computed by solving a finite hierarchy of semidefinite relaxations. Numerical experiments are presented to show how to do this.

preprint2014arXiv

Free Semidefinite Representation of Matrix Power Functions

Consider the matrix power function X^p defined over the cone of positive definite matrices S^{n}_{++}. It is known that X^p is convex over S^{n}_{++} if p is in [-1,0] or [1,2] and X^p is concave over S^{n}_{++} if p is in [0,1]. We show that the hypograph of X^p admits a free semidefinite representation if p in [0,1] is rational, and the epigraph of X^p admits a free semidefinite representation if p in [-1,0] or [1,2] is rational.

preprint2014arXiv

Linear Optimization with Cones of Moments and Nonnegative Polynomials

Let A be a finite subset of N^n and R[x]_A be the space of real polynomials whose monomial powers are from A. Let K be a compact basic semialgebraic set of R^n such that R[x]_A contains a polynomial that is positive on K. Denote by P_A(K) the cone of polynomials in R[x]_A that are nonnegative on K. The dual cone of P_A(K) is R_A(K), the set of all A-truncated moment sequences in R^A that admit representing measures supported in K. Our main results are: i) We study the properties of P_A(K) and R_A(K) (like interiors, closeness, duality, memberships), and construct a convergent hierarchy of semidefinite relaxations for each of them. ii) We propose a semidefinite algorithm for solving linear optimization problems with the cones P_A(K) and R_A(K), and prove its asymptotic and finite convergence; a stopping criterion is also given. iii) We show how to check whether P_A(K) and R_A(K) intersect affine subspaces; if they do, we show to get get a point in the intersections; if they do not, we prove certificates for the non-intersecting.

preprint2014arXiv

Nearly Low Rank Tensors and Their Approximations

The low rank tensor approximation problem (LRTAP) is to find a tensor whose rank is small and that is close to a given one. This paper studies the LRTAP when the tensor to be approximated is close to a low rank one. Both symmetric and nonsymmetric tensors are discussed. We propose a new approach for solving the LRTAP. It consists of three major stages: i) Find a set of linear relations that are approximately satisfied by the tensor; such linear relations can be expressed by polynomials and can be found by solving linear least squares. ii) Compute a set of points that are approximately common zeros of the obtained polynomials; they can be found by computing Schur decompositions. iii) Construct a low rank approximating tensor from the obtained points; this can be done by solving linear least squares. Our main conclusion is that if the given tensor is sufficiently close to a low rank one, then the computed tensor is a good enough low rank approximation. This approach can also be applied to efficiently compute low rank tensor decompositions, especially for large scale tensors.

preprint2014arXiv

Semidefinite Relaxations for Best Rank-1 Tensor Approximations

This paper studies the problem of finding best rank-1 approximations for both symmetric and nonsymmetric tensors. For symmetric tensors, this is equivalent to optimizing homogeneous polynomials over unit spheres; for nonsymmetric tensors, this is equivalent to optimizing multi-quadratic forms over multi-spheres. We propose semidefinite relaxations, based on sum of squares representations, to solve these polynomial optimization problems. Their properties and structures are studied. In applications, the resulting semidefinite programs are often large scale. The recent Newton-CG augmented Lagrangian method by Zhao, Sun and Toh is suitable for solving these semidefinite relaxations. Extensive numerical experiments are presented to show that this approach is practical in getting best rank-1 approximations.

preprint2014arXiv

The A-truncated K-moment problem

Let A be a finite subset of N^n, and K be a compact semialgebraic set in R^n. An A-tms is a vector y indexed by elements in A. The A-truncated K-moment problem (A-TKMP) studies whether a given A-tms y admits a K-measure or not. This paper proposes a numerical algorithm for solving A-TKMPs. It is based on finding a flat extension of y by solving a hierarchy of semidefinite relaxations {(SDR)_k} for a moment optimization problem, whose objective R is generated in a certain randomized way. If y admits no K-measures and R[x]_A is K-full, then (SDR)_k is infeasible for all K big enough, which gives a certificate for the nonexistence of representing measures. If y admits a K-measure, then for almost all generated R, we prove that: i) we can asymptotically get a flat extension of y by solving the hierarchy {(SDR)_k\}; ii) under a general condition that is almost sufficient and necessary, we can get a flat extension of y by solving (SDR)_k for some k; this occurred in all our numerical experiments; iii) the obtained flat extensions admit a r-atomic K-measure with r <= |A|. The decomposition problems for completely positive matrices and sums of even powers of real linear forms, and the standard truncated K-moment problems, are special cases of A-TKMPs, and hence can be solved numerically by this algorithm.

preprint2014arXiv

The Hierarchy of Local Minimums in Polynomial Optimization

This paper studies the hierarchy of local minimums of a polynomial in the space. For this purpose, we first compute H-minimums, for which the first and second order optimality conditions are satisfied. To compute each H-minimum, we construct a sequence of semidefinite relaxations, based on optimality conditions. We prove that each constructed sequence has finite convergence, under some generic conditions. A procedure for computing all local minimums is given. When there are equality constraints, we have similar results for computing the hierarchy of critical values and the hierarchy of local minimums. Several extensions are discussed.

preprint2013arXiv

Optimality Conditions and Finite Convergence of Lasserre's Hierarchy

Lasserre's hierarchy is a sequence of semidefinite relaxations for solving polynomial optimization problems globally. This paper studies the relationship between optimality conditions in nonlinear programming theory and finite convergence of Lasserre's hierarchy. Our main results are: i) Lasserre's hierarchy has finite convergence when the constraint qualification, strict complementarity and second order sufficiency conditions hold at every global minimizer, under the standard archimedean assumption; the proof uses a result of Marshall on boundary hessian conditions. ii) these optimality conditions are all satisfied at every local minimizer if a finite set of polynomials, which are in the coefficients of input polynomials, do not vanish at the input data (i.e., they hold in a Zariski open set). This implies that Lasserre's hierarchy has finite convergence generically.

preprint2013arXiv

Polynomial Optimization with Real Varieties

We consider the optimization problem of minimizing a polynomial f(x) subject to polynomial constraints h(x)=0, g(x)>=0. Lasserre's hierarchy is a sequence of sum of squares relaxations for finding the global minimum. Let K be the feasible set. We prove the following results: i) If the real variety V_R(h) is finite, then Lasserre's hierarchy has finite convergence, no matter the complex variety V_C(h) is finite or not. This solves an open question in Laurent's survey. ii) If K and V_R(h) have the same vanishing ideal, then the finite convergence of Lasserre's hierarchy is independent of the choice of defining polynomials for the real variety V_R(h). iii) When K is finite, a refined version of Lasserre's hierarchy (using the preordering of g) has finite convergence.

preprint2012arXiv

A Semidefinite Approach for Truncated K-Moment Problems

A truncated moment sequence (tms) of degree d is a vector indexed by monomials whose degree is at most d. Let K be a semialgebraic set.The truncated K-moment problem (TKMP) is: when does a tms y admit a positive Borel measure supported? This paper proposes a semidefinite programming (SDP) approach for solving TKMP. When K is compact, we get the following results: whether a tms y of degree d admits a K-measure or notcan be checked via solving a sequence of SDP problems; when y admits no K-measure, a certificate will be given; when y admits a K-measure, a representing measure for y would be obtained from solving the SDP under some necessary and some sufficient conditions. Moreover, we also propose a practical SDP method for finding flat extensions, which in our numerical experiments always finds a finitely atomic representing measure for a tms when it admits one.

preprint2012arXiv

Certifying Convergence of Lasserre's Hierarchy via Flat Truncation

This paper studies how to certify the convergence of Lasserre's hierarchy of semidefinite programming relaxations for solving multivariate polynomial optimization. We propose flat truncation as a general certificate for this purpose. Assume the set of global minimizers is nonempty and finite. Our main results are: i) Putinar type Lasserre's hierarchy has finite convergence if and only if flat truncation holds, under some general assumptions, and this is also true for the Schmudgen type one; ii) under the archimedean condition, flat truncation is asymptotically satisfied for Putinar type Lasserre's hierarchy, and similar is true for the Schmudgen type one; iii) for the hierarchy of Jacobian SDP relaxations, flat truncation is always satisfied. The case of unconstrained polynomial optimization is also discussed.

preprint2011arXiv

Convex Hulls of Quadratically Parameterized Sets With Quadratic Constraints

Let V be a semialgebraic set parameterized by quadratic polynomials over a quadratic set T. This paper studies semidefinite representation of its convex hull by projections of spectrahedra (defined by linear matrix inequalities). When T is defined by a single quadratic constraint, we prove that its convex hull is equal to the first order moment type semidefinite relaxation of $V$, up to taking closures. Similar results hold when every quadratic polynomial is homogeneous and T is defined by two homogeneous quadratic constraints,or V is defined by rational quadratic parameterizations.

preprint2011arXiv

Polynomial Matrix Inequality and Semidefinite Representation

Consider a convex set S defined by a matrix inequality of polynomials or rational functions over a domain. The set S is called semidefinite programming (SDP) representable or just semidefinite representable if it equals the projection of a higher dimensional set which is defined by a linear matrix inequality (LMI). This paper studies sufficient conditions guaranteeing semidefinite representability of S. We prove that S is semidefinite representable in the following cases: (i) the domain is the whole space and the matrix polynomial is matrix sos-concave; (ii) the domain is compact convex and the matrix polynomial is strictly matrix concave; (iii) the rational matrix function is q-module matrix concave on the domain. Explicit constructions of SDP representations are given. Some examples are illustrated.

preprint2011arXiv

Regularization Methods for SDP Relaxations in Large Scale Polynomial Optimization

We study how to solve semidefinite programming relaxations for large scale polynomial optimization. When interior-point methods are used, typically only small or moderately large problems could be solved. This paper studies regularization methods for solving polynomial optimization problems. We describe these methods for semidefinite optimization with block structures, and then apply them to solve large scale polynomial optimization problems. The performance is tested on various numerical examples. By regularization methods, significantly bigger problems could be solved on a regular computer, which is almost impossible by interior point methods.

preprint2010arXiv

An Exact Jacobian SDP Relaxation for Polynomial Optimization

Given polynomials f(x), g_i(x), h_j(x), we study how to minimize f on the semialgebraic set S = { x \in R^n: h_1(x)=...=h_{m_1}(x) =0, g_1(x) >= 0, ..., g_{m_2}(x) >= 0}. Let f_{min} be the minimum of f on S. Suppose S is nonsingular and f_{min} is achievable on S,which is true generically. The paper proposes a new semidefinite programming (SDP) relaxation for this problem. First we construct a set of new polynomials φ_1(x), \ldots, φ_r(x), by using the Jacobian of f,h_i,g_j, such that the above problem is unchanged by adding new equations φ_j(x)=0. Then we prove that for all $N$ big enough, the standard N-th order Lasserre's SDP relaxation is exact for solving this equivalent problem, that is, it returns a lower bound that is equal to f_{min}. Some variations and examples are also shown.

preprint2010arXiv

Discriminants and Nonnegative Polynomials

For a semialgebraic set K in R^n, let P_d(K) be the cone of polynomials in R^n of degrees at most d that are nonnegative on K. This paper studies the geometry of its boundary. When K=R^n and d is even, we show that its boundary lies on the irreducible hypersurface defined by the discriminant of a single polynomial. When K is a real algebraic variety, we show that P_d(K) lies on the hypersurface defined by the discriminant of several polynomials. When K is a general semialgebraic set, we show that P_d(K) lies on a union of hypersurfaces defined by the discriminantal equations. Explicit formulae for the degrees of these hypersurfaces and discriminants are given. We also prove that typically P_d(K) does not have a log-polynomial type barrier, but a log-semialgebraic type barrier exits. Some illustrating examples are shown.

preprint2007arXiv

Semidefinite Representation of the $k$-Ellipse

The $k$-ellipse is the plane algebraic curve consisting of all points whose sum of distances from $k$ given points is a fixed number. The polynomial equation defining the $k$-ellipse has degree $2^k$ if $k$ is odd and degree $2^k{-}\binom{k}{k/2}$ if $k$ is even. We express this polynomial equation as the determinant of a symmetric matrix of linear polynomials. Our representation extends to weighted $k$-ellipses and $k$-ellipsoids in arbitrary dimensions, and it leads to new geometric applications of semidefinite programming.

preprint2007arXiv

Sparse SOS Relaxations for Minimizing Functions that are Summations of Small Polynomials

This paper discusses how to find the global minimum of functions that are summations of small polynomials (``small'' means involving a small number of variables). Some sparse sum of squares (SOS) techniques are proposed. We compare their computational complexity and lower bounds with prior SOS relaxations. Under certain conditions, we also discuss how to extract the global minimizers from these sparse relaxations. The proposed methods are especially useful in solving sparse polynomial system and nonlinear least squares problems. Numerical experiments are presented, which show that the proposed methods significantly improve the computational performance of prior methods for solving these problems. Lastly, we present applications of this sparsity technique in solving polynomial systems derived from nonlinear differential equations and sensor network localization.