BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

Zuoqiang Shi

Zuoqiang Shi appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
math.NAInformation TheoryMachine Learningmath.ITmath.APmath.SPNumerical AnalysisArtificial Intelligencemath.DGComputer Visioneess.IVmath.PRphysics.med-ph

Catalog footprint

What is connected

28works
13topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

28 published item(s)

preprint2026arXiv

Constant-Target Energy Matching: A Unified Framework for Continuous and Discrete Density Estimation

Density estimation is a central primitive in probabilistic modeling, yet continuous, discrete, and mixed-variable domains are often treated by separate objectives, limiting the ability to exploit a common statistical structure across data types. Continuous score-based methods rely on log-density gradients, while discrete extensions typically use concrete score whose unbounded targets become unstable near low-probability states. We introduce Constant-Target Energy Matching (CTEM), a unified energy-based framework for density estimation on general state spaces. CTEM replaces ordinary density-ratio regression with a bounded energy-difference transform and derives from it a sample-only training objective with the constant target 1. The learned scalar potential recovers log p without partition-function estimation or explicit unbounded ratio regression. Across continuous, discrete, and mixed-variable benchmarks, CTEM substantially improves density estimation over competitive baselines and yields higher-quality samples under standard sampling procedures.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

A non-local gradient based approach of infinity Laplacian with $Γ$-convergence

We propose an infinity Laplacian method to address the problem of interpolation on an unstructured point cloud. In doing so, we find the labeling function with the smallest infinity norm of its gradient. By introducing the non-local gradient, the continuous functional is approximated with a discrete form. The discrete problem is convex and can be solved efficiently with the split Bregman method. Experimental results indicate that our approach provides consistent interpolations and the labeling functions obtained are globally smooth, even in the case of extreme low sampling rate. More importantly, convergence of the discrete minimizer to the optimal continuous labeling function is proved using $Γ$-convergence and compactness, which guarantees the reliability of the infinity Laplacian method in various potential applications.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

A scalable deep learning approach for solving high-dimensional dynamic optimal transport

The dynamic formulation of optimal transport has attracted growing interests in scientific computing and machine learning, and its computation requires to solve a PDE-constrained optimization problem. The classical Eulerian discretization based approaches suffer from the curse of dimensionality, which arises from the approximation of high-dimensional velocity field. In this work, we propose a deep learning based method to solve the dynamic optimal transport in high dimensional space. Our method contains three main ingredients: a carefully designed representation of the velocity field, the discretization of the PDE constraint along the characteristics, and the computation of high dimensional integral by Monte Carlo method in each time step. Specifically, in the representation of the velocity field, we apply the classical nodal basis function in time and the deep neural networks in space domain with the H1-norm regularization. This technique promotes the regularity of the velocity field in both time and space such that the discretization along the characteristic remains to be stable during the training process. Extensive numerical examples have been conducted to test the proposed method. Compared to other solvers of optimal transport, our method could give more accurate results in high dimensional cases and has very good scalability with respect to dimension. Finally, we extend our method to more complicated cases such as crowd motion problem.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

BI-GreenNet: Learning Green's functions by boundary integral network

Green's function plays a significant role in both theoretical analysis and numerical computing of partial differential equations (PDEs). However, in most cases, Green's function is difficult to compute. The troubles arise in the following three folds. Firstly, compared with the original PDE, the dimension of Green's function is doubled, making it impossible to be handled by traditional mesh-based methods. Secondly, Green's function usually contains singularities which increase the difficulty to get a good approximation. Lastly, the computational domain may be very complex or even unbounded. To override these problems, we leverage the fundamental solution, boundary integral method and neural networks to develop a new method for computing Green's function with high accuracy in this paper. We focus on Green's function of Poisson and Helmholtz equations in bounded domains, unbounded domains. We also consider Poisson equation and Helmholtz domains with interfaces. Extensive numerical experiments illustrate the efficiency and the accuracy of our method for solving Green's function. In addition, we also use the Green's function calculated by our method to solve a class of PDE, and also obtain high-precision solutions, which shows the good generalization ability of our method on solving PDEs.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

M2N: Mesh Movement Networks for PDE Solvers

Mainstream numerical Partial Differential Equation (PDE) solvers require discretizing the physical domain using a mesh. Mesh movement methods aim to improve the accuracy of the numerical solution by increasing mesh resolution where the solution is not well-resolved, whilst reducing unnecessary resolution elsewhere. However, mesh movement methods, such as the Monge-Ampere method, require the solution of auxiliary equations, which can be extremely expensive especially when the mesh is adapted frequently. In this paper, we propose to our best knowledge the first learning-based end-to-end mesh movement framework for PDE solvers. Key requirements of learning-based mesh movement methods are alleviating mesh tangling, boundary consistency, and generalization to mesh with different resolutions. To achieve these goals, we introduce the neural spline model and the graph attention network (GAT) into our models respectively. While the Neural-Spline based model provides more flexibility for large deformation, the GAT based model can handle domains with more complicated shapes and is better at performing delicate local deformation. We validate our methods on stationary and time-dependent, linear and non-linear equations, as well as regularly and irregularly shaped domains. Compared to the traditional Monge-Ampere method, our approach can greatly accelerate the mesh adaptation process, whilst achieving comparable numerical error reduction.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Unsupervised Deep Learning Meets Chan-Vese Model

The Chan-Vese (CV) model is a classic region-based method in image segmentation. However, its piecewise constant assumption does not always hold for practical applications. Many improvements have been proposed but the issue is still far from well solved. In this work, we propose an unsupervised image segmentation approach that integrates the CV model with deep neural networks, which significantly improves the original CV model's segmentation accuracy. Our basic idea is to apply a deep neural network that maps the image into a latent space to alleviate the violation of the piecewise constant assumption in image space. We formulate this idea under the classic Bayesian framework by approximating the likelihood with an evidence lower bound (ELBO) term while keeping the prior term in the CV model. Thus, our model only needs the input image itself and does not require pre-training from external datasets. Moreover, we extend the idea to multi-phase case and dataset based unsupervised image segmentation. Extensive experiments validate the effectiveness of our model and show that the proposed method is noticeably better than other unsupervised segmentation approaches.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Interpolation between Residual and Non-Residual Networks

Although ordinary differential equations (ODEs) provide insights for designing network architectures, its relationship with the non-residual convolutional neural networks (CNNs) is still unclear. In this paper, we present a novel ODE model by adding a damping term. It can be shown that the proposed model can recover both a ResNet and a CNN by adjusting an interpolation coefficient. Therefore, the damped ODE model provides a unified framework for the interpretation of residual and non-residual networks. The Lyapunov analysis reveals better stability of the proposed model, and thus yields robustness improvement of the learned networks. Experiments on a number of image classification benchmarks show that the proposed model substantially improves the accuracy of ResNet and ResNeXt over the perturbed inputs from both stochastic noise and adversarial attack methods. Moreover, the loss landscape analysis demonstrates the improved robustness of our method along the attack direction.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

MAGIC: Manifold and Graph Integrative Convolutional Network for Low-Dose CT Reconstruction

Low-dose computed tomography (LDCT) scans, which can effectively alleviate the radiation problem, will degrade the imaging quality. In this paper, we propose a novel LDCT reconstruction network that unrolls the iterative scheme and performs in both image and manifold spaces. Because patch manifolds of medical images have low-dimensional structures, we can build graphs from the manifolds. Then, we simultaneously leverage the spatial convolution to extract the local pixel-level features from the images and incorporate the graph convolution to analyze the nonlocal topological features in manifold space. The experiments show that our proposed method outperforms both the quantitative and qualitative aspects of state-of-the-art methods. In addition, aided by a projection loss component, our proposed method also demonstrates superior performance for semi-supervised learning. The network can remove most noise while maintaining the details of only 10% (40 slices) of the training data labeled.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

A convergent point integral method for isotropic elliptic equations on point cloud

In this paper, we propose a numerical method to solve isotropic elliptic equations on point cloud by generalizing the point integral method. The idea of the point integral method is to approximate the differential operators by integral operators and discretize the corresponding integral equation on point cloud. The key step is to get the integral approximation. In this paper, with proper kernel function, we get an integral approximation for the elliptic operators with isotropic coefficients. Moreover, the integral approximation has been proved to keep the coercivity of the original elliptic operator. The convergence of the point integral method is also proved.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

A Harmonic Extension Approach for Collaborative Ranking

We present a new perspective on graph-based methods for collaborative ranking for recommender systems. Unlike user-based or item-based methods that compute a weighted average of ratings given by the nearest neighbors, or low-rank approximation methods using convex optimization and the nuclear norm, we formulate matrix completion as a series of semi-supervised learning problems, and propagate the known ratings to the missing ones on the user-user or item-item graph globally. The semi-supervised learning problems are expressed as Laplace-Beltrami equations on a manifold, or namely, harmonic extension, and can be discretized by a point integral method. We show that our approach does not impose a low-rank Euclidean subspace on the data points, but instead minimizes the dimension of the underlying manifold. Our method, named LDM (low dimensional manifold), turns out to be particularly effective in generating rankings of items, showing decent computational efficiency and robust ranking quality compared to state-of-the-art methods.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Convergence of the Point Integral method for Poisson equation on point cloud

The Laplace-Beltrami operator (LBO) is a fundamental object associated to Riemannian manifolds, which encodes all intrinsic geometry of the manifolds and has many desirable properties. Recently, we proposed a novel numerical method, Point Integral method (PIM), to discretize the Laplace-Beltrami operator on point clouds \cite{LSS}. In this paper, we analyze the convergence of Point Integral method (PIM) for Poisson equation with Neumann boundary condition on submanifolds isometrically embedded in Euclidean spaces.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Convergence of the Point Integral method for the Poisson equation with Dirichlet boundary on point cloud

The Poisson equation on manifolds plays an fundamental role in many applications. Recently, we proposed a novel numerical method called the Point Integral method (PIM) to solve the Poisson equations on manifolds from point clouds. In this paper, we prove the convergence of the point integral method for solving the Poisson equation with the Dirichlet boundary condition.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Convergence of Laplacian Spectra from Point Clouds

The spectral structure of the Laplacian-Beltrami operator (LBO) on manifolds has been widely used in many applications, include spectral clustering, dimensionality reduction, mesh smoothing, compression and editing, shape segmentation, matching and parameterization, and so on. Typically, the underlying Riemannian manifold is unknown and often given by a set of sample points. The spectral structure of the LBO is estimated from some discrete Laplace operator constructed from this set of sample points. In our previous papers, we proposed the point integral method to discretize the LBO from point clouds, which is also capable to solve the eigenproblem. Then one fundmental issue is the convergence of the eigensystem of the discrete Laplacian to that of the LBO. In this paper, for compact manifolds isometrically embedded in Euclidean spaces possibly with boundary, we show that the eigenvalues and the eigenvectors obtained by the point integral method converges to the eigenvalues and the eigenfunctions of the LBO with the Neumann boundary, and in addition, we give an estimate of the convergence rate. This result provides a solid mathematical foundation for the point integral method in the computation of Laplacian spectra from point clouds.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Convergence of Laplacian spectra from random samples

Eigenvectors and eigenvalues of discrete graph Laplacians are often used for manifold learning and nonlinear dimensionality reduction. It was previously proved by Belkin and Niyogi that the eigenvectors and eigenvalues of the graph Laplacian converge to the eigenfunctions and eigenvalues of the Laplace-Beltrami operator of the manifold in the limit of infinitely many data points sampled independently from the uniform distribution over the manifold. Recently, we introduced Point Integral method (PIM) to solve elliptic equations and corresponding eigenvalue problem on point clouds. We have established a unified framework to approximate the elliptic differential operators on point clouds. In this paper, we prove that the eigenvectors and eigenvalues obtained by PIM converge in the limit of infinitely many random samples independently from a distribution (not necessarily to be uniform distribution). Moreover, one estimate of the rate of the convergence is also given.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Enforce the Dirichlet boundary condition by volume constraint in Point Integral method

Recently, Shi and Sun proposed Point Integral method (PIM) to discretize Laplace-Beltrami operator on point cloud. In PIM, Neumann boundary is nature, but Dirichlet boundary needs some special treatment. In our previous work, we use Robin boundary to approximate Dirichlet boundary. In this paper, we introduce another approach to deal with the Dirichlet boundary condition in point integral method using the volume constraint proposed by Du et.al.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Extracting a shape function for a signal with intra-wave frequency modulation

In this paper, we consider signals with intra-wave frequency modulation. To handle this kind of signals effectively, we generalize our data-driven time-frequency analysis by using a shape function to describe the intra-wave frequency modulation. The idea of using a shape function in time-frequency analysis was first proposed by Wu. A shape function could be any periodic function. Based on this model, we propose to solve an optimization problem to extract the shape function. By exploring the fact that s is a periodic function, we can identify certain low rank structure of the signal. This structure enables us to extract the shape function from the signal. To test the robustness of our method, we apply our method on several synthetic and real signals. The results are very encouraging.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Harmonic Extension

In this paper, we consider the harmonic extension problem, which is widely used in many applications of machine learning. We find that the transitional method of graph Laplacian fails to produce a good approximation of the classical harmonic function. To tackle this problem, we propose a new method called the point integral method (PIM). We consider the harmonic extension problem from the point of view of solving PDEs on manifolds. The basic idea of the PIM method is to approximate the harmonicity using an integral equation, which is easy to be discretized from points. Based on the integral equation, we explain the reason why the transitional graph Laplacian may fail to approximate the harmonicity in the classical sense and propose a different approach which we call the volume constraint method (VCM). Theoretically, both the PIM and the VCM computes a harmonic function with convergence guarantees, and practically, they are both simple, which amount to solve a linear system. One important application of the harmonic extension in machine learning is semi-supervised learning. We run a popular semi-supervised learning algorithm by Zhu et al. over a couple of well-known datasets and compare the performance of the aforementioned approaches. Our experiments show the PIM performs the best.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

On the Uniqueness of Sparse Time-Frequency Representation of Multiscale Data

In this paper, we analyze the uniqueness of the sparse time frequency decomposition and investigate the efficiency of the nonlinear matching pursuit method. Under the assumption of scale separation, we show that the sparse time frequency decomposition is unique up to an error that is determined by the scale separation property of the signal. We further show that the unique decomposition can be obtained approximately by the sparse time frequency decomposition using nonlinear matching pursuit.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Point Integral Method for Solving Poisson-type Equations on Manifolds from Point Clouds with Convergence Guarantees

Partial differential equations (PDE) on manifolds arise in many areas, including mathematics and many applied fields. Among all kinds of PDEs, the Poisson-type equations including the standard Poisson equation and the related eigenproblem of the Laplace-Beltrami operator are of the most important. Due to the complicated geometrical structure of the manifold, it is difficult to get efficient numerical method to solve PDE on manifold. In the paper, we propose a method called point integral method (PIM) to solve the Poisson-type equations from point clouds with convergence guarantees. In PIM, the key idea is to derive the integral equations which approximates the Poisson-type equations and contains no derivatives but only the values of the unknown function. The latter makes the integral equation easy to be approximated from point cloud. In the paper, we explain the derivation of the integral equations, describe the point integral method and its implementation, and present the numerical experiments to demonstrate the convergence of PIM.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Sparse Time-Frequency decomposition for multiple signals with same frequencies

In this paper, we consider multiple signals sharing same instantaneous frequencies. This kind of data is very common in scientific and engineering problems. To take advantage of this special structure, we modify our data-driven time-frequency analysis by updating the instantaneous frequencies simultaneously. Moreover, based on the simultaneously sparsity approximation and fast Fourier transform, some efficient algorithms is developed. Since the information of multiple signals is used, this method is very robust to the perturbation of noise. And it is applicable to the general nonperiodic signals even with missing samples or outliers. Several synthetic and real signals are used to test this method. The performances of this method are very promising.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Sparse Time-Frequency decomposition by dictionary learning

In this paper, we propose a time-frequency analysis method to obtain instantaneous frequencies and the corresponding decomposition by solving an optimization problem. In this optimization problem, the basis to decompose the signal is not known. Instead, it is adapted to the signal and is determined as part of the optimization problem. In this sense, this optimization problem can be seen as a dictionary learning problem. This dictionary learning problem is solved by using the Augmented Lagrangian Multiplier method (ALM) iteratively. We further accelerate the convergence of the ALM method in each iteration by using the fast wavelet transform. We apply our method to decompose several signals, including signals with poor scale separation, signals with outliers and polluted by noise and a real signal. The results show that this method can give accurate recovery of both the instantaneous frequencies and the intrinsic mode functions.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Convergence of a data-driven time-frequency analysis method

In a recent paper, Hou and Shi introduced a new adaptive data analysis method to analyze nonlinear and non-stationary data. The main idea is to look for the sparsest representation of multiscale data within the largest possible dictionary consisting of intrinsic mode functions of the form $\{a(t) \cos(θ(t))\}$, where $a \in V(θ)$, $V(θ)$ consists of the functions smoother than $\cos(θ(t))$ and $θ'\ge 0$. This problem was formulated as a nonlinear $L^0$ optimization problem and an iterative nonlinear matching pursuit method was proposed to solve this nonlinear optimization problem. In this paper, we prove the convergence of this nonlinear matching pursuit method under some sparsity assumption on the signal. We consider both well-resolved and sparse sampled signals. In the case without noise, we prove that our method gives exact recovery of the original signal.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Data-Driven Time-Frequency Analysis

In this paper, we introduce a new adaptive data analysis method to study trend and instantaneous frequency of nonlinear and non-stationary data. This method is inspired by the Empirical Mode Decomposition method (EMD) and the recently developed compressed (compressive) sensing theory. The main idea is to look for the sparsest representation of multiscale data within the largest possible dictionary consisting of intrinsic mode functions of the form $\{a(t) \cos(θ(t))\}$, where $a \in V(θ)$, $V(θ)$ consists of the functions smoother than $\cos(θ(t))$ and $θ'\ge 0$. This problem can be formulated as a nonlinear $L^0$ optimization problem. In order to solve this optimization problem, we propose a nonlinear matching pursuit method by generalizing the classical matching pursuit for the $L^0$ optimization problem. One important advantage of this nonlinear matching pursuit method is it can be implemented very efficiently and is very stable to noise. Further, we provide a convergence analysis of our nonlinear matching pursuit method under certain scale separation assumptions. Extensive numerical examples will be given to demonstrate the robustness of our method and comparison will be made with the EMD/EEMD method. We also apply our method to study data without scale separation, data with intra-wave frequency modulation, and data with incomplete or under-sampled data.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

On Singularity Formation of a 3D Model for Incompressible Navier-Stokes Equations

We investigate the singularity formation of a 3D model that was recently proposed by Hou and Lei in [16] for axisymmetric 3D incompressible Navier-Stokes equations with swirl. The main difference between the 3D model of Hou and Lei and the reformulated 3D Navier-Stokes equations is that the convection term is neglected in the 3D model. This model shares many properties of the 3D incompressible Navier-Stokes equations. One of the main results of this paper is that we prove rigorously the finite time singularity formation of the 3D inviscid model for a class of initial boundary value problems with smooth initial data of finite energy. We also prove the global regularity of the 3D inviscid model for a class of small smooth initial data.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

On the Local Well-posedness of a 3D Model for Incompressible Navier-Stokes Equations with Partial Viscosity

In this short note, we study the local well-posedness of a 3D model for incompressible Navier-Stokes equations with partial viscosity. This model was originally proposed by Hou-Lei in \cite{HouLei09a}. In a recent paper, we prove that this 3D model with partial viscosity will develop a finite time singularity for a class of initial condition using a mixed Dirichlet Robin boundary condition. The local well-posedness analysis of this initial boundary value problem is more subtle than the corresponding well-posedness analysis using a standard boundary condition because the Robin boundary condition we consider is non-dissipative. We establish the local well-posedness of this initial boundary value problem by designing a Picard iteration in a Banach space and proving the convergence of the Picard iteration by studying the well-posedness property of the heat equation with the same Dirichlet Robin boundary condition.

0 citations0 reviewsNo code linkedOpen access
preprint2010arXiv

Dynamic Growth Estimates of Maximum Vorticity for 3D Incompressible Euler Equations and the SQG Model

By performing estimates on the integral of the absolute value of vorticity along a local vortex line segment, we establish a relatively sharp dynamic growth estimate of maximum vorticity under some assumptions on the local geometric regularity of the vorticity vector. Our analysis applies to both the 3D incompressible Euler equations and the surface quasi-geostrophic model (SQG). As an application of our vorticity growth estimate, we apply our result to the 3D Euler equation with the two anti-parallel vortex tubes initial data considered by Hou-Li. Under some additional assumption on the vorticity field, which seems to be consistent with the computational results of Hou-Li, we show that the maximum vorticity can not grow faster than double exponential in time. Our analysis extends the earlier results by Cordoba-Fefferman and Deng-Hou-Yu.

0 citations0 reviewsNo code linkedOpen access
preprint2010arXiv

On Singularity Formation of a Nonlinear Nonlocal System

We investigate the singularity formation of a nonlinear nonlocal system. This nonlocal system is a simplified one-dimensional system of the 3D model that was recently proposed by Hou and Lei in [13] for axisymmetric 3D incompressible Navier-Stokes equations with swirl. The main difference between the 3D model of Hou and Lei and the reformulated 3D Navier-Stokes equations is that the convection term is neglected in the 3D model. In the nonlocal system we consider in this paper, we replace the Riesz operator in the 3D model by the Hilbert transform. One of the main results of this paper is that we prove rigorously the finite time singularity formation of the nonlocal system for a large class of smooth initial data with finite energy. We also prove the global regularity for a class of smooth initial data. Numerical results will be presented to demonstrate the asymptotically self-similar blow-up of the solution. The blowup rate of the self-similar singularity of the nonlocal system is similar to that of the 3D model.

0 citations0 reviewsNo code linkedOpen access