BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

Bangti Jin

Bangti Jin appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
math.NANumerical Analysismath.OCmath.APMachine Learningeess.IVInformation Theorymath.ITComputer Visionmath.CAmath.STStatistics TheorySystems and Control

Catalog footprint

What is connected

47works
13topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

47 published item(s)

preprint2023arXiv

Recovery of a Distributed Order Fractional Derivative in an Unknown Medium

In this work, we study an inverse problem of recovering information about the weight in distributed-order time-fractional diffusion from the observation at one single point on the domain boundary. In the absence of an explicit knowledge of the medium, we prove that the one-point observation can uniquely determine the support bound of the weight. The proof is based on asymptotics of the data, analytic continuation and Titchmarch convolution theorem. When the medium is known, we give an alternative proof of an existing result, i.e., the one-point boundary observation uniquely determines the weight. Several numerical experiments are also presented to complement the analysis.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Bayesian Experimental Design for Computed Tomography with the Linearised Deep Image Prior

We investigate adaptive design based on a single sparse pilot scan for generating effective scanning strategies for computed tomography reconstruction. We propose a novel approach using the linearised deep image prior. It allows incorporating information from the pilot measurements into the angle selection criteria, while maintaining the tractability of a conjugate Gaussian-linear model. On a synthetically generated dataset with preferential directions, linearised DIP design allows reducing the number of scans by up to 30% relative to an equidistant angle baseline.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Imaging Anisotropic Conductivities from Current Densities

In this paper, we propose and analyze a reconstruction algorithm for imaging an anisotropic conductivity tensor in a second-order elliptic PDE with a nonzero Dirichlet boundary condition from internal current densities. It is based on a regularized output least-squares formulation with the standard $L^2(Ω)^{d,d}$ penalty, which is then discretized by the standard Galerkin finite element method. We establish the continuity and differentiability of the forward map with respect to the conductivity tensor in the $L^p(Ω)^{d,d}$-norms, the existence of minimizers and optimality systems of the regularized formulation using the concept of H-convergence. Further, we provide a detailed analysis of the discretized problem, especially the convergence of the discrete approximations with respect to the mesh size, using the discrete counterpart of H-convergence. In addition, we develop a projected Newton algorithm for solving the first-order optimality system. We present extensive two-dimensional numerical examples to show the efficiency of the proposed method.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Imaging Conductivity from Current Density Magnitude using Neural Networks

Conductivity imaging represents one of the most important tasks in medical imaging. In this work we develop a neural network based reconstruction technique for imaging the conductivity from the magnitude of the internal current density. It is achieved by formulating the problem as a relaxed weighted least-gradient problem, and then approximating its minimizer by standard fully connected feedforward neural networks. We derive bounds on two components of the generalization error, i.e., approximation error and statistical error, explicitly in terms of properties of the neural networks (e.g., depth, total number of parameters, and the bound of the network parameters). We illustrate the performance and distinct features of the approach on several numerical experiments. Numerically, it is observed that the approach enjoys remarkable robustness with respect to the presence of data noise.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

An Analysis of Stochastic Variance Reduced Gradient for Linear Inverse Problems

Stochastic variance reduced gradient (SVRG) is a popular variance reduction technique for accelerating stochastic gradient descent (SGD). We provide a first analysis of the method for solving a class of linear inverse problems in the lens of the classical regularization theory. We prove that for a suitable constant step size schedule, the method can achieve an optimal convergence rate in terms of the noise level (under suitable regularity condition) and the variance of the SVRG iterate error is smaller than that by SGD. These theoretical findings are corroborated by a set of numerical experiments.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Numerical Estimation of a Diffusion Coefficient in Subdiffusion

In this work, we consider the numerical recovery of a spatially dependent diffusion coefficient in a subdiffusion model from distributed observations. The subdiffusion model involves a Caputo fractional derivative of order $α\in(0,1)$ in time. The numerical estimation is based on the regularized output least-squares formulation, with an $H^1(Ω)$ penalty. We prove the well-posedness of the continuous formulation, e.g., existence and stability. Next, we develop a fully discrete scheme based on the Galerkin finite element method in space and backward Euler convolution quadrature in time. We prove the subsequential convergence of the sequence of discrete solutions to a solution of the continuous problem as the discretization parameters (mesh size and time step size) tend to zero. Further, under an additional regularity condition on the exact coefficient, we derive convergence rates in a weighted $L^2(Ω)$ norm for the discrete approximations to the exact coefficient {in the one- and two-dimensional cases}. The analysis relies heavily on suitable nonstandard nonsmooth data error estimates for the direct problem. We provide illustrative numerical results to support the theoretical study.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

An Inverse Potential Problem for Subdiffusion: Stability and Reconstruction

In this work, we study the inverse problem of recovering a potential coefficient in the subdiffusion model, which involves a Djrbashian-Caputo derivative of order $α\in(0,1)$ in time, from the terminal data. We prove that the inverse problem is locally Lipschitz for small terminal time, under certain conditions on the initial data. This result extends the result in Choulli and Yamamoto (1997) for the standard parabolic case to the fractional case. The analysis relies on refined properties of two-parameter Mittag-Leffler functions, e.g., complete monotonicity and asymptotics. Further, we develop an efficient and easy-to-implement algorithm for numerically recovering the coefficient based on (preconditioned) fixed point iteration and Anderson acceleration. The efficiency and accuracy of the algorithm is illustrated with several numerical examples.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Incomplete Iterative Solution of the Subdiffusion Problem

In this work, we develop an efficient incomplete iterative scheme for the numerical solution of the subdiffusion model involving a Caputo derivative of order $α\in(0,1)$ in time. It is based on piecewise linear Galerkin finite element method in space and backward Euler convolution quadrature in time and solves one linear algebraic system inexactly by an iterative algorithm at each time step. We present theoretical results for both smooth and nonsmooth solutions, using novel weighted estimates of the time-stepping scheme. The analysis indicates that with the number of iterations at each time level chosen properly, the error estimates are nearly identical with that for the exact linear solver, and the theoretical findings provide guidelines on the choice. Illustrative numerical results are presented to complement the theoretical analysis.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

L1 data fitting for robust reconstruction in magnetic particle imaging: quantitative evaluation on Open MPI dataset

Magnetic particle imaging is an emerging quantitative imaging modality, exploiting the unique nonlinear magnetization phenomenon of superparamagnetic iron oxide nanoparticles for recovering the concentration. Traditionally the reconstruction is formulated into a penalized least-squares problem with nonnegativity constraint, and then solved using a variant of Kaczmarz method which is often stopped early after a small number of iterations. Besides the phantom signal, measurements additionally include a background signal and a noise signal. In order to obtain good reconstructions, a preprocessing step of frequency selection to remove the deleterious influences of the noise is often adopted. In this work, we propose a complementary pure variational approach to noise treatment, by viewing highly noisy measurements as outliers, and employing the l1 data fitting, one popular approach from robust statistics. When compared with the standard approach, it is easy to implement with a comparable computational complexity. Experiments with a public domain dataset, i.e., Open MPI dataset, show that it can give accurate reconstructions, and is less prone to noisy measurements, which is illustrated by quantitative (PSNR / SSIM) and qualitative comparisons with the Kaczmarz method. We also investigate the performance of the Kaczmarz method for small iteration numbers quantitatively.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

On the Discrepancy Principle for Stochastic Gradient Descent

Stochastic gradient descent (SGD) is a promising numerical method for solving large-scale inverse problems. However, its theoretical properties remain largely underexplored in the lens of classical regularization theory. In this note, we study the classical discrepancy principle, one of the most popular \textit{a posteriori} choice rules, as the stopping criterion for SGD, and prove the finite iteration termination property and the convergence of the iterate in probability as the noise level tends to zero. The theoretical results are complemented with extensive numerical experiments.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Probabilistic Residual Learning for Aleatoric Uncertainty in Image Restoration

Aleatoric uncertainty is an intrinsic property of ill-posed inverse and imaging problems. Its quantification is vital for assessing the reliability of relevant point estimates. In this paper, we propose an efficient framework for quantifying aleatoric uncertainty for deep residual learning and showcase its significant potential on image restoration. In the framework, we divide the conditional probability modeling for the residual variable into a deterministic homo-dimensional level, a stochastic low-dimensional level and a merging level. The low-dimensionality is especially suitable for sparse correlation between image pixels, enables efficient sampling for high dimensional problems and acts as a regularizer for the distribution. Preliminary numerical experiments show that the proposed method can give not only state-of-the-art point estimates of image restoration but also useful associated uncertainty information.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Subdiffusion with Time-Dependent Coefficients: Improved Regularity and Second-Order Time Stepping

This article concerns second-order time discretization of subdiffusion equations with time-dependent diffusion coefficients. High-order differentiability and regularity estimates are established for subdiffusion equations with time-dependent coefficients. Using these regularity results and a perturbation argument of freezing the diffusion coefficient, we prove that the convolution quadrature generated by the second-order backward differentiation formula, with proper correction at the first time step, can achieve second-order convergence for both nonsmooth initial data and incompatible source term. Numerical experiments are consistent with the theoretical results.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Wasserstein Gradient Flow Formulation of the Time-Fractional Fokker-Planck Equation

In this work, we investigate a variational formulation for a time-fractional Fokker-Planck equation which arises in the study of complex physical systems involving anomalously slow diffusion. The model involves a fractional-order Caputo derivative in time, and thus inherently nonlocal. The study follows the Wasserstein gradient flow approach pioneered by [26]. We propose a JKO type scheme for discretizing the model, using the L1 scheme for the Caputo fractional derivative in time, and establish the convergence of the scheme as the time step size tends to zero. Illustrative numerical results in one- and two-dimensional problems are also presented to show the approach.

0 citations0 reviewsNo code linkedOpen access
preprint2019arXiv

A Parameter Choice Rule for Tikhonov Regularization Based on Predictive Risk

In this work, we propose a new criterion for choosing the regularization parameter in Tikhonov regularization when the noise is white Gaussian. The criterion minimizes a lower bound of the predictive risk, when both data norm and noise variance are known, and the parameter choice involves minimizing a function whose solution depends only on the signal-to-noise ratio. Moreover, when neither noise variance nor data norm is given, we propose an iterative algorithm which alternates between a minimization step of finding the regularization parameter and an estimation step of estimating signal-to-noise ratio. Simulation studies on both small- and large-scale datasets suggest that the approach can provide very accurate and stable regularized inverse solutions and, for small sized samples, it outperforms discrepancy principle, balancing principle, unbiased predictive risk estimator, L-curve method generalized cross validation, and quasi-optimality criterion, and achieves excellent stability hitherto unavailable.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

An Analysis of Galerkin Proper Orthogonal Decomposition for Subdiffusion

In this work, we develop a novel Galerkin-L1-POD scheme for the subdiffusion model with a Caputo fractional derivative of order $α\in (0,1)$ in time, which is often used to describe anomalous diffusion processes in heterogeneous media. The nonlocality of the fractional derivative requires storing all the solutions from time zero. The proposed scheme is based on continuous piecewise linear finite elements, L1 time stepping, and proper orthogonal decomposition (POD). By constructing an effective reduced-order scheme using problem-adapted basis functions, it can significantly reduce the computational complexity and storage requirement. We shall provide a complete error analysis of the scheme under realistic regularity assumptions by means of a novel energy argument. Extensive numerical experiments are presented to verify the convergence analysis and the efficiency of the proposed scheme.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Group Sparse Recovery via the $\ell^0(\ell^2)$ Penalty: Theory and Algorithm

In this work we propose and analyze a novel approach for group sparse recovery. It is based on regularized least squares with an $\ell^0(\ell^2)$ penalty, which penalizes the number of nonzero groups. One distinct feature of the approach is that it has the built-in decorrelation mechanism within each group, and thus can handle challenging strong inner-group correlation. We provide a complete analysis of the regularized model, e.g., existence of a global minimizer, invariance property, support recovery, and properties of block coordinatewise minimizers. Further, the regularized problem admits an efficient primal dual active set algorithm with a provable finite-step global convergence. At each iteration, it involves solving a least-squares problem on the active set only, and exhibits a fast local convergence, which makes the method extremely efficient for recovering group sparse signals. Extensive numerical experiments are presented to illustrate salient features of the model and the efficiency and accuracy of the algorithm. A comparative study indicates its competitiveness with existing approaches.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

A Finite Element Method With Singularity Reconstruction for Fractional Boundary Value Problems

We consider a two-point boundary value problem involving a Riemann-Liouville fractional derivative of order $\al\in (1,2)$ in the leading term on the unit interval $(0,1)$. Generally the standard Galerkin finite element method can only give a low-order convergence even if the source term is very smooth due to the presence of the singularity term $x^{\al-1}$ in the solution representation. In order to enhance the convergence, we develop a simple singularity reconstruction strategy by splitting the solution into a singular part and a regular part, where the former captures explicitly the singularity. We derive a new variational formulation for the regular part, and establish that the Galerkin approximation of the regular part can achieve a better convergence order in the $L^2(0,1)$, $H^{\al/2}(0,1)$ and $L^\infty(0,1)$-norms than the standard Galerkin approach, with a convergence rate for the recovered singularity strength identical with the $L^2(0,1)$ error estimate. The reconstruction approach is very flexible in handling explicit singularity, and it is further extended to the case of a Neumann type boundary condition on the left end point, which involves a strong singularity $x^{\al-2}$. Extensive numerical results confirm the theoretical study and efficiency of the proposed approach.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

A Petrov-Galerkin Finite Element Method for Fractional Convection-Diffusion Equations

In this work, we develop variational formulations of Petrov-Galerkin type for one-dimensional fractional boundary value problems involving either a Riemann-Liouville or Caputo derivative of order $α\in(3/2, 2)$ in the leading term and both convection and potential terms. They arise in the mathematical modeling of asymmetric super-diffusion processes in heterogeneous media. The well-posedness of the formulations and sharp regularity pickup of the variational solutions are established. A novel finite element method is developed, which employs continuous piecewise linear finite elements and "shifted" fractional powers for the trial and test space, respectively. The new approach has a number of distinct features: It allows deriving optimal error estimates in both $L^2(D)$ and $H^1(D)$ norms; and on a uniform mesh, the stiffness matrix of the leading term is diagonal and the resulting linear system is well conditioned. Further, in the Riemann-Liouville case, an enriched FEM is proposed to improve the convergence. Extensive numerical results are presented to verify the theoretical analysis and robustness of the numerical scheme.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

A simple finite element method for the boundary value problem with a Riemann-Liouville derivative

We consider a boundary value problem involving a Riemann-Liouville fractional derivative of order $α\in (3/2,2)$ on the unit interval $(0,1)$. The standard Galerkin finite element approximation converges slowly due to the presence of singularity term $x^{α-1}$ in the solution representation. In this work, we develop a simple technique, by transforming it into a second-order two-point boundary value problem with nonlocal low order terms, whose solution can reconstruct directly the solution to the original problem. The stability of the variational formulation, and the optimal regularity pickup of the solution are analyzed. A novel Galerkin finite element method with piecewise linear or quadratic finite elements is developed, and $L^2(D)$ error estimates are provided. The approach is then applied to the corresponding fractional Sturm-Liouville problem, and error estimates of the eigenvalue approximations are given. Extensive numerical results fully confirm our theoretical study.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

A Tutorial on Inverse Problems for Anomalous Diffusion Processes

Over the last two decades, anomalous diffusion processes in which the mean squares variance grows slower or faster than that in a Gaussian process have found many applications. At a macroscopic level, these processes are adequately described by fractional differential equations, which involves fractional derivatives in time or/and space. The fractional derivatives describe either history mechanism or long range interactions of particle motions at a microscopic level. The new physics can change dramatically the behavior of the forward problems. Naturally one expects that the new physics will impact related inverse problems in terms of uniqueness, stability, and degree of ill-posedness. The last aspect is especially important from a practical point of view, i.e., stably reconstructing the quantities of interest. In this paper, we employ a formal analytic and numerical way to examine the degree of ill-posedness of several "classical" inverse problems for fractional differential equations involving a Djrbashian-Caputo fractional derivative in either time or space, which represent the fractional analogues of that for classical integral order differential equations. We discuss four inverse problems, i.e., backward fractional diffusion, sideways problem, inverse source problem and inverse potential problem for time fractional diffusion, and inverse Sturm-Liouville problem, Cauchy problem, backward fractional diffusion and sideways problem for space fractional diffusion. It is found that contrary to the wide belief, the influence of anomalous diffusion on the degree of ill-posedness is not definitive: it can either significantly improve or worsen the conditioning of related inverse problems, depending crucially on the specific type of given data and quantity of interest. Further, the study exhibits distinct new features of "fractional" inverse problems.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

An analysis of the L1 Scheme for the subdiffusion equation with nonsmooth data

The subdiffusion equation with a Caputo fractional derivative of order $α\in(0,1)$ in time arises in a wide variety of practical applications, and it is often adopted to model anomalous subdiffusion processes in heterogeneous media. The L1 scheme is one of the most popular and successful numerical methods for discretizing the Caputo fractional derivative in time. The scheme was analyzed earlier independently by Lin and Xu (2007) and Sun and Wu (2006), and an $O(τ^{2-α})$ convergence rate was established, under the assumption that the solution is twice continuously differentiable in time. However, in view of the smoothing property of the subdiffusion equation, this regularity condition is restrictive, since it does not hold even for the homogeneous problem with a smooth initial data. In this work, we revisit the error analysis of the scheme, and establish an $O(τ)$ convergence rate for both smooth and nonsmooth initial data. The analysis is valid for more general sectorial operators. In particular, the L1 scheme is applied to one-dimensional space-time fractional diffusion equations, which involves also a Riemann-Liouville derivative of order $β\in(3/2,2)$ in space, and error estimates are provided for the fully discrete scheme. Numerical experiments are provided to verify the sharpness of the error estimates, and robustness of the scheme with respect to data regularity.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

An Analysis of the Rayleigh-Stokes problem for a Generalized Second-Grade Fluid

We study the Rayleigh-Stokes problem for a generalized second-grade fluid which involves a Riemann-Liouville fractional derivative in time, and present an analysis of the problem in the continuous, space semidiscrete and fully discrete formulations. We establish the Sobolev regularity of the homogeneous problem for both smooth and nonsmooth initial data $v$, including $v\in L^2(Ω)$. A space semidiscrete Galerkin scheme using continuous piecewise linear finite elements is developed, and optimal with respect to initial data regularity error estimates for the finite element approximations are derived. Further, two fully discrete schemes based on the backward Euler method and second-order backward difference method and the related convolution quadrature are developed, and optimal error estimates are derived for the fully discrete approximations for both smooth and nonsmooth initial data. Numerical results for one- and two-dimensional examples with smooth and nonsmooth initial data are presented to illustrate the efficiency of the method, and to verify the convergence theory.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Error Estimates for Approximations of Distributed Order Time Fractional Diffusion with Nonsmooth Data

In this work, we consider the numerical solution of an initial boundary value problem for the distributed order time fractional diffusion equation. The model arises in the mathematical modeling of ultra-slow diffusion processes observed in some physical problems, whose solution decays only logarithmically as the time $t$ tends to infinity. We develop a space semidiscrete scheme based on the standard Galerkin finite element method, and establish error estimates optimal with respect to data regularity in $L^2(D)$ and $H^1(D)$ norms for both smooth and nonsmooth initial data. Further, we propose two fully discrete schemes, based on the Laplace transform and convolution quadrature generated by the backward Euler method, respectively, and provide optimal convergence rates in the $L^2(D)$ norm, which exhibits exponential convergence and first-order convergence in time, respectively. Extensive numerical experiments are provided to verify the error estimates for both smooth and nonsmooth initial data, and to examine the asymptotic behavior of the solution.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Lagrange optimality system for a class of nonsmooth convex optimization

In this paper, we revisit the augmented Lagrangian method for a class of nonsmooth convex optimization. We present the Lagrange optimality system of the augmented Lagrangian associated with the problems, and establish its connections with the standard optimality condition and the saddle point condition of the augmented Lagrangian, which provides a powerful tool for developing numerical algorithms. We apply a linear Newton method to the Lagrange optimality system to obtain a novel algorithm applicable to a variety of nonsmooth convex optimization problems arising in practical applications. Under suitable conditions, we prove the nonsingularity of the Newton system and the local convergence of the algorithm.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

On Nonnegativity Preservation in Finite Element Methods for Subdiffusion Equations

We consider three types of subdiffusion models, namely single-term, multi-term and distributed order fractional diffusion equations, for which the maximum-principle holds and which, in particular, preserve nonnegativity. Hence the solution is nonnegative for nonnegative initial data. Following earlier work on the heat equation, our purpose is to study whether this property is inherited by certain spatially semidiscrete and fully discrete piecewise linear finite element methods, including the standard Galerkin method, the lumped mass method and the finite volume element method. It is shown that, as for the heat equation, when the mass matrix is nondiagonal, nonnegativity is not preserved for small time or time-step, but may reappear after a positivity threshold. For the lumped mass method nonnegativity is preserved if and only if the triangulation in the finite element space is of Delaunay type. Numerical experiments illustrate and complement the theoretical results.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Two Schemes for Fractional Diffusion and Diffusion-Wave Equations with Nonsmooth Data

We consider the initial/boundary value problem for the fractional diffusion and diffusion-wave equations involving a Caputo fractional derivative in time. We develop two "simple" fully discrete schemes based on the Galerkin finite element method in space and convolution quadrature in time with the generating function given by the implicit backward Euler method/second-order backward difference method, and establish error estimates optimal with respect to the regularity of the initial data. These two schemes are first and second-order accurate in time for nonsmooth initial data. Extensive numerical experiments for one and two-dimensional problems confirm the convergence analysis. A detailed comparison with several popular time stepping schemes is also performed. The numerical results indicate that the proposed fully discrete schemes are accurate and robust for nonsmooth data, and competitive with existing schemes.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

A Primal Dual Active Set with Continuation Algorithm for the \ell^0-Regularized Optimization Problem

We develop a primal dual active set with continuation algorithm for solving the \ell^0-regularized least-squares problem that frequently arises in compressed sensing. The algorithm couples the the primal dual active set method with a continuation strategy on the regularization parameter. At each inner iteration, it first identifies the active set from both primal and dual variables, and then updates the primal variable by solving a (typically small) least-squares problem defined on the active set, from which the dual variable can be updated explicitly. Under certain conditions on the sensing matrix, i.e., mutual incoherence property or restricted isometry property, and the noise level, the finite step global convergence of the algorithm is established. Extensive numerical examples are presented to illustrate the efficiency and accuracy of the algorithm and the convergence analysis.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Multilevel Markov Chain Monte Carlo Method for High-Contrast Single-Phase Flow Problems

In this paper we propose a general framework for the uncertainty quantification of quantities of interest for high-contrast single-phase flow problems. It is based on the generalized multiscale finite element method (GMsFEM) and multilevel Monte Carlo (MLMC) methods. The former provides a hierarchy of approximations of different resolution, whereas the latter gives an efficient way to estimate quantities of interest using samples on different levels. The number of basis functions in the online GMsFEM stage can be varied to determine the solution resolution and the computational cost, and to efficiently generate samples at different levels. In particular, it is cheap to generate samples on coarse grids but with low resolution, and it is expensive to generate samples on fine grids with high accuracy. By suitably choosing the number of samples at different levels, one can leverage the expensive computation in larger fine-grid spaces toward smaller coarse-grid spaces, while retaining the accuracy of the final Monte Carlo estimate. Further, we describe a multilevel Markov chain Monte Carlo method, which sequentially screens the proposal with different levels of approximations and reduces the number of evaluations required on fine grids, while combining the samples at different levels to arrive at an accurate estimate. The framework seamlessly integrates the multiscale features of the GMsFEM with the multilevel feature of the MLMC methods following the work in \cite{ketelson2013}, and our numerical experiments illustrate its efficiency and accuracy in comparison with standard Monte Carlo estimates.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

The Galerkin Finite Element Method for A Multi-term Time-Fractional Diffusion equation

We consider the initial/boundary value problem for a diffusion equation involving multiple time-fractional derivatives on a bounded convex polyhedral domain. We analyze a space semidiscrete scheme based on the standard Galerkin finite element method using continuous piecewise linear functions. Nearly optimal error estimates for both cases of initial data and inhomogeneous term are derived, which cover both smooth and nonsmooth data. Further we develop a fully discrete scheme based on a finite difference discretization of the time-fractional derivatives, and discuss its stability and error estimate. Extensive numerical experiments for one and two-dimension problems confirm the convergence rates of the theoretical results.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

A Finite Element Method for the Fractional Sturm-Liouville Problem

In this work, we propose an efficient finite element method for solving fractional Sturm-Liouville problems involving either the Caputo or Riemann-Liouville derivative of order $α\in(1,2)$ on the unit interval $(0,1)$. It is based on novel variational formulations of the eigenvalue problem. Error estimates are provided for the finite element approximations of the eigenvalues. Numerical results are presented to illustrate the efficiency and accuracy of the method. The results indicate that the method can achieve a second-order convergence for both fractional derivatives, and can provide accurate approximations to multiple eigenvalues simultaneously.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

An Analysis of Finite Element Approximation in Electrical Impedance Tomography

We present a finite element analysis of electrical impedance tomography for reconstructing the conductivity distribution from electrode voltage measurements by means of Tikhonov regularization. Two popular choices of the penalty term, i.e., $H^1(Ω)$-norm smoothness penalty and total variation seminorm penalty, are considered. A piecewise linear finite element method is employed for discretizing the forward model, i.e., the complete electrode model, the conductivity, and the penalty functional. The convergence of the finite element approximations for the Tikhonov model on both polyhedral and smooth curved domains is established. This provides rigorous justifications for the ad hoc discretization procedures in the literature.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Error Analysis of Finite Element Methods for Space-Fractional Parabolic Equations

We consider an initial/boundary value problem for one-dimensional fractional-order parabolic equations with a space fractional derivative of Riemann-Liouville type and order $α\in (1,2)$. We study a spatial semidiscrete scheme with the standard Galerkin finite element method with piecewise linear finite elements, as well as fully discrete schemes based on the backward Euler method and Crank-Nicolson method. Error estimates in the $L^2\II$- and $H^{α/2}\II$-norm are derived for the semidiscrete scheme, and in the $L^2\II$-norm for the fully discrete schemes. These estimates are for both smooth and nonsmooth initial data, and are expressed directly in terms of the smoothness of the initial data. Extensive numerical results are presented to illustrate the theoretical results.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Error Analysis of Semidiscrete Finite Element Methods for Inhomogeneous Time-Fractional Diffusion

We consider the initial boundary value problem for the inhomogeneous time-fractional diffusion equation with a homogeneous Dirichlet boundary condition and a nonsmooth right hand side data in a bounded convex polyhedral domain. We analyze two semidiscrete schemes based on the standard Galerkin and lumped mass finite element methods. Almost optimal error estimates are obtained for right hand side data $f(x,t)\in L^\infty(0,T;\dot H^q(Ω))$, $-1< q \le 1$, for both semidiscrete schemes. For lumped mass method, the optimal $L^2(Ω)$-norm error estimate requires symmetric meshes. Finally, numerical experiments for one- and two-dimensional examples are presented to verify our theoretical results.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Expectation Propagation for Nonlinear Inverse Problems -- with an Application to Electrical Impedance Tomography

In this paper, we study a fast approximate inference method based on expectation propagation for exploring the posterior probability distribution arising from the Bayesian formulation of nonlinear inverse problems. It is capable of efficiently delivering reliable estimates of the posterior mean and covariance, thereby providing an inverse solution together with quantified uncertainties. Some theoretical properties of the iterative algorithm are discussed, and the efficient implementation for an important class of problems of projection type is described. The method is illustrated with one typical nonlinear inverse problem, electrical impedance tomography with complete electrode model, under sparsity constraints. Numerical results for real experimental data are presented, and compared with that by Markov chain Monte Carlo. The results indicate that the method is accurate and computationally very efficient.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Galerkin FEM for fractional order parabolic equations with initial data in $H^{-s},~0 < s \le 1$

We investigate semi-discrete numerical schemes based on the standard Galerkin and lumped mass Galerkin finite element methods for an initial-boundary value problem for homogeneous fractional diffusion problems with non-smooth initial data. We assume that $Ω\subset \mathbb{R}^d$, $d=1,2,3$ is a convex polygonal (polyhedral) domain. We theoretically justify optimal order error estimates in $L_2$- and $H^1$-norms for initial data in $H^{-s}(Ω),~0\le s \le 1$. We confirm our theoretical findings with a number of numerical tests that include initial data $v$ being a Dirac $δ$-function supported on a $(d-1)$-dimensional manifold.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Multi-Parameter Tikhonov Regularization -- An Augmented Approach

We study multi-parameter regularization (multiple penalties) for solving linear inverse problems to promote simultaneously distinct features of the sought-for objects. We revisit a balancing principle for choosing regularization parameters from the viewpoint of augmented Tikhonov regularization, and derive a new parameter choice strategy called the \textit{balanced discrepancy principle}. A priori and a posteriori error estimates are provided to theoretically justify the principles, and numerical algorithms for efficiently implementing the principles are also provided. Numerical results on denoising are presented to illustrate the feasibility of the balanced discrepancy principle.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Variational formulation of problems involving fractional order differential operators

In this work, we consider boundary value problems involving Caputo and Riemann-Liouville fractional derivatives of order $α\in(1,2)$ on the unit interval $(0,1)$. These fractional derivatives lead to non-symmetric boundary value problems, which are investigated from a variational point of view. The variational problem for the Riemann-Liouville case is coercive on the space $H_0^{α/2}(0,1)$ but the solutions are less regular, whereas that for the Caputo case involves different test and trial spaces. The numerical analysis of these problems requires the so-called shift theorems which show that the solutions of the variational problem are more regular. The regularity pickup enables one to establish convergence rates of the finite element approximations. Finally, numerical results are presented to illustrate the error estimates.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

A Direct Sampling Method for Inverse Electromagnetic Medium Scattering

In this paper, we study the inverse electromagnetic medium scattering problem of estimating the support and shape of medium scatterers from scattered electric or magnetic near-field data. We shall develop a novel direct sampling method based on an analysis of electromagnetic scattering and the behavior of the fundamental solution. The method is applicable even with one incident field and needs only to compute inner products of the measured scattered field with the fundamental solutions located at sampling points. Hence it is strictly direct, computationally very efficient, and highly tolerant to the presence of noise in the data. Two- and three-dimensional numerical experiments indicate that it can provide reliable support estimates of one single and multiple scatterers in case of both exact and highly noisy data.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

A Two-stage Method for Inverse Medium Scattering

We present a novel numerical method to the time-harmonic inverse medium scattering problem of recovering the refractive index from near-field scattered data. The approach consists of two stages, one pruning step of detecting the scatterer support, and one resolution enhancing step with mixed regularization. The first step is strictly direct and of sampling type, and faithfully detects the scatterer support. The second step is an innovative application of nonsmooth mixed regularization, and it accurately resolves the scatterer sizes as well as intensities. The model is efficiently solved by a semi-smooth Newton-type method. Numerical results for two- and three-dimensional examples indicate that the approach is accurate, computationally efficient, and robust with respect to data noise.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

An inverse Sturm-Liouville problem with a fractional derivative

In this paper, we numerically investigate an inverse problem of recovering the potential term in a fractional Sturm-Liouville problem from one spectrum. The qualitative behaviors of the eigenvalues and eigenfunctions are discussed, and numerical reconstructions of the potential with a Newton method from finite spectral data are presented. Surprisingly, it allows very satisfactory reconstructions for both smooth and discontinuous potentials, provided that the order $α\in(1,2)$ of fractional derivative is sufficiently away from 2.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Error estimates for a semidiscrete finite element method for fractional order parabolic equations

We consider the initial boundary value problem for the homogeneous time-fractional diffusion equation $\partial^α_t u - \De u =0$ ($0< α< 1$) with initial condition $u(x,0)=v(x)$ and a homogeneous Dirichlet boundary condition in a bounded polygonal domain $Ω$. We shall study two semidiscrete approximation schemes, i.e., Galerkin FEM and lumped mass Galerkin FEM, by using piecewise linear functions. We establish optimal with respect to the regularity of the solution error estimates, including the case of nonsmooth initial data, i.e., $v \in L_2(Ω)$.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Gradient-based estimation of Manning's friction coefficient from noisy data

We study the numerical recovery of Manning's roughness coefficient for the diffusive wave approximation of the shallow water equation. We describe a conjugate gradient method for the numerical inversion. Numerical results for one-dimensional model are presented to illustrate the feasibility of the approach. Also we provide a proof of the differentiability of the weak form with respect to the coefficient as well as the continuity and boundedness of the linearized operator under reasonable assumptions using the maximal parabolic regularity theory.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

A new approach to nonlinear constrained Tikhonov regularization

We present a novel approach to nonlinear constrained Tikhonov regularization from the viewpoint of optimization theory. A second-order sufficient optimality condition is suggested as a nonlinearity condition to handle the nonlinearity of the forward operator. The approach is exploited to derive convergence rates results for a priori as well as a posteriori choice rules, e.g., discrepancy principle and balancing principle, for selecting the regularization parameter. The idea is further illustrated on a general class of parameter identification problems, for which (new) source and nonlinearity conditions are derived and the structural property of the nonlinearity term is revealed. A number of examples including identifying distributed parameters in elliptic differential equations are presented.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

A variational Bayesian method for inverse problems with impulsive noise

We propose a novel numerical method for solving inverse problems subject to impulsive noises which possibly contain a large number of outliers. The approach is of Bayesian type, and it exploits a heavy-tailed t distribution for data noise to achieve robustness with respect to outliers. A hierarchical model with all hyper-parameters automatically determined from the given data is described. An algorithm of variational type by minimizing the Kullback-Leibler divergence between the true posteriori distribution and a separable approximation is developed. The numerical method is illustrated on several one- and two-dimensional linear and nonlinear inverse problems arising from heat conduction, including estimating boundary temperature, heat flux and heat transfer coefficient. The results show its robustness to outliers and the fast and steady convergence of the algorithm.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

Multi-Parameter Tikhonov Regularization

We study multi-parameter Tikhonov regularization, i.e., with multiple penalties. Such models are useful when the sought-for solution exhibits several distinct features simultaneously. Two choice rules, i.e., discrepancy principle and balancing principle, are studied for choosing an appropriate (vector-valued) regularization parameter, and some theoretical results are presented. In particular, the consistency of the discrepancy principle as well as convergence rate are established, and an a posteriori error estimate for the balancing principle is established. Also two fixed point algorithms are proposed for computing the regularization parameter by the latter rule. Numerical results for several nonsmooth multi-parameter models are presented, which show clearly their superior performance over their single-parameter counterparts.

0 citations0 reviewsNo code linkedOpen access
preprint2010arXiv

Heuristic parameter-choice rules for convex variational regularization based on error estimates

In this paper, we are interested in heuristic parameter choice rules for general convex variational regularization which are based on error estimates. Two such rules are derived and generalize those from quadratic regularization, namely the Hanke-Raus rule and quasi-optimality criterion. A posteriori error estimates are shown for the Hanke-Raus rule, and convergence for both rules is also discussed. Numerical results for both rules are presented to illustrate their applicability.

0 citations0 reviewsNo code linkedOpen access
preprint2009arXiv

Elastic-Net Regularization: Error estimates and Active Set Methods

This paper investigates theoretical properties and efficient numerical algorithms for the so-called elastic-net regularization originating from statistics, which enforces simultaneously l^1 and l^2 regularization. The stability of the minimizer and its consistency are studied, and convergence rates for both a priori and a posteriori parameter choice rules are established. Two iterative numerical algorithms of active set type are proposed, and their convergence properties are discussed. Numerical results are presented to illustrate the features of the functional and algorithms.

0 citations0 reviewsNo code linkedOpen access