Source author record

Ting-Zhu Huang

Ting-Zhu Huang appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

17works
10topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

17 published item(s)

preprint2020arXiv

Fast second-order implicit difference schemes for time distributed-order and Riesz space fractional diffusion-wave equations

In this paper, fast numerical methods are established for solving a class of time distributed-order and Riesz space fractional diffusion-wave equations. We derive new difference schemes by the weighted and shifted Gr$\ddot{\rm{u}}$nwald formula in time and the fractional centered difference formula in space. The unconditional stability and second-order convergence in time, space and distributed-order of the difference schemes are analyzed. In the one-dimensional case, the Gohberg-Semencul formula utilizing the preconditioned Krylov subspace method is developed to solve the symmetric positive definite Toeplitz linear systems derived from the proposed difference scheme. In the two-dimensional case, we also design a global preconditioned conjugate gradient method with a truncated preconditioner to solve the discretized Sylvester matrix equations. We prove that the spectrums of the preconditioned matrices in both cases are clustered around one, such that the proposed numerical methods with preconditioners converge very quickly. Some numerical experiments are carried out to demonstrate the effectiveness of the proposed difference schemes and show that the performances of the proposed fast solution algorithms are better than other numerical methods.

preprint2020arXiv

Framelet Representation of Tensor Nuclear Norm for Third-Order Tensor Completion

The main aim of this paper is to develop a framelet representation of the tensor nuclear norm for third-order tensor completion. In the literature, the tensor nuclear norm can be computed by using tensor singular value decomposition based on the discrete Fourier transform matrix, and tensor completion can be performed by the minimization of the tensor nuclear norm which is the relaxation of the sum of matrix ranks from all Fourier transformed matrix frontal slices. These Fourier transformed matrix frontal slices are obtained by applying the discrete Fourier transform on the tubes of the original tensor. In this paper, we propose to employ the framelet representation of each tube so that a framelet transformed tensor can be constructed. Because of framelet basis redundancy, the representation of each tube is sparsely represented. When the matrix slices of the original tensor are highly correlated, we expect the corresponding sum of matrix ranks from all framelet transformed matrix frontal slices would be small, and the resulting tensor completion can be performed much better. The proposed minimization model is convex and global minimizers can be obtained. Numerical results on several types of multi-dimensional data (videos, multispectral images, and magnetic resonance imaging data) have tested and shown that the proposed method outperformed the other testing methods.

preprint2020arXiv

Hyperspectral Image Super-resolution via Deep Spatio-spectral Convolutional Neural Networks

Hyperspectral images are of crucial importance in order to better understand features of different materials. To reach this goal, they leverage on a high number of spectral bands. However, this interesting characteristic is often paid by a reduced spatial resolution compared with traditional multispectral image systems. In order to alleviate this issue, in this work, we propose a simple and efficient architecture for deep convolutional neural networks to fuse a low-resolution hyperspectral image (LR-HSI) and a high-resolution multispectral image (HR-MSI), yielding a high-resolution hyperspectral image (HR-HSI). The network is designed to preserve both spatial and spectral information thanks to an architecture from two folds: one is to utilize the HR-HSI at a different scale to get an output with a satisfied spectral preservation; another one is to apply concepts of multi-resolution analysis to extract high-frequency information, aiming to output high quality spatial details. Finally, a plain mean squared error loss function is used to measure the performance during the training. Extensive experiments demonstrate that the proposed network architecture achieves best performance (both qualitatively and quantitatively) compared with recent state-of-the-art hyperspectral image super-resolution approaches. Moreover, other significant advantages can be pointed out by the use of the proposed approach, such as, a better network generalization ability, a limited computational burden, and a robustness with respect to the number of training samples.

preprint2020arXiv

Multi-dimensional imaging data recovery via minimizing the partial sum of tubal nuclear norm

In this paper, we investigate tensor recovery problems within the tensor singular value decomposition (t-SVD) framework. We propose the partial sum of the tubal nuclear norm (PSTNN) of a tensor. The PSTNN is a surrogate of the tensor tubal multi-rank. We build two PSTNN-based minimization models for two typical tensor recovery problems, i.e., the tensor completion and the tensor principal component analysis. We give two algorithms based on the alternating direction method of multipliers (ADMM) to solve proposed PSTNN-based tensor recovery models. Experimental results on the synthetic data and real-world data reveal the superior of the proposed PSTNN.

preprint2020arXiv

Tensor completion via nonconvex tensor ring rank minimization with guaranteed convergence

In recent studies, the tensor ring (TR) rank has shown high effectiveness in tensor completion due to its ability of capturing the intrinsic structure within high-order tensors. A recently proposed TR rank minimization method is based on the convex relaxation by penalizing the weighted sum of nuclear norm of TR unfolding matrices. However, this method treats each singular value equally and neglects their physical meanings, which usually leads to suboptimal solutions in practice. In this paper, we propose to use the logdet-based function as a nonconvex smooth relaxation of the TR rank for tensor completion, which can more accurately approximate the TR rank and better promote the low-rankness of the solution. To solve the proposed nonconvex model efficiently, we develop an alternating direction method of multipliers algorithm and theoretically prove that, under some mild assumptions, our algorithm converges to a stationary point. Extensive experiments on color images, multispectral images, and color videos demonstrate that the proposed method outperforms several state-of-the-art competitors in both visual and quantitative comparison. Key words: nonconvex optimization, tensor ring rank, logdet function, tensor completion, alternating direction method of multipliers.

preprint2020arXiv

Tensor train rank minimization with nonlocal self-similarity for tensor completion

The tensor train (TT) rank has received increasing attention in tensor completion due to its ability to capture the global correlation of high-order tensors ($\textrm{order} >3$). For third order visual data, direct TT rank minimization has not exploited the potential of TT rank for high-order tensors. The TT rank minimization accompany with \emph{ket augmentation}, which transforms a lower-order tensor (e.g., visual data) into a higher-order tensor, suffers from serious block-artifacts. To tackle this issue, we suggest the TT rank minimization with nonlocal self-similarity for tensor completion by simultaneously exploring the spatial, temporal/spectral, and nonlocal redundancy in visual data. More precisely, the TT rank minimization is performed on a formed higher-order tensor called group by stacking similar cubes, which naturally and fully takes advantage of the ability of TT rank for high-order tensors. Moreover, the perturbation analysis for the TT low-rankness of each group is established. We develop the alternating direction method of multipliers tailored for the specific structure to solve the proposed model. Extensive experiments demonstrate that the proposed method is superior to several existing state-of-the-art methods in terms of both qualitative and quantitative measures.

preprint2020arXiv

Two CSCS-based iteration methods for solving absolute value equations

Recently, two families of HSS-based iteration methods are constructed for solving the system of absolute value equations (AVEs), which is a class of non-differentiable NP-hard problems. In this study, we establish the Picard-CSCS iteration method and the nonlinear CSCS-like iteration method for AVEs involving the Toeplitz matrix. Then, we analyze the convergence of the Picard-CSCS iteration method for solving AVEs. By using the theory about nonsmooth analysis, we particularly prove the convergence of the nonlinear CSCS-like iterationsolver for AVEs. The advantage of these methods is that they do not require the storage of coefficient matrices at all, and the sub-system of linear equations can be solved efficiently via the fast Fourier transforms (FFTs). Therefore, computational cost and storage can be saved in practical implementations. Numerical examples including numerical solutions of nonlinear fractional diffusion equations are reported to show the effectiveness of the proposed methods in comparison with some existing methods.

preprint2018arXiv

Rain Streak Removal for Single Image via Kernel Guided CNN

Rain streak removal is an important issue and has recently been investigated extensively. Existing methods, especially the newly emerged deep learning methods, could remove the rain streaks well in many cases. However the essential factor in the generative procedure of the rain streaks, i.e., the motion blur, which leads to the line pattern appearances, were neglected by the deep learning rain streaks approaches and this resulted in over-derain or under-derain results. In this paper, we propose a novel rain streak removal approach using a kernel guided convolutional neural network (KGCNN), achieving the state-of-the-art performance with simple network architectures. We first model the rain streak interference with its motion blur mechanism. Then, our framework starts with learning the motion blur kernel, which is determined by two factors including angle and length, by a plain neural network, denoted as parameter net, from a patch of the texture component. Then, after a dimensionality stretching operation, the learned motion blur kernel is stretched into a degradation map with the same spatial size as the rainy patch. The stretched degradation map together with the texture patch is subsequently input into a derain convolutional network, which is a typical ResNet architecture and trained to output the rain streaks with the guidance of the learned motion blur kernel. Experiments conducted on extensive synthetic and real data demonstrate the effectiveness of the proposed method, which preserves the texture and the contrast while removing the rain streaks.

preprint2016arXiv

Block variants of the COCG and COCR methods for solving complex symmetric linear systems with multiple right-hand sides

In the present study, we establish two new block variants of the Conjugate Orthogonal Conjugate Gradient (COCG) and the Conjugate A-Orthogonal Conjugate Residual (COCR) Krylov subspace methods for solving complex symmetric linear systems with multiple right hand sides. The proposed Block iterative solvers can fully exploit the complex symmetry property of coefficient matrix of the linear system. We report on extensive numerical experiments to show the favourable convergence properties of our newly developed Block algorithms for solving realistic electromagnetic simulations.

preprint2015arXiv

Regularization preconditioners for frame-based image deblurring with reduced boundary artifacts

Thresholding iterative methods are recently successfully applied to image deblurring problems. In this paper, we investigate the modified linearized Bregman algorithm (MLBA) used in image deblurring problems, with a proper treatment of the boundary artifacts. We consider two standard approaches: the imposition of boundary conditions and the use of the rectangular blurring matrix. The fast convergence of the MLBA depends on a regularizing preconditioner that could be computationally expensive and hence it is usually chosen as a block circulant circulant block (BCCB) matrix, diagonalized by discrete Fourier transform. We show that the standard approach based on the BCCB preconditioner may provide low quality restored images and we propose different preconditioning strategies, that improve the quality of the restoration and save some computational cost at the same time. Motivated by a recent nonstationary preconditioned iteration, we propose a new algorithm that combines such method with the MLBA.We prove that it is a regularizing and convergent method. A variant with a stationary preconditioner is also considered. Finally, a large number of numerical experiments shows that our methods provide accurate and fast restorations, when compared with the state of the art.

preprint2015arXiv

Single image super-resolution by approximated Heaviside functions

Image super-resolution is a process to enhance image resolution. It is widely used in medical imaging, satellite imaging, target recognition, etc. In this paper, we conduct continuous modeling and assume that the unknown image intensity function is defined on a continuous domain and belongs to a space with a redundant basis. We propose a new iterative model for single image super-resolution based on an observation: an image is consisted of smooth components and non-smooth components, and we use two classes of approximated Heaviside functions (AHFs) to represent them respectively. Due to sparsity of the non-smooth components, a $L_{1}$ model is employed. In addition, we apply the proposed iterative model to image patches to reduce computation and storage. Comparisons with some existing competitive methods show the effectiveness of the proposed method.

preprint2014arXiv

From Sylvester's determinant identity to Cramer's rule

The object of this paper is to introduce a new and fascinating method of solving large linear equations, based on Cramer's rule or Gaussian elimination but employing Sylvester's determinant identity in its computation process. In addition, a scheme suitable for parallel computing is presented for this kind of generalized Chiò's determinant condensation processes, which makes this new method have a property of natural parallelism. Finally, some numerical experiments also confirm our theoretical analysis.

preprint2014arXiv

New explicit thresholding/shrinkage formulas for one class of regularization problems with overlapping group sparsity and their applications

The least-square regression problems or inverse problems have been widely studied in many fields such as compressive sensing, signal processing, and image processing. To solve this kind of ill-posed problems, a regularization term (i.e., regularizer) should be introduced, under the assumption that the solutions have some specific properties, such as sparsity and group sparsity. Widely used regularizers include the $\ell_1$ norm, total variation (TV) semi-norm, and so on. Recently, a new regularization term with overlapping group sparsity has been considered. Majorization minimization iteration method or variable duplication methods are often applied to solve them. However, there have been no direct methods for solve the relevant problems because of the difficulty of overlapping. In this paper, we proposed new explicit shrinkage formulas for one class of these relevant problems, whose regularization terms have translation invariant overlapping groups. Moreover, we apply our results in TV deblurring and denoising with overlapping group sparsity. We use alternating direction method of multipliers to iterate solve it. Numerical results also verify the validity and effectiveness of our new explicit shrinkage formulas.

preprint2014arXiv

Solving the collective-risk social dilemma with risky assets in well-mixed and structured populations

In the collective-risk social dilemma, players lose their personal endowments if contributions to the common pool are too small. This fact alone, however, does not always deter selfish individuals from defecting. The temptations to free-ride on the prosocial efforts of others are strong because we are hardwired to maximize our own fitness regardless of the consequences this might have for the public good. Here we show that the addition of risky assets to the personal endowments, both of which are lost if the collective target is not reached, can contribute to solving the collective-risk social dilemma. In infinite well-mixed populations risky assets introduce new stable and unstable mixed steady states, whereby the stable mixed steady state converges to full cooperation as either the risk of collective failure or the amount of risky assets increases. Similarly, in finite well-mixed populations the introduction of risky assets enforces configurations where cooperative behavior thrives. In structured populations cooperation is promoted as well, but the distribution of assets amongst the groups is crucial. Surprisingly, we find that the completely rational allocation of assets only to the most successful groups is not optimal, and this regardless of whether the risk of collective failure is high or low. Instead, in low-risk situations bounded rational allocation of assets works best, while in high-risk situations the simplest uniform distribution of assets among all the groups is optimal. These results indicate that prosocial behavior depends sensitively on the potential losses individuals are likely to endure if they fail to cooperate.

preprint2013arXiv

Image Restoration using Total Variation with Overlapping Group Sparsity

Image restoration is one of the most fundamental issues in imaging science. Total variation (TV) regularization is widely used in image restoration problems for its capability to preserve edges. In the literature, however, it is also well known for producing staircase-like artifacts. Usually, the high-order total variation (HTV) regularizer is an good option except its over-smoothing property. In this work, we study a minimization problem where the objective includes an usual $l_2$ data-fidelity term and an overlapping group sparsity total variation regularizer which can avoid staircase effect and allow edges preserving in the restored image. We also proposed a fast algorithm for solving the corresponding minimization problem and compare our method with the state-of-the-art TV based methods and HTV based method. The numerical experiments illustrate the efficiency and effectiveness of the proposed method in terms of PSNR, relative error and computing time.

preprint2013arXiv

Strang-type preconditioners for solving fractional diffusion equations by boundary value methods

The finite difference scheme with the shifted Grünwarld formula is employed to semi-discrete the fractional diffusion equations. This spatial discretization can reduce to the large system of ordinary differential equations (ODEs) with initial values. Recently, boundary value method (BVM) was developed as a popular algorithm for solving large systems of ODEs. This method requires the solutions of one or more nonsymmetric, large and sparse linear systems. In this paper, the GMRES method with the block circulant preconditioner is proposed for solving these linear systems. One of the main results is that if an $A_{ν_1,ν_2}$-stable boundary value method is used for an m-by-m system of ODEs, then the preconditioner is invertible and the preconditioned matrix can be decomposed as I+L, where I is the identity matrix and the rank of L is at most $2m(ν_1+ν_2)$. It means that when the GMRES method is applied to solve the preconditioned linear systems, the method will converge in at most $2m(ν_1+ν_2)+1$ iterations.Finally, extensive numerical experiments are reported to illustrate the effectiveness of our methods for solving the fractional diffusion equations.

preprint2013arXiv

Total variation with overlapping group sparsity for image deblurring under impulse noise

The total variation (TV) regularization method is an effective method for image deblurring in preserving edges. However, the TV based solutions usually have some staircase effects. In this paper, in order to alleviate the staircase effect, we propose a new model for restoring blurred images with impulse noise. The model consists of an $\ell_1$-fidelity term and a TV with overlapping group sparsity (OGS) regularization term. Moreover, we impose a box constraint to the proposed model for getting more accurate solutions. An efficient and effective algorithm is proposed to solve the model under the framework of the alternating direction method of multipliers (ADMM). We use an inner loop which is nested inside the majorization minimization (MM) iteration for the subproblem of the proposed method. Compared with other methods, numerical results illustrate that the proposed method, can significantly improve the restoration quality, both in avoiding staircase effects and in terms of peak signal-to-noise ratio (PSNR) and relative error (ReE).