Source author record

Ken'ichiro Tanaka

Ken'ichiro Tanaka appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

10works
7topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

10 published item(s)

preprint2022arXiv

Sparse solutions of the kernel herding algorithm by improved gradient approximation

The kernel herding algorithm is used to construct quadrature rules in a reproducing kernel Hilbert space (RKHS). While the computational efficiency of the algorithm and stability of the output quadrature formulas are advantages of this method, the convergence speed of the integration error for a given number of nodes is slow compared to that of other quadrature methods. In this paper, we propose a modified kernel herding algorithm whose framework was introduced in a previous study and aim to obtain sparser solutions while preserving the advantages of standard kernel herding. In the proposed algorithm, the negative gradient is approximated by several vertex directions, and the current solution is updated by moving in the approximate descent direction in each iteration. We show that the convergence speed of the integration error is directly determined by the cosine of the angle between the negative gradient and approximate gradient. Based on this, we propose new gradient approximation algorithms and analyze them theoretically, including through convergence analysis. In numerical experiments, we confirm the effectiveness of the proposed algorithms in terms of sparsity of nodes and computational efficiency. Moreover, we provide a new theoretical analysis of the kernel quadrature rules with fully-corrective weights, which realizes faster convergence speeds than those of previous studies.

preprint2022arXiv

Sparser Kernel Herding with Pairwise Conditional Gradients without Swap Steps

The Pairwise Conditional Gradients (PCG) algorithm is a powerful extension of the Frank-Wolfe algorithm leading to particularly sparse solutions, which makes PCG very appealing for problems such as sparse signal recovery, sparse regression, and kernel herding. Unfortunately, PCG exhibits so-called swap steps that might not provide sufficient primal progress. The number of these bad steps is bounded by a function in the dimension and as such known guarantees do not generalize to the infinite-dimensional case, which would be needed for kernel herding. We propose a new variant of PCG, the so-called Blended Pairwise Conditional Gradients (BPCG). This new algorithm does not exhibit any swap steps, is very easy to implement, and does not require any internal gradient alignment procedures. The convergence rate of BPCG is basically that of PCG if no drop steps would occur and as such is no worse than PCG but improves and provides new rates in many cases. Moreover, we observe in the numerical experiments that BPCG's solutions are much sparser than those of PCG. We apply BPCG to the kernel herding setting, where we derive nice quadrature rules and provide numerical results demonstrating the performance of our method.

preprint2022arXiv

Wavelet characterization of exponentially weighted Besov space with dominating mixed smoothness and its application to function approximation

Although numerous studies have focused on normal Besov spaces, limited studies have been conducted on exponentially weighted Besov spaces. Therefore, we define exponentially weighted Besov space $VB_{p,q}^{δ,w}(\mathbb{R}^d)$ whose smoothness includes normal Besov spaces, Besov spaces with dominating mixed smoothness, and their interpolation. Furthermore, we obtain wavelet characterization of $VB_{p,q}^{δ,w}(\mathbb{R}^d)$. Next, approximation formulas such as sparse grids are derived using the determined formula. The results of this study are expected to provide considerable insight into the application of exponentially weighted Besov spaces with mixed smoothness.

preprint2021arXiv

Kernel quadrature by applying a point-wise gradient descent method to discrete energies

We propose a method for generating nodes for kernel quadrature by a point-wise gradient descent method. For kernel quadrature, most methods for generating nodes are based on the worst case error of a quadrature formula in a reproducing kernel Hilbert space corresponding to the kernel. In typical ones among those methods, a new node is chosen among a candidate set of points in each step by an optimization problem with respect to a new node. Although such sequential methods are appropriate for adaptive quadrature, it is difficult to apply standard routines for mathematical optimization to the problem. In this paper, we propose a method that updates a set of points one by one with a simple gradient descent method. To this end, we provide an upper bound of the worst case error by using the fundamental solution of the Laplacian on $\mathbf{R}^{d}$. We observe the good performance of the proposed method by numerical experiments.

preprint2020arXiv

Kernel-based interpolation at approximate Fekete points

We construct approximate Fekete point sets for kernel-based interpolation by maximising the determinant of a kernel Gram matrix obtained via truncation of an orthonormal expansion of the kernel. Uniform error estimates are proved for kernel interpolants at the resulting points. If the kernel is Gaussian we show that the approximate Fekete points in one dimension are the solution to a convex optimisation problem and that the interpolants converge with a super-exponential rate. Numerical examples are provided for the Gaussian kernel.

preprint2016arXiv

Potential theoretic approach to design of accurate formulas for function approximation in symmetric weighted Hardy spaces

We propose a method for designing accurate interpolation formulas on the real axis for the purpose of function approximation in weighted Hardy spaces. In particular, we consider the Hardy space of functions that are analytic in a strip region around the real axis, being characterized by a weight function $w$ that determines the decay rate of its elements in the neighborhood of infinity. Such a space is considered as a set of functions that are transformed by variable transformations that realize a certain decay rate at infinity. Popular examples of such transformations are given by the single exponential (SE) and double exponential (DE) transformations for the SE-Sinc and DE-Sinc formulas, which are very accurate owing to the accuracy of sinc interpolation in the weighted Hardy spaces with single and double exponential weights $w$, respectively. However, it is not guaranteed that the sinc formulas are optimal in weighted Hardy spaces, although Sugihara has demonstrated that they are near optimal. An explicit form for an optimal approximation formula has only been given in weighted Hardy spaces with SE weights of a certain type. In general cases, explicit forms for optimal formulas have not been provided so far. We adopt a potential theoretic approach to obtain almost optimal formulas in weighted Hardy spaces in the case of general weight functions $w$. We formulate the problem of designing an optimal formula in each space as an optimization problem written in terms of a Green potential with an external field. By solving the optimization problem numerically, we obtain an almost optimal formula in each space. Furthermore, some numerical results demonstrate the validity of this method. In particular, for the case of a DE weight, the formula designed by our method outperforms the DE-Sinc formula.

preprint2015arXiv

Discretizing Distributions with Exact Moments: Error Estimate and Convergence Analysis

The maximum entropy principle is a powerful tool for solving underdetermined inverse problems. This paper considers the problem of discretizing a continuous distribution, which arises in various applied fields. We obtain the approximating distribution by minimizing the Kullback-Leibler information (relative entropy) of the unknown discrete distribution relative to an initial discretization based on a quadrature formula subject to some moment constraints. We study the theoretical error bound and the convergence of this approximation method as the number of discrete points increases. We prove that (i) the theoretical error bound of the approximate expectation of any bounded continuous function has at most the same order as the quadrature formula we start with, and (ii) the approximate discrete distribution weakly converges to the given continuous distribution. Moreover, we present some numerical examples that show the advantage of the method and apply to numerically solving an optimal portfolio problem.

preprint2014arXiv

A fast and accurate numerical method for the symmetric Lévy processes based on the Fourier transform and sinc-Gauss sampling formula

In this paper, we propose a fast and accurate numerical method based on Fourier transform to solve Kolmogorov forward equations of symmetric scalar Lévy processes. The method is based on the accurate numerical formulas for Fourier transform proposed by Ooura. These formulas are combined with nonuniform fast Fourier transform (FFT) and fractional FFT to speed up the numerical computations. Moreover, we propose a formula for numerical indefinite integration on equispaced grids as a component of the method. The proposed integration formula is based on the sinc-Gauss sampling formula, which is a function approximation formula. This integration formula is also combined with the FFT. Therefore, all steps of the proposed method are executed using the FFT and its variants. The proposed method allows us to be free from some special treatments for a non-smooth initial condition and numerical time integration. The numerical solutions obtained by the proposed method appeared to be exponentially convergent on the interval if the corresponding exact solutions do not have sharp cusps. Furthermore, the real computational times are approximately consistent with the theoretical estimates.

preprint2013arXiv

Error control of a numerical formula for the Fourier transform by Ooura's continuous Euler transform and fractional FFT

In this paper, we consider a method for fast numerical computation of the Fourier transform of a slowly decaying function with given accuracy in given ranges of the frequency. In these decades, some useful formulas for the Fourier transform are proposed to recover difficulty of the computation due to the slow decay and the oscillation of the integrand. In particular, Ooura proposed formulas with continuous Euler transformation and showed their effectiveness. It is, however, also reported that errors of them become large outside some ranges of the frequency. Then, for an illustrating representative of the formulas, we choose parameters in the formula based on its error analysis to compute the Fourier transform with given accuracy in given ranges of the frequency. Furthermore, combining the formula and fractional FFT, a generalization of the fast Fourier transform (FFT), we execute the computation in the same order of computation time as the FFT.

preprint2012arXiv

Convergence Rates and Explicit Error Bounds of Hill's Method for Spectra of Self-Adjoint Differential Operators

We present the convergence rates and the explicit error bounds of Hill's method, which is a numerical method for computing the spectra of ordinary differential operators with periodic coefficients. This method approximates the operator by a finite dimensional matrix. On the assumption that the operator is selfadjoint, it is shown that, under some conditions, we can obtain the convergence rates of eigenvalues with respect to the dimension and the explicit error bounds. Numerical examples demonstrate that we can verify these conditions using Gershgorin's theorem for some real problems. Main theorems are proved using the Dunford integrals which project an eigenvector to the corresponding eigenspace.