BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

Isao Ishikawa

Isao Ishikawa appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
Machine Learningmath.FAmath.OAmath.CVmath.DSmath.NTNeural and Evolutionary Computing

Catalog footprint

What is connected

7works
7topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

7 published item(s)

preprint2022arXiv

Universal approximation property of invertible neural networks

Invertible neural networks (INNs) are neural network architectures with invertibility by design. Thanks to their invertibility and the tractability of Jacobian, INNs have various machine learning applications such as probabilistic modeling, generative modeling, and representation learning. However, their attractive properties often come at the cost of restricting the layer designs, which poses a question on their representation power: can we use these models to approximate sufficiently diverse functions? To answer this question, we have developed a general theoretical framework to investigate the representation power of INNs, building on a structure theorem of differential geometry. The framework simplifies the approximation problem of diffeomorphisms, which enables us to show the universal approximation properties of INNs. We apply the framework to two representative classes of INNs, namely Coupling-Flow-based INNs (CF-INNs) and Neural Ordinary Differential Equations (NODEs), and elucidate their high representation power despite the restrictions on their architectures.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Composition operators on reproducing kernel Hilbert spaces with analytic positive definite functions

In this paper, we specify what functions induce the bounded composition operators on a reproducing kernel Hilbert space (RKHS) associated with an analytic positive definite function defined on $\mathbf{R}^d$. We prove that only affine transforms can do so in a pretty large class of RKHS. Our result covers not only the Paley-Wiener space on the real line, studied in previous works, but also much more general RKHSs corresponding to analytic positive definite functions where existing methods do not work. Our method only relies on an intrinsic properties of the RKHSs, and we establish a connection between the behavior of composition operators and the asymptotic properties of the greatest zeros of orthogonal polynomials on a weighted $L^2$-spaces on the real line. We also investigate the compactness of the composition operators and show that any bounded composition operators cannot be compact in our situation.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Ridge Regression with Over-Parametrized Two-Layer Networks Converge to Ridgelet Spectrum

Characterization of local minima draws much attention in theoretical studies of deep learning. In this study, we investigate the distribution of parameters in an over-parametrized finite neural network trained by ridge regularized empirical square risk minimization (RERM). We develop a new theory of ridgelet transform, a wavelet-like integral transform that provides a powerful and general framework for the theoretical study of neural networks involving not only the ReLU but general activation functions. We show that the distribution of the parameters converges to a spectrum of the ridgelet transform. This result provides a new insight into the characterization of the local minima of neural networks, and the theoretical background of an inductive bias theory based on lazy regimes. We confirm the visual resemblance between the parameter distribution trained by SGD, and the ridgelet spectrum calculated by numerical integration through numerical experiments with finite models.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Analysis via Orthonormal Systems in Reproducing Kernel Hilbert $C^*$-Modules and Applications

Kernel methods have been among the most popular techniques in machine learning, where learning tasks are solved using the property of reproducing kernel Hilbert space (RKHS). In this paper, we propose a novel data analysis framework with reproducing kernel Hilbert $C^*$-module (RKHM), which is another generalization of RKHS than vector-valued RKHS (vv-RKHS). Analysis with RKHMs enables us to deal with structures among variables more explicitly than vv-RKHS. We show the theoretical validity for the construction of orthonormal systems in Hilbert $C^*$-modules, and derive concrete procedures for orthonormalization in RKHMs with those theoretical properties in numerical computations. Moreover, we apply those to generalize with RKHM kernel principal component analysis and the analysis of dynamical systems with Perron-Frobenius operators. The empirical performance of our methods is also investigated by using synthetic and real-world data.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Boundedness of composition operators on Morrey spaces and weak Morrey spaces

In this study, we investigate the boundedness of composition operators acting on Morrey spaces and weak Morrey spaces. The primary aim of this study is to investigate a necessary and sufficient condition on the boundedness of the composition operator induced by a diffeomorphism on Morrey spaces. In particular, detailed information is derived from the boundedness, i.e., the bi-Lipschitz continuity of the mapping that induces the composition operator follows from the continuity of the composition mapping. The idea of the proof is to determine the Morrey norm of the characteristic functions, and employ a specific function composed of a characteristic function. As the specific function belongs to Morrey spaces but not to Lebesgue spaces, the result reveals a new phenomenon not observed in Lebesgue spaces. Subsequently, we prove the boundedness of the composition operator induced by a mapping that satisfies a suitable volume estimate on general weak-type spaces generated by normed spaces. As a corollary, a necessary and sufficient condition for the boundedness of the composition operator on weak Morrey spaces is provided.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Kernel Mean Embeddings of Von Neumann-Algebra-Valued Measures

Kernel mean embedding (KME) is a powerful tool to analyze probability measures for data, where the measures are conventionally embedded into a reproducing kernel Hilbert space (RKHS). In this paper, we generalize KME to that of von Neumann-algebra-valued measures into reproducing kernel Hilbert modules (RKHMs), which provides an inner product and distance between von Neumann-algebra-valued measures. Von Neumann-algebra-valued measures can, for example, encode relations between arbitrary pairs of variables in a multivariate distribution or positive operator-valued measures for quantum mechanics. Thus, this allows us to perform probabilistic analyses explicitly reflected with higher-order interactions among variables, and provides a way of applying machine learning frameworks to problems in quantum mechanics. We also show that the injectivity of the existing KME and the universality of RKHS are generalized to RKHM, which confirms many useful features of the existing KME remain in our generalized KME. And, we investigate the empirical performance of our methods using synthetic and real-world data.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Integrals on $p$-adic upper half planes and Hida families over totally real fields

Bertolini-Darmon and Mok proved a formula of the second derivative of the two-variable $p$-adic $L$-function of a modular elliptic curve over a totally real field along the Hida family in terms of the image of a global point by some $p$-adic logarithm map. The theory of $p$-adic indefinite integrals and $p$-adic multiplicative integrals on $p$-adic upper half planes plays an important role in their work. In this paper, we generalize these integrals for $p$-adic measures which are not necessarily $\mathbf{Z}$-valued, and prove a formula of the second derivative of the two-variable $p$-adic $L$-function of an abelian variety of ${\rm GL}(2)$-type associated to a Hilbert modular form of weight 2.

0 citations0 reviewsNo code linkedOpen access