Source author record

Akiyoshi Sannai

Explore this author’s publications, collaborators and research topics. This catalog record has not been claimed by its author.

ResearcherUnclaimed source record

Catalog footprint

Research overview

12works
7topics
4close collaborators

Published work

12 publications

preprint2022arXiv

Bézier Flow: a Surface-wise Gradient Descent Method for Multi-objective Optimization

In this paper, we propose a strategy to construct a multi-objective optimization algorithm from a single-objective optimization algorithm by using the Bézier simplex model. Also, we extend the stability of optimization algorithms in the sense of Probability Approximately Correct (PAC) learning and define the PAC stability. We prove that it leads to an upper bound on the generalization with high probability. Furthermore, we show that multi-objective optimization algorithms derived from a gradient descent-based single-objective optimization algorithm are PAC stable. We conducted numerical experiments and demonstrated that our method achieved lower generalization errors than the existing multi-objective optimization algorithm.

preprint2021arXiv

Group Equivariant Conditional Neural Processes

We present the group equivariant conditional neural process (EquivCNP), a meta-learning method with permutation invariance in a data set as in conventional conditional neural processes (CNPs), and it also has transformation equivariance in data space. Incorporating group equivariance, such as rotation and scaling equivariance, provides a way to consider the symmetry of real-world data. We give a decomposition theorem for permutation-invariant and group-equivariant maps, which leads us to construct EquivCNPs with an infinite-dimensional latent space to handle group symmetries. In this paper, we build architecture using Lie group convolutional layers for practical implementation. We show that EquivCNP with translation equivariance achieves comparable performance to conventional CNPs in a 1D regression task. Moreover, we demonstrate that incorporating an appropriate Lie group equivariance, EquivCNP is capable of zero-shot generalization for an image-completion task by selecting an appropriate Lie group equivariance.

preprint2021arXiv

On the Number of Linear Functions Composing Deep Neural Network: Towards a Refined Definition of Neural Networks Complexity

The classical approach to measure the expressive power of deep neural networks with piecewise linear activations is based on counting their maximum number of linear regions. This complexity measure is quite relevant to understand general properties of the expressivity of neural networks such as the benefit of depth over width. Nevertheless, it appears limited when it comes to comparing the expressivity of different network architectures. This lack becomes particularly prominent when considering permutation-invariant networks, due to the symmetrical redundancy among the linear regions. To tackle this, we propose a refined definition of piecewise linear function complexity: instead of counting the number of linear regions directly, we first introduce an equivalence relation among the linear functions composing a piecewise linear function and then count those linear functions relative to that equivalence relation. Our new complexity measure can clearly distinguish between the two aforementioned models, is consistent with the classical measure, and increases exponentially with depth.

preprint2011arXiv

F-signature of graded Gorenstein rings

For a commutative ring RR, the FF-signature was defined by Huneke and Leuschke \cite{H-L}. It is an invariant that measures the order of the rank of the free direct summand of R(e)R^{(e)}. Here, R(e)R^{(e)} is RR itself, regarded as an RR-module through ee-times Frobenius action FeF^e.In this paper, we show a connection of the F-signature of a graded ring with other invariants. More precisely, for a graded FF-finite Gorenstein ring RR of dimension dd, we give an inequality among the FF-signature s(R)s(R), aa-invariant a(R)a(R) and Poincaré polynomial P(R,t)P(R,t). s(R)≤(−a(R))d2d−1d!lim⁡t→1(1−t)dP(R,t) s(R)\le\frac{(-a(R))^d}{2^{d-1}d!}\lim_{t\rightarrow 1}(1-t)^dP(R,t) Moreover, we show that R(e)R^{(e)} has only one free direct summand for any ee, if and only if RR is FF-pure and a(R)=0a(R)=0. This gives a characterization of such rings.

preprint2011arXiv

Galois extensions, plus closure, and maps on local cohomology

Given a local domain (R,m)(R,m) of prime characteristic that is a homomorphic image of a Gorenstein ring, Huneke and Lyubeznik proved that there exists a module-finite extension domain SS such that the induced map on local cohomology modules Hmi(R)→Hmi(S)H^i_m(R)\to H^i_m(S) is zero for each i<dim⁡Ri<\dim R. We prove that the extension SS may be chosen to be generically Galois, and analyze the Galois groups that arise.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.