Source author record

Tomoaki Nishimura

Tomoaki Nishimura appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Machine Learning gr-qc hep-th quant-ph

Catalog footprint

What is connected

3works

4topics

4close collaborators

Actions

Connect this record

Open graph Browse works

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

preprint2020arXiv

Compression based bound for non-compressed network: unified generalization error analysis of large compressible deep neural network

One of the biggest issues in deep learning theory is the generalization ability of networks with huge model size. The classical learning theory suggests that overparameterized models cause overfitting. However, practically used large deep models avoid overfitting, which is not well explained by the classical approaches. To resolve this issue, several attempts have been made. Among them, the compression based bound is one of the promising approaches. However, the compression based bound can be applied only to a compressed network, and it is not applicable to the non-compressed original network. In this paper, we give a unified frame-work that can convert compression based bounds to those for non-compressed original networks. The bound gives even better rate than the one for the compressed network by improving the bias term. By establishing the unified frame-work, we can obtain a data dependent generalization error bound which gives a tighter evaluation than the data independent ones.

preprint2020arXiv

Spectral Pruning: Compressing Deep Neural Networks via Spectral Analysis and its Generalization Error

Compression techniques for deep neural network models are becoming very important for the efficient execution of high-performance deep learning systems on edge-computing devices. The concept of model compression is also important for analyzing the generalization error of deep learning, known as the compression-based error bound. However, there is still huge gap between a practically effective compression method and its rigorous background of statistical learning theory. To resolve this issue, we develop a new theoretical framework for model compression and propose a new pruning method called {\it spectral pruning} based on this framework. We define the ``degrees of freedom'' to quantify the intrinsic dimensionality of a model by using the eigenvalue distribution of the covariance matrix across the internal nodes and show that the compression ability is essentially controlled by this quantity. Moreover, we present a sharp generalization error bound of the compressed model and characterize the bias--variance tradeoff induced by the compression procedure. We apply our method to several datasets to justify our theoretical analyses and show the superiority of the the proposed method.

preprint2010arXiv

Dynamical Casimir effect for TE and TM modes in a resonant cavity bisected by a plasma sheet

Parametric photon creation via the dynamical Casimir effect (DCE) is evaluated numerically, in a three-dimensional rectangular resonant cavity bisected by a semiconductor diaphragm (SD), which is irradiated by a pulsed laser with frequency of GHz order. The aim of this paper is to determine some of the optimum conditions required to detect DCE photons relevant to a novel experimental detection system. We expand upon the thin plasma sheet model [Crocce et al., Phys. Rev. A 70 033811 (2004)] to estimate the number of photons for both TE and TM modes at any given SD position. Numerical calculations are performed considering up to 51 inter-mode couplings by varying the SD location, driving period and laser power without any perturbations. It is found that the number of photons created for TE modes strongly depends on SD position, where the strongest enhancement occurs at the midpoint (not near the cavity wall); while TM modes have weak dependence on SD position. Another important finding is the fact that significant photon production for TM$_{111}$ modes still takes place at the midpoint even for a low laser power of 0.01 micro J/pulse, although the number of TE$_{111}$ photons decreases almost proportionately with laser power. We also find a relatively wide tuning range for both TE and TM modes that is correlated with the frequency variation of the instantaneous mode functions caused by the interaction between the cavity photons and conduction electrons in the SD excited by a pulsed laser.