Source author record

Toshiyuki Tanaka

Toshiyuki Tanaka appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

27works
13topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

27 published item(s)

preprint2020arXiv

Kernel Selection for Modal Linear Regression: Optimal Kernel and IRLS Algorithm

Modal linear regression (MLR) is a method for obtaining a conditional mode predictor as a linear model. We study kernel selection for MLR from two perspectives: "which kernel achieves smaller error?" and "which kernel is computationally efficient?". First, we show that a Biweight kernel is optimal in the sense of minimizing an asymptotic mean squared error of a resulting MLR parameter. This result is derived from our refined analysis of an asymptotic statistical behavior of MLR. Secondly, we provide a kernel class for which iteratively reweighted least-squares algorithm (IRLS) is guaranteed to converge, and especially prove that IRLS with an Epanechnikov kernel terminates in a finite number of iterations. Simulation studies empirically verified that using a Biweight kernel provides good estimation accuracy and that using an Epanechnikov kernel is computationally efficient. Our results improve MLR of which existing studies often stick to a Gaussian kernel and modal EM algorithm specialized for it, by providing guidelines of kernel selection.

preprint2020arXiv

Linear algebraic structure of zero-determinant strategies in repeated games

Zero-determinant (ZD) strategies, a recently found novel class of strategies in repeated games, has attracted much attention in evolutionary game theory. A ZD strategy unilaterally enforces a linear relation between average payoffs of players. Although existence and evolutional stability of ZD strategies have been studied in simple games, their mathematical properties have not been well-known yet. For example, what happens when more than one players employ ZD strategies have not been clarified. In this paper, we provide a general framework for investigating situations where more than one players employ ZD strategies in terms of linear algebra. First, we theoretically prove that a set of linear relations of average payoffs enforced by ZD strategies always has solutions, which implies that incompatible linear relations are impossible. Second, we prove that linear payoff relations are independent of each other under some conditions. These results hold for general games with public monitoring including perfect-monitoring games. Furthermore, we provide a simple example of a two-player game in which one player can simultaneously enforce two linear relations, that is, simultaneously control her and her opponent's average payoffs. All of these results elucidate general mathematical properties of ZD strategies.

preprint2020arXiv

Modelling Population III stars for semi-numerical simulations

Theoretically modelling the 21-cm signals caused by Population III stars (Pop III stars) is the key to extracting fruitful information on Pop III stars from current and forthcoming 21-cm observations. In this work we develop a new module of Pop III stars in which the escape fractions of ionizing photons and Lyman-Werner (LW) photons, photo-heating by UV radiation, and LW feedback are consistently incorporated. By implementing the module into a public 21-cm semi-numerical simulation code, 21CMFAST, we demonstrate 21-cm signal calculations and investigate the importance of Pop III star modelling. What we find is that the contribution from Pop III stars to cosmic reionization significantly depends on the treatment of the escape fraction. With our escape fraction model, Pop III stars hardly contribute to reionization because less massive halos, whose escape fraction are high, cannot host Pop III stars due to LW feedback. On the other hand, Pop III stars well contribute to reionization with the conventional constant escape fraction. We also find that UV photo-heating has non-negligible impact on the 21-cm global signal and the 21-cm power spectrum if the ionization fraction of the Universe is higher than roughly 1 percent. In this case, the strength of the 21-cm global signal depends on the photo-heating efficiency and thus on the Pop III star mass. We conclude that detailed modelling of Pop III stars is imperative to predict 21-cm observables accurately for future observations.

preprint2020arXiv

Spatially Aggregated Gaussian Processes with Multivariate Areal Outputs

We propose a probabilistic model for inferring the multivariate function from multiple areal data sets with various granularities. Here, the areal data are observed not at location points but at regions. Existing regression-based models can only utilize the sufficiently fine-grained auxiliary data sets on the same domain (e.g., a city). With the proposed model, the functions for respective areal data sets are assumed to be a multivariate dependent Gaussian process (GP) that is modeled as a linear mixing of independent latent GPs. Sharing of latent GPs across multiple areal data sets allows us to effectively estimate the spatial correlation for each areal data set; moreover it can easily be extended to transfer learning across multiple domains. To handle the multivariate areal data, we design an observation model with a spatial aggregation process for each areal data set, which is an integral of the mixed GP over the corresponding region. By deriving the posterior GP, we can predict the data value at any location point by considering the spatial correlations and the dependences between areal data sets, simultaneously. Our experiments on real-world data sets demonstrate that our model can 1) accurately refine coarse-grained areal data, and 2) offer performance improvements by using the areal data sets from multiple domains.

preprint2020arXiv

The 21-cm signals from ultracompact minihalos as a probe of primordial small-scale fluctuations

Ultracompact minihalos~(UCMHs) can form after the epoch of matter-radiation equality, if the density fluctuations of dark matter have significantly large amplitude on small scales. The constraint on the UCMH abundance allows us to access such small-scale fluctuations. In this paper, we present that, through the measurement of 21-cm fluctuations before the epoch of reionization~ we can obtain a constraint on the UCMH abundance. We calculate the 21-cm signal from UCMHs and show that UCMHs provide the enhancement of the 21-cm fluctuations. We also investigate the constraint on the UCMH abundance and small-scale curvature perturbations. Our results indicate that the upcoming 21-cm observation, the Square Kilometre Array (SKA), provides the constraint on amplitude of primordial curvature power spectrum, ${\cal A}_ζ \lesssim 10^{-6}$ on $100~{\rm Mpc}^{-1} \lesssim k \lesssim 1000~{\rm Mpc}^{-1}$. Although it is not stronger than the one from the non-detection of gamma rays induced by dark matter annihilation in UCMHs, the constraint by the SKA will be important because this constraint is independent of the dark matter particle model.

preprint2014arXiv

Inclusive spectrum of the $d(π^+, K^+)$ reaction at 1.69 GeV/c

We have measured an inclusive missing-mass spectrum of the $d(π^+, K^+)$ reaction at the pion incident momentum of 1.69 GeV/$c$ at the laboratory scattering angles between 2$^\circ$ and 16$^\circ$ with the missing-mass resolution of 2.7 $\pm$ 0.1 MeV/$c^2$ (FWHM) at the missing mass of 2.27 GeV/$c^{2}$. In this Letter, we first try to understand the spectrum as a simple quasi-free picture based on several known elementary cross sections, considering the neutron/proton Fermi motion in deuteron. While gross spectrum structures are well understood in this picture, we have observed two distinct deviations; one peculiar enhancement at 2.13 GeV/$c^2$ is due to the $ΣN$ cusp, and the other notable feature is a shift of a broad bump structure, mainly originating from hyperon resonance productions of $Λ(1405)$ and $Σ(1385)^{+/0}$, by about 22.4 $\pm$ 0.4 (stat.) $^{+2.7}_{-1.7}$ (syst.) MeV/$c^2$ toward the low-mass side, which is calculated in the kinematics of a proton at rest as the target.

preprint2014arXiv

Observation of the "$K^-pp$"-like structure in the $d(π^+, K^+)$ reaction at 1.69 GeV/$c$

We have observed a "$K^-pp$"-like structure in the $d(π^+,K^+)$ reaction at 1.69 GeV/$c$. In this reaction $Λ(1405)$ hyperon resonance is expected to be produced as a doorway to form the $K^-pp$ through the $Λ^*p\rightarrow K^-pp$ process. However, most of the produced $Λ(1405)$'s would escape from deuteron without secondary reactions. Therefore, coincidence of high-momentum ($>$ 250~MeV/$c$) proton(s) in large emission angles ($39^\circ<θ_{lab.}<122^\circ$) was requested to enhance the signal-to-background ratio. A broad enhancement in the proton coincidence spectra are observed around the missing-mass of 2.27 GeV/$c^2$, which corresponds to the $K^-pp$ binding energy of 95 $^{+18}_{-17}$ (stat.) $^{+30}_{-21}$ (syst.) MeV and the width of 162 $^{+87}_{-45}$ (stat.) $^{+66}_{-78}$ (syst.) MeV.

preprint2014arXiv

Performance Improvement of Iterative Multiuser Detection for Large Sparsely-Spread CDMA Systems by Spatial Coupling

Kudekar et al. proved that the belief-propagation (BP) performance for low-density parity check (LDPC) codes can be boosted up to the maximum-a-posteriori (MAP) performance by spatial coupling. In this paper, spatial coupling is applied to sparsely-spread code-division multiple-access (CDMA) systems to improve the performance of iterative multiuser detection based on BP. Two iterative receivers based on BP are considered: One receiver is based on exact BP and the other on an approximate BP with Gaussian approximation. The performance of the two BP receivers is evaluated via density evolution (DE) in the dense limit after taking the large-system limit, in which the number of users and the spreading factor tend to infinity while their ratio is kept constant. The two BP receivers are shown to achieve the same performance as each other in these limits. Furthermore, taking a continuum limit for the obtained DE equations implies that the performance of the two BP receivers can be improved up to the performance achieved by the symbol-wise MAP detection, called individually-optimal detection, via spatial coupling. Numerical simulations show that spatial coupling can provide a significant improvement in bit error rate for finite-sized systems especially in the region of high system loads.

preprint2014arXiv

Source and Channel Polarization over Finite Fields and Reed-Solomon Matrices

Polarization phenomenon over any finite field $\mathbb{F}_{q}$ with size $q$ being a power of a prime is considered. This problem is a generalization of the original proposal of channel polarization by Arikan for the binary field, as well as its extension to a prime field by Sasoglu, Telatar, and Arikan. In this paper, a necessary and sufficient condition of a matrix over a finite field $\mathbb{F}_q$ is shown under which any source and channel are polarized. Furthermore, the result of the speed of polarization for the binary alphabet obtained by Arikan and Telatar is generalized to arbitrary finite field. It is also shown that the asymptotic error probability of polar codes is improved by using the Reed-Solomon matrix, which can be regarded as a natural generalization of the $2\times 2$ binary matrix used in the original proposal by Arikan.

preprint2013arXiv

A Potential Theory of General Spatially-Coupled Systems via a Continuum Approximation

This paper analyzes general spatially-coupled (SC) systems with multi-dimensional coupling. A continuum approximation is used to derive potential functions that characterize the performance of the SC systems. For any dimension of coupling, it is shown that, if the boundary of the SC systems is fixed to the unique stable solution that minimizes the potential over all stationary solutions, the systems can approach the optimal performance as the number of coupled systems tends to infinity.

preprint2013arXiv

On an Achievable Rate of Large Rayleigh Block-Fading MIMO Channels with No CSI

Training-based transmission over Rayleigh block-fading multiple-input multiple-output (MIMO) channels is investigated. As a training method a combination of a pilot-assisted scheme and a biased signaling scheme is considered. The achievable rates of successive decoding (SD) receivers based on the linear minimum mean-squared error (LMMSE) channel estimation are analyzed in the large-system limit, by using the replica method under the assumption of replica symmetry. It is shown that negligible pilot information is best in terms of the achievable rates of the SD receivers in the large-system limit. The obtained analytical formulas of the achievable rates can improve the existing lower bound on the capacity of the MIMO channel with no channel state information (CSI), derived by Hassibi and Hochwald, for all signal-to-noise ratios (SNRs). The comparison between the obtained bound and a high SNR approximation of the channel capacity, derived by Zheng and Tse, implies that the high SNR approximation is unreliable unless quite high SNR is considered. Energy efficiency in the low SNR regime is also investigated in terms of the power per information bit required for reliable communication. The required minimum power is shown to be achieved at a positive rate for the SD receiver with no CSI, whereas it is achieved in the zero-rate limit for the case of perfect CSI available at the receiver. Moreover, numerical simulations imply that the presented large-system analysis can provide a good approximation for not so large systems. The results in this paper imply that SD schemes can provide a significant performance gain in the low-to-moderate SNR regimes, compared to conventional receivers based on one-shot channel estimation.

preprint2012arXiv

Central Approximation in Statistical Physics and Information Theory

In statistical physics and information theory, although the exponent of the partition function is often of our primary interest, there are cases where one needs more detailed information. In this paper, we present a general framework to study more precise asymptotic behaviors of the partition function, using the central approximation in conjunction with the method of types.

preprint2012arXiv

New Generalizations of the Bethe Approximation via Asymptotic Expansion

The Bethe approximation, discovered in statistical physics, gives an efficient algorithm called belief propagation (BP) for approximating a partition function. BP empirically gives an accurate approximation for many problems, e.g., low-density parity-check codes, compressed sensing, etc. Recently, Vontobel gives a novel characterization of the Bethe approximation using graph cover. In this paper, a new approximation based on the Bethe approximation is proposed. The new approximation is derived from Vontobel's characterization using graph cover, and expressed by using the edge zeta function, which is related with the Hessian of the Bethe free energy as shown by Watanabe and Fukumizu. On some conditions, it is proved that the new approximation is asymptotically better than the Bethe approximation.

preprint2012arXiv

Parametric Return Density Estimation for Reinforcement Learning

Most conventional Reinforcement Learning (RL) algorithms aim to optimize decision-making rules in terms of the expected returns. However, especially for risk management purposes, other risk-sensitive criteria such as the value-at-risk or the expected shortfall are sometimes preferred in real applications. Here, we describe a parametric method for estimating density of the returns, which allows us to handle various criteria in a unified manner. We first extend the Bellman equation for the conditional expected return to cover a conditional probability density of the returns. Then we derive an extension of the TD-learning algorithm for estimating the return densities in an unknown environment. As test instances, several parametric density estimation algorithms are presented for the Gaussian, Laplace, and skewed Laplace distributions. We show that these algorithms lead to risk-sensitive as well as robust RL paradigms through numerical experiments.

preprint2011arXiv

A Phenomenological Study on Threshold Improvement via Spatial Coupling

Kudekar et al. proved an interesting result in low-density parity-check (LDPC) convolutional codes: The belief-propagation (BP) threshold is boosted to the maximum-a-posteriori (MAP) threshold by spatial coupling. Furthermore, the authors showed that the BP threshold for code-division multiple-access (CDMA) systems is improved up to the optimal one via spatial coupling. In this letter, a phenomenological model for elucidating the essence of these phenomenon, called threshold improvement, is proposed. The main result implies that threshold improvement occurs for spatially-coupled general graphical models.

preprint2011arXiv

Capacity and Modulations with Peak Power Constraint

A practical communication channel often suffers from constraints on input other than the average power, such as the peak power constraint. In order to compare achievable rates with different constellations as well as the channel capacity under such constraints, it is crucial to take these constraints into consideration properly. In this paper, we propose a direct approach to compare the achievable rates of practical input constellations and the capacity under such constraints. As an example, we study the discrete-time complex-valued additive white Gaussian noise (AWGN) channel and compare the capacity under the peak power constraint with the achievable rates of phase shift keying (PSK) and quadrature amplitude modulation (QAM) input constellations.

preprint2011arXiv

Improvement of BP-Based CDMA Multiuser Detection by Spatial Coupling

Kudekar et al. proved that the belief-propagation (BP) threshold for low-density parity-check codes can be boosted up to the maximum-a-posteriori (MAP) threshold by spatial coupling. In this paper, spatial coupling is applied to randomly-spread code-division multiple-access (CDMA) systems in order to improve the performance of BP-based multiuser detection (MUD). Spatially-coupled CDMA systems can be regarded as multi-code CDMA systems with two transmission phases. The large-system analysis shows that spatial coupling can improve the BP performance, while there is a gap between the BP performance and the individually-optimal (IO) performance.

preprint2011arXiv

Large-System Analysis of Joint Channel and Data Estimation for MIMO DS-CDMA Systems

This paper presents a large-system analysis of the performance of joint channel estimation, multiuser detection, and per-user decoding (CE-MUDD) for randomly-spread multiple-input multiple-output (MIMO) direct-sequence code-division multiple-access (DS-CDMA) systems. A suboptimal receiver based on successive decoding in conjunction with linear minimum mean-squared error (LMMSE) channel estimation is investigated. The replica method, developed in statistical mechanics, is used to evaluate the performance in the large-system limit, where the number of users and the spreading factor tend to infinity while their ratio and the number of transmit and receive antennas are kept constant. The performance of the joint CE-MUDD based on LMMSE channel estimation is compared to the spectral efficiencies of several receivers based on one-shot LMMSE channel estimation, in which the decoded data symbols are not utilized to refine the initial channel estimates. The results imply that the use of joint CE-MUDD significantly reduces rate loss due to transmission of pilot signals, especially for multiple-antenna systems. As a result, joint CE-MUDD can provide significant performance gains, compared to the receivers based on one-shot channel estimation.

preprint2011arXiv

Rate-Dependent Analysis of the Asymptotic Behavior of Channel Polarization

For a binary-input memoryless symmetric channel $W$, we consider the asymptotic behavior of the polarization process in the large block-length regime when transmission takes place over $W$. In particular, we study the asymptotics of the cumulative distribution $\mathbb{P}(Z_n \leq z)$, where $\{Z_n\}$ is the Bhattacharyya process defined from $W$, and its dependence on the rate of transmission. On the basis of this result, we characterize the asymptotic behavior, as well as its dependence on the rate, of the block error probability of polar codes using the successive cancellation decoder. This refines the original bounds by Arıkan and Telatar. Our results apply to general polar codes based on $\ell \times \ell$ kernel matrices. We also provide lower bounds on the block error probability of polar codes using the MAP decoder. The MAP lower bound and the successive cancellation upper bound coincide when $\ell=2$, but there is a gap for $\ell>2$.

preprint2011arXiv

Statistical Mechanical Analysis of Low-Density Parity-Check Codes on General Markov Channel

Low-density parity-check (LDPC) codes on symmetric memoryless channels have been analyzed using statistical physics by several authors. In this paper, statistical mechanical analysis of LDPC codes is performed for asymmetric memoryless channels and general Markov channels. It is shown that the saddle point equations of the replica symmetric solution for a Markov channel is equivalent to the density evolution of the belief propagation on the factor graph representing LDPC codes on the Markov channel. The derivation uses the method of types for Markov chain.

preprint2010arXiv

Channel Polarization on q-ary Discrete Memoryless Channels by Arbitrary Kernels

A method of channel polarization, proposed by Arikan, allows us to construct efficient capacity-achieving channel codes. In the original work, binary input discrete memoryless channels are considered. A special case of $q$-ary channel polarization is considered by Sasoglu, Telatar, and Arikan. In this paper, we consider more general channel polarization on $q$-ary channels. We further show explicit constructions using Reed-Solomon codes, on which asymptotically fast channel polarization is induced.

preprint2010arXiv

Effects of Single-Cycle Structure on Iterative Decoding for Low-Density Parity-Check Codes

We consider communication over the binary erasure channel (BEC) using low-density parity-check (LDPC) codes and belief propagation (BP) decoding. For fixed numbers of BP iterations, the bit error probability approaches a limit as blocklength tends to infinity, and the limit is obtained via density evolution. On the other hand, the difference between the bit error probability of codes with blocklength $n$ and that in the large blocklength limit is asymptotically $α(ε,t)/n + Θ(n^{-2})$ where $α(ε,t)$ denotes a specific constant determined by the code ensemble considered, the number $t$ of iterations, and the erasure probability $ε$ of the BEC. In this paper, we derive a set of recursive formulas which allows evaluation of the constant $α(ε,t)$ for standard irregular ensembles. The dominant difference $α(ε,t)/n$ can be considered as effects of cycle-free and single-cycle structures of local graphs. Furthermore, it is confirmed via numerical simulations that estimation of the bit error probability using $α(ε,t)$ is accurate even for small blocklengths.

preprint2010arXiv

Non-Binary Polar Codes using Reed-Solomon Codes and Algebraic Geometry Codes

Polar codes, introduced by Arikan, achieve symmetric capacity of any discrete memoryless channels under low encoding and decoding complexity. Recently, non-binary polar codes have been investigated. In this paper, we calculate error probability of non-binary polar codes constructed on the basis of Reed-Solomon matrices by numerical simulations. It is confirmed that 4-ary polar codes have significantly better performance than binary polar codes on binary-input AWGN channel. We also discuss an interpretation of polar codes in terms of algebraic geometry codes, and further show that polar codes using Hermitian codes have asymptotically good performance.

preprint2007arXiv

Asymptotic Analysis of General Multiuser Detectors in MIMO DS-CDMA Channels

We analyze a MIMO DS-CDMA channel with a general multiuser detector including a nonlinear multiuser detector, using the replica method. In the many-user, limit the MIMO DS-CDMA channel with the multiuser detector is decoupled into a bank of single-user SIMO Gaussian channels if a spatial spreading scheme is employed. On the other hand, it is decoupled into a bank of single-user MIMO Gaussian channels if a spatial spreading scheme is not employed. The spectral efficiency of the MIMO DS-CDMA channel with the spatial spreading scheme is comparable with that of the MIMO DS-CDMA channel using an optimal space-time block code without the spatial spreading scheme. In the case of the QPSK data modulation scheme the spectral efficiency of the MIMO DS-CDMA channel with the MMSE detector shows {\it waterfall} behavior and is very close to the corresponding sum capacity when the system load is just below the transition point of the {\it waterfall} behavior. Our result implies that the performance of a multiuser detector taking the data modulation scheme into consideration can be far superior to that of linear multiuser detectors.

preprint2007arXiv

Spectral Density of Sparse Sample Covariance Matrices

Applying the replica method of statistical mechanics, we evaluate the eigenvalue density of the large random matrix (sample covariance matrix) of the form $J = A^{\rm T} A$, where $A$ is an $M \times N$ real sparse random matrix. The difference from a dense random matrix is the most significant in the tail region of the spectrum. We compare the results of several approximation schemes, focusing on the behavior in the tail region.