Source author record

Takashi Mori

Takashi Mori appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

31works
8topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

31 published item(s)

preprint2022arXiv

Heating Rates under Fast Periodic Driving beyond Linear Response

Heating under periodic driving is a generic nonequilibrium phenomenon, and it is a challenging problem in nonequilibrium statistical physics to derive a quantitatively accurate heating rate. In this work, we provide a simple formula on the heating rate under fast and strong periodic driving in classical and quantum many-body systems. The key idea behind the formula is constructing a time-dependent dressed Hamiltonian by moving to a rotating frame, which is found by a truncation of the high-frequency expansion of the micromotion operator, and applying the linear-response theory. It is confirmed for specific classical and quantum models that the second-order truncation of the high-frequency expansion yields quantitatively accurate heating rates beyond the linear-response regime. Our result implies that the information on heating dynamics is encoded in the first few terms of the high-frequency expansion, although heating is often associated with an asymptotically divergent behavior of the high-frequency expansion.

preprint2022arXiv

Interplay between depth of neural networks and locality of target functions

It has been recognized that heavily overparameterized deep neural networks (DNNs) exhibit surprisingly good generalization performance in various machine-learning tasks. Although benefits of depth have been investigated from different perspectives such as the approximation theory and the statistical learning theory, existing theories do not adequately explain the empirical success of overparameterized DNNs. In this work, we report a remarkable interplay between depth and locality of a target function. We introduce $k$-local and $k$-global functions, and find that depth is beneficial for learning local functions but detrimental to learning global functions. This interplay is not properly captured by the neural tangent kernel, which describes an infinitely wide neural network within the lazy learning regime.

preprint2022arXiv

Power-law escape rate of SGD

Stochastic gradient descent (SGD) undergoes complicated multiplicative noise for the mean-square loss. We use this property of SGD noise to derive a stochastic differential equation (SDE) with simpler additive noise by performing a random time change. Using this formalism, we show that the log loss barrier $Δ\log L=\log[L(θ^s)/L(θ^*)]$ between a local minimum $θ^*$ and a saddle $θ^s$ determines the escape rate of SGD from the local minimum, contrary to the previous results borrowing from physics that the linear loss barrier $ΔL=L(θ^s)-L(θ^*)$ decides the escape rate. Our escape-rate formula strongly depends on the typical magnitude $h^*$ and the number $n$ of the outlier eigenvalues of the Hessian. This result explains an empirical fact that SGD prefers flat minima with low effective dimensions, giving an insight into implicit biases of SGD.

preprint2022arXiv

Strength of Minibatch Noise in SGD

The noise in stochastic gradient descent (SGD), caused by minibatch sampling, is poorly understood despite its practical importance in deep learning. This work presents the first systematic study of the SGD noise and fluctuations close to a local minimum. We first analyze the SGD noise in linear regression in detail and then derive a general formula for approximating SGD noise in different types of minima. For application, our results (1) provide insight into the stability of training a neural network, (2) suggest that a large learning rate can help generalization by introducing an implicit regularization, (3) explain why the linear learning rate-batchsize scaling law fails at a large learning rate or at a small batchsize and (4) can provide an understanding of how discrete-time nature of SGD affects the recently discovered power-law phenomenon of SGD.

preprint2021arXiv

Is deeper better? It depends on locality of relevant features

It has been recognized that a heavily overparameterized artificial neural network exhibits surprisingly good generalization performance in various machine-learning tasks. Recent theoretical studies have made attempts to unveil the mystery of the overparameterization. In most of those previous works, the overparameterization is achieved by increasing the width of the network, while the effect of increasing the depth has remained less well understood. In this work, we investigate the effect of increasing the depth within an overparameterized regime. To gain an insight into the advantage of depth, we introduce local and global labels as abstract but simple classification rules. It turns out that the locality of the relevant feature for a given classification rule plays a key role; our experimental results suggest that deeper is better for local labels, whereas shallower is better for global labels. We also compare the results of finite networks with those of the neural tangent kernel (NTK), which is equivalent to an infinitely wide network with a proper initialization and an infinitesimal learning rate. It is shown that the NTK does not correctly capture the depth dependence of the generalization performance, which indicates the importance of the feature learning rather than the lazy learning.

preprint2020arXiv

Thermalization in open many-body systems based on eigenstate thermalization hypothesis

We investigate steady states of macroscopic quantum systems under dissipation not obeying the detailed balance condition. We argue that the Gibbs state at an effective temperature gives a good description of the steady state provided that the system Hamiltonian obeys the eigenstate thermalization hypothesis (ETH) and the perturbation theory in the weak system-environment coupling is valid in the thermodynamic limit. We derive a criterion to guarantee the validity of the perturbation theory, which is satisfied in the thermodynamic limit for sufficiently weak dissipation when the Liouvillian is gapped for bulk-dissipated systems, while the perturbation theory breaks down in boundary-dissipated chaotic systems due to the presence of diffusive transports. We numerically confirm these theoretical predictions. This work suggests a connection between steady states of macroscopic open quantum systems and the ETH.

preprint2016arXiv

Effective Floquet-Gibbs states for dissipative quantum systems

A periodically driven quantum system, when coupled to a heat bath, relaxes to a non-equilibrium asymptotic state. In the general situation, the retrieval of this asymptotic state presents a rather non-trivial task. It was recently shown that in the limit of an infinitesimal coupling, using so-called rotating wave approximation (RWA), and under strict conditions imposed on the time-dependent system Hamiltonian, the asymptotic state can attain the Gibbs form. A Floquet-Gibbs state is characterized by a density matrix which is diagonal in the Floquet basis of the system Hamiltonian with the diagonal elements obeying a Gibbs distribution, being parametrized by the corresponding Floquet quasi-energies. Addressing the non-adiabatic driving regime, upon using the Magnus expansion, we employ the concept of a corresponding effective Floquet Hamiltonian. In doing so we go beyond the conventionally used RWA and demonstrate that the idea of Floquet-Gibbs states can be extended to the realistic case of a weak, although finite system-bath coupling, herein termed effective Floquet-Gibbs states.

preprint2016arXiv

Extensive increase of entropy in quantum quench

In the setup of isolated quantum systems, it is proved that the thermodynamic entropy and the diagonal entropy must increase extensively in any nontrivial quantum quench. The extensive increase of the thermodynamic entropy is shown for any initial state (even for a pure state) that represents thermal equilibrium. On the other hand, the extensive increase of the diagonal entropy is shown for any stationary initial state under the condition that both the pre-quench and the post-quench Hamiltonians satisfy the eigenstate thermalization hypothesis.

preprint2016arXiv

Floquet-Magnus Theory and Generic Transient Dynamics in Periodically Driven Many-Body Quantum Systems

This work explores a fundamental dynamical structure for a wide range of many-body quantum systems under periodic driving. Generically, in the thermodynamic limit, such systems are known to heat up to infinite temperature states after infinite-time evolution, irrespective of dynamical details. In the present study, instead of considering infinitely long-time scale, we aim to provide a framework to understand the long but finite time behavior, namely the transient dynamics. In the analysis, we focus on the Floquet-Magnus (FM) expansion that gives a formal expression of the effective Hamiltonian on the system. Although in general the full series expansion is not convergent in the thermodynamics limit, we give a clear relationship between the FM expansion and the transient dynamics. More precisely, we rigorously show that a truncated version of the FM expansion accurately describes the exact dynamics for a finite-time scale. Our result reveals a reliable time scale of the validity of the FM expansion, which can be comparable to the experimental time scale. Furthermore, we discuss several dynamical phenomena, such as the effect of small integrability breaking, efficient numerical simulation of periodically driven systems, dynamical localization and thermalization. Especially on thermalization, we discuss generic scenario of the prethermalization phenomenon in periodically driven systems.

preprint2016arXiv

Macrostate equivalence of two general ensembles and specific relative entropies

The two criteria of ensemble equivalence, i.e. the macrostate equivalence and the measure equivalence, are investigated for a general pair of states. The macrostate equivalence implies the two ensembles are indistinguishable by the measurement of macroscopic quantities obeying the large-deviation principle, and the measure equivalence means that the specific relative entropy of these two states vanishes in the thermodynamic limit. It is shown that the measure equivalence implies the macrostate equivalence for a general pair of states by deriving an inequality connecting the large-deviation rate functions to the specific relative Renyi entropies. The result is applicable to both quantum and classical systems. As applications, a sufficient condition for thermalization, the timescale of quantum dynamics of macrovariables, and the second law with strict irreversibility in a quantum quench are discussed.

preprint2016arXiv

Weak eigenstate thermalization with large deviation bound

We investigate the eigenstate thermalization hypothesis (ETH) for a translationally invariant quantum spin system on the $d$-dimensional cubic lattice under the periodic boundary conditions. It is known that the ETH holds in this model for typical energy eigenstates in the sense that the standard deviation of the expectation values of a local observable in the energy eigenstates within the microcanonical energy shell vanishes in the thermodynamic limit, which is called the weak ETH. Here, it is remarked that the diagonal elements of a local observable in the energy representation shows the large deviation behavior. This result implies that the fraction of atypical eigenstates which do not represent thermal equilibrium is exponentially small.

preprint2015arXiv

Condition for emergence of the Floquet-Gibbs state in periodically driven open systems

We study probability distribution of a steady state of a periodically driven system coupled to a thermal bath by using a quantum master equation in the weak coupling limit. It is proved that, even when the external field is strong, the probability distribution is independent of the detailed nature of the thermal bath under the following conditions: (i) the Hamiltonian of the relevant system is bounded and the period of the driving field is short, (ii) the Hamiltonians for the driving field at different times commute, and (iii) the Hamiltonians of the driving field and of the interaction between the relevant system and the thermal bath commute. It is shown that the steady state is described by the Gibbs distribution of the Floquet states of the relevant system at the temperature of the thermal bath.

preprint2015arXiv

Existence of shape-dependent thermodynamic limit in spin systems with short- and long-range interactions

The existence of the thermodynamic limit in spin systems with short- and long-range interactions is established. We consider the infinite-volume limit with a fixed shape of the system. The variational expressions of the entropy density and the free energy density are obtained, which explicitly depend on the shape of the system. This shape dependence of thermodynamic functions implies the nonadditivity, which is one of the most important characteristics of long-range interacting systems.

preprint2015arXiv

Floquet resonant states and validity of the Floquet-Magnus expansion in the periodically driven Friedrichs models

The Floquet eigenvalue problem is analyzed for periodically driven Friedrichs models on discrete and continuous space. In the high-frequency regime, there exists a Floquet bound state consistent with the Floquet-Magnus expansion in the discrete Friedrichs model, while it is not the case in the continuous model. In the latter case, however, the bound state predicted by the Floquet-Magnus expansion appears as a metastable state whose lifetime diverges in the limit of large frequencies. We obtain the lifetime by evaluating the imaginary part of the quasi-energy of the Floquet resonant state. In the low-frequency regime, there is no Floquet bound state and instead the Floquet resonant state with exponentially small imaginary part of the quasi-energy appears, which is understood as the quantum tunneling in the energy space.

preprint2015arXiv

Thermodynamics of extensive but nonadditive systems: modified Gibbs-Duhem equation in the dipolar gas

Thermodynamic properties of extensive but nonadditive systems are investigated. The precise definitions of additivity and extensivity are presented, and we will see that additivity derives several important properties including the shape-independence of the thermodynamic functions, the concavity of the entropy, and the equivalence of ensembles. In nonadditive systems, some of the above properties can be violated. It is pointed out that the shape-dependence of the entropy density in a nonadditive system results in the violation of the Gibbs-Duhem equation. As an example, the dipolar gas is numerically studied and the violation of the Gibbs-Duhem equation is confirmed. The predicted violation of the Gibbs-Duhem equation should be observable in cold-atom experiment with polarized dipolar gas.

preprint2014arXiv

Entanglement prethermalization: Locally thermal but non-locally non-thermal states in a one-dimensional Bose gas

A well-isolated system often shows relaxation to a quasi-stationary state before reaching thermal equilibrium. Such a prethermalization has attracted considerable interest recently in association with closely related fundamental problems of relaxation and thermalization of isolated quantum systems. Motivated by the recent experiment in ultracold atoms, we study the dynamics of a one-dimensional Bose gas which is split into two subsystems, and find that individual subsystems relax to Gibbs states, yet the entire system does not due to quantum entanglement. In view of recent experimental realization on a small well-defined number of ultracold atoms, our prediction based on exact few-body calculations is amenable to experimental test.

preprint2014arXiv

Natural correlation between a system and a thermal reservoir

Non-Markovian corrections to the Markovian quantum master equation of an open quantum system are investigated up to the second order of the interaction between the system of interest and a thermal reservoir. The concept of "natural correlation" is discussed. When the system is naturally correlated with a thermal reservoir, the time evolution of the reduced density matrix looks Markovian even in a short-time regime. If the total system was initially in an "unnatural" state, the natural correlation is established during the time evolution, and after that the time evolution becomes Markovian in a long-time regime. It is also shown that for a certain set of reduced density matrices, the naturally correlated state does not exist. If the initial reduced density matrix has no naturally correlated state, the time evolution is inevitably non-Markovian in a short-time regime.

preprint2014arXiv

Novel symmetry-broken phase in a driven cavity system in the thermodynamic limit

We study non-equilibrium stationary states of a cavity system consisting of many atoms interacting with a quantized cavity field mode, under a driving field in a dissipative environment. We derive a quantum master equation which is suitable for treating systems with a strong driving field and a strong atom-photon interaction. We do this by making use of the fact that the mean-field dynamics are exact in the thermodynamic limit thanks to a uniform coupling between atoms and photons. We find ordered states with symmetry-broken components of the photon field and atomic excitation driven by the external field. The mechanism by which these ordered states arise is discussed from the viewpoint of the quantum interference effect.

preprint2014arXiv

Quasi-equilibrium nonadditivity

The possibility that a short-range interacting system exhibits nonadditivity is investigated. After the discussion on the precise definition of additivity and its consequence, we show that it is possible when the system is in a quasi-equilibrium state by examining the specific model, in which the spin degrees of freedom are coupled to the motional degrees of freedom and which exhibits a type of structural phase transitions.

preprint2013arXiv

Analysis of the exactness of mean-field theory in long-range interacting systems

Relationships between general long-range interacting classical systems on a lattice and the corresponding mean-field models (infinitely long-range interacting models) are investigated. We study systems in arbitrary dimension d for periodic boundary conditions and focus on the free energy for fixed value of the total magnetization. As a result, it is shown that the equilibrium free energy of the long-range interacting systems are exactly the same as that of the corresponding mean-field models (exactness of the mean-field theory). Moreover, the mean-field metastable states can be also preserved in general long-range interacting systems. It is found that in the case that the magnetization is conserved, the mean-field theory does not give correct property in some parameter region.

preprint2013arXiv

Asymptotic forms and scaling properties of the relaxation time near threshold points in spinodal-type dynamical phase transitions

We study critical properties of the relaxation time at a threshold point in switching processes between bistable states under change of external fields. In particular, we investigate the relaxation processes near the spinodal point of the infinitely long-range interaction model (the Husimi-Temperley model) by analyzing the scaling properties of the corresponding Fokker-Planck equation. We also confirm the obtained scaling relations by direct numerical solution of the original master equation, and by kinetic Monte Carlo simulation of the stochastic decay process. In particular, we study the asymptotic forms of the divergence of the relaxation time near the spinodal point, and reexamine its scaling properties. We further extend the analysis to transient critical phenomena such as a threshold behavior with diverging switching time under a general external driving perturbation. This models photo-excitation processes in spin-crossover materials. In the ongoing development of nano-size fabrication, such size-dependence of switching processes should be an important issue, and the properties obtained here will be applicable to a wide range of physical processes.

preprint2013arXiv

Exactness of the mean-field dynamics in optical cavity systems

Validity of the mean-field approach to open system dynamics in the optical cavity system is examined. It is rigorously shown that the mean-field approach is justified in the thermodynamic limit. The result is applicable to nonequilibrium situations, e.g. the thermal reservoirs may have different temperatures, and the system may be subject to a time-dependent external field. The result of this work will lead to further studies on macroscopic open quantum systems.

preprint2013arXiv

Nonadditivity in Quasiequilibrium States of Spin Systems with Lattice Distortion

It is pointed out that there exists a short-range interacting system, i.e. the elastic spin model, which is extensive but nonadditive. It is numerically shown that, depending on the statistical ensemble, the specific heat or the susceptibility becomes negative in a certain parameter region, which shows ensemble inequivalence in this model. Further, we numerically estimate the effective Hamiltonian for spin variables, and it is clarified that the effective interaction among spin variables is long-ranged. Remarkably, the so called Kac's prescription, which is usually regarded as a mathematical operation to make the system extensive, naturally holds in the effective interaction.

preprint2013arXiv

Phase transitions in systems with non-additive long-range interactions

We consider spin systems with long-range interactions in nonadditive regime. When the non-additive scaling limit is employed, the energy and the entropy compete and the system exhibits some phase transitions. Such systems do not satisfy the additivity, which results in some unfamiliar properties related to phase transitions. In this paper, the concept of additivity and its consequence are explained and the recent progress on statistical mechanics of long-range interacting systems are reviewed. It is shown that the parameter space is clearly decomposed into the three regions according to the stability of the uniform state predicted by the mean-field theory. Based on this parameter space decomposition, recent results on the exactness of MF theory are explained. When the interaction is non-negative (ferromagnetic), the analysis of the mean-field theory is exact and a typical spin configuration is always uniform in the canonical ensemble. However, in the restricted canonical ensemble, i.e., the canonical ensemble with a restriction of the value of the magnetization, it is shown that the mean-field theory does not necessarily give the exact description of the system and phase transitions between the mean-field uniform states (MF phase) and the inhomogeneous states (non-MF phase) occur. A new finding is that when the interaction potential changes its sign depending on the distance, the non-MF phase appears even in the canonical ensemble.

preprint2012arXiv

Critical temperature and correlation length of an elastic interaction model for spin-crossover materials

It has previously been pointed out that the coexistence of infinite-range and short-range interactions causes a system to have a phase transition of the mean-field universality class, in which the cluster size is finite even at the critical point. In the present paper, we study this property in a model of bistable molecules, whose size changes depending on the bistable states. The molecules can move in space, interacting via an elastic interaction. It is known that due to the different sizes, an effective long-range interaction between the spins appears, and thus this model has a mean-field type of phase transition. It is found that the scaling properties of the shift of the critical temperature from the pure short-range limit in the model with infinite-range and short-range interactions hold also in the present model, regarding the ratio of the size of the two states as a control parameter for the strength of the long-range interaction. By studying the structure factor, it is shown that the dependence of the cluster size at the critical temperature also shows the same scaling properties as a previously studied model with both infinite-range and short-range interactions. We therefore conclude that these scaling relations hold universally in hybrid models with both short-range and weak long-range interactions.

preprint2012arXiv

Equilibrium Properties of Quantum Spin Systems with Non-additive Long-Range Interactions

We study equilibrium states of quantum spin systems with non-additive long-range interactions by adopting an appropriate scaling of the interaction strength, i.e., the so called Kac prescription. In classical spin systems, it is known that the equilibrium free energy is obtained by minimizing the free energy functional over the coarse-grained magnetization. Here we show that it is also true for quantum spin systems. From this observation, it is found that when the canonical ensemble and the microcanonical ensemble are not equivalent in some parameter region, it is not necessarily justified to replace the actual long-range interaction by the infinite-range interaction (Curie-Weiss type interaction). On the other hand, in the parameter region where the two ensembles are equivalent, this replacement is always justified. We examine the Heisenberg XXZ model as an illustrative example, and discuss the relation to experiments.

preprint2012arXiv

Microcanonical Analysis of Exactness of the Mean-Field Theory in Long-Range Interacting Systems

Classical spin systems with nonadditive long-range interactions are studied in the microcanonical ensemble. It is expected that the entropy of such a system is identical to that of the corresponding mean-field model, which is called "exactness of the mean-field theory". It is found out that this expectation is not necessarily true if the microcanonical ensemble is not equivalent to the canonical ensemble in the mean-field model. Moreover, necessary and sufficient conditions for exactness of the mean-field theory are obtained. These conditions are investigated for two concrete models, the α-Potts model with annealed vacancies and the α-Potts model with invisible states.

preprint2011arXiv

Crossover between a Short-range and a Long-range Ising model

Recently, it has been found that an effective long-range interaction is realized among local bistable variables (spins) in systems where the elastic interaction causes ordering of the spins. In such systems, generally we expect both long-range and short-range interactions to exist. In the short-range Ising model, the correlation length diverges at the critical point. In contrast, in the long-range interacting model the spin configuration is always uniform and the correlation length is zero. As long as a system has non-zero long-range interactions, it shows criticality in the mean-field universality class, and the spin configuration is uniform beyond a certain scale. Here we study the crossover from the pure short-range interacting model to the long-range interacting model. We investigate the infinite-range model (Husimi-Temperley model) as a prototype of this competition, and we study how the critical temperature changes as a function of the strength of the long-range interaction. This model can also be interpreted as an approximation for the Ising model on a small-world network. We derive a formula for the critical temperature as a function of the strength of the long-range interaction. We also propose a scaling form for the spin correlation length at the critical point, which is finite as long as the long-range interaction is included, though it diverges in the limit of the pure short-range model. These properties are confirmed by extensive Monte Carlo simulations.

preprint2011arXiv

Instability of the mean-field states and generalization of phase separation in long-range interacting systems

Equilibrium properties of long-range interacting systems on lattices are investigated. There was a conjecture by Cannas et. al. that the mean-field theory is exact for spin systems with non-additive long-range interactions. This is called "exactness of the mean-field theory". We show that the exactness of the mean-field theory holds for systems on a lattice with non-additive two body long-range interactions in the canonical ensemble with non-fixed order parameters. We also show that in canonical ensemble with fixed order parameters (e.g. lattice gas model with a fixed number of particles), exactness of the mean-field theory does not hold in some parameter region, which we call "non-MF region". In the non-MF region, an inhomogeneous configuration appears contrary to the uniform configuration in the region where the mean-field theory holds. This inhomogeneous configuration is not the one given by the standard phase separation. Therefore, the mean-field picture is not adequate to describe these states. We discuss phase transitions between the MF region and the non-MF region. Exactness of the mean-field theory in spin glasses is also discussed.

preprint2009arXiv

Comparison among Various Expressions of Complex Admittance for Quantum System in Contact with Heat Reservoir

Relation among various expressions of the complex admittance for quantum systems in contact with heat reservoir is studied. Exact expressions of the complex admittance are derived in various types of formulations of equations of motion under contact with heat reservoir. Namely, the complex admittance is studied in the relaxation method and the external-field method. In the former method, the admittance is calculated using the Kubo formula for quantum systems in contact with heat reservoir in no external driving fields, while in the latter method the admittance is directly calculated from equations of motion with external driving terms. In each method, two types of equation of motions are considered, i.e., the time-convolution (TC) equation and time-convolutionless (TCL) equation. That is, the full of the four cases are studied. It is turned out that the expression of the complex admittance obtained by using the relaxation method with the TC equation exactly coincides with that obtained by using the external-field method with the TC equation, while other two methods give different forms. It is also explicitly demonstrated that all the expressions of the complex admittance coincide with each other in the lowest Born approximation for the systemreservoir interaction. The formulae necessary for the higher order expansions in powers of the system-reservoir interaction are derived, and also the expressions of the admittance in the n-th order approximation are given. To characterize the TC and TCL methods, we study the expressions of the admittances of two exactly solvable models. Each exact form of admittance is compared with the results of the two methods in the lowest Born approximation. It is found that depending on the model, either of TC and TCL would be the better method.

preprint2009arXiv

Threshold Phenomena under Photo Excitation of Spin-crossover Materials with Cooperativity due to Elastic Interactions

Photo-induced switching from the low-spin state to the high-spin state is studied in a model of spin-crossover materials, in which long-range interactions are induced by elastic distortions due to different molecular sizes the two spin states. At a threshold value of the light intensity we observe nonequilibrium critical behavior corresponding to a mean-field spinodal point. Finite-size scaling of the divergence of the relaxation time is revealed by analysis of kinetic Monte Carlo simulations.