BZPEERReading, trust and collaboration for research
Menu

Discover

GraphFollow connections around a paper, topic or saved view.

Workspaces

HomePick up where your research flow left off.InboxHandle requests, replies and notifications from one place.CollectionsCurate reading lists, evidence sets and shareable dossiers.ResearchSee your private provenance graph, trail and imports.CollaborationMove from discovery into focused discussion rooms.PublishDraft, preview and publish full-text research articles.

Network

ExpertsFind specialists worth following or asking for help.CommunitiesJoin research circles organized around shared work.PartnersSee external organizations active around the same topics.

Opportunities

ListingsBrowse roles, calls and collaborations with clearer fit signals.

Account

Log inReturn to your reading and collaboration workspace.Create accountStart saving work, following people and joining teams.
Log inCreate account

Researcher profile

Juan P. Garrahan

Juan P. Garrahan contributes to research discovery and scholarly infrastructure.

ResearcherAffiliation not importedOpen to collaborate
cond-mat.stat-mechquant-phcond-mat.dis-nnMachine Learningnlin.CGcond-mat.softmath-phmath.MPnlin.SIphysics.atom-phphysics.chem-ph

Trust snapshot

Quick read

Trust 21 - EmergingVerification L1Unclaimed author
18works
0followers
11topics
4close collaborators

Actions

Decide how to stay connected

Follow researcher0

Identity and collaboration

How to connect with this researcher

Claiming links this public author record to a researcher profile and unlocks direct collaboration workflows.

Log in to claim

Direct collaboration

Open a focused conversation when the fit is right

Claim this author entity first to unlock direct invitations.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

18 published item(s)

preprint2022arXiv

Finite time large deviations via matrix product states

Recent work has shown the effectiveness of tensor network methods for computing large deviation functions in constrained stochastic models in the infinite time limit. Here we show that these methods can also be used to study the statistics of dynamical observables at arbitrary finite time. This is a harder problem because, in contrast to the infinite time case where only the extremal eigenstate of a tilted Markov generator is relevant, for finite time the whole spectrum plays a role. We show that finite time dynamical partition sums can be computed efficiently and accurately in one dimension using matrix product states, and describe how to use such results to generate rare event trajectories on demand. We apply our methods to the Fredrickson-Andersen (FA) and East kinetically constrained models, and to the symmetric simple exclusion process (SSEP), unveiling dynamical phase diagrams in terms of counting field and trajectory time. We also discuss extensions of this method to higher dimensions.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Topological phases in the dynamics of the simple exclusion process

We study the dynamical large deviations of the classical stochastic symmetric simple exclusion process (SSEP) by means of numerical matrix product states. We show that for half-filling, long-time trajectories with a large enough imbalance between the number hops in even and odd bonds of the lattice belong to distinct symmetry protected topological (SPT) phases. Using tensor network techniques, we obtain the large deviation (LD) phase diagram in terms of counting fields conjugate to the dynamical activity and the total hop imbalance. We show the existence of high activity trivial and non-trivial SPT phases (classified according to string-order parameters) separated by either a critical phase or a critical point. Using the leading eigenstate of the tilted generator, obtained from infinite-system density matrix renormalisation group (DMRG) simulations, we construct a near-optimal dynamics for sampling the LDs, and show that the SPT phases manifest at the level of rare stochastic trajectories. We also show how to extend these results to other filling fractions, and discuss generalizations to asymmetric SEPs.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Exact solution of the Rule 150 reversible cellular automaton

We study the dynamics of the Rule 150 reversible cellular automaton (RCA). This is a one-dimensional lattice system of binary variables with synchronous (Floquet) dynamics, corresponding to a bulk deterministic and reversible discrete version of the kinetically constrained XOR-Fredrickson-Andersen model, whereby the local dynamics is restricted: a site flips if and only if the states of its neighbouring sites are different from each other. Like other RCA which have been studied recently, such as Rule 54 and Rule 201, Rule 150 is integrable, however, in contrast is noninteracting. In particular, the emergent quasiparticles - the domain walls - behave as free fermions. This then allows us to solve the model by means of matrix product ansätze. We find the exact equilibrium and nonequilibrium stationary states for systems with closed (periodic) and open (stochastic) boundaries, respectively, resolve the full spectrum of the time evolution operator and, therefore, gain access to the relaxation dynamics, and obtain the exact large deviation statistics of dynamical observables in the long time limit.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Reinforcement learning of rare diffusive dynamics

We present a method to probe rare molecular dynamics trajectories directly using reinforcement learning. We consider trajectories that are conditioned to transition between regions of configuration space in finite time, like those relevant in the study of reactive events, as well as trajectories exhibiting rare fluctuations of time-integrated quantities in the long time limit, like those relevant in the calculation of large deviation functions. In both cases, reinforcement learning techniques are used to optimize an added force that minimizes the Kullback-Leibler divergence between the conditioned trajectory ensemble and a driven one. Under the optimized added force, the system evolves the rare fluctuation as a typical one, affording a variational estimate of its likelihood in the original trajectory ensemble. Low variance gradients employing value functions are proposed to increase the convergence of the optimal force. The method we develop employing these gradients leads to efficient and accurate estimates of both the optimal force and the likelihood of the rare event for a variety of model systems.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

A Deep Learning Functional Estimator of Optimal Dynamics for Sampling Large Deviations

In stochastic systems, numerically sampling the relevant trajectories for the estimation of the large deviation statistics of time-extensive observables requires overcoming their exponential (in space and time) scarcity. The optimal way to access these rare events is by means of an auxiliary dynamics obtained from the original one through the so-called ``generalised Doob transformation''. While this optimal dynamics is guaranteed to exist its use is often impractical, as to define it requires the often impossible task of diagonalising a (tilted) dynamical generator. While approximate schemes have been devised to overcome this issue they are difficult to automate as they tend to require knowledge of the systems under study. Here we address this problem from the perspective of deep learning. We devise an iterative semi-supervised learning scheme which converges to the optimal or Doob dynamics with the clear advantage of requiring no prior knowledge of the system. We test our method in a paradigmatic statistical mechanics model with non-trivial dynamical fluctuations, the fully packed classical dimer model on the square lattice, showing that it compares favourably with more traditional approaches. We discuss broader implications of our results for the study of rare dynamical trajectories.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

A reinforcement learning approach to rare trajectory sampling

Very often when studying non-equilibrium systems one is interested in analysing dynamical behaviour that occurs with very low probability, so called rare events. In practice, since rare events are by definition atypical, they are often difficult to access in a statistically significant way. What are required are strategies to "make rare events typical" so that they can be generated on demand. Here we present such a general approach to adaptively construct a dynamics that efficiently samples atypical events. We do so by exploiting the methods of reinforcement learning (RL), which refers to the set of machine learning techniques aimed at finding the optimal behaviour to maximise a reward associated with the dynamics. We consider the general perspective of dynamical trajectory ensembles, whereby rare events are described in terms of ensemble reweighting. By minimising the distance between a reweighted ensemble and that of a suitably parametrised controlled dynamics we arrive at a set of methods similar to those of RL to numerically approximate the optimal dynamics that realises the rare behaviour of interest. As simple illustrations we consider in detail the problem of excursions of a random walker, for the case of rare events with a finite time horizon; and the problem of a studying current statistics of a particle hopping in a ring geometry, for the case of an infinite time horizon. We discuss natural extensions of the ideas presented here, including to continuous-time Markov systems, first passage time problems and non-Markovian dynamics.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

A Tensor Network Approach to Finite Markov Decision Processes

Tensor network (TN) techniques - often used in the context of quantum many-body physics - have shown promise as a tool for tackling machine learning (ML) problems. The application of TNs to ML, however, has mostly focused on supervised and unsupervised learning. Yet, with their direct connection to hidden Markov chains, TNs are also naturally suited to Markov decision processes (MDPs) which provide the foundation for reinforcement learning (RL). Here we introduce a general TN formulation of finite, episodic and discrete MDPs. We show how this formulation allows us to exploit algorithms developed for TNs for policy optimisation, the key aim of RL. As an application we consider the issue - formulated as an RL problem - of finding a stochastic evolution that satisfies specific dynamical conditions, using the simple example of random walk excursions as an illustration.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Matrix product state of multi-time correlations

For an interacting spatio-temporal lattice system we introduce a formal way of expressing multi-time correlation functions of local observables located at the same spatial point with a time state, i.e. a statistical distribution of configurations observed along a time lattice. Such a time state is defined with respect to a particular equilibrium state that is invariant under space and time translations. The concept is developed within the Rule 54 reversible cellular automaton, for which we explicitly construct a matrix product form of the time state, with matrices that act on the 3-dimensional auxiliary space. We use the matrix-product state to express equal-space time-dependent density-density correlation function, which, for special maximum-entropy values of equilibrium parameters, agrees with the previous results. Additionally, we obtain an explicit expression for the probabilities of observing all multi-time configurations, which enables us to study distributions of times between consecutive excitations and prove the absence of decoupling of timescales in the Rule 54 model.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Quantum East model: localization, non-thermal eigenstates and slow dynamics

We study in detail the properties of the quantum East model, an interacting quantum spin chain inspired by simple kinetically-constrained models of classical glasses. Through a combination of analytics, exact diagonalization and tensor-network methods we show the existence of a transition, from a fast to a slow thermalization regime, which manifests itself throughout the spectrum. On the slow side, by exploiting the localization of the ground state and the form of the Hamiltonian, we explicitly construct a large (exponential in size) number of non-thermal states which become exact finite-energy-density eigenstates in the large-size limit, as expected for a true phase transition. A ``super-spin'' generalization allows us to find a further large class of area-law states proved to display very slow relaxation. These states retain memory of their initial conditions for extremely long times. Our numerical analysis reveals that the localization properties are not limited to the ground state and that} many eigenstates have large overlap with product states and can be approximated well by matrix product states at arbitrary energy densities. The mechanism that induces localization to the ground state, and hence the non-thermal behavior of the system, can be extended to a wide range of models including a number of simple spin chains. We discuss implications of our results for slow thermalization and non-ergodicity more generally in disorder-free systems with constraints and we give numerical evidence that these results may be extended to two dimensional systems.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Symmetry-induced fluctuation relations for dynamical observables irrespective of their behaviour under time-reversal

We extend previous work to describe a class of fluctuation relations (FRs) that emerge as a consequence of symmetries at the level of stochastic trajectories in Markov chains. We prove that given such a symmetry, and for a suitable dynamical observable, it is always possible to obtain a FR under a biased dynamics corresponding to the so-called generalized Doob transform. The general transformations of the dynamics that we consider go beyond time-reversal or spatial isometries, and an implication is the existence of FRs for observables irrespective of their behaviour under time-reversal, for example for time-symmetric observables rather than currents. We further show how to deduce in the long-time limit these FRs from the symmetry properties of the generator of the dynamics. We illustrate our results with four examples that highlight the novel features of our work.

0 citations0 reviewsNo code linkedOpen access
preprint2019arXiv

A non-equilibrium quantum many-body Rydberg atom engine

The standard approach to quantum engines is based on equilibrium systems and on thermodynamic transformations between Gibbs states. However, non-equilibrium quantum systems offer enhanced experimental flexibility in the control of their parameters and, if used as engines, a more direct interpretation of the type of work they deliver. Here we introduce an out-of-equilibrium quantum engine inspired by recent experiments with cold atoms. Our system is connected to a single environment and produces mechanical work from many-body interparticle interactions arising between atoms in highly excited Rydberg states. As such, it is not a heat engine but an isothermal one. We perform many-body simulations to show that this system can produce work. The setup we introduce and investigate represents a promising platform for devising new types of microscopic machines and for exploring quantum effects in thermodynamic processes.

0 citations0 reviewsNo code linkedOpen access
preprint2019arXiv

Trajectory phase transitions in non-interacting spin systems

We show that a collection of independent Ising spins evolving stochastically can display surprisingly large fluctuations towards ordered behaviour, as quantified by certain types of time-integrated plaquette observables, despite the underlying dynamics being non-interacting. In the large deviation (LD) regime of long times and large system size, this can give rise to a phase transition in trajectory space. As a non-interacting system we consider a collection of spins undergoing single spin-flip dynamics at infinite-temperature. For the dynamical observables we study, the associated tilted generators have an exact and explicit spin-plaquette duality. Such setup suggests the existence of a transition (in the large size limit) at the self-dual point of the tilted generator. The nature of the LD transition depends on the observable. We consider explicitly two situations: (i) for a pairwise bond observable the LD transition is continuous, and equivalent to that of the transverse field Ising model; (ii) for a higher order plaquette observable, in contrast, the LD transition is first order. Case (i) is easy to prove analytically, while we confirm case (ii) numerically via an efficient trajectory sampling scheme that exploits the non-interacting nature of the original dynamics.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Thermodynamics of Quadrature Trajectories in Open Quantum Systems

We apply a large-deviation method to study the diffusive trajectories of the quadrature operators of light within a reservoir connected to dissipative quantum systems. We formulate the study of quadrature trajectories in terms of characteristic operators and show that in the long time limit the statistics of such trajectories obey a large-deviation principle. We take our motivation from homodyne detection schemes which allow the statistics of quadrature operator of the light field to be measured. We illustrate our approach with four examples of increasing complexity: a driven two-level system, a `blinking' three-level system, a pair of weakly-coupled two-level driven systems, and the micromaser. We discuss how quadrature operators can serve as alternative order parameters for the classification of dynamical phases, which is particularly useful in cases where the statistics of quantum jumps cannot distinguish between such phases. The formalism we introduce also allows us to analyse the properties of the light emitted by quantum jump trajectories which fluctuate far from the typical dynamics.

0 citations0 reviewsNo code linkedOpen access
preprint2010arXiv

Kinetically Constrained Models

In this chapter we summarize recent developments in the study of kinetically constrained models (KCMs) as models for glass formers. After recalling the definition of the KCMs which we cover we study the possible occurrence of ergodicity breaking transitions and discuss in some detail how, before any such transition occurs, relaxation timescales depend on the relevant control parameter (density or temperature). Then we turn to the main issue: the prediction of KCMs for dynamical heterogeneities. We focus in particular on multipoint correlation functions and susceptibilities, and decoupling in the transport coefficients. Finally we discuss the recent view of KCMs as being at first order coexistence between an active and an inactive space-time phase.

0 citations0 reviewsNo code linkedOpen access
preprint2010arXiv

Thermalization in a coherently driven ensemble of two-level systems

We study the coherent quantum evolution of a closed and driven mesoscopic chain of two-level systems that interact via the van-der-Waals interaction in their excited state. The Hamiltonian consists of a part corresponding to a classical lattice gas and an off-diagonal driving term without classical counterpart. We show that in a certain parameter range the latter leads to a thermalization of the system with respect to observables of the classical lattice gas such as the interaction energy and particle number distribution. We investigate the evolution of the system into this thermal state and discuss how to determine the corresponding temperature. Our findings can be applied to understand thermalization in strongly interacting systems of laser-driven Rydberg atoms, ions or polar molecules.

0 citations0 reviewsNo code linkedOpen access
preprint2009arXiv

Dynamics on the Way to Forming Glass: Bubbles in Space-time

We review a theoretical perspective of the dynamics of glass forming liquids and the glass transition. It is a perspective we have developed with our collaborators during this decade. It is based upon the structure of trajectory space. This structure emerges from spatial correlations of dynamics that appear in disordered systems as they approach non-ergodic or jammed states. It is characterized in terms of dynamical heterogeneity, facilitation and excitation lines. These features are associated with a newly discovered class of non-equilibrium phase transitions. Equilibrium properties have little if anything to do with it. The broken symmetries of these transitions are obscure or absent in spatial structures, but they are vivid in space-time (i.e., trajectory space). In our view, the glass transition is an example of this class of transitions. The basic ideas and principles we review were originally developed through the analysis of idealized and abstract models. Nevertheless, the central ideas are easily illustrated with reference to molecular dynamics of more realistic atomistic models, and we use that illustrative approach here.

0 citations0 reviewsNo code linkedOpen access
preprint2009arXiv

Metastable states and space-time phase transitions in a spin-glass model

We study large deviations of the dynamical activity in the random orthogonal model (ROM). This is a fully connected spin-glass model with one-step replica symmetry breaking behaviour, consistent with the random first-order transition scenario for structural glasses. We show that this model displays dynamical (space-time) phase-transitions between active and inactive phases, as demonstrated by singularities in large deviation functions. We argue that such transitions are generic in systems with long-lived metastable states.

0 citations0 reviewsNo code linkedOpen access
preprint2009arXiv

Thermodynamics of Quantum Jump Trajectories

We apply the large-deviation method to study trajectories in dissipative quantum systems. We show that in the long time limit the statistics of quantum jumps can be understood from thermodynamic arguments by exploiting the analogy between large-deviation and free-energy functions. This approach is particularly useful for uncovering properties of rare dissipative trajectories. We also prove, via an explicit quantum mapping, that rare trajectories of one system can be realized as typical trajectories of an alternative system.

0 citations0 reviewsNo code linkedOpen access