Source author record

Vitaly Vanchurin

Vitaly Vanchurin appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

20works
14topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

20 published item(s)

preprint2022arXiv

Bio-inspired Machine Learning: programmed death and replication

We analyze algorithmic and computational aspects of biological phenomena, such as replication and programmed death, in the context of machine learning. We use two different measures of neuron efficiency to develop machine learning algorithms for adding neurons to the system (i.e. replication algorithm) and removing neurons from the system (i.e. programmed death algorithm). We argue that the programmed death algorithm can be used for compression of neural networks and the replication algorithm can be used for improving performance of the already trained neural networks. We also show that a combined algorithm of programmed death and replication can improve the learning efficiency of arbitrary machine learning systems. The computational advantages of the bio-inspired algorithms are demonstrated by training feedforward neural networks on the MNIST dataset of handwritten images.

preprint2022arXiv

Towards a theory of quantum gravity from neural networks

Neural network is a dynamical system described by two different types of degrees of freedom: fast-changing non-trainable variables (e.g. state of neurons) and slow-changing trainable variables (e.g. weights and biases). We show that the non-equilibrium dynamics of trainable variables can be described by the Madelung equations, if the number of neurons is fixed, and by the Schrodinger equation, if the learning system is capable of adjusting its own parameters such as the number of neurons, step size and mini-batch size. We argue that the Lorentz symmetries and curved space-time can emerge from the interplay between stochastic entropy production and entropy destruction due to learning. We show that the non-equilibrium dynamics of non-trainable variables can be described by the geodesic equation (in the emergent space-time) for localized states of neurons, and by the Einstein equations (with cosmological constant) for the entire network. We conclude that the quantum description of trainable variables and the gravitational description of non-trainable variables are dual in the sense that they provide alternative macroscopic descriptions of the same learning system, defined microscopically as a neural network.

preprint2021arXiv

Dual Path Integral: a non-perturbative approach to strong coupling

We develop a non-perturbative method for calculating partition functions of strongly coupled quantum mechanical systems with interactions between subsystems described by a path integral of a dual system. The dual path integral is derived starting from non-interacting subsystems at zeroth order and then by introducing couplings of increasing complexity at each order of an iterative procedure. These orders of interactions play the role of a dual time and the full quantum partition function is expressed as a transition amplitude in the dual system. More precisely, it is expressed as a path integral from a deformation-operators dependent initial state at zero time/order to the inverse-temperature dependent final state at later time/order. We provide three examples of strongly coupled systems with first-order, second-order and higher-order interactions and discuss a possible emergence of space-time, quantum field theories and general relativity in context of the dual path integral.

preprint2021arXiv

Towards a theory of machine learning

We define a neural network as a septuple consisting of (1) a state vector, (2) an input projection, (3) an output projection, (4) a weight matrix, (5) a bias vector, (6) an activation map and (7) a loss function. We argue that the loss function can be imposed either on the boundary (i.e. input and/or output neurons) or in the bulk (i.e. hidden neurons) for both supervised and unsupervised systems. We apply the principle of maximum entropy to derive a canonical ensemble of the state vectors subject to a constraint imposed on the bulk loss function by a Lagrange multiplier (or an inverse temperature parameter). We show that in an equilibrium the canonical partition function must be a product of two factors: a function of the temperature and a function of the bias vector and weight matrix. Consequently, the total Shannon entropy consists of two terms which represent respectively a thermodynamic entropy and a complexity of the neural network. We derive the first and second laws of learning: during learning the total entropy must decrease until the system reaches an equilibrium (i.e. the second law), and the increment in the loss function must be proportional to the increment in the thermodynamic entropy plus the increment in the complexity (i.e. the first law). We calculate the entropy destruction to show that the efficiency of learning is given by the Laplacian of the total free energy which is to be maximized in an optimal neural architecture, and explain why the optimization condition is better satisfied in a deep network with a large number of hidden layers. The key properties of the model are verified numerically by training a supervised feedforward neural network using the method of stochastic gradient descent. We also discuss a possibility that the entire universe on its most fundamental level is a neural network.

preprint2016arXiv

Ideal MHD(-Einstein) Solutions Obeying The Force-Free Condition

We find two families of analytic solutions to the ideal magnetohydrodynamics (iMHD) equations, in a class of 4-dimensional (4D) curved spacetimes. The plasma current is null, and as a result, the stress-energy tensor of the plasma itself can be chosen to take a cosmological-constant-like form. Despite the presence of a plasma, the force-free condition - where the electromagnetic current is orthogonal to the Maxwell tensor - continues to be maintained. Moreover, a special case of one of these two families leads us to a fully self-consistent solution to the Einstein-iMHD equations: we obtain the Vaidya-(anti-)de Sitter metric sourced by the plasma and a null electromagnetic stress tensor. We also provide a Mathematica code that researchers may use to readily verify analytic solutions to these iMHD equations in any curved 4D geometry.

preprint2015arXiv

Field Theory for Perfect String Fluids

We develop a field theory description of non-dissipative string fluids and construct an explicit mapping between field theory degrees of freedom and hydrodynamic variables. The theory generalizes both a perfect particle fluid and pressureless string fluid to what we call a perfect string fluid. Ideal magnetohydrodynamics is shown to be an example of the perfect string fluid whose equations of motion can be obtained from a particular choice of the Lagrangian. The Lagrangian framework suggests a straightforward extension of the perfect string fluid to more general anisotropic fluids describing higher dimensional branes such as domain walls. Other modifications of the Lagrangian are discussed which may be useful in describing relativistic superfluids and fluids containing additional currents.

preprint2014arXiv

String Fluid in Local Equilibrium

We study the solutions of string fluid equations under assumption of a local equilibrium which was previously obtained in the context of the kinetic theory. We show that the fluid can be foliated into non-interacting submanifolds whose equations of motion are exactly that of the wiggly strings considered previously by Vilenkin and Carter. In a special case of negligible statistical variance in either the left or the right-moving directions of microscopic strings, the submanifolds are described by the action of chiral strings proposed by Witten. When both variances vanish the submanifolds are described by the Nambu-Goto action and the string fluid reduces to the string dust introduced by Stachel.

preprint2014arXiv

The Continuum of Discrete Trajectories in Eternal Inflation

We discuss eternal inflation in context of classical probability spaces defined by a triplet: sample space, $σ$-algebra and probability measure. We show that the measure problem is caused by the countable additivity axiom applied to the maximal $σ$-algebra of countably infinite sample spaces. This is a serious problem if the bulk space-time is treated as a sample space which is thought to be effectively countably infinite due to local quantum uncertainties. However, in semiclassical description of eternal inflation the physical space expands exponentially which makes the sample space of infinite trajectories uncountable and the (future) boundary space effectively continuous. Then the measure problem can be solved by defining a probability measure on the continuum of trajectories or holographically on the future boundary. We argue that the probability measure which is invariant under the symmetries of the tree-like structure of eternal inflation can be generated from the Lebesgue measure on unit interval. According to Vitali theorem the Lebesgue measure leaves some sets without a measure which means that there are certain probabilistic questions in eternal inflation that cannot be answered.

preprint2013arXiv

Fluid Mechanics of Strings

We consider conserved currents in an interacting network of one-dimensional objects (or strings). Singular currents localized on a single string are considered in general, and a formal procedure for coarse-graining over many strings is developed. This procedure is applied to strings described by the Nambu-Goto action such as cosmic strings. In addition to conserved currents corresponding to the energy-momentum tensor, we consider an antisymmetric tensor of conserved currents related to the string tangent vector. Under the assumption of local equilibrium we derive a complete set of hydrodynamic equations for strings.

preprint2013arXiv

Kinetic Theory and Hydrodynamics of Cosmic Strings

We develop further a kinetic theory of strings and derive a transport equation for a network of cosmic strings with Nambu-Goto evolution, interactions and background gravitational effects taken into account. We prove an H-theorem and obtain necessary and sufficient conditions for a thermodynamic equilibrium. At the lowest order the equilibrium is estimated by the von Mises-Fisher distributions parametrized by mean directions and dispersions of the right- and left-moving tangent vectors. Under assumption of a local equilibrium we derive a complete set of hydrodynamic equations that govern the evolution of strings on large scales. We also argue that on small scales the assumption of a local equilibrium would break down, and non-equilibrium steady states, described by the Sinai-Ruelle-Bowen distributions, should be used instead.

preprint2013arXiv

Transport Equation for Nambu-Goto Strings

We consider a covariant approach to coarse-graining a network of interacting Nambu-Goto strings. A transport equation is constructed for a spatially flat Friedmann universe. In Minkowski space and with no spatial dependence this model agrees with a previous model. Thus it likewise converges to an equilibrium with a factorizability property. We present an argument that this property does not depend on a `string chaos' assumption on the correlations between strings. And in contrast to the earlier model, this transport equation agrees with conservation equations for a fluid of strings derived from a different perspective.

preprint2012arXiv

Dynamical systems of eternal inflation: A possible solution to the problems of entropy, measure, observables and initial conditions

There are two main approaches to non-equlibrium statistical mechanics: one using stochastic processes and the other using dynamical systems. To model the dynamics during inflation one usually adopts a stochastic description, which is known to suffer from serious conceptual problems. To overcome the problems and/or to gain more insight, we develop a dynamical systems approach. A key assumption that goes into analysis is the chaotic hypothesis, which is a natural generalization of the ergodic hypothesis to non-Hamiltonian systems. The unfamiliar feature for gravitational systems is that the local phase space trajectories can either reproduce or escape due to the presence of cosmological and black hole horizons. We argue that the effect of horizons can be studied using dynamical systems and apply the so-called thermodynamic formalism to derive the equilibrium (or Sinai-Ruelle-Bowen) measure given by a variational principle. We show that the only physical measure is not the Liouville measure (i.e. no entropy problem), but the equilibrium measure (i.e. no measure problem) defined over local trajectories (i.e. no problem of observables) and supported on only infinite trajectories (i.e. no problem of initial conditions). Phenomenological aspects of the fluctuation theorem are discussed.

preprint2011arXiv

Eternal Inflation, Global Time Cutoff Measures, and a Probability Paradox

The definition of probabilities in eternally inflating universes requires a measure to regulate the infinite spacetime volume, and much of the current literature uses a global time cutoff for this purpose. Such measures have been found to lead to paradoxical behavior, and recently Bousso, Freivogel, Leichenauer, and Rosenhaus have argued that, under reasonable assumptions, the only consistent interpretation for such measures is that time must end at the cutoff. Here we argue that there is an alternative, consistent formulation of such measures, in which time extends to infinity. Our formulation begins with a mathematical model of the infinite multiverse, which can be constructed without the use of a measure. Probabilities, which obey all the standard requirements for a probability measure, can then be defined by mathematical limits. They have a peculiar feature, however, which we call time-delay bias: if the outcome of an experiment is reported with a time delay that depends on the outcome, then the observation of the reports will be biased in favor of the shorter time delay. We show how the paradoxes can be resolved in this interpretation of the measure.

preprint2011arXiv

Geocentric cosmology: a new look at the measure problem

We show that most of cutoff measures of the multiverse violate some of the basic properties of probability theory when applied repeatedly to predict the results of local experiments. Starting from minimal assumptions, such as Markov property, we derive a correspondence between cosmological measures and quantum field theories in one lesser dimension. The correspondence allows us to replace the picture of an infinite multiverse with a finite causally connected region accessible by a given observer in conjunction with a Euclidean theory defined on its past boundary.

preprint2011arXiv

Towards a kinetic theory of strings

We study the dynamics of strings by means of a distribution function f(A, B, x, t) defined on a 9+1D phase space, where A and B are the correlation vectors of right- and left-moving waves. We derive a transport equation (an analogous to Boltzmann transport equation for particles) that governs the evolution of long strings with Nambu-Goto dynamics as well as reconnections taken into account. We also derive a system of coupled transport equations (an analogous to BBGKY hierarchy for particles) which can simultaneously describe long strings \tilde{f}(A, B, x, t) as well as simple loops \mathring{f}(A, B, x, t) made out of four correlation vectors. The formalism can be used to study non-linear dynamics of fundamental strings, D-brane strings or field theory strings. For example, the complicated semi-scaling behavior of cosmic strings translates into a simple solution of the transport system at small energy densities.

preprint2010arXiv

How many universes are in the multiverse?

We argue that the total number of distinguishable locally Friedmann universes generated by eternal inflation is proportional to the exponent of the entropy of inflationary perturbations and is limited by e^{e^{3 N}}, where N is the number of e-folds of slow-roll post-eternal inflation. For simplest models of chaotic inflation, N is approximately equal to de Sitter entropy at the end of eternal inflation; it can be exponentially large. However, not all of these universes can be observed by a local observer. In the presence of a cosmological constant Λthe number of distinguishable universes is bounded by e^{|Λ|^{-3/4}}. In the context of the string theory landscape, the overall number of different universes is expected to be exponentially greater than the total number of vacua in the landscape. We discuss the possibility that the strongest constraint on the number of distinguishable universes may be related not to the properties of the multiverse but to the properties of observers.

preprint2010arXiv

Non-linear dynamics of cosmic strings with non-scaling loops

At early stages the dynamics of cosmic string networks is expected to be influenced by an excessive production of small loops at the scales of initial conditions l_{min}. To understand the late time behavior we propose a very simple analytical model of strings with a non-scaling population of loops. The complicated non-linear dynamics is described by only a single parameter N ~ 2/(1-C(l_{min})) where C(l) is a correlation function of the string tangent vectors. The model predicts an appearance of two new length scales: the coherence length ξ~ t/N^2 and the cross-correlation length χ~ t/N. At the onset of evolution N ~ 10 and at late times N is expected to grow logarithmically due to cosmological stretching and emission of small loops. The very late time evolution might be modified further when the gravitational back-reaction scale grows larger than l_{min}.

preprint2010arXiv

Semi-scaling cosmic strings

We develop a model of string dynamics with back-reaction from both scaling and non-scaling loops taken into account. The evolution of a string network is described by the distribution functions of coherence segments and kinks. We derive two non-linear equations which govern the evolution of the two distributions and solve them analytically in the limit of late times. We also show that the correlation function is an exponential, and solve the dynamics for the corresponding spectrum of scaling loops.

preprint2010arXiv

Towards a non-anthropic solution to the cosmological constant problem

Many probability measures in the multiverse depend exponentially on some observable parameters, giving rise to potential problems such as youngness bias, Q-catastrophe etc. In this paper we explore a possibility that the exponential runaway dependence should be viewed not as a problem, but as a feature that may help us to fix all parameters in the landscape, including the value of the cosmological constant, without using anthropic considerations.

preprint2005arXiv

Cosmic string scaling in flat space

We investigate the evolution of infinite strings as a part of a complete cosmic string network in flat space. We perform a simulation of the network which uses functional forms for the string position and thus is exact to the limits of computer arithmetic. Our results confirm that the wiggles on the strings obey a scaling law described by universal power spectrum. The average distance between long strings also scales accurately with the time. These results suggest that small-scale structure will also scale in expanding universe, even in the absence of gravitational damping.