Source author record

David S. Berman

David S. Berman appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

25works
6topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

25 published item(s)

preprint2026arXiv

A path to natural language through tokenisation and transformers

Natural languages exhibit striking regularities in their statistical structure, including notably the emergence of Zipf's and Heaps' laws. Despite this, it remains broadly unclear how these properties relate to the modern tokenisation schemes used in contemporary transformer models. In this note, we analyse the information content (as measured by the Shannon entropy) of various corpora under the assumption of a Zipfian frequency distribution, and derive a closed-form expression for the slot entropy expectation value. We then empirically investigate how byte--pair encoding (BPE) transforms corpus statistics, showing that recursive applications of BPE drive token frequencies toward a Zipfian power law while inducing a characteristic growth pattern in empirical entropy. Utilizing the ability of transformers to learn context dependent token probability distributions, we train language models on corpora tokenised at varying BPE depths, revealing that the model predictive entropies increasingly agree with Zipf-derived predictions as the BPE depth increases. Attention-based diagnostics further indicate that deeper tokenisation reduces local token dependencies, bringing the empirical distribution closer to the weakly dependent (near IID) regime. Together, these results clarify how BPE acts not only as a compression mechanism but also as a statistical transform that reconstructs key informational properties of natural language.

preprint2022arXiv

Machine Learning Calabi-Yau Hypersurfaces

We revisit the classic database of weighted-P4s which admit Calabi-Yau 3-fold hypersurfaces equipped with a diverse set of tools from the machine-learning toolbox. Unsupervised techniques identify an unanticipated almost linear dependence of the topological data on the weights. This then allows us to identify a previously unnoticed clustering in the Calabi-Yau data. Supervised techniques are successful in predicting the topological parameters of the hypersurface from its weights with an accuracy of R^2 > 95%. Supervised learning also allows us to identify weighted-P4s which admit Calabi-Yau hypersurfaces to 100% accuracy by making use of partitioning supported by the clustering behaviour.

preprint2022arXiv

On the Dynamics of Inference and Learning

Statistical Inference is the process of determining a probability distribution over the space of parameters of a model given a data set. As more data becomes available this probability distribution becomes updated via the application of Bayes' theorem. We present a treatment of this Bayesian updating process as a continuous dynamical system. Statistical inference is then governed by a first order differential equation describing a trajectory or flow in the information geometry determined by a parametric family of models. We solve this equation for some simple models and show that when the Cramér-Rao bound is saturated the learning rate is governed by a simple $1/T$ power-law, with $T$ a time-like variable denoting the quantity of data. The presence of hidden variables can be incorporated in this setting, leading to an additional driving term in the resulting flow equation. We illustrate this with both analytic and numerical examples based on Gaussians and Gaussian Random Processes and inference of the coupling constant in the 1D Ising model. Finally we compare the qualitative behaviour exhibited by Bayesian flows to the training of various neural networks on benchmarked data sets such as MNIST and CIFAR10 and show how that for networks exhibiting small final losses the simple power-law is also satisfied.

preprint2022arXiv

Twisted Self-duality

We examine a generalisation of the usual self-duality equations for Yang-Mills theory when the colour space admits a non-trivial involution. This involution allows us to construct a non-trivial twist which may be combined with the Hodge star to form a twisted self-dual curvature. We will construct a simple example of twisted self-duality for $su(2) \oplus su(2)$ gauge theory along with its explicit solutions and then dimensionally reduce from four dimensions to obtain families of non-trivial non-linear equations in lower dimensions. This twisted self-duality constraint will be shown to arise in E_7 exceptional field theory through a Scherk-Schwarz reduction and we will show how an Eguchi-Hanson gravitational instanton also obeys the twisted self-duality condition.

preprint2020arXiv

Reductions of Exceptional Field Theories

Double Field Theory (DFT) and Exceptional Field Theory (EFT), collectively called ExFTs, have proven to be a remarkably powerful new framework for string and M-theory. Exceptional field theories were constructed on a case by case basis as often each EFT has its own idiosyncrasies. Intuitively though, an $E_{n-1(n-1)}$ EFT must be contained in an $E_{n(n)}$ ExFT. In this paper we propose a generalised Kaluza-Klein ansatz to relate different ExFTs. We then discuss in more detail the different aspects of the relationship between various ExFTs including the coordinates, section condition and (pseudo)-Lagrangian densities. For the $E_{8(8)}$ EFT we describe a generalisation of the Mukhi-Papageorgakis mechanism to relate the d = 3 topological term in the $E_{8(8)}$ EFT to a Yang-Mills action in the $E_{7(7)}$ EFT.

preprint2020arXiv

S-duality and the Double Copy

The double copy formalism provides an intriguing connection between gauge theories and gravity. It was first demonstrated in the perturbative context of scattering amplitudes but recently the formalism has been applied to exact classical solutions in gauge theories such as the monopole and instanton. In this paper we will investigate how duality symmetries in the gauge theory double copy to gravity and relate these to solution generating transformations and the action of $Sl(2,R)$ in general relativity.

preprint2015arXiv

Branes are Waves and Monopoles

In a recent paper it was shown that fundamental strings are null waves in Double Field Theory. Similarly, membranes are waves in exceptional extended geometry. Here the story is continued by showing how various branes are Kaluza-Klein monopoles of these higher dimensional theories. Examining the specific case of the E7 exceptional extended geometry, we see that all branes are both waves and monopoles. Along the way we discuss the O(d; d) transformation of localized brane solutions not associated to an isometry and how true T-duality emerges in Double Field Theory when the background possesses isometries.

preprint2015arXiv

Strings, Branes and the Self-dual Solutions of Exceptional Field Theory

It has been shown that membranes and fivebranes are wave-like or monopole-like solutions in some higher dimensional theory. Here the picture is completed by combining the wave and monopole solutions into a single solution of Exceptional Field Theory. This solution solves the twisted self-duality constraint. The 1/2 BPS brane spectrum, consisting of fundamental, solitonic and Dirichlet branes, in ten- and eleven-dimensional supergravity may all be extracted from this single solution of Exceptional Field Theory. The solution's properties such as the singularity structure and its asymptotic behaviour near the core and at infinity are investigated.

preprint2014arXiv

Duality Symmetric String and M-Theory

We review recent developments in duality symmetric string theory. We begin with the world sheet doubled formalism which describes strings in an extended space time with extra coordinates conjugate to winding modes. This formalism is T-duality symmetric and can accommodate non-geometric T-fold backgrounds which are beyond the scope of Riemannian geometry. Vanishing of the conformal anomaly of this theory can be interpreted as a set of spacetime equations for the background fields. These equations follow from an action principle that has been dubbed Double Field Theory (DFT). We review the aspects of generalised geometry relevant for DFT. We outline recent extensions of DFT and explain how, by relaxing the so-called strong constraint with a Scherk Schwarz ansatz, one can obtain backgrounds that simultaneously depend on both the regular and T-dual coordinates. This provides a purely geometric higher dimensional origin to gauged supergravities that arise from non-geometric compactification. We then turn to M-theory and describe recent progress in formulating an E_{n(n)} U-duality covariant description of the dynamics. We describe how spacetime may be extended to accommodate coordinates conjugate to brane wrapping modes and the construction of generalised metrics in this extend space that unite the bosonic fields of supergravity into a single object. We review the action principles for these theories and their novel gauge symmetries. We also describe how a Scherk Schwarz reduction can be applied in the M-theory context and the resulting relationship to the embedding tensor formulation of maximal gauged supergravities.

preprint2014arXiv

Global aspects of double geometry

We consider the concept of a generalised manifold in the O(d,d) setting, i.e., in double geometry. The conjecture by Hohm and Zwiebach for the form of finite generalised diffeomorphisms is shown to hold. Transition functions on overlaps are defined. Triple overlaps are trivial concerning their action on coordinates, but non-trivial on fields, including the generalised metric. A generalised manifold is an ordinary manifold, but the generalised metric on the manifold carries a gerbe structure. We show how the abelian behaviour of the gerbe is embedded in the non-abelian T-duality group. We also comment on possibilities and difficulties in the U-duality setting.

preprint2014arXiv

Supersymmetry for Gauged Double Field Theory and Generalised Scherk-Schwarz Reductions

Previous constructions of supersymmetry for double field theory have relied on the so called strong constraint. In this paper, the strong constraint is relaxed and the theory is shown to possess supersymmetry once the generalised Scherk-Schwarz reduction is imposed. The equivalence between the generalised Scherk-Schwarz reduced theory and the gauged double field theory is then examined in detail for the supersymmetric theory. As a byproduct we write the generalised Killing spinor equations for the supersymmetric double field theory.

preprint2013arXiv

The Navier-Stokes equation and solution generating symmetries from holography

The fluid-gravity correspondence provides us with explicit spacetime metrics that are holographically dual to (non-)relativistic nonlinear hydrodynamics. The vacuum Einstein equations, in the presence of a Killing vector, possess solution-generating symmetries known as spacetime Ehlers transformations. These form a subgroup of the larger generalized Ehlers group acting on spacetimes with arbitrary matter content. We apply this generalized Ehlers group, in the presence of Killing isometries, to vacuum metrics with hydrodynamic duals to develop a formalism for solution-generating transformations of Navier-Stokes fluids. Using this we provide examples of a linear energy scaling from RG flow under vanishing vorticity, and a set of Z_2 symmetries for fixed viscosity.

preprint2013arXiv

The O_{D,D} Geometry of String Theory

We construct an action for double field theory using a metric connection that is compatible with both the generalised metric and the O_{D,D} structure. The connection is simultaneously torsionful and flat. Using this connection one may construct a proper covariant derivative for double field theory. We then write the doubled action in terms of the generalised torsion of this connection. This action then exactly reproduces that required for doubled field theory and gauged supergravity.

preprint2012arXiv

Duality Invariant M-theory: Gauged supergravities and Scherk-Schwarz reductions

We consider the reduction of the duality invariant approach to M-theory by a U-duality group valued Scherk-Schwarz twist. The result is to produce potentials for gauged supergravities that are normally associated with non-geometric compactifications. The local symmetry reduces to gauge transformations with the gaugings exactly matching those of the embedding tensor approach to gauged supergravity. Importantly, this approach now includes a nontrivial dependence of the fields on the extra coordinates of the extended space.

preprint2012arXiv

The gauge structure of generalised diffeomorphisms

We investigate the generalised diffeomorphisms in M-theory, which are gauge transformations unifying diffeomorphisms and tensor gauge transformations. After giving an En(n)-covariant description of the gauge transformations and their commutators, we show that the gauge algebra is infinitely reducible, i.e., the tower of ghosts for ghosts is infinite. The Jacobiator of generalised diffeomorphisms gives such a reducibility transformation. We give a concrete description of the ghost structure, and demonstrate that the infinite sums give the correct (regularised) number of degrees of freedom. The ghost towers belong to the sequences of rep- resentations previously observed appearing in tensor hierarchies and Borcherds algebras. All calculations rely on the section condition, which we reformulate as a linear condition on the cotangent directions. The analysis holds for n < 8. At n = 8, where the dual gravity field becomes relevant, the natural guess for the gauge parameter and its reducibility still yields the correct counting of gauge parameters.

preprint2011arXiv

Boundary Terms in Generalized Geometry and doubled field theory

We propose a boundary action to complement the recently developed duality manifest actions in string and M-theory using generalized geometry. This boundary action combines the Gibbons-Hawking term with boundary pieces that were previously neglected in the construction of these actions. The combination may be written in terms of the metric of generalized geometry. The result is to produce an action that is duality invariant including boundary terms.

preprint2011arXiv

Duality Invariant Actions and Generalised Geometry

We construct the non-linear realisation of the semi-direct product of E(11) and its first fundamental representation at lowest order and appropriate to spacetime dimensions four to seven. This leads to a non-linear realisation of the duality groups and introduces fields that depend on a generalised space which possess a generalised vielbein. We focus on the part of the generalised space on which the duality groups alone act and construct an invariant action.

preprint2011arXiv

Generalized Geometry and M theory

We reformulate the Hamiltonian form of bosonic eleven dimensional supergravity in terms of an object that unifies the three-form and the metric. For the case of four spatial dimensions, the duality group is manifest and the metric and C-field are on an equal footing even though no dimensional reduction is required for our results to hold. One may also describe our results using the generalized geometry that emerges from membrane duality. The relationship between the twisted Courant algebra and the gauge symmetries of eleven dimensional supergravity are described in detail.

preprint2011arXiv

The local symmetries of M-theory and their formulation in generalised geometry

In the doubled field theory approach to string theory, the T-duality group is promoted to a manifest symmetry at the expense of replacing ordinary Riemannian geometry with generalised geometry on a doubled space. The local symmetries are then given by a generalised Lie derivative and its associated algebra. This paper constructs an analogous structure for M-theory. A crucial by-product of this is the derivation of the physical section condition for M-theory formulated in an extended space.

preprint2010arXiv

Boundary Conditions for Interacting Membranes

We investigate supersymmetric boundary conditions in both the Bagger-Lambert and the ABJM theories of interacting membranes. We find boundary conditions associated to the fivebrane, the ninebrane and the M-theory wave. For the ABJM theory we are able to understand the enhancement of supersymmetry to produce the (4,4) supersymmetry of the self-dual string. We also include supersymmetric boundary conditions on the gauge fields that cancel the classical gauge anomaly of the Chern-Simons terms.

preprint2001arXiv

Holographic Noncommutativity

We examine noncommutative Yang-Mills and open string theories using magnetically and electrically deformed supergravity duals. The duals are near horizon regions of Dp-brane bound state solutions which are obtained by using O(p+1,p+1) transformations of Dp-branes. The action of the T-duality group implies that the noncommutativity parameter is constant along holographic RG-flows. The moduli of the noncommutative theory, i.e., the open string metric and coupling constant, as well as the zero-force condition are shown to be invariant under the O(p+1,p+1) transformation, i.e., deformation independent. We find sufficient conditions, including zero force and constant dilaton in the ISO(3,1)-invariant D3 brane solution, for exact S-duality between noncommutative Yang-Mills and open string theories. These results are used to construct noncommutative field and string theories with N=1 supersymmetry from the T^(1,1) and Pilch-Warner solutions. The latter has a non-trivial zero-force condition due to the warping.