Source author record

Alexander Rush

Alexander Rush appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

5works
7topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

5 published item(s)

preprint2020arXiv

AdaptivFloat: A Floating-point based Data Type for Resilient Deep Learning Inference

Conventional hardware-friendly quantization methods, such as fixed-point or integer, tend to perform poorly at very low word sizes as their shrinking dynamic ranges cannot adequately capture the wide data distributions commonly seen in sequence transduction models. We present AdaptivFloat, a floating-point inspired number representation format for deep learning that dynamically maximizes and optimally clips its available dynamic range, at a layer granularity, in order to create faithful encoding of neural network parameters. AdaptivFloat consistently produces higher inference accuracies compared to block floating-point, uniform, IEEE-like float or posit encodings at very low precision ($\leq$ 8-bit) across a diverse set of state-of-the-art neural network topologies. And notably, AdaptivFloat is seen surpassing baseline FP32 performance by up to +0.3 in BLEU score and -0.75 in word error rate at weight bit widths that are $\leq$ 8-bit. Experimental results on a deep neural network (DNN) hardware accelerator, exploiting AdaptivFloat logic in its computational datapath, demonstrate per-operation energy and area that is 0.9$\times$ and 1.14$\times$, respectively, that of equivalent bit width integer-based accelerator variants.

preprint2016arXiv

Classical-quantum correspondence in bosonic two-mode conversion systems: polynomial algebras and Kummer shapes

Bosonic quantum conversion systems can be modeled by many-particle single-mode Hamiltonians describing a conversion of $n$ molecules of type A into $m$ molecules of type B and vice versa. These Hamiltonians are analyzed in terms of generators of a polynomially deformed $su(2)$ algebra. In the mean-field limit of large particle numbers, these systems become classical and their Hamiltonian dynamics can again be described by polynomial deformations of a Lie algebra, where quantum commutators are replaced by Poisson brackets. The Casimir operator restricts the motion to Kummer shapes, deformed Bloch spheres with cusp singularities depending on $m$ and $n$. It is demonstrated that the many-particle eigenvalues can be recovered from the mean-field dynamics using a WKB type quantization condition. The many-particle state densities can be semiclassically approximated by the time-periods of periodic orbits, which show characteristic steps and singularities related to the fixed points, whose bifurcation properties are analyzed.

preprint2016arXiv

Propagation of Gaussian beams in the presence of gain and loss

We consider the propagation of Gaussian beams in a waveguide with gain and loss in the paraxial approximation governed by the Schrödinger equation. We derive equations of motion for the beam in the semiclassical limit that are valid when the waveguide profile is locally well approximated by quadratic functions. For Hermitian systems, without any loss or gain, these dynamics are given by Hamilton's equations for the center of the beam and its conjugate momentum. Adding gain and/or loss to the waveguide introduces a non-Hermitian component, causing the width of the Gaussian beam to play an important role in its propagation. Here we show how the width affects the motion of the beam and how this may be used to filter Gaussian beams located at the same initial position based on their width.

preprint2015arXiv

Semiclassical quantisation for a bosonic atom-molecule conversion system

We consider a simple quantum model of atom-molecule conversion where bosonic atoms can combine into diatomic molecules and vice versa. The many-particle system can be expressed in terms of the generators a deformed $SU(2)$ algebra, and the mean-field dynamics takes place on a deformed version of the Bloch sphere, a teardrop shaped surface with a cusp singularity. We analyse the mean-field and many-particle correspondence, which shows typical features of quantum-classical correspondence. We demonstrate that semiclassical methods can be employed to recover full many-particle features from the mean-field description in cold atom systems with atom-molecule conversion, and derive an analytic expression for the many-particle density of states in the limit of large particle numbers.

preprint2014arXiv

Classical and quantum dynamics in the (non-Hermitian) Swanson oscillator

The non-Hermitian quadratic oscillator studied by Swanson is one of the popular $PT$-symmetric model systems. Here a full classical description of its dynamics is derived using recently developed metriplectic flow equations, which combine the classical symplectic flow for Hermitian systems with a dissipative metric flow for the anti-Hermitian part. Closed form expressions for the metric and phase-space trajectories are presented which are found to be periodic in time. Since the Hamiltonian is only quadratic the classical dynamics exactly describes the quantum dynamics of Gaussian wave packets. It is shown that the classical metric and trajectories as well as the quantum wave functions can diverge in finite time even though the $PT$-symmetry is unbroken, i.e., the eigenvalues are purely real.