Source author record

Daniel Goldstein

Daniel Goldstein appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Artificial Intelligence Computation and Language cond-mat.soft Machine Learning math.AG math.CA math.GR math.NT math.RT nlin.PS physics.comp-ph

Catalog footprint

What is connected

7works

11topics

4close collaborators

Actions

Connect this record

Open graph Browse works

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

preprint2026arXiv

Key-Value Means: Transformers with Expandable Block-Recurrent Compressed Memory

We present Key-Value Means ("KVM"), a novel block-recurrence for attention that can accommodate either fixed-size or growing state. Equipping a strong transformer baseline with fixed-size KVM attention layers yields a strong $O(N)$ chunked RNN, while adding only an insignificant number of new parameters. We train a transformer with a growable KVM cache and show it performs competitively on long-context tests with only subquadratic prefill time and sublinear state growth. KVM is implementable with standard operations and without custom kernels, and supports chunk-wise parallelizable training and prefill. It provides many of the benefits of both traditional transformers (expandable context memory, chunk-wise parallelizable training and prefill) and linear RNNs in a single unified package. It can be used on every layer, saving KV-cache memory, and allowing a continuous range of choices of prefill time complexity between $O(N)$ and $O(N^2)$. It can also be implemented in a hybrid solution in tandem with LRNN layers in place of traditional attention, to supplement the LRNN with improved sublinear memory growth context length usage and long context decoding. We release our code at https://github.com/featherless-ai/KVM-paper and trained models at https://huggingface.co/collections/featherless-ai/kvm-paper under the Apache 2.0 license.

preprint2022arXiv

Morpho -- A programmable environment for shape optimization and shapeshifting problems

An emerging theme across many domains of science and engineering is materials that change shape, often dramatically. Determining their structure involves solving a shape optimization problem where a given energy functional is minimized with respect to the shape of the domain and auxiliary fields describing the structure. Such problems are very challenging to solve and there is a lack of suitable simulation tools that are both readily accessible and general purpose. To address this gap, we present Morpho, an open-source programmable environment, and demonstrate its versatility by showcasing three applications to different areas of soft matter - swelling hydrogels, complex fluids that form aspherical droplets, to soap films and membranes - and advise on broader uses.

preprint2016arXiv

A lower bound for the dimension of a highest weight module

For each integer $t>0$ and each complex simple Lie algebra $\mathfrak{g}$, we determine the least dimension of an irreducible highest weight representation of $\mathfrak{g}$ whose highest weight has height $t$. As a corollary, we classify all irreducible modules whose dimension equals a product of two primes.

preprint2015arXiv

Synchronization Patterns in Geometrically Frustrated Turing Rings

Coupled nonlinear oscillators can exhibit a wide variety of patterns. We study the Brusselator as a prototypical autocatalytic reaction diffusion model. Working in the limit of strong nonlinearity provides a clear timescale separation that leads to a canard explosion in a single Brusselator. In this highly nonlinear regime it is numerically found that rings of coupled Brusselators do not follow the predictions from Turning analysis. We find that the behavior can be explained using a piecewise linear approximation.

preprint2013arXiv

On the Steinhaus tiling problem in three dimensions

H. Steinhaus asked in the 1950's whether there exists a set in the plane R^2 meeting every isometric copy of Z^2 in precisely one point. Such a "Steinhaus set" was constructed by Jackson and Mauldin. What about three-space R^3? Is there a subset of R^3 meeting every isometric copy of Z^3 in exactly one point? We offer heuristic evidence that the answer is "no".

preprint2012arXiv

Cosets of Sylow p-subgroups and a Question of Richard Taylor

We prove that for any prime p there exist infinitely many finite simple groups G with a coset xP of a Sylow p-subgroup P of G such that every element of xP has order divisible by p. John Thompson proved this for p=2 in 1967 answering a question of Lowell Paige. This result is used to answer a question of Richard Taylor on adequate representations.

preprint2008arXiv

Nonisomorphic curves that become isomorphic over extensions of coprime degrees

We show that one can find two nonisomorphic curves over a field K that become isomorphic to one another over two finite extensions of K whose degrees over K are coprime to one another. More specifically, let K_0 be an arbitrary prime field and let r and s be integers greater than 1 that are coprime to one another. We show that one can find a finite extension K of K_0, a degree-r extension L of K, a degree-s extension M of K, and two curves C and D over K such that C and D become isomorphic to one another over L and over M, but not over any proper subextensions of L/K or M/K. We show that such C and D can never have genus 0, and that if K is finite, C and D can have genus 1 if and only if {r,s} = {2,3} and K is an odd-degree extension of F_3. On the other hand, when {r,s}={2,3} we show that genus-2 examples occur in every characteristic other than 3. Our detailed analysis of the case {r,s} = {2,3} shows that over every finite field K there exist nonisomorphic curves C and D that become isomorphic to one another over the quadratic and cubic extensions of K. Most of our proofs rely on Galois cohomology. Without using Galois cohomology, we show that two nonisomorphic genus-0 curves over an arbitrary field remain nonisomorphic over every odd-degree extension of the base field.