Source author record

Yu

Explore this author’s publications, collaborators and research topics. This catalog record has not been claimed by its author.

ResearcherUnclaimed source record

Machine Learning Computation and Language cond-mat.mtrl-sci cond-mat.supr-con physics.flu-dyn quant-ph Social and Information Networks

Catalog footprint

Research overview

4works

7topics

4close collaborators

Actions

Is this your work?

Open graph Browse papers

preprint2022arXiv

N-Grammer: Augmenting Transformers with latent n-grams

Transformer models have recently emerged as one of the foundational models in natural language processing, and as a byproduct, there is significant recent interest and investment in scaling these models. However, the training and inference costs of these large Transformer language models are prohibitive, thus necessitating more research in identifying more efficient variants. In this work, we propose a simple yet effective modification to the Transformer architecture inspired by the literature in statistical language modeling, by augmenting the model with n-grams that are constructed from a discrete latent representation of the text sequence. We evaluate our model, the N-Grammer on language modeling on the C4 data-set as well as text classification on the SuperGLUE data-set, and find that it outperforms several strong baselines such as the Transformer and the Primer. We open-source our model for reproducibility purposes in Jax.

preprint2015arXiv

Pressure-induced decomposition of solid hydrogen sulfide

Solid hydrogen sulfide is well known as a typical molecular crystal but its stability under pressure is still under debate. Particularly, Eremets et al. found the high pressure superconductivity with $T_{c}\approx$ 190 K in a H $_{2}$ S sample [arXiv: 1412.0460 (2014)] which is associates with the elemental decomposition into H $_{3}$ S [Sci. Rep. 4, 6968 (2014)]. Therefore, on what pressure H $_{2}$ S can decompose and which kind of the products of decomposition urgent need to be solved. In this paper, we have performed an extensive structural study on different stoichiometries H $_{n}$ S with ${n> 1}$ under high pressure using $ab$ $initio$ calculations. Our results show that H $_{2}$ S is stable below 50 GPa and decomposes into H $_3$ S and sulfur at high pressure, while H $_{3}$ S is stable at least up to 300 GPa. The other hydrogen-rich H $_{4}$ S, H $_{5}$ S, and H $_{6}$ S are unstable in the pressure range from 20 to 300 GPa.

preprint2014arXiv

GLAD: Group Anomaly Detection in Social Media Analysis- Extended Abstract

Traditional anomaly detection on social media mostly focuses on individual point anomalies while anomalous phenomena usually occur in groups. Therefore it is valuable to study the collective behavior of individuals and detect group anomalies. Existing group anomaly detection approaches rely on the assumption that the groups are known, which can hardly be true in real world social media applications. In this paper, we take a generative approach by proposing a hierarchical Bayes model: Group Latent Anomaly Detection (GLAD) model. GLAD takes both pair-wise and point-wise data as input, automatically infers the groups and detects group anomalies simultaneously. To account for the dynamic properties of the social media data, we further generalize GLAD to its dynamic extension d-GLAD. We conduct extensive experiments to evaluate our models on both synthetic and real world datasets. The empirical results demonstrate that our approach is effective and robust in discovering latent groups and detecting group anomalies.

preprint2014arXiv

Power-law scaling of asymmetries in viscous flow with PT-symmetric inflow and outflow

In recent years, open systems with balanced loss and gain, that are invariant under the combined parity and time-reversal ( $\mathcal{PT}$ ) operations, have been studied via asymmetries of their solutions. They represent systems as diverse as coupled optical waveguides and electrical or mechanical oscillators. We numerically investigate the asymmetries of incompressible viscous flow in two and three dimensions with "balanced" inflow-outflow ( $\mathcal{PT}$ -symmetric) configurations. By introducing configuration-dependent classes of asymmetry functions in velocity, kinetic energy density, and vorticity fields, we find that the flow asymmetries exhibit power-law scaling with a single exponent in the laminar regime with the Reynolds number ranging over four decades. We show that such single-exponent scaling is expected for small Reynolds numbers, although its robustness at large values of Reynolds numbers is unexpected. Our results imply that $\mathcal{PT}$ -symmetric inflow-outflow configurations provide a hitherto unexplored avenue to tune flow properties.

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Yu