BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

Dan Padnos

Dan Padnos appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
astro-ph.GAComputation and LanguageMachine Learningastro-ph.CONeural and Evolutionary Computing

Catalog footprint

What is connected

4works
5topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

4 published item(s)

preprint2020arXiv

SenseBERT: Driving Some Sense into BERT

The ability to learn from large unlabeled corpora has allowed neural language models to advance the frontier in natural language understanding. However, existing self-supervision techniques operate at the word form level, which serves as a surrogate for the underlying semantic content. This paper proposes a method to employ weak-supervision directly at the word sense level. Our model, named SenseBERT, is pre-trained to predict not only the masked words but also their WordNet supersenses. Accordingly, we attain a lexical-semantic level language model, without the use of human annotation. SenseBERT achieves significantly improved lexical understanding, as we demonstrate by experimenting on SemEval Word Sense Disambiguation, and by attaining a state of the art result on the Word in Context task.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Technical Report: Auxiliary Tuning and its Application to Conditional Text Generation

We introduce a simple and efficient method, called Auxiliary Tuning, for adapting a pre-trained Language Model to a novel task; we demonstrate this approach on the task of conditional text generation. Our approach supplements the original pre-trained model with an auxiliary model that shifts the output distribution according to the target task. The auxiliary model is trained by adding its logits to the pre-trained model logits and maximizing the likelihood of the target task output. Our method imposes no constraints on the auxiliary architecture. In particular, the auxiliary model can ingest additional input relevant to the target task, independently from the pre-trained model's input. Furthermore, mixing the models at the logits level provides a natural probabilistic interpretation of the method. Our method achieved similar results to training from scratch for several different tasks, while using significantly fewer resources for training; we share a specific example of text generation conditioned on keywords.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Instability of Supersonic Cold Streams Feeding Galaxies I: Linear Kelvin-Helmholtz Instability with Body Modes

Massive galaxies at high redshift are predicted to be fed from the cosmic web by narrow, dense, cold streams. These streams penetrate supersonically through the hot medium encompassed by a stable shock near the virial radius of the dark-matter halo. Our long-term goal is to explore the heating and dissipation rate of the streams and their fragmentation and possible breakup, in order to understand how galaxies are fed, and how this affects their star-formation rate and morphology. We present here the first step, where we analyze the linear Kelvin-Helmholtz instability (KHI) of a cold, dense slab or cylinder flowing through a hot, dilute medium in the transonic regime. The current analysis is limited to the adiabatic case with no gravity and assuming equal pressure in the stream and the medium. By analytically solving the linear dispersion relation, we find a transition from a dominance of the familiar rapidly growing surface modes in the subsonic regime to more slowly growing body modes in the supersonic regime. The system is parameterized by three parameters: the density contrast between the stream and the medium, the Mach number of stream velocity with respect to the medium, and the stream width with respect to the halo virial radius. We find that a realistic choice for these parameters places the streams near the mode transition, with the KHI exponential-growth time in the range 0.01-10 virial crossing times for a perturbation wavelength comparable to the stream width. We confirm our analytic predictions with idealized hydrodynamical simulations. Our linear-KHI estimates thus indicate that KHI may in principle be effective in the evolution of streams by the time they reach the galaxy. More definite conclusions await the extension of the analysis to the nonlinear regime and the inclusion of cooling, thermal conduction, the halo potential well, self-gravity and magnetic fields.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

The hydrodynamic stability of gaseous cosmic filaments

Virial shocks at edges of cosmic-web structures are a clear prediction of standard structure formation theories. We derive a criterion for the stability of the post-shock gas and of the virial shock itself in spherical, filamentary and planar infall geometries. When gas cooling is important, we find that shocks become unstable, and gas flows uninterrupted towards the center of the respective halo, filament or sheet. For filaments, we impose this criterion on self-similar infall solutions. We find that instability is expected for filament masses between $10^{11}-10^{13}M_\odot Mpc^{-1}.$ Using a simplified toy model, we then show that these filaments will likely feed halos with $10^{10}M_{\odot}\lesssim M_{halo}\lesssim 10^{13}M_{\odot}$ at redshift $z=3$, as well as $10^{12}M_{\odot}\lesssim M_{halo}\lesssim 10^{15}M_{\odot}$ at $z=0$. The instability will affect the survivability of the filaments as they penetrate gaseous halos in a non-trivial way. Additionally, smaller halos accreting onto non-stable filaments will not be subject to ram-pressure inside the filaments. The instreaming gas will continue towards the center, and stop either once its angular momentum balances the gravitational attraction, or when its density becomes so high that it becomes self-shielded to radiation.

0 citations0 reviewsNo code linkedOpen access