BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

Yong Zhu

Yong Zhu appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
cond-mat.supr-conArtificial IntelligenceComputation and Languagecond-mat.str-elcond-mat.mes-hallcond-mat.stat-mechphysics.app-ph

Catalog footprint

What is connected

14works
7topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

14 published item(s)

preprint2022arXiv

Building Chinese Biomedical Language Models via Multi-Level Text Discrimination

Pre-trained language models (PLMs), such as BERT and GPT, have revolutionized the field of NLP, not only in the general domain but also in the biomedical domain. Most prior efforts in building biomedical PLMs have resorted simply to domain adaptation and focused mainly on English. In this work we introduce eHealth, a Chinese biomedical PLM built from scratch with a new pre-training framework. This new framework pre-trains eHealth as a discriminator through both token- and sequence-level discrimination. The former is to detect input tokens corrupted by a generator and recover their original identities from plausible candidates, while the latter is to further distinguish corruptions of a same original sequence from those of others. As such, eHealth can learn language semantics at both token and sequence levels. Extensive experiments on 11 Chinese biomedical language understanding tasks of various forms verify the effectiveness and superiority of our approach. We release the pre-trained model at \url{https://github.com/PaddlePaddle/Research/tree/master/KG/eHealth} and will also release the code later.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Complex Evolutional Pattern Learning for Temporal Knowledge Graph Reasoning

A Temporal Knowledge Graph (TKG) is a sequence of KGs corresponding to different timestamps. TKG reasoning aims to predict potential facts in the future given the historical KG sequences. One key of this task is to mine and understand evolutional patterns of facts from these sequences. The evolutional patterns are complex in two aspects, length-diversity and time-variability. Existing models for TKG reasoning focus on modeling fact sequences of a fixed length, which cannot discover complex evolutional patterns that vary in length. Furthermore, these models are all trained offline, which cannot well adapt to the changes of evolutional patterns from then on. Thus, we propose a new model, called Complex Evolutional Network (CEN), which uses a length-aware Convolutional Neural Network (CNN) to handle evolutional patterns of different lengths via an easy-to-difficult curriculum learning strategy. Besides, we propose to learn the model under the online setting so that it can adapt to the changes of evolutional patterns over time. Extensive experiments demonstrate that CEN obtains substantial performance improvement under both the traditional offline and the proposed online settings.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Mixture of Experts for Biomedical Question Answering

Biomedical Question Answering (BQA) has attracted increasing attention in recent years due to its promising application prospect. It is a challenging task because the biomedical questions are professional and usually vary widely. Existing question answering methods answer all questions with a homogeneous model, leading to various types of questions competing for the shared parameters, which will confuse the model decision for each single type of questions. In this paper, in order to alleviate the parameter competition problem, we propose a Mixture-of-Expert (MoE) based question answering method called MoEBQA that decouples the computation for different types of questions by sparse routing. To be specific, we split a pretrained Transformer model into bottom and top blocks. The bottom blocks are shared by all the examples, aiming to capture the general features. The top blocks are extended to an MoE version that consists of a series of independent experts, where each example is assigned to a few experts according to its underlying question type. MoEBQA automatically learns the routing strategy in an end-to-end manner so that each expert tends to deal with the question types it is expert in. We evaluate MoEBQA on three BQA datasets constructed based on real examinations. The results show that our MoE extension significantly boosts the performance of question answering models and achieves new state-of-the-art performance. In addition, we elaborately analyze our MoE modules to reveal how MoEBQA works and find that it can automatically group the questions into human-readable clusters.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Boundary curvature guided shape-programming kirigami sheets

Kirigami, an ancient paper cutting art, offers a promising strategy for 2D-to-3D shape morphing through cut-guided deformation. Existing kirigami designs for target 3D curved shapes rely on intricate cut patterns in thin sheets, making the inverse design challenging. Motivated by the Gauss-Bonnet theorem that correlates the geodesic curvature along the boundary with the topological Gaussian curvature, here, we exploit programming the curvature of cut boundaries rather than complex cut patterns in kirigami sheets for target 3D curved topologies through both forward and inverse designs. Such a new strategy largely simplifies the inverse design. We demonstrate the achievement of varieties of dynamic 3D shape shifting under both mechanical stretching and remote magnetic actuation, and its potential application as an untethered predator-like kirigami soft robot. This study opens a new avenue to encode boundary curvatures for shape-programing materials with potential applications in shape-morphing structures, soft robots, and multifunctional devices.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Entity Structure Within and Throughout: Modeling Mention Dependencies for Document-Level Relation Extraction

Entities, as the essential elements in relation extraction tasks, exhibit certain structure. In this work, we formulate such structure as distinctive dependencies between mention pairs. We then propose SSAN, which incorporates these structural dependencies within the standard self-attention mechanism and throughout the overall encoding stage. Specifically, we design two alternative transformation modules inside each self-attention building block to produce attentive biases so as to adaptively regularize its attention flow. Our experiments demonstrate the usefulness of the proposed entity structure and the effectiveness of SSAN. It significantly outperforms competitive baselines, achieving new state-of-the-art results on three popular document-level relation extraction datasets. We further provide ablation and visualization to show how the entity structure guides the model for better relation extraction. Our code is publicly available.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

CoKE: Contextualized Knowledge Graph Embedding

Knowledge graph embedding, which projects symbolic entities and relations into continuous vector spaces, is gaining increasing attention. Previous methods allow a single static embedding for each entity or relation, ignoring their intrinsic contextual nature, i.e., entities and relations may appear in different graph contexts, and accordingly, exhibit different properties. This work presents Contextualized Knowledge Graph Embedding (CoKE), a novel paradigm that takes into account such contextual nature, and learns dynamic, flexible, and fully contextualized entity and relation embeddings. Two types of graph contexts are studied: edges and paths, both formulated as sequences of entities and relations. CoKE takes a sequence as input and uses a Transformer encoder to obtain contextualized representations. These representations are hence naturally adaptive to the input, capturing contextual meanings of entities and relations therein. Evaluation on a wide variety of public benchmarks verifies the superiority of CoKE in link prediction and path query answering. It performs consistently better than, or at least equally well as current state-of-the-art in almost every case, in particular offering an absolute improvement of 21.0% in H@10 on path query answering. Our code is available at \url{https://github.com/PaddlePaddle/Research/tree/master/KG/CoKE}.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

A Review on Mechanics and Mechanical Properties of 2D Materials - Graphene and Beyond

Since the first successful synthesis of graphene just over a decade ago, a variety of two-dimensional (2D) materials (e.g., transition metal-dichalcogenides, hexagonal boron-nitride, etc.) have been discovered. Among the many unique and attractive properties of 2D materials, mechanical properties play important roles in manufacturing, integration and performance for their potential applications. Mechanics is indispensable in the study of mechanical properties, both experimentally and theoretically. The coupling between the mechanical and other physical properties (thermal, electronic, optical) is also of great interest in exploring novel applications, where mechanics has to be combined with condensed matter physics to establish a scalable theoretical framework. Moreover, mechanical interactions between 2D materials and various substrate materials are essential for integrated device applications of 2D materials, for which the mechanics of interfaces (adhesion and friction) has to be developed for the 2D materials. Here we review recent theoretical and experimental works related to mechanics and mechanical properties of 2D materials. While graphene is the most studied 2D material to date, we expect continual growth of interest in the mechanics of other 2D materials beyond graphene.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Critical behaviors and universality classes of percolation phase transitions on two-dimensional square lattice

We have investigated both site and bond percolation on two dimensional lattice under the random rule and the product rule respectively. With the random rule, sites or bonds are added randomly into the lattice. From two candidates picked randomly, the site or bond with the smaller size product of two connected clusters is added when the product rule is taken. Not only the size of the largest cluster but also its size jump are studied to characterize the universality class of percolation. The finite-size scaling forms of giant cluster size and size jump are proposed and used to determine the critical exponents of percolation from Monte Carlo data. It is found that the critical exponents of both size and size jump in random site percolation are equal to that in random bond percolation. With the random rule, site and bond percolation belong to the same universality class. We obtain the critical exponents of the site percolation under the product rule, which are different from that of both random percolation and the bond percolation under the product rule. The universality class of site percolation differs different from that of bond percolation when the product rule is used.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

Extraction of Electron Self-Energy and Gap Function in the Superconducting State of Bi_2Sr_2CaCu_2O_8 Superconductor via Laser-Based Angle-Resolved Photoemission

Super-high resolution laser-based angle-resolved photoemission measurements have been performed on a high temperature superconductor Bi_2Sr_2CaCu_2O_8. The band back-bending characteristic of the Bogoliubov-like quasiparticle dispersion is clearly revealed at low temperature in the superconducting state. This makes it possible for the first time to experimentally extract the complex electron self-energy and the complex gap function in the superconducting state. The resultant electron self-energy and gap function exhibit features at ~54 meV and ~40 meV, in addition to the superconducting gap-induced structure at lower binding energy and a broad featureless structure at higher binding energy. These information will provide key insight and constraints on the origin of electron pairing in high temperature superconductors.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

Growth, Characterization and Fermi Surface of Heavy Fermion CeCoIn5 Superconductor

High quality single crystals of heavy Fermion CeCoIn5 superconductor have been grown by flux method with a typical size of (1~2)mm x (1~2)mm x ~0.1 mm. The single crystals are characterized by structural analysis from X-ray diffraction and Laue diffraction, as well as compositional analysis. Magnetic and electrical measurements on the single crystals show a sharp superconducting transition with a transition temperature at Tc(onset) ~ 2.3 K and a transition width of ~0.15 K. The resistivity of the CeCoIn5 crystal exhibits a hump at ~45 K which is typical of a heavy Fermion system. High resolution angle-resolved photoemission spectroscopy (ARPES) measurements of CeCoIn5 reveal clear Fermi surface sheets that are consistent with the band structure calculations when assuming itinerant Ce 4f electrons at low temperature. This work provides important information on the electronic structure of heavy Fermion CeCoIn5 superconductor. It also lays a foundation for further studies on the physical properties and superconducting mechanism of the heavy Fermion superconductors.

0 citations0 reviewsNo code linkedOpen access
preprint2010arXiv

Quantitative Determination of Eliashberg Function and Evidence of Strong Electron Coupling with Multiple Phonon Modes in Heavily Over doped (Bi,Pb)2Sr2CuO6

Super-high resolution laser-based angle-resolved photoemission spectroscopy measurements have been carried out on a heavily overdoped (Bi,Pb)2Sr2CuO6 (Tc> 5 K) superconductor. Taking advantage of the high-precision data on the subtle change of the quasi-particle dispersion at different temperatures, we develop a general procedure to determine the bare band dispersion and extract the bosonic spectral function quantitatively. Our results show unambiguously that the 70 meV nodal kink is due to the electron coupling with the multiple phonon modes, with a large mass enhancement factor Lamda= 0.42 even in the heavily over-doped regime.

0 citations0 reviewsNo code linkedOpen access
preprint2010arXiv

Unusual Electronic Structure and Observation of Dispersion Kink in CeFeAsO Parent Compound of FeAs-Based Superconductors

We report the first comprehensive high-resolution angle-resolved photoemission measurements on CeFeAsO, a parent compound of FeAs-based high temperature superconductors with a mangetic/structural transition at $\sim$150 K. In the magnetic ordering state, four hole-like Fermi surface sheets are observed near $Γ$(0,0) and the Fermi surface near M(+/-$π$,+/-$π$) shows a tiny electron-like pocket at M surrounded by four Dirac cone-like strong spots. The unusual Fermi surface topology deviates strongly from the band structure calculations. The electronic signature of the magnetic/structural transition shows up in the dramatic change of the quasiparticle scattering rate. A dispersion kink at $\sim$ 25meV is for the first time observed in the parent compound of Fe-based superconductors.

0 citations0 reviewsNo code linkedOpen access
preprint2009arXiv

Coexistence of Fermi arcs and Fermi pockets in a high Tc copper oxide superconductor

In the pseudogap state of the high-Tc copper-oxide (cuprate) superconductors, angle-resolved photoemission (ARPES) measurements have seen an Fermi arc, i.e., an open-ended gapless section in the large Fermi surface, rather than a closed loop expected of an ordinary metal. This is all the more puzzling because Fermi pockets (small closed Fermi surface features) have been suggested from recent quantum oscillation measurements. The Fermi arcs have worried the high-Tc community for many years because they cannot be understood in terms of existing theories. Theorists came up with a way out in the form of conventional Fermi surface pockets associated with competing order, with a back side that is for detailed reasons invisible by photoemission. Here we report ARPES measurements of La-Bi2201 that give direct evidence of the Fermi pocket. The charge carriers in the pocket are holes and the pockets show an unusual dependence upon doping, namely, they exist in underdoped but not overdoped samples. A big surprise is that these Fermi pockets appear to coexist with the Fermi arcs. This coexistence has not been expected theoretically and the understanding of the mysterious pseudogap state in the high-Tc cuprate superconductors will rely critically on understanding such a new finding.

0 citations0 reviewsNo code linkedOpen access
preprint2008arXiv

Identification of Nodal Kink in Electron-Doped (Nd$_{1.85}$Ce$_{0.15}$)CuO$_4$ Superconductor from Laser-Based Angle-Resolved Photoemission Spectroscopy

High-resolution laser-based angle-resolved photoemission measurements have been carried out on the electron-doped (Nd$_{1.85}$Ce$_{0.15}$)CuO$_4$ high temperature superconductor. We have revealed a clear kink at $\sim$60 meV in the dispersion along the (0,0)-($π$,$π$) nodal direction, accompanied by a peak-dip-hump feature in the photoemission spectra. This indicates that the nodal electrons are coupled to collective excitations (bosons) in electron-doped superconductors, with the phonons as the most likely candidate of the boson. This finding has established a universality of nodal electron coupling in both hole- and electron-doped high temperature cuprate superconductors.

0 citations0 reviewsNo code linkedOpen access