Source author record

Ming Gao

Ming Gao appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

26works
13topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

26 published item(s)

preprint2022arXiv

A Neural Network Architecture for Program Understanding Inspired by Human Behaviors

Program understanding is a fundamental task in program language processing. Despite the success, existing works fail to take human behaviors as reference in understanding programs. In this paper, we consider human behaviors and propose the PGNN-EK model that consists of two main components. On the one hand, inspired by the "divide-and-conquer" reading behaviors of humans, we present a partitioning-based graph neural network model PGNN on the upgraded AST of codes. On the other hand, to characterize human behaviors of resorting to other resources to help code comprehension, we transform raw codes with external knowledge and apply pre-training techniques for information extraction. Finally, we combine the two embeddings generated from the two components to output code embeddings. We conduct extensive experiments to show the superior performance of PGNN-EK on the code summarization and code clone detection tasks. In particular, to show the generalization ability of our model, we release a new dataset that is more challenging for code clone detection and could advance the development of the community. Our codes and data are publicly available at https://github.com/RecklessRonan/PGNN-EK.

preprint2022arXiv

KECP: Knowledge Enhanced Contrastive Prompting for Few-shot Extractive Question Answering

Extractive Question Answering (EQA) is one of the most important tasks in Machine Reading Comprehension (MRC), which can be solved by fine-tuning the span selecting heads of Pre-trained Language Models (PLMs). However, most existing approaches for MRC may perform poorly in the few-shot learning scenario. To solve this issue, we propose a novel framework named Knowledge Enhanced Contrastive Prompt-tuning (KECP). Instead of adding pointer heads to PLMs, we introduce a seminal paradigm for EQA that transform the task into a non-autoregressive Masked Language Modeling (MLM) generation problem. Simultaneously, rich semantics from the external knowledge base (KB) and the passage context are support for enhancing the representations of the query. In addition, to boost the performance of PLMs, we jointly train the model by the MLM and contrastive learning objectives. Experiments on multiple benchmarks demonstrate that our method consistently outperforms state-of-the-art approaches in few-shot settings by a large margin.

preprint2022arXiv

Optimal estimation of Gaussian DAG models

We study the optimal sample complexity of learning a Gaussian directed acyclic graph (DAG) from observational data. Our main results establish the minimax optimal sample complexity for learning the structure of a linear Gaussian DAG model in two settings of interest: 1) Under equal variances without knowledge of the true ordering, and 2) For general linear models given knowledge of the ordering. In both cases the sample complexity is $n\asymp q\log(d/q)$, where $q$ is the maximum number of parents and $d$ is the number of nodes. We further make comparisons with the classical problem of learning (undirected) Gaussian graphical models, showing that under the equal variance assumption, these two problems share the same optimal sample complexity. In other words, at least for Gaussian models with equal error variances, learning a directed graphical model is statistically no more difficult than learning an undirected graphical model. Our results also extend to more general identification assumptions as well as subgaussian errors.

preprint2022arXiv

Towards Unified Prompt Tuning for Few-shot Text Classification

Prompt-based fine-tuning has boosted the performance of Pre-trained Language Models (PLMs) on few-shot text classification by employing task-specific prompts. Yet, PLMs are unfamiliar with prompt-style expressions during pre-training, which limits the few-shot learning performance on downstream tasks. It would be desirable if the models can acquire some prompting knowledge before adaptation to specific NLP tasks. We present the Unified Prompt Tuning (UPT) framework, leading to better few-shot text classification for BERT-style models by explicitly capturing prompting semantics from non-target NLP datasets. In UPT, a novel paradigm Prompt-Options-Verbalizer is proposed for joint prompt learning across different NLP tasks, forcing PLMs to capture task-invariant prompting knowledge. We further design a self-supervised task named Knowledge-enhanced Selective Masked Language Modeling to improve the PLM's generalization abilities for accurate adaptation to previously unseen tasks. After multi-task learning across multiple tasks, the PLM can be better prompt-tuned towards any dissimilar target tasks in low-resourced settings. Experiments over a variety of NLP tasks show that UPT consistently outperforms state-of-the-arts for prompt-based fine-tuning.

preprint2022arXiv

Understanding Long Programming Languages with Structure-Aware Sparse Attention

Programming-based Pre-trained Language Models (PPLMs) such as CodeBERT have achieved great success in many downstream code-related tasks. Since the memory and computational complexity of self-attention in the Transformer grow quadratically with the sequence length, PPLMs typically limit the code length to 512. However, codes in real-world applications are generally long, such as code searches, which cannot be processed efficiently by existing PPLMs. To solve this problem, in this paper, we present SASA, a Structure-Aware Sparse Attention mechanism, which reduces the complexity and improves performance for long code understanding tasks. The key components in SASA are top-$k$ sparse attention and Abstract Syntax Tree (AST)-based structure-aware attention. With top-$k$ sparse attention, the most crucial attention relation can be obtained with a lower computational cost. As the code structure represents the logic of the code statements, which is a complement to the code sequence characteristics, we further introduce AST structures into attention. Extensive experiments on CodeXGLUE tasks show that SASA achieves better performance than the competing baselines.

preprint2020arXiv

EDSL: An Encoder-Decoder Architecture with Symbol-Level Features for Printed Mathematical Expression Recognition

Printed Mathematical expression recognition (PMER) aims to transcribe a printed mathematical expression image into a structural expression, such as LaTeX expression. It is a crucial task for many applications, including automatic question recommendation, automatic problem solving and analysis of the students, etc. Currently, the mainstream solutions rely on solving image captioning tasks, all addressing image summarization. As such, these methods can be suboptimal for solving MER problem. In this paper, we propose a new method named EDSL, shorted for encoder-decoder with symbol-level features, to identify the printed mathematical expressions from images. The symbol-level image encoder of EDSL consists of segmentation module and reconstruction module. By performing segmentation module, we identify all the symbols and their spatial information from images in an unsupervised manner. We then design a novel reconstruction module to recover the symbol dependencies after symbol segmentation. Especially, we employ a position correction attention mechanism to capture the spatial relationships between symbols. To alleviate the negative impact from long output, we apply the transformer model for transcribing the encoded image into the sequential and structural output. We conduct extensive experiments on two real datasets to verify the effectiveness and rationality of our proposed EDSL method. The experimental results have illustrated that EDSL has achieved 92.7\% and 89.0\% in evaluation metric Match, which are 3.47\% and 4.04\% higher than the state-of-the-art method. Our code and datasets are available at https://github.com/abcAnonymous/EDSL .

preprint2020arXiv

Hierarchical Optimization Time Integration for CFL-rate MPM Stepping

We propose Hierarchical Optimization Time Integration (HOT) for efficient implicit time-stepping of the Material Point Method (MPM) irrespective of simulated materials and conditions. HOT is an MPM-specialized hierarchical optimization algorithm that solves nonlinear time step problems for large-scale MPM systems near the CFL-limit. HOT provides convergent simulations "out-of-the-box" across widely varying materials and computational resolutions without parameter tuning. As an implicit MPM time stepper accelerated by a custom-designed Galerkin multigrid wrapped in a quasi-Newton solver, HOT is both highly parallelizable and robustly convergent. As we show in our analysis, HOT maintains consistent and efficient performance even as we grow stiffness, increase deformation, and vary materials over a wide range of finite strain, elastodynamic and plastic examples. Through careful benchmark ablation studies, we compare the effectiveness of HOT against seemingly plausible alternative combinations of MPM with standard multigrid and other Newton-Krylov models. We show how these alternative designs result in severe issues and poor performance. In contrast, HOT outperforms the existing state-of-the-art, heavily optimized implicit MPM codes with an up to 10x performance speedup across a wide range of challenging benchmark test simulations.

preprint2020arXiv

Learning Vertex Representations for Bipartite Networks

Recent years have witnessed a widespread increase of interest in network representation learning (NRL). By far most research efforts have focused on NRL for homogeneous networks like social networks where vertices are of the same type, or heterogeneous networks like knowledge graphs where vertices (and/or edges) are of different types. There has been relatively little research dedicated to NRL for bipartite networks. Arguably, generic network embedding methods like node2vec and LINE can also be applied to learn vertex embeddings for bipartite networks by ignoring the vertex type information. However, these methods are suboptimal in doing so, since real-world bipartite networks concern the relationship between two types of entities, which usually exhibit different properties and patterns from other types of network data. For example, E-Commerce recommender systems need to capture the collaborative filtering patterns between customers and products, and search engines need to consider the matching signals between queries and webpages.

preprint2016arXiv

Evidence of both surface and bulk Dirac bands in ZrSiS and the unconventional magnetoresistance

The unconventional magnetoresistance of ZrSiS single crystals is found unsaturated till the magnetic field of 53 T with the butterfly shaped angular dependence. Intense Shubnikov-de Haas oscillations resolve a bulk Dirac cone with a nontrivial Berry phase, where the Fermi surface area is 1.80*10^-3 Å-2 and reaches the quantum limit before 20 T. Angle resolved photoemission spectroscopy measurement reveals an electronic state with the two-dimensional nature around the X point of Brillouin zone boundary. By integrating the density functional theory calculations, ZrSiS is suggested to be a Dirac material with both surface and bulk Dirac bands.

preprint2016arXiv

Quantum cloning attacks against PUF-based quantum authentication systems

With the advent of Physical Unclonable Functions (PUFs), PUF-based quantum authentication systems (QAS) have been proposed for security purposes and recently proof-of-principle experiment has been demonstrated. As a further step towards completing the security analysis, we investigate quantum cloning attacks against PUF-based quantum authentication systems and prove that quantum cloning attacks outperform the so-called challenge-estimation attacks. We present the analytical expression of the false accept probability by use of the corresponding optimal quantum cloning machines and extend the previous results in the literature. In light of these findings, an explicit comparison is made between PUF-based quantum authentication systems and quantum key distribution (QKD) protocols in the context of cloning attacks. Moreover, from an experimental perspective, a trade-off between the average photon number and the detection efficiency is discussed in detail.

preprint2016arXiv

Quantum oscillation and nontrivial transport in the Dirac Semimetal Cd3As2 nanodevice

Here we demonstrate the Shubnikov de Haas oscillation in high-quality Cd3As2 nanowires grown by a chemical vapor deposition approach. The dominant transport of topological Dirac fermions is evident by the nontrivial Berry phase in the Landau Fan diagram. The quantum oscillations rise at a small field of 2 Tesla and preserves till up to 100K, revealing a sizeable Landau level gap and a mobility of over 2000 cm2/V-1s-1. The angle-variable oscillations indicates the isotropy of the bulk Dirac transport. The large estimated mean free path appeals the one-dimensional transport of Dirac semimetals.

preprint2016arXiv

Universally-composable finite-key analysis for efficient four-intensity decoy-state quantum key distribution

We propose an efficient four-intensity decoy-state BB84 protocol and derive concise security bounds for this protocol with the universally composable finite-key analysis method. Comparing with the efficient three-intensity protocol, we find that our efficient four-intensity protocol can increase the secret key rate by at least $30\%$. Particularly, this increasing rate of secret key rate will be raised as the transmission distance increases. At a large transmission distance, our efficient four-intensity protocol can improve the performance of quantum key distribution profoundly.

preprint2015arXiv

A global estimation of the lower bound of the privacy amplification term for decoy-state quantum key distribution

The privacy amplification term, of which the lower bound needs to be estimated with the decoy-state method, plays a positive role in the secure key rate formula for decoy-state quantum key distribution. In previous work, the yield and the bit error rate of single-photon state are estimated separately to gain this lower bound. In this work, we for the first time take the privacy amplification term as a whole to consider this lower bound. The mathematical description for the correlation between the yield and the bit error rate of single-photon state is given with just two unknown variables. Based on this, we obtain the global estimation of this lower bound for both BB84 protocol and measurement-device-independent protocol. The results of numerical simulation show that the global estimation can significantly improve the performance of quantum key distribution.

preprint2015arXiv

Dynamics and entanglement of a membrane-in-the-middle optomechanical system in the extremely-large-amplitude regime

The study of optomechanical systems has attracted much attention, most of which are concentrated in the physics in the small-amplitude regime. While in this article, we focus on optomechanics in the extremely-large-amplitude regime and consider both classical and quantum dynamics. Firstly, we study classical dynamics in a membrane-in-the-middle optomechanical system in which a partially reflecting and flexible membrane is suspended inside an optical cavity. We show that the membrane can present self-sustained oscillations with limit cycles in the shape of sawtooth-edged ellipses and exhibit dynamical multistability. Then, we study the dynamics of the quantum fluctuations around the classical orbits. By using the logarithmic negativity, we calculate the evolution of the quantum entanglement between the optical cavity mode and the membrane during the mechanical oscillation. We show that there is some synchronism between the classical dynamical process and the evolution of the quantum entanglement.

preprint2015arXiv

Scaling of liquid-drop impact craters in wet granular media

Combining high-speed photography with laser profilometry, we study the dynamics and the morphology of liquid-drop impact cratering in wet granular media---a ubiquitous phenomenon relevant to many important geological, agricultural, and industrial processes. By systematically investigating important variables such as impact energy, the size of impinging drops and the degree of liquid saturation in granular beds, we uncover a novel scaling for the size of impact craters. We show that this scaling can be explained by considering the balance between the inertia of impinging drops and the strength of impacted surface. Such a theoretical understanding confirms that the unique energy partition originally proposed for liquid-drop impact cratering in dry granular media also applies for impact cratering in wet granular media. Moreover, we demonstrate that compressive stresses, instead of shear stresses, control granular impact cratering. Our study enriches the picture of generic granular impact cratering and sheds light on the familiar phenomena of raindrop impacts in granular media.

preprint2015arXiv

Self-Sustained Oscillation and Dynamical Multistability of Optomechanical Systems in the Extremely-Large-Amplitude Regime

Optomechanics concerns with the coupling between optical cavities and mechanical resonators. Most early works are concentrated in the physics of optomechanics in the small-displacement regime and consider one single optical cavity mode participating in the optomechanical coupling. In this paper, we focus on optomechanics in the extremely-large-amplitude regime in which a mechanical resonator is coupled with multiple optical cavity modes during the oscillation. We explicitly show that the mechanical resonator can present self-sustained oscillations in a novel way with limit cycles in the shape of sawtooth-edged ellipses and exhibit dynamical multistability. By analyzing the mechanical oscillation process and the accompanied variation of the optical cavity occupation, we develop an energy-balanced condition to ensure the stability of self-sustained oscillation. The effect of the mechanical nonlinearities on the dynamics of the mechanical resonator is also investigated.

preprint2015arXiv

Stringent Statistical Fluctuation Analysis for Quantum Key Distribution Considering After-pulse Contributions

Statistical fluctuation problems are faced by all quantum key distribution (QKD) protocols under finite-key condition. Most of the current statistical fluctuation analysis methods work based on independent random samples, however, the precondition cannot be always satisfied on account of different choice of samples and actual parameters. As a result, proper statistical fluctuation methods are required to figure out this problem. Taking the after-pulse contributions into consideration, we give the expression of secure key rate and the mathematical model for statistical fluctuations, focusing on a decoy-state QKD protocol (Sci Rep. 3, 2453, 2013) with biased basis choice. On this basis, a classified analysis of statistical fluctuation is represented according to the mutual relationship between random samples. First for independent identical relations, we make a deviation comparison between law of large numbers and standard error analysis. Secondly, we give a sufficient condition that Chernoff bound achieves a better result than Hoeffding's inequality based on independent relations only. Thirdly, by constructing the proper martingale, for the first time we represent a stringent way to deal with statistical fluctuation issues upon dependent ones through making use of Azuma's inequality. In numerical optimization, we show the impact on secure key rate, the ones and respective deviations under various kinds of statistical fluctuation analyses.

preprint2015arXiv

Transfer of high-dimensional quantum state through an XXZ-Heisenberg quantum spin chain

We propose and analyze an efficient high-dimensional quantum state transfer scheme through an $XXZ$-Heisenberg spin chain in an inhomogeneous magnetic field. By the use of a combination of coherent quantum coupling and free spin-wave approximation, pure unitary evolution results in a perfect high-dimensional swap operation between two remote quantum registers mediated by a uniform quantum data bus, and the feasibility is confirmed by numerical simulations. Also, we observe that either the strong $z$-directional coupling or high quantum spin number can partly suppress the thermal excitations and protect quantum information from the thermal noises when the quantum data bus is in the thermal equilibrium state.

preprint2013arXiv

Classification of arbitrary-dimensional multipartite pure states under stochastic local operations and classical communication using the rank of coefficient matrix

We study multipartite entanglement under stochastic local operations and classical communication (SLOCC) and propose the entanglement classification under SLOCC for arbitrary-dimensional multipartite ($n$-qudit) pure states via the rank of coefficient matrix, together with the permutation of qudits. The ranks of the coefficient matrices have been proved to be entanglement monotones. The entanglement classification of the $2 \otimes 2 \otimes 2 \otimes 4$ system is discussed in terms of the generalized method, and 22 different SLOCC families are found.

preprint2013arXiv

Decoy-state quantum key distribution with biased basis choice

We propose a quantum key distribution scheme that combines a biased basis choice with the decoy-state method. In this scheme, Alice sends all signal states in the $Z$ basis and decoy states in the $X$ and $Z$ basis with certain probabilities, and Bob measures received pulses with optimal basis choice. This scheme simplifies the system and reduces the random number consumption. From the simulation result taking into account of statistical fluctuations, we find that in a typical experimental setup, the proposed scheme can increase the key rate by at least 45% comparing to the standard decoy-state scheme. In the postprocessing, we also apply a rigorous method to upper bound the phase error rate of the single-photon components of signal states.

preprint2013arXiv

Partially random phase attack to the practical two-way quantum-key-distribution system

Phase randomization is a very important assumption in the Bennett-Brassard 1984 quantum key distribution (QKD) system with a weak coherent source. Thus an active phase modulator is needed to randomize the phase of source. However, it is hard to check whether the phase of source is randomized totally or not in practical QKD systems. In this paper a partially random phase attack is proposed to exploit this imperfection. Our analysis shows that Eve can break the security of a two-way QKD system by using our attack, even if an active phase randomization is adopted by Alice. Furthermore, the numerical simulation shows that in some parameter regimes, our attack is immune to the one-decoy-state method.

preprint2013arXiv

Practical decoy-state measurement-device-independent quantum key distribution

Measurement-device-independent quantum key distribution (MDI-QKD) is immune to all the detection attacks; thus when it is combined with the decoy-state method, the final key is unconditionally secure, even if a practical weak coherent source is used by Alice and Bob. However, until now, the analysis of decoy-state MDI-QKD with a weak coherent source is incomplete. In this paper, we derive, with only vacuum+weak decoy state, some tight formulas to estimate the lower bound of yield and the upper bound of error rate for the fraction of signals in which both Alice and Bob send a single-photon pulse to the untrusted third party Charlie. The numerical simulations show that our method with only vacuum+weak decoy state can asymptotically approach the theoretical limit of the infinite number of decoy states. Furthermore, the statistical fluctuation due to the finite length of date is also considered based on the standard statistical analysis.

preprint2011arXiv

On frequency errors of nanomechanical-resonators-based-on quantum computing

We study the consequence of the frequency errors of individual oscillators on the scalability of quantum computing based on nanomechanical resonators. We show the fidelity change of the quantum operation due to the frequency shifts numerically. We present a method to perfectly compensate for these negative effects. Our method is robust to whatever large frequency errors.

preprint2011arXiv

Quantum phase transition of light in a 1-D photon-hopping-controllable resonator array

We give a concrete experimental scheme for engineering the insulator-superfluid transition of light in a one-dimensional (1-D) array of coupled superconducting stripline resonators. In our proposed architecture, the on-site interaction and the photon hopping rate can be tuned independently by adjusting the transition frequencies of the charge qubits inside the resonators and at the resonator junctions, respectively, which permits us to systematically study the quantum phase transition of light in a complete parameter space. By combining the techniques of photon-number-dependent qubit transition and fast read-out of the qubit state using a separate low-Q resonator mode, the statistical property of the excitations in each resonator can be obtained with a high efficiency. An analysis of the various decoherence sources and disorders shows that our scheme can serve as a guide to coming experiments involving a small number of coupled resonators.

preprint2011arXiv

Quantum superposition of localized and delocalized phases of photons

Based on a variant of 2-site Jaynes-Cummings-Hubbard model, which is constructed using superconducting circuits, we propose a method to coherently superpose the localized and delocalized phases of photons. In our model, two nonlinear superconducting stripline resonators are coupled by an interfacial circuit composed of parallel combination of a superconducting qubit and a capacitor, which plays the role of a quantum knob for the photon hopping rate: with the knob qubit in its ground/excited state, the injected photons tend to be localized/delocalized in the resonators. We show that, by applying a microwave field with appropriate frequency on the knob qubit, we could demonstrate Rabi oscillation between photonic localized phase and delocalized phase. Furthermore, this set-up offers advantages (e. g. infinite on/off ratio) over other proposals for the realization of scalable quantum computation with superconducting qubits.

preprint2011arXiv

Scalable one-way quantum computer using on-chip resonator qubits

We propose a scalable and robust architecture for one-way quantum computation using coupled networks of superconducting transmission line resonators. In our protocol, quantum information is encoded into the long-lived photon states of the resonators, which have a much longer coherence time than the usual superconducting qubits. Each resonator contains a charge qubit used for the state initialization and local projective measurement of the photonic qubit. Any pair of neighboring photonic qubits are coupled via a mediator charge qubit, and large photonic cluster states can be created by applying Stark-shifted Rabi pulses to these mediator qubits. The distinct advantage of our architecture is that it combines both the excellent scalability of the solid-state systems and the long coherence time of the photonic qubits. Furthermore, this architecture is very robust against the parameter variations.