Trust snapshot

Quick read

Trust 21 - EmergingVerification L1Unclaimed author
18works
0followers
20topics
4close collaborators

Actions

Decide how to stay connected

Follow researcher0

Identity and collaboration

How to connect with this researcher

Claiming links this public author record to a researcher profile and unlocks direct collaboration workflows.

Log in to claim

Direct collaboration

Open a focused conversation when the fit is right

Claim this author entity first to unlock direct invitations.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

18 published item(s)

preprint2026arXiv

LCGNav: Local Candidate-Aware Geometric Enhancement for General Topological Planning in Vision-Language Navigation

Online topological planning has become an effective paradigm for Vision-Language Navigation in Continuous Environments (VLN-CE), but existing methods still suffer from two limitations: redundant local depth information and weakened focus on current frontier candidates as the topological graph grows. To address this, we propose LCGNav, a modular local geometric enhancement framework for topological VLN. LCGNav explicitly converts candidate depth views into 3D point clouds and applies physical truncation based on the agent's reachable range, enabling more compact local geometric modeling. It further introduces a dimension-preserving local fusion strategy with transient state degradation, so that geometric enhancement is applied only to the currently relevant ghost nodes without changing the original planner interface. Experiments on R2R-CE and RxR-CE show that LCGNav serves as an effective cross-architecture enhancement module, consistently improving multiple key metrics of representative online topological baselines with low additional training cost. When integrated with ETP-R1, LCGNav achieves the best performance among the compared online topological methods on the val-unseen splits of the R2R-CE and RxR-CE benchmarks. The code is available at https://github.com/shannanshouyin/LCGNav.

preprint2022arXiv

Chat-to-Design: AI Assisted Personalized Fashion Design

In this demo, we present Chat-to-Design, a new multimodal interaction system for personalized fashion design. Compared to classic systems that recommend apparel based on keywords, Chat-to-Design enables users to design clothes in two steps: 1) coarse-grained selection via conversation and 2) fine-grained editing via an interactive interface. It encompasses three sub-systems to deliver an immersive user experience: A conversation system empowered by natural language understanding to accept users' requests and manages dialogs; A multimodal fashion retrieval system empowered by a large-scale pretrained language-image network to retrieve requested apparel; A fashion design system empowered by emerging generative techniques to edit attributes of retrieved clothes.

preprint2022arXiv

Fantastic Questions and Where to Find Them: FairytaleQA -- An Authentic Dataset for Narrative Comprehension

Question answering (QA) is a fundamental means to facilitate assessment and training of narrative comprehension skills for both machines and young children, yet there is scarcity of high-quality QA datasets carefully designed to serve this purpose. In particular, existing datasets rarely distinguish fine-grained reading skills, such as the understanding of varying narrative elements. Drawing on the reading education research, we introduce FairytaleQA, a dataset focusing on narrative comprehension of kindergarten to eighth-grade students. Generated by educational experts based on an evidence-based theoretical framework, FairytaleQA consists of 10,580 explicit and implicit questions derived from 278 children-friendly stories, covering seven types of narrative elements or relations. Our dataset is valuable in two folds: First, we ran existing QA models on our dataset and confirmed that this annotation helps assess models' fine-grained learning skills. Second, the dataset supports question generation (QG) task in the education domain. Through benchmarking with QG models, we show that the QG model trained on FairytaleQA is capable of asking high-quality and more diverse questions.

preprint2022arXiv

GEMv2: Multilingual NLG Benchmarking in a Single Line of Code

Evaluation in machine learning is usually informed by past choices, for example which datasets or metrics to use. This standardization enables the comparison on equal footing using leaderboards, but the evaluation choices become sub-optimal as better alternatives arise. This problem is especially pertinent in natural language generation which requires ever-improving suites of datasets, metrics, and human evaluation to make definitive claims. To make following best model evaluation practices easier, we introduce GEMv2. The new version of the Generation, Evaluation, and Metrics Benchmark introduces a modular infrastructure for dataset, model, and metric developers to benefit from each others work. GEMv2 supports 40 documented datasets in 51 languages. Models for all datasets can be evaluated online and our interactive data card creation and rendering tools make it easier to add new datasets to the living benchmark.

preprint2022arXiv

It is AI's Turn to Ask Humans a Question: Question-Answer Pair Generation for Children's Story Books

Existing question answering (QA) techniques are created mainly to answer questions asked by humans. But in educational applications, teachers often need to decide what questions they should ask, in order to help students to improve their narrative understanding capabilities. We design an automated question-answer generation (QAG) system for this education scenario: given a story book at the kindergarten to eighth-grade level as input, our system can automatically generate QA pairs that are capable of testing a variety of dimensions of a student's comprehension skills. Our proposed QAG model architecture is demonstrated using a new expert-annotated FairytaleQA dataset, which has 278 child-friendly storybooks with 10,580 QA pairs. Automatic and human evaluations show that our model outperforms state-of-the-art QAG baseline systems. On top of our QAG system, we also start to build an interactive story-telling application for the future real-world deployment in this educational scenario.

preprint2022arXiv

Measurement of DC Magneto-Optical Kerr Effect with Sensitivity of $10^{-7} \text{Rad}/\sqrt{\text{Hz}}$

A high-sensitive DC Magneto-Optical Kerr Effect (MOKE) apparatus is described in this letter. Via detailed analysis on several dominating noise sources, we have proposed solutions that significantly lower the MOKE noise, and a sensitivity of $1.5\times10^{-7} \text{rad}/\sqrt{\text{Hz}}$ is achieved with long-term stability. The sensitivity of the apparatus is tested by measuring a wedge-shaped Ni thin film on $\text{SiO}_2$ with Ni thickness varying from 0 to 3 nm. A noise floor of $1.5\times10^{-8}$ rad is demonstrated. The possibility of further improving sensitivity to $10^{-9}$ rad via applying ac modulation is also discussed.

preprint2022arXiv

Novel Materials and Concepts for Next-Generation High Power Target Applications

Novel beam-intercepting materials and targetry concepts are essential to improve the performance, reliability and operation lifetimes of next generation multi-megawatt (multi-MW) accelerator target facilities. The beam-intercepting materials and components must sustain an order-of-magnitude increase in particle beam intensities and are beyond the current state-of-the-art. With conventional materials already limiting the scope of experiments, it is crucial to investigate novel target materials, technologies and concepts that will satisfy the requirements and maximize the physics benefits of future energy and intensity frontier experiments. This paper provides an overview of the related targetry R&D required over the next 10 years to support and enable future high-power accelerator target facilities.

preprint2022arXiv

Observation of Structure Evolution and Reaction Intermediates at the Gate-tunable Suspended Graphene/Electrolyte Interface

Graphene serves as an ideal platform to investigate the microscopic structure and reaction kinetics at the graphitic electrode interfaces. However, graphene is susceptible to various extrinsic factors, e.g. substrate, causing much confusion and controversy. Hereby we have obtained cm-sized substrate-free monolayer graphene suspended on electrolyte surface with gate tunability. Using sum-frequency spectroscopy, we have observed the structural evolution versus the gate voltage at the graphene/water interface. The Stern layer structure is invariant within the water electrolysis window, but undergoes drastic change when switching on the electrochemical reactions. The electrode is turned from hydrophobic to hydrophilic near the onset of hydrogen evolution reaction due to hydrogen adsorption. The large-size suspended pristine graphene offers a new platform to unravel the microscopic processes at the graphitic electrode interfaces.

preprint2022arXiv

StoryBuddy: A Human-AI Collaborative Chatbot for Parent-Child Interactive Storytelling with Flexible Parental Involvement

Despite its benefits for children's skill development and parent-child bonding, many parents do not often engage in interactive storytelling by having story-related dialogues with their child due to limited availability or challenges in coming up with appropriate questions. While recent advances made AI generation of questions from stories possible, the fully-automated approach excludes parent involvement, disregards educational goals, and underoptimizes for child engagement. Informed by need-finding interviews and participatory design (PD) results, we developed StoryBuddy, an AI-enabled system for parents to create interactive storytelling experiences. StoryBuddy's design highlighted the need for accommodating dynamic user needs between the desire for parent involvement and parent-child bonding and the goal of minimizing parent intervention when busy. The PD revealed varied assessment and educational goals of parents, which StoryBuddy addressed by supporting configuring question types and tracking child progress. A user study validated StoryBuddy's usability and suggested design insights for future parent-AI collaboration systems.

preprint2022arXiv

The Role of Permanent and Induced Electrostatic Dipole Moments for Schottky Barriers in Janus MXY/Graphene Heterostructures: a First Principles Study

The Schottky barrier height ($E_{SBH}$) is a crucial factor in determining the transport properties of semiconductor materials as it directly regulates the carrier mobility in opto-electronics devices. In principle, van der Waals (vdW) Janus heterostructures offer an appealing avenue to controlling the ESBH. However, the underlying atomistic mechanisms are far from understood conclusively, which prompts for further research in the topic. To this end, here, we carry out an extensive first principles study of the electronic properties and $E_{SBH}$ of several vdW Janus MXY/Graphene (M=Mo, W; X, Y=S, Se, Te) heterostructures. The results of the simulations show that by changing the composition and geometry of the heterostructure's interface, it is possible to control its electrical contact, thence electron transport properties, from Ohmic to Schottky with nearly one order of magnitude variations in the $E_{SBH}$. Detailed analysis of the simulations enables rationalization of this highly attractive property on the basis of the interplay between the permanent dipole moment of the Janus MXY sheet and the induced one due to interfacial charge redistribution at the MXY/Gr interface. Such an interplay is shown to be highly effective in altering the electrostatic potential difference across the vdW Janus heterostructure, determining its ESBH, thence Schottky (Ohmic) contact type. These computational findings contribute guidelines to control electrical contacts in Janus heterostructures towards rational design of electrical contacts in nanoscale devices.

preprint2021arXiv

ActionBert: Leveraging User Actions for Semantic Understanding of User Interfaces

As mobile devices are becoming ubiquitous, regularly interacting with a variety of user interfaces (UIs) is a common aspect of daily life for many people. To improve the accessibility of these devices and to enable their usage in a variety of settings, building models that can assist users and accomplish tasks through the UI is vitally important. However, there are several challenges to achieve this. First, UI components of similar appearance can have different functionalities, making understanding their function more important than just analyzing their appearance. Second, domain-specific features like Document Object Model (DOM) in web pages and View Hierarchy (VH) in mobile applications provide important signals about the semantics of UI elements, but these features are not in a natural language format. Third, owing to a large diversity in UIs and absence of standard DOM or VH representations, building a UI understanding model with high coverage requires large amounts of training data. Inspired by the success of pre-training based approaches in NLP for tackling a variety of problems in a data-efficient way, we introduce a new pre-trained UI representation model called ActionBert. Our methodology is designed to leverage visual, linguistic and domain-specific features in user interaction traces to pre-train generic feature representations of UIs and their components. Our key intuition is that user actions, e.g., a sequence of clicks on different UI components, reveals important information about their functionality. We evaluate the proposed model on a wide variety of downstream tasks, ranging from icon classification to UI component retrieval based on its natural language description. Experiments show that the proposed ActionBert model outperforms multi-modal baselines across all downstream tasks by up to 15.5%.

preprint2021arXiv

Estimating the Number of Infected Cases in COVID-19 Pandemic

The COVID-19 pandemic has caused major disturbance to human life. An important reason behind the widespread social anxiety is the huge uncertainty about the pandemic. A fundamental uncertainty is how many or what percentage of people have been infected. There are published and frequently updated data on various statistics of the pandemic, at local, country or global level. However, due to various reasons, many cases were not included in those reported numbers. We propose a structured approach for the estimation of the number of unreported cases, where we distinguish cases that arrive late in the reported numbers and those who had mild or no symptoms and thus were not captured by any medical system at all. We use post-report data for the estimation of the former and population matching to the latter. We estimate that the reported number of infected cases in the US should be corrected by multiplying a factor of 220.54% as of Apr 20, 2020, while the infection ratio out of the US population is estimated to be 0.53%, implying a case mortality rate at 2.85% which is close to the 3.4% suggested by the WHO in Mar 2020. Towards the end of the summer of 2020, the overall infection ratio of the US rises to 2.49% while the case mortality decreases to 2.09%, and the ratio of asymptomatic cases out of all infected cases reduces from the pre-summer 35-40% to around 20-25%.

preprint2021arXiv

Understanding in Artificial Intelligence

Current Artificial Intelligence (AI) methods, most based on deep learning, have facilitated progress in several fields, including computer vision and natural language understanding. The progress of these AI methods is measured using benchmarks designed to solve challenging tasks, such as visual question answering. A question remains of how much understanding is leveraged by these methods and how appropriate are the current benchmarks to measure understanding capabilities. To answer these questions, we have analysed existing benchmarks and their understanding capabilities, defined by a set of understanding capabilities, and current research streams. We show how progress has been made in benchmark development to measure understanding capabilities of AI methods and we review as well how current methods develop understanding capabilities.

preprint2021arXiv

Voltage Inference for and Coordination of Distributed Voltage Controls in Extremely-High DER-Penetration Distribution Networks

The unique problems and phenomena in the distributed voltage control of large-scale power distribution systems with extremely-high DER-penetration are targeted in this paper. First, a DER-explicit distribution network model and voltage sensitivity are derived. Based on that, a voltage inference method is implemented to fill the gap of measurement insufficiency in the grid-edge areas. Then, autonomous Q control being implemented in each local area, a $\overline{Q}$-coordinated P control is designed to coordinate the reactive and real power controls. All the algorithms have been tested in standard and synthetic systems, and have expected results. Moreover, an open-source software platform, which integrates the modeling of communication networks, DER controls, and power networks, is developed to enable the distributed control and optimization algorithms in the grid simulation of the large-scale distribution systems.

preprint2020arXiv

Bubble Storytelling with Automated Animation: A Brexit Hashtag Activism Case Study

Hashtag data are common and easy to acquire. Thus, they are widely used in studies and visual data storytelling. For example, a recent story by China Central Television Europe (CCTV Europe) depicts Brexit as a hashtag movement displayed on an animated bubble chart. However, creating such a story is usually laborious and tedious, because narrators have to switch between different tools and discuss with different collaborators. To reduce the burden, we develop a prototype system to help explore the bubbles' movement by automatically inserting animations connected to the storytelling of the video creators and the interaction of viewers to those videos. We demonstrate the usability of our method through both use cases and a semi-structured user study.

preprint2020arXiv

Elephant in the Room: An Evaluation Framework for Assessing Adversarial Examples in NLP

An adversarial example is an input transformed by small perturbations that machine learning models consistently misclassify. While there are a number of methods proposed to generate adversarial examples for text data, it is not trivial to assess the quality of these adversarial examples, as minor perturbations (such as changing a word in a sentence) can lead to a significant shift in their meaning, readability and classification label. In this paper, we propose an evaluation framework consisting of a set of automatic evaluation metrics and human evaluation guidelines, to rigorously assess the quality of adversarial examples based on the aforementioned properties. We experiment with six benchmark attacking methods and found that some methods generate adversarial examples with poor readability and content preservation. We also learned that multiple factors could influence the attacking performance, such as the length of the text inputs and architecture of the classifiers.

preprint2020arXiv

GraphFederator: Federated Visual Analysis for Multi-party Graphs

This paper presents GraphFederator, a novel approach to construct joint representations of multi-party graphs and supports privacy-preserving visual analysis of graphs. Inspired by the concept of federated learning, we reformulate the analysis of multi-party graphs into a decentralization process. The new federation framework consists of a shared module that is responsible for joint modeling and analysis, and a set of local modules that run on respective graph data. Specifically, we propose a federated graph representation model (FGRM) that is learned from encrypted characteristics of multi-party graphs in local modules. We also design multiple visualization views for joint visualization, exploration, and analysis of multi-party graphs. Experimental results with two datasets demonstrate the effectiveness of our approach.

preprint2019arXiv

Data-Driven Wide-Area Control Design of Power System Using the Passivity Shortage Framework

A novel wide-area control design is presented to mitigate inter-area power frequency oscillations. A large-scale power system is decomposed into a network of passivity-short subsystems whose nonlinear interconnections have a state-dependent affine form, and by utilizing the passivity shortage framework a two-level design procedure is developed. At the lower level, any generator control can be viewed as one that makes the generator passivity-short and $L_2$ stable, and the stability impact of the lower-level control on the overall system can be characterized in terms of two parameters. While the system is nonlinear, the impact parameters can be optimized by solving a data-driven matrix inequality (DMI), and the high-level wide-area control is then designed by solving another Lyapunov matrix inequality in terms of the design parameters. The proposed methodology makes the design modular, and the resulting control is adaptive with respect to operating conditions of the power system. A test system is used to illustrate the proposed design, including DMI and the wide-area control, and simulation results demonstrate effectiveness in damping out inter-area oscillations.