Researcher profile

Lijuan Liu

Lijuan Liu contributes to research discovery and scholarly infrastructure.

ResearcherAffiliation not importedOpen to collaborate

Trust snapshot

Quick read

Trust 21 - EmergingVerification L1Unclaimed author
11works
0followers
10topics
4close collaborators

Actions

Decide how to stay connected

Follow researcher0

Identity and collaboration

How to connect with this researcher

Claiming links this public author record to a researcher profile and unlocks direct collaboration workflows.

Log in to claim

Direct collaboration

Open a focused conversation when the fit is right

Claim this author entity first to unlock direct invitations.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

11 published item(s)

preprint2022arXiv

DETR++: Taming Your Multi-Scale Detection Transformer

Convolutional Neural Networks (CNN) have dominated the field of detection ever since the success of AlexNet in ImageNet classification [12]. With the sweeping reform of Transformers [27] in natural language processing, Carion et al. [2] introduce the Transformer-based detection method, i.e., DETR. However, due to the quadratic complexity in the self-attention mechanism in the Transformer, DETR is never able to incorporate multi-scale features as performed in existing CNN-based detectors, leading to inferior results in small object detection. To mitigate this issue and further improve performance of DETR, in this work, we investigate different methods to incorporate multi-scale features and find that a Bi-directional Feature Pyramid (BiFPN) works best with DETR in further raising the detection precision. With this discovery, we propose DETR++, a new architecture that improves detection results by 1.9% AP on MS COCO 2017, 11.5% AP on RICO icon detection, and 9.1% AP on RICO layout extraction over existing baselines.

preprint2022arXiv

Geometry-Guided Progressive NeRF for Generalizable and Efficient Neural Human Rendering

In this work we develop a generalizable and efficient Neural Radiance Field (NeRF) pipeline for high-fidelity free-viewpoint human body synthesis under settings with sparse camera views. Though existing NeRF-based methods can synthesize rather realistic details for human body, they tend to produce poor results when the input has self-occlusion, especially for unseen humans under sparse views. Moreover, these methods often require a large number of sampling points for rendering, which leads to low efficiency and limits their real-world applicability. To address these challenges, we propose a Geometry-guided Progressive NeRF (GP-NeRF). In particular, to better tackle self-occlusion, we devise a geometry-guided multi-view feature integration approach that utilizes the estimated geometry prior to integrate the incomplete information from input views and construct a complete geometry volume for the target human body. Meanwhile, for achieving higher rendering efficiency, we introduce a progressive rendering pipeline through geometry guidance, which leverages the geometric feature volume and the predicted density values to progressively reduce the number of sampling points and speed up the rendering process. Experiments on the ZJU-MoCap and THUman datasets show that our method outperforms the state-of-the-arts significantly across multiple generalization settings, while the time cost is reduced > 70% via applying our efficient progressive rendering pipeline.

preprint2022arXiv

On the nature of photospheric horizontal magnetic field increase in major solar flares

Rapid increase of horizontal magnetic field ($B_h$) around the flaring polarity inversion line is the most prominent photospheric field change during flares. It is considered to be caused by the contraction of flare loops, the details behind which is still not fully understood. Here we investigate the $B_h$-increase in 35 major flares using HMI high-cadence vector magnetograms. We find that $B_h$-increase is always accompanied by the increase of field inclination. It usually initiates near the flare ribbons, showing step-like change in between the ribbons. In particular, its evolution in early flare phase shows close spatio-temporal correlation to flare ribbons. We further find that $B_h$-increase tends to have similar intensity in confined and eruptive flares, but larger spatial-extent in eruptive flares in a statistical sense. Its intensity and timescale have inverse and positive correlations to the initial ribbon separations, respectively. The results altogether are well consistent with a recent proposed scenario which suggests that the reconnection-driven contraction of flare loops enhances photospheric $B_h$ according to the ideal induction equation, providing statistical evidence to the reconnection-driven origin for $B_h$-increase for the first time.

preprint2022arXiv

The Rotation of Magnetic Flux Rope Formed during Solar Eruption

The eruptions of solar filaments often show rotational motion about their rising direction, but it remains elusive what mechanism governs such rotation and how the rotation is related to the initial morphology of the pre-eruptive filament (and co-spatial sigmoid), filament chirality, and magnetic helicity. The conventional view regarding the rotation as a result of a magnetic flux rope (MFR) under-going the ideal kink instability still has confusion in explaining these relationships. Here we proposed an alternative explanation for the rotation during eruptions, by analyzing a magnetohydrodynamic simulation in which magnetic reconnection initiates an eruption from a sheared arcade configuration and an MFR is formed during eruption through the reconnection. The simulation reproduces a reverse S-shaped MFR with dextral chirality, and the axis of this MFR rotates counterclockwise while rising, which compares favorably with a typical filament eruption observed from dual viewing angles. By calculating the twist and writhe numbers of the modeled MFR during its eruption, we found that accompanied with the rotation, the nonlocal writhe of the MFR's axis decreases while the twist of its surrounding field lines increases, and this is distinct from the kink instability, which converts magnetic twist into writhe of the MFR axis.

preprint2021arXiv

ActionBert: Leveraging User Actions for Semantic Understanding of User Interfaces

As mobile devices are becoming ubiquitous, regularly interacting with a variety of user interfaces (UIs) is a common aspect of daily life for many people. To improve the accessibility of these devices and to enable their usage in a variety of settings, building models that can assist users and accomplish tasks through the UI is vitally important. However, there are several challenges to achieve this. First, UI components of similar appearance can have different functionalities, making understanding their function more important than just analyzing their appearance. Second, domain-specific features like Document Object Model (DOM) in web pages and View Hierarchy (VH) in mobile applications provide important signals about the semantics of UI elements, but these features are not in a natural language format. Third, owing to a large diversity in UIs and absence of standard DOM or VH representations, building a UI understanding model with high coverage requires large amounts of training data. Inspired by the success of pre-training based approaches in NLP for tackling a variety of problems in a data-efficient way, we introduce a new pre-trained UI representation model called ActionBert. Our methodology is designed to leverage visual, linguistic and domain-specific features in user interaction traces to pre-train generic feature representations of UIs and their components. Our key intuition is that user actions, e.g., a sequence of clicks on different UI components, reveals important information about their functionality. We evaluate the proposed model on a wide variety of downstream tasks, ranging from icon classification to UI component retrieval based on its natural language description. Experiments show that the proposed ActionBert model outperforms multi-modal baselines across all downstream tasks by up to 15.5%.

preprint2021arXiv

In-game Residential Home Planning via Visual Context-aware Global Relation Learning

In this paper, we propose an effective global relation learning algorithm to recommend an appropriate location of a building unit for in-game customization of residential home complex. Given a construction layout, we propose a visual context-aware graph generation network that learns the implicit global relations among the scene components and infers the location of a new building unit. The proposed network takes as input the scene graph and the corresponding top-view depth image. It provides the location recommendations for a newly-added building units by learning an auto-regressive edge distribution conditioned on existing scenes. We also introduce a global graph-image matching loss to enhance the awareness of essential geometry semantics of the site. Qualitative and quantitative experiments demonstrate that the recommended location well reflects the implicit spatial rules of components in the residential estates, and it is instructive and practical to locate the building units in the 3D scene of the complex construction.

preprint2021arXiv

Resolving Two Distinct Thermal X-ray Components in A compound Solar Flare

X-ray emission provides the most direct diagnostics of the energy-release process in solar flares. Occasionally, a superhot X-ray source is found to be above hot flare loops of ~10 MK temperature. While the origin of the superhot plasma is still elusive, it has conjured up an intriguing image of in-situ plasma heating near the reconnection site high above the flare loops, in contrast to the conventional picture of chromospheric evaporation. Here we investigate an extremely long-duration solar flare, in which EUV images show two distinct flare loop systems that appear successively along a Gamma-shaped polarity inversion line (PIL). When both flare loop systems are present, the HXR spectrum is found to be well fitted by combining a hot component (Te ~12 MK) and a superhot component (Te ~30 MK). Associated with a fast CME, the superhot X-ray source is located at top of the flare arcade that appears earlier, straddling and extending along the long "arm" of the Gamma-shaped PIL. Associated with a slow CME, the hot X-ray source is located at the top of the flare arcade that appears later and sits astride the short "arm" of the Gamma-shaped PIL. Aided by observations from a different viewing angle, we are able to verify that the superhot X-ray source is above the hot one in projection, but the two sources belong to different flare loop systems. Thus, this case study provides a stereoscopic observation explaining the co-existence of superhot and hot X-ray emitting plasmas in solar flares.

preprint2020arXiv

Magnetic Flux of Active Regions Determining the Eruptive Character of Large Solar Flares

We establish the largest eruptive/confined flare database to date and analyze 322 flares of \emph{GOES} class M1.0 and larger that occurred during 2010$-$2019, i.e., almost spanning the entire solar cycle 24. We find that the total unsigned magnetic flux ($Φ$$_{AR}$) of active regions (ARs) is a key parameter in governing the eruptive character of large flares, with the proportion of eruptive flares exhibiting a strong anti-correlation with $Φ$$_{AR}$. This means that an AR containing a large magnetic flux has a lower probability for the large flares it produces to be associated with a coronal mass ejection (CME). This finding is supported by the high positive correlation we obtained between the critical decay index height and $Φ$$_{AR}$, implying that ARs with a larger $Φ$$_{AR}$ have a stronger magnetic confinement. Moreover, the confined flares originating from ARs larger than 1.0$\times$$10^{23}$ Mx have several characteristics in common: stable filament, slipping magnetic reconnection and strongly sheared post-flare loops. Our findings reveal new relations between the magnetic flux of ARs and the occurrence of CMEs in association with large flares. These relations obtained here provide quantitative criteria for forecasting CMEs and adverse space weather, and have also important implications for "superflares" on solar-type stars and stellar CMEs. The link of database is https://doi.org/10.12149/101030.

preprint2020arXiv

Quality Control of Neuron Reconstruction Based on Deep Learning

Neuron reconstruction is essential to generate exquisite neuron connectivity map for understanding brain function. Despite the significant amount of effect that has been made on automatic reconstruction methods, manual tracing by well-trained human annotators is still necessary. To ensure the quality of reconstructed neurons and provide guidance for annotators to improve their efficiency, we propose a deep learning based quality control method for neuron reconstruction in this paper. By formulating the quality control problem into a binary classification task regarding each single point, the proposed approach overcomes the technical difficulties resulting from the large image size and complex neuron morphology. Not only it provides the evaluation of reconstruction quality, but also can locate exactly where the wrong tracing begins. This work presents one of the first comprehensive studies for whole-brain scale quality control of neuron reconstructions. Experiments on five-fold cross validation with a large dataset demonstrate that the proposed approach can detect 74.7% errors with only 1.4% false alerts.

preprint2020arXiv

The Relationship between Chirality, Sense of Rotation, and Hemispheric Preference of Solar Eruptive Filaments

The orientation, chirality, and dynamics of solar eruptive filaments is a key to understanding the magnetic field of coronal mass ejections (CMEs) and therefore to predicting the geoeffectiveness of CMEs arriving at Earth. However, confusion and contention remain over the relationship between the filament chirality, magnetic helicity, and sense of rotation during eruption. To resolve the ambiguity in observations, in this paper, we used stereoscopic observations to determine the rotation direction of filament apex and the method proposed by Chen et al. (2014) to determine the filament chirality. Our sample of 12 eruptive active-region filaments establishes a strong one-to-one relationship, i.e., during the eruption, sinistral/dextral filaments (located in the southern/northern hemisphere) rotate clockwise/counterclockwise when viewed from above, and corroborates a weak hemispheric preference, i.e., a filament and related sigmoid both exhibit a forward (reverse) S shape in the southern (northern) hemisphere, which suggests that the sigmoidal filament is associated with a low-lying magnetic flux rope with its axis dipped in the middle. As a result of rotation, the projected S shape of a filament is anticipated to be reversed during eruption.