Researcher profile

Jinyu Liu

Jinyu Liu contributes to research discovery and scholarly infrastructure.

ResearcherAffiliation not importedOpen to collaborate

Trust snapshot

Quick read

Trust 21 - EmergingVerification L1Unclaimed author
7works
0followers
8topics
4close collaborators

Actions

Decide how to stay connected

Follow researcher0

Identity and collaboration

How to connect with this researcher

Claiming links this public author record to a researcher profile and unlocks direct collaboration workflows.

Log in to claim

Direct collaboration

Open a focused conversation when the fit is right

Claim this author entity first to unlock direct invitations.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

7 published item(s)

preprint2022arXiv

Acoustic-to-articulatory Inversion based on Speech Decomposition and Auxiliary Feature

Acoustic-to-articulatory inversion (AAI) is to obtain the movement of articulators from speech signals. Until now, achieving a speaker-independent AAI remains a challenge given the limited data. Besides, most current works only use audio speech as input, causing an inevitable performance bottleneck. To solve these problems, firstly, we pre-train a speech decomposition network to decompose audio speech into speaker embedding and content embedding as the new personalized speech features to adapt to the speaker-independent case. Secondly, to further improve the AAI, we propose a novel auxiliary feature network to estimate the lip auxiliary features from the above personalized speech features. Experimental results on three public datasets show that, compared with the state-of-the-art only using the audio speech feature, the proposed method reduces the average RMSE by 0.25 and increases the average correlation coefficient by 2.0% in the speaker-dependent case. More importantly, the average RMSE decreases by 0.29 and the average correlation coefficient increases by 5.0% in the speaker-independent case.

preprint2022arXiv

Modality-Aware Contrastive Instance Learning with Self-Distillation for Weakly-Supervised Audio-Visual Violence Detection

Weakly-supervised audio-visual violence detection aims to distinguish snippets containing multimodal violence events with video-level labels. Many prior works perform audio-visual integration and interaction in an early or intermediate manner, yet overlooking the modality heterogeneousness over the weakly-supervised setting. In this paper, we analyze the modality asynchrony and undifferentiated instances phenomena of the multiple instance learning (MIL) procedure, and further investigate its negative impact on weakly-supervised audio-visual learning. To address these issues, we propose a modality-aware contrastive instance learning with self-distillation (MACIL-SD) strategy. Specifically, we leverage a lightweight two-stream network to generate audio and visual bags, in which unimodal background, violent, and normal instances are clustered into semi-bags in an unsupervised way. Then audio and visual violent semi-bag representations are assembled as positive pairs, and violent semi-bags are combined with background and normal instances in the opposite modality as contrastive negative pairs. Furthermore, a self-distillation module is applied to transfer unimodal visual knowledge to the audio-visual model, which alleviates noises and closes the semantic gap between unimodal and multimodal features. Experiments show that our framework outperforms previous methods with lower complexity on the large-scale XD-Violence dataset. Results also demonstrate that our proposed approach can be used as plug-in modules to enhance other networks. Codes are available at https://github.com/JustinYuu/MACIL_SD.

preprint2022arXiv

Self-Supervised Video Representation Learning with Motion-Contrastive Perception

Visual-only self-supervised learning has achieved significant improvement in video representation learning. Existing related methods encourage models to learn video representations by utilizing contrastive learning or designing specific pretext tasks. However, some models are likely to focus on the background, which is unimportant for learning video representations. To alleviate this problem, we propose a new view called long-range residual frame to obtain more motion-specific information. Based on this, we propose the Motion-Contrastive Perception Network (MCPNet), which consists of two branches, namely, Motion Information Perception (MIP) and Contrastive Instance Perception (CIP), to learn generic video representations by focusing on the changing areas in videos. Specifically, the MIP branch aims to learn fine-grained motion features, and the CIP branch performs contrastive learning to learn overall semantics information for each instance. Experiments on two benchmark datasets UCF-101 and HMDB-51 show that our method outperforms current state-of-the-art visual-only self-supervised approaches.

preprint2020arXiv

A Néel-type antiferromagnetic order in the spin 1/2 rare-earth honeycomb YbCl$_3$

Most of the searches for Kitaev materials deal with $4d/5d$ magnets with spin-orbit-coupled ${J=1/2}$ local moments such as iridates and $α$-RuCl$_3$. Here we propose the monoclinic YbCl$_3$ with a Yb$^{3+}$ honeycomb lattice for the exploration of Kiteav physics. We perform thermodynamic, $ac$ susceptibility, angle-dependent magnetic torque and neutron diffraction measurements on YbCl$_3$ single crystal. We find that the Yb$^{3+}$ ion exhibits a Kramers doublet ground state that gives rise to an effective spin ${J_{\text{eff}}=1/2}$ local moment. The compound exhibits short-range magnetic order below 1.20 K, followed by a long-range Néel-type antiferromagnetic order at 0.60 K, below which the ordered Yb$^{3+}$ spins lie in the $ac$ plane with an angle of 16(11)$^{\circ}$ away from the $a$ axis. These orders can be suppressed by in-plane and out-of-plane magnetic fields at around 6 and 10 T, respectively. Moreover, the Néel temperature varies non-monotonically under the out-of-plane magnetic fields. The in-plane magnetic anisotropy and the reduced order moment 0.8(1) $μ_B$ at 0.25 K indicate that YbCl$_3$ could be a two-dimensional spin system to proximate the Kitaev physics.

preprint2020arXiv

Quantum oscillation and unusual protection mechanism of the surface state in nonsymmorphic semimetals

In a topological semimetal with Dirac or Weyl points, the bulk edge correspondence principle predicts a gapless edge mode if the essential symmetry is still preserved at the surface. The detection of such topological surface state has been considered as the fingerprint prove for crystals with nontrivial topological bulk band. On the contrary, it has been proposed that even with symmetry broken at the surface, a new surface band can emerge in nonsymmorphic topological semimetals. The symmetry reduction at the surface lifts the bulk band degeneracies, produces an unusual floating surface band with trivial topology. Here, we report quantum transport probing to ZrSiSe thin flakes and reveal transport signatures of this new surface state. Remarkably, though topologically trivial, such a surface band exhibit substantial two dimensional Shubnikov de Haas quantum oscillations with high mobility, which signifies a new protection mechanism and may open applications for surface-related devices.

preprint2020arXiv

Tuning quantum transport by controlling spin reorientations in Dirac semimetal candidates Eu$_{1-x}$Sr$_{x}$MnSb$_{2}$

Magnetic topological semimetals have attracted intense attention recently since these materials carry a great promise for potential applications in novel spintronic devices. Here, we report an intimate interplay between lattice, Eu magnetic order and topological semimetallic behavior in Eu$_{1-x}$Sr$_{x}$MnSb$_{2}$ driven by nonmagnetic Sr doping on magnetic Eu site. Different types of Eu spin reorientations are controllable by the Sr concentration, temperature or magnetic field, and coupled to the quantum transport properties of Dirac fermions generated by the 2D Sb layers. Our study opens a new pathway to achieving exotic magnetic order and topological semimetallic state via controlling spin reorientation. The effective strategy of substituting rare-earth site by nonmagnetic element demonstrated here may be applicable to the AMnCh$_{2}$ (A=rare-earth elements; Ch=Bi/Sb) family and a wide variation of other layered compounds involving spatially separated rare-earth and transition metal layers.

preprint2019arXiv

A van der Waals antiferromagnetic topological insulator with weak interlayer magnetic coupling

Magnetic topological insulators (TI) provide an important material platform to explore quantum phenomena such as quantized anomalous Hall (QAH) effect and Majorana modes, etc. Their successful material realization is thus essential for our fundamental understanding and potential technical revolutions. By realizing a bulk van der Waals material MnBi4Te7 with alternating septuple [MnBi2Te4] and quintuple [Bi2Te3] layers, we show that it is ferromagnetic in plane but antiferromagnetic along the c axis with an out-of-plane saturation field of ~ 0.22 T at 2 K. Our angle-resolved photoemission spectroscopy measurements and first-principles calculations further demonstrate that MnBi4Te7 is a Z2 antiferromagnetic TI with two types of surface states associated with the [MnBi2Te4] or [Bi2Te3] termination, respectively. Additionally, its superlattice nature may make various heterostructures of [MnBi2Te4] and [Bi2Te3] layers possible by exfoliation. Therefore, the low saturation field and the superlattice nature of MnBi4Te7 make it an ideal system to investigate rich emergent phenomena.