Researcher profile

Zhen Zhu

Zhen Zhu contributes to research discovery and scholarly infrastructure.

ResearcherAffiliation not importedOpen to collaborate

Trust snapshot

Quick read

Trust 21 - EmergingVerification L1Unclaimed author
10works
0followers
9topics
4close collaborators

Actions

Decide how to stay connected

Follow researcher0

Identity and collaboration

How to connect with this researcher

Claiming links this public author record to a researcher profile and unlocks direct collaboration workflows.

Log in to claim

Direct collaboration

Open a focused conversation when the fit is right

Claim this author entity first to unlock direct invitations.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

10 published item(s)

preprint2022arXiv

CCPL: Contrastive Coherence Preserving Loss for Versatile Style Transfer

In this paper, we aim to devise a universally versatile style transfer method capable of performing artistic, photo-realistic, and video style transfer jointly, without seeing videos during training. Previous single-frame methods assume a strong constraint on the whole image to maintain temporal consistency, which could be violated in many cases. Instead, we make a mild and reasonable assumption that global inconsistency is dominated by local inconsistencies and devise a generic Contrastive Coherence Preserving Loss (CCPL) applied to local patches. CCPL can preserve the coherence of the content source during style transfer without degrading stylization. Moreover, it owns a neighbor-regulating mechanism, resulting in a vast reduction of local distortions and considerable visual quality improvement. Aside from its superior performance on versatile style transfer, it can be easily extended to other tasks, such as image-to-image translation. Besides, to better fuse content and style features, we propose Simple Covariance Transformation (SCT) to effectively align second-order statistics of the content feature with the style feature. Experiments demonstrate the effectiveness of the resulting model for versatile style transfer, when armed with CCPL.

preprint2022arXiv

MobileFaceSwap: A Lightweight Framework for Video Face Swapping

Advanced face swapping methods have achieved appealing results. However, most of these methods have many parameters and computations, which makes it challenging to apply them in real-time applications or deploy them on edge devices like mobile phones. In this work, we propose a lightweight Identity-aware Dynamic Network (IDN) for subject-agnostic face swapping by dynamically adjusting the model parameters according to the identity information. In particular, we design an efficient Identity Injection Module (IIM) by introducing two dynamic neural network techniques, including the weights prediction and weights modulation. Once the IDN is updated, it can be applied to swap faces given any target image or video. The presented IDN contains only 0.50M parameters and needs 0.33G FLOPs per frame, making it capable for real-time video face swapping on mobile phones. In addition, we introduce a knowledge distillation-based method for stable training, and a loss reweighting module is employed to obtain better synthesized results. Finally, our method achieves comparable results with the teacher models and other state-of-the-art methods.

preprint2022arXiv

Observation of magnetism induced topological edge state in antiferromagnetic topological insulator MnBi4Te7

Breaking time reversal symmetry in a topological insulator may lead to quantum anomalous Hall effect and axion insulator phase. MnBi4Te7 is a recently discovered antiferromagnetic topological insulator with TN ~12.5 K, which is constituted of alternatively stacked magnetic layer (MnBi2Te4) and non-magnetic layer (Bi2Te3). By means of scanning tunneling spectroscopy, we clearly observe the electronic state present at a step edge of a magnetic MnBi2Te4 layer but absent at non-magnetic Bi2Te3 layers at 4.5 K. Furthermore, we find that as the temperature rises above TN, the edge state vanishes, while the point defect induced state persists upon temperature increasing. These results confirm the observation of magnetism induced edge states. Our analysis based on an axion insulator theory reveals that the nontrivial topological nature of the observed edge state.

preprint2021arXiv

FaceController: Controllable Attribute Editing for Face in the Wild

Face attribute editing aims to generate faces with one or multiple desired face attributes manipulated while other details are preserved. Unlike prior works such as GAN inversion, which has an expensive reverse mapping process, we propose a simple feed-forward network to generate high-fidelity manipulated faces. By simply employing some existing and easy-obtainable prior information, our method can control, transfer, and edit diverse attributes of faces in the wild. The proposed method can consequently be applied to various applications such as face swapping, face relighting, and makeup transfer. In our method, we decouple identity, expression, pose, and illumination using 3D priors; separate texture and colors by using region-wise style codes. All the information is embedded into adversarial learning by our identity-style normalization module. Disentanglement losses are proposed to enhance the generator to extract information independently from each attribute. Comprehensive quantitative and qualitative evaluations have been conducted. In a single framework, our method achieves the best or competitive scores on a variety of face applications.

preprint2021arXiv

Sustainable Border Control Policy in the COVID-19 Pandemic: A Math Modeling Study

Imported COVID-19 cases, if unchecked, can jeopardize the effort of domestic containment. We aim to find out what sustainable border control options for different entities (e.g., countries, states) exist during the reopening phases, given their own choice of domestic control measures and new technologies such as contact tracing. We propose a SUIHR model, which represents an extension to the discrete time SIR models. The model focuses on studying the spreading of virus predominantly by asymptomatic and pre-symptomatic patients. Imported risk and (1-tier) contact tracing are both built into the model. Under plausible parameter assumptions, we seek sustainable border control policies, in combination with sufficient internal measures, which allow entities to confine the virus without the need to revert back to more restrictive life styles or to rely on herd immunity. When the base reproduction number of COVID-19 exceeds 2.5, even 100% effective contact tracing alone is not enough to contain the spreading. For an entity that has completely eliminated the virus domestically, and resumes "normal", very strict pre-departure screening and test and isolation upon arrival combined with effective contact tracing can only delay another outbreak by 6 months. However, if the total net imported cases are non-increasing, and the entity employs a confining domestic control policy, then the total new cases can be contained even without border control.

preprint2020arXiv

Counterfactual Learning to Rank using Heterogeneous Treatment Effect Estimation

Learning-to-Rank (LTR) models trained from implicit feedback (e.g. clicks) suffer from inherent biases. A well-known one is the position bias -- documents in top positions are more likely to receive clicks due in part to their position advantages. To unbiasedly learn to rank, existing counterfactual frameworks first estimate the propensity (probability) of missing clicks with intervention data from a small portion of search traffic, and then use inverse propensity score (IPS) to debias LTR algorithms on the whole data set. These approaches often assume the propensity only depends on the position of the document, which may cause high estimation variance in applications where the search context (e.g. query, user) varies frequently. While context-dependent propensity models reduce variance, accurate estimations may require randomization or intervention on a large amount of traffic, which may not be realistic in real-world systems, especially for long tail queries. In this work, we employ heterogeneous treatment effect estimation techniques to estimate position bias when intervention click data is limited. We then use such estimations to debias the observed click distribution and re-draw a new de-biased data set, which can be used for any LTR algorithms. We conduct simulations with varying experiment conditions and show the effectiveness of the proposed method in regimes with long tail queries and sparse clicks.

preprint2020arXiv

Discovery of segmented Fermi surface induced by Cooper pair momentum

Since the early days of Bardeen-Cooper-Schrieffer theory, it has been predicted that a sufficiently large supercurrent can close the energy gap in a superconductor and creates gapless Bogoliubov quasiparticles through the Doppler shift of quasiparticle energy due to the Cooper pair momentum. In this gapless superconducting state, zero-energy quasiparticles reside on a segment of the normal state Fermi surface, while its remaining part is still gapped. The finite density of states of field-induced quasiparticles, known as the Volovik effect, has been observed in tunneling and specific heat measurements on d- and s-wave superconductors. However, the segmented Fermi surface of a finite-momentum state carrying a supercurrent has never been detected directly. Here we use quasiparticle interference (QPI) technique to image field-controlled Fermi surface of Bi$_2$Te$_3$ thin films proximitized by the superconductor NbSe$_2$. By applying a small in-plane magnetic field, a screening supercurrent is induced which leads to finite-momentum pairing on topological surface states of Bi$_2$Te$_3$. Our measurements and analysis reveal the strong impact of finite Cooper pair momentum on the quasiparticle spectrum, and thus pave the way for STM study of pair density wave and FFLO states in unconventional superconductors.

preprint2020arXiv

Semantically Multi-modal Image Synthesis

In this paper, we focus on semantically multi-modal image synthesis (SMIS) task, namely, generating multi-modal images at the semantic level. Previous work seeks to use multiple class-specific generators, constraining its usage in datasets with a small number of classes. We instead propose a novel Group Decreasing Network (GroupDNet) that leverages group convolutions in the generator and progressively decreases the group numbers of the convolutions in the decoder. Consequently, GroupDNet is armed with much more controllability on translating semantic labels to natural images and has plausible high-quality yields for datasets with many classes. Experiments on several challenging datasets demonstrate the superiority of GroupDNet on performing the SMIS task. We also show that GroupDNet is capable of performing a wide range of interesting synthesis applications. Codes and models are available at: https://github.com/Seanseattle/SMIS.

preprint2019arXiv

Highly Mobile Carriers in a Candidate of Quasi-Two-Dimensional Topological Semimetal AuTe$_2$Br

We report the crystal and electronic structures of a non-centrosymmetric quasi-two-dimensional (2D), candidate of topological semimetal AuTe2Br. The Fermi surface of this layered compound consists of 2D-like, topological trivial electron and non-trivial hole pockets which host a Dirac cone along the kz direction. Our transport measurements on the single crystals show highly anisotropic, compensated low-density electrons and holes, both of which exhibit ultrahigh mobility at a level of 10^5cm^2V^-1s^-1 at low temperature. The highly mobile, compensated carriers lead a non-saturated, parabolic magnetoresistance as large as 3*10^5 in single-crystalline AuTe2Br in a magnetic field up to 58 T.

preprint2018arXiv

Non-Stationary Texture Synthesis by Adversarial Expansion

The real world exhibits an abundance of non-stationary textures. Examples include textures with large-scale structures, as well as spatially variant and inhomogeneous textures. While existing example-based texture synthesis methods can cope well with stationary textures, non-stationary textures still pose a considerable challenge, which remains unresolved. In this paper, we propose a new approach for example-based non-stationary texture synthesis. Our approach uses a generative adversarial network (GAN), trained to double the spatial extent of texture blocks extracted from a specific texture exemplar. Once trained, the fully convolutional generator is able to expand the size of the entire exemplar, as well as of any of its sub-blocks. We demonstrate that this conceptually simple approach is highly effective for capturing large-scale structures, as well as other non-stationary attributes of the input exemplar. As a result, it can cope with challenging textures, which, to our knowledge, no other existing method can handle.