Source author record

Hongyi Xu

Hongyi Xu appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

13works
6topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

13 published item(s)

preprint2022arXiv

AvatarGen: a 3D Generative Model for Animatable Human Avatars

Unsupervised generation of clothed virtual humans with various appearance and animatable poses is important for creating 3D human avatars and other AR/VR applications. Existing methods are either limited to rigid object modeling, or not generative and thus unable to synthesize high-quality virtual humans and animate them. In this work, we propose AvatarGen, the first method that enables not only non-rigid human generation with diverse appearance but also full control over poses and viewpoints, while only requiring 2D images for training. Specifically, it extends the recent 3D GANs to clothed human generation by utilizing a coarse human body model as a proxy to warp the observation space into a standard avatar under a canonical space. To model non-rigid dynamics, it introduces a deformation network to learn pose-dependent deformations in the canonical space. To improve geometry quality of the generated human avatars, it leverages signed distance field as geometric representation, which allows more direct regularization from the body model on the geometry learning. Benefiting from these designs, our method can generate animatable human avatars with high-quality appearance and geometry modeling, significantly outperforming previous 3D GANs. Furthermore, it is competent for many applications, e.g., single-view reconstruction, reanimation, and text-guided synthesis. Code and pre-trained model will be available.

preprint2022arXiv

Trajectory Optimization for Physics-Based Reconstruction of 3d Human Pose from Monocular Video

We focus on the task of estimating a physically plausible articulated human motion from monocular video. Existing approaches that do not consider physics often produce temporally inconsistent output with motion artifacts, while state-of-the-art physics-based approaches have either been shown to work only in controlled laboratory conditions or consider simplified body-ground contact limited to feet. This paper explores how these shortcomings can be addressed by directly incorporating a fully-featured physics engine into the pose estimation process. Given an uncontrolled, real-world scene as input, our approach estimates the ground-plane location and the dimensions of the physical body model. It then recovers the physical motion by performing trajectory optimization. The advantage of our formulation is that it readily generalizes to a variety of scenes that might have diverse ground properties and supports any form of self-contact and contact between the articulated body and scene geometry. We show that our approach achieves competitive results with respect to existing physics-based methods on the Human3.6M benchmark, while being directly applicable without re-training to more complex dynamic motions from the AIST benchmark and to uncontrolled internet videos.

preprint2021arXiv

Feature Generation and Hypothesis Verification for Reliable Face Anti-Spoofing

Although existing face anti-spoofing (FAS) methods achieve high accuracy in intra-domain experiments, their effects drop severely in cross-domain scenarios because of poor generalization. Recently, multifarious techniques have been explored, such as domain generalization and representation disentanglement. However, the improvement is still limited by two issues: 1) It is difficult to perfectly map all faces to a shared feature space. If faces from unknown domains are not mapped to the known region in the shared feature space, accidentally inaccurate predictions will be obtained. 2) It is hard to completely consider various spoof traces for disentanglement. In this paper, we propose a Feature Generation and Hypothesis Verification framework to alleviate the two issues. Above all, feature generation networks which generate hypotheses of real faces and known attacks are introduced for the first time in the FAS task. Subsequently, two hypothesis verification modules are applied to judge whether the input face comes from the real-face space and the real-face distribution respectively. Furthermore, some analyses of the relationship between our framework and Bayesian uncertainty estimation are given, which provides theoretical support for reliable defense in unknown domains. Experimental results show our framework achieves promising results and outperforms the state-of-the-art approaches on extensive public datasets.

preprint2020arXiv

InsteaDMatic: Towards cross-platform automated continuous rotation electron diffraction

A DigitalMicrograph script InsteaDMatic has been developed to facilitate rapid automated continuous rotation electron diffraction (cRED) data acquisition. The script coordinates microscope functions, such as stage rotation, camera functions relevant for data collection, and stores the experiment metadata. The script is compatible with any microscope that can be controlled by DigitalMicrograph and has been tested on both JEOL and Thermo Fisher Scientific microscopes. A proof-of-concept has been performed through employing InsteaDMatic for data collection and structure determination of a ZSM-5 zeolite. The influence of illumination settings and electron dose rate on the quality of diffraction data, unit cell determination and structure solution has been investigated in order to optimize the data acquisition procedure.

preprint2020arXiv

Weakly Supervised 3D Human Pose and Shape Reconstruction with Normalizing Flows

Monocular 3D human pose and shape estimation is challenging due to the many degrees of freedom of the human body and thedifficulty to acquire training data for large-scale supervised learning in complex visual scenes. In this paper we present practical semi-supervised and self-supervised models that support training and good generalization in real-world images and video. Our formulation is based on kinematic latent normalizing flow representations and dynamics, as well as differentiable, semantic body part alignment loss functions that support self-supervised learning. In extensive experiments using 3D motion capture datasets like CMU, Human3.6M, 3DPW, or AMASS, as well as image repositories like COCO, we show that the proposed methods outperform the state of the art, supporting the practical construction of an accurate family of models based on large-scale training with diverse and incompletely labeled image and video data.

preprint2016arXiv

Probing topological protection using a designer surface plasmon structure

Topological photonic states, inspired by robust chiral edge states in topological insulators, have recently been demonstrated in a few photonic systems, including an array of coupled on-chip ring resonators at communication wavelengths. However, the intrinsic difference between electrons and photons determines that the topological protection in time-reversal-invariant photonic systems does not share the same robustness as its counterpart in electronic topological insulators. Here, in a designer surface plasmon platform consisting of tunable metallic sub-wavelength structures, we construct photonic topological edge states and probe their robustness against a variety of defect classes, including some common time-reversal-invariant photonic defects that can break the topological protection, but do not exist in electronic topological insulators. This is also the first experimental realization of anomalous Floquet topological edge states, whose topological phase cannot be predicted by the usual Chern number topological invariants.

preprint2016arXiv

Spoof surface plasmon Fabry-Perot open resonators in a surface-wave photonic crystal

We report on the proposal and experimental realization of a spoof surface plasmon Fabry-Perot (FP) open resonator in a surface-wave photonic crystal. This surface-wave FP open resonator is formed by introducing a finite line defect in a surface-wave photonic crystal. The resonance frequencies of the surface-wave FP open resonator lie exactly within the forbidden band gap of the surface-wave photonic crystal and the FP open resonator uses this complete forbidden band gap to concentrate surface waves within a subwavelength cavity. Due to the complete forbidden band gap of the surface-wave photonic crystal, a new FP plasmonic resonance mode that exhibits monopolar features which is missing in traditional FP resonators and plasmonic resonators is demonstrated. Near-field response spectra and mode profiles are presented in the microwave regime to characterize properties of the proposed FP open resonator for spoof surface plasmons.

preprint2016arXiv

Surface-wave photonic quasicrystal

In developing strategies of manipulating surface electromagnetic waves, it has been recently recognized that a complete forbidden band gap can exist in a periodic surface-wave photonic crystal, which has subsequently produced various surface-wave photonic devices. However, it is not obvious whether such a concept can be extended to a non-periodic surface-wave system that lacks translational symmetry. Here we experimentally demonstrate that a surface-wave photonic quasicrystal that lacks periodicity can also exhibit a forbidden band gap for surface electromagnetic waves. The lower cutoff of this forbidden band gap is mainly determined by the maximum separation between nearest neighboring pillars. Point defects within this band gap show distinct properties compared to a periodic photonic crystal for the absence of translational symmetry. A line-defect waveguide, which is crafted out of this surface-wave photonic quasicrystal by shortening a random row of metallic rods, is also demonstrated to guide and bend surface waves around sharp corners along an irregular waveguiding path.

preprint2016arXiv

Translation and Rotation of Transformation Media under Electromagnetic Pulse

It is well known that optical media create artificial geometry for light, and curved geometry acts as an effective optical medium. This correspondence originates from the form invariance of Maxwells equations, which recently has spawned a booming field called transformation optics. Here we investigate responses of three transformation media under electromagnetic pulses, and find that pulse radiation can induce unbalanced net force on transformation media, which will cause translation and rotation of transformation media although their final momentum can still be zero. Therefore, the transformation media do not necessarily stay the same after an electromagnetic wave passes through.

preprint2016arXiv

Tunable band-notched line-defect waveguide in a surface-wave photonic crystal

We propose and experimentally demonstrate a tunable band-notched line-defect waveguide in a surface-wave photonic crystal, which consists of a straight line-defect waveguide and side-coupled defect cavities. A tunable narrow stopband can be observed in the broadband transmission spectra. We also demonstrate that both the filtering levels and filtering frequencies of the band-notched line-defect waveguide can be conveniently tuned through changing the total number and the pillar height of the side-coupled defect cavities. The band-notch function is based on the idea that the propagating surface modes with the resonance frequencies of the side-coupled defect cavities will be tightly localized around the defect sites, being filtered from the waveguide output. Transmission spectra measurements and direct near-field profiles imaging are performed at microwave frequencies to verify our idea and design. These results may enable new band-notched devices design and provide routes for the realization of tunable surface-wave filters on a single metal surface.

preprint2015arXiv

Caustic graphene plasmons with Kelvin angle

A century-long argument made by Lord Kelvin that all swimming objects have an effective Mach number of 3, corresponding to the Kelvin angle of 19.5 degree for ship waves, has been recently challenged with the conclusion that the Kelvin angle should gradually transit to the Mach angle as the ship velocity increases. Here we show that a similar phenomenon can happen for graphene plasmons. By analyzing the caustic wave pattern of graphene plasmons stimulated by a swift charged particle moving uniformly above graphene, we show that at low velocities of the charged particle, the caustics of graphene plasmons form the Kelvin angle. At large velocities of the particle, the caustics disappear and the effective semi-angle of the wave pattern approaches the Mach angle. Our study introduces caustic wave theory to the field of graphene plasmonics, and reveals a novel physical picture of graphene plasmon excitation during electron energy-loss spectroscopy measurement.

preprint2013arXiv

Experimental demonstration of an ultra-thin three-dimensional thermal cloak

We report the first experimental realization of a three-dimensional thermal cloak shielding an air bubble in a bulk metal without disturbing external thermal flux. The cloak is made of a thin layer of homogeneous and isotropic material with specially designed three-dimensional manufacturing. The thickness of cloak is 100 um while the cloaked air bubble has a diameter of 1 cm, achieving the ratio between dimensions of the cloak and the cloaked object two orders smaller than previous thermal cloaks which were mainly realized in a two-dimensional geometry. This work can find applications in novel thermal devices in the three-dimensional physical space.

preprint2011arXiv

Affine nonmagnetic transformation optics and its application to a practical bending adapter design

One of the bottlenecks that limit the transition of transformation-optics devices from concepts to practical use is the non-unit magnetic permeability generally required from a mathematical transformation. Simple renormalization of permeability, as used in many previous designs and experiments, introduces impedance mismatch and thus degrades the functional photonic performance. Here we propose an area-preserving affine coordinate transformation as a general method to solve this problem. Ideal transformation-optics functions can be preserved while nonmagnetism is achieved. As a specific example, we illustrate how to apply this affine method into the design of a two-dimensional electromagnetic beam bending adapter. Concerns related to fabrication, such as anisotropy degree and bending angles, are fully discussed. Our study is a significant step toward practical use of ideal transformation optics devices that can be implemented directly with existing dielectric materials.