Researcher profile

Jianfeng Zhang

Jianfeng Zhang contributes to research discovery and scholarly infrastructure.

ResearcherAffiliation not importedOpen to collaborate

Trust snapshot

Quick read

Trust 21 - EmergingVerification L1Unclaimed author
14works
0followers
11topics
4close collaborators

Actions

Decide how to stay connected

Follow researcher0

Identity and collaboration

How to connect with this researcher

Claiming links this public author record to a researcher profile and unlocks direct collaboration workflows.

Log in to claim

Direct collaboration

Open a focused conversation when the fit is right

Claim this author entity first to unlock direct invitations.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

14 published item(s)

preprint2023arXiv

Dynamic programming equation for the mean field optimal stopping problem

We study the optimal stopping problem of McKean-Vlasov diffusions when the criterion is a function of the law of the stopped process. A remarkable new feature in this setting is that the stopping time also impacts the dynamics of the stopped process through the dependence of the coefficients on the law. The mean field stopping problem is introduced in weak formulation in terms of the joint marginal law of the stopped underlying process and the survival process. This specification satisfies a dynamic programming principle. The corresponding dynamic programming equation is an obstacle problem on the Wasserstein space, and is obtained by means of a general Itô formula for flows of marginal laws of càdlàg semimartingales. Our verification result characterizes the nature of optimal stopping policies, highlighting the crucial need to randomized stopping. The effectiveness of our dynamic programming equation is illustrated by various examples including the mean-variance optimal stopping problem.

preprint2022arXiv

A New Probabilistic V-Net Model with Hierarchical Spatial Feature Transform for Efficient Abdominal Multi-Organ Segmentation

Accurate and robust abdominal multi-organ segmentation from CT imaging of different modalities is a challenging task due to complex inter- and intra-organ shape and appearance variations among abdominal organs. In this paper, we propose a probabilistic multi-organ segmentation network with hierarchical spatial-wise feature modulation to capture flexible organ semantic variants and inject the learnt variants into different scales of feature maps for guiding segmentation. More specifically, we design an input decomposition module via a conditional variational auto-encoder to learn organ-specific distributions on the low dimensional latent space and model richer organ semantic variations that is conditioned on input images.Then by integrating these learned variations into the V-Net decoder hierarchically via spatial feature transformation, which has the ability to convert the variations into conditional Affine transformation parameters for spatial-wise feature maps modulating and guiding the fine-scale segmentation. The proposed method is trained on the publicly available AbdomenCT-1K dataset and evaluated on two other open datasets, i.e., 100 challenging/pathological testing patient cases from AbdomenCT-1K fully-supervised abdominal organ segmentation benchmark and 90 cases from TCIA+&BTCV dataset. Highly competitive or superior quantitative segmentation results have been achieved using these datasets for four abdominal organs of liver, kidney, spleen and pancreas with reported Dice scores improved by 7.3% for kidneys and 9.7% for pancreas, while being ~7 times faster than two strong baseline segmentation methods(nnUNet and CoTr).

preprint2022arXiv

AvatarGen: a 3D Generative Model for Animatable Human Avatars

Unsupervised generation of clothed virtual humans with various appearance and animatable poses is important for creating 3D human avatars and other AR/VR applications. Existing methods are either limited to rigid object modeling, or not generative and thus unable to synthesize high-quality virtual humans and animate them. In this work, we propose AvatarGen, the first method that enables not only non-rigid human generation with diverse appearance but also full control over poses and viewpoints, while only requiring 2D images for training. Specifically, it extends the recent 3D GANs to clothed human generation by utilizing a coarse human body model as a proxy to warp the observation space into a standard avatar under a canonical space. To model non-rigid dynamics, it introduces a deformation network to learn pose-dependent deformations in the canonical space. To improve geometry quality of the generated human avatars, it leverages signed distance field as geometric representation, which allows more direct regularization from the body model on the geometry learning. Benefiting from these designs, our method can generate animatable human avatars with high-quality appearance and geometry modeling, significantly outperforming previous 3D GANs. Furthermore, it is competent for many applications, e.g., single-view reconstruction, reanimation, and text-guided synthesis. Code and pre-trained model will be available.

preprint2022arXiv

Geometry-Guided Progressive NeRF for Generalizable and Efficient Neural Human Rendering

In this work we develop a generalizable and efficient Neural Radiance Field (NeRF) pipeline for high-fidelity free-viewpoint human body synthesis under settings with sparse camera views. Though existing NeRF-based methods can synthesize rather realistic details for human body, they tend to produce poor results when the input has self-occlusion, especially for unseen humans under sparse views. Moreover, these methods often require a large number of sampling points for rendering, which leads to low efficiency and limits their real-world applicability. To address these challenges, we propose a Geometry-guided Progressive NeRF (GP-NeRF). In particular, to better tackle self-occlusion, we devise a geometry-guided multi-view feature integration approach that utilizes the estimated geometry prior to integrate the incomplete information from input views and construct a complete geometry volume for the target human body. Meanwhile, for achieving higher rendering efficiency, we introduce a progressive rendering pipeline through geometry guidance, which leverages the geometric feature volume and the predicted density values to progressively reduce the number of sampling points and speed up the rendering process. Experiments on the ZJU-MoCap and THUman datasets show that our method outperforms the state-of-the-arts significantly across multiple generalization settings, while the time cost is reduced > 70% via applying our efficient progressive rendering pipeline.

preprint2022arXiv

Mean Field Games Master Equations with Non-separable Hamiltonians and Displacement Monotonicity

In this manuscript, we propose a structural condition on non-separable Hamiltonians, which we term displacement monotonicity condition, to study second order mean field games master equations. A rate of dissipation of a bilinear form is brought to bear a global (in time) well-posedness theory, based on a--priori uniform Lipschitz estimates on the solution in the measure variable. Displacement monotonicity being sometimes in dichotomy with the widely used Lasry-Lions monotonicity condition, the novelties of this work persist even when restricted to separable Hamiltonians.

preprint2022arXiv

Mean Field Games of Controls: Propagation of Monotonicities

The theory of Mean Field Game of Controls considers a class of mean field games where the interaction is through the joint distribution of the state and control. It is well known that, for standard mean field games, certain monotonicity condition is crucial to guarantee the uniqueness of mean field equilibria and then the global wellposedness for master equations. In the literature, the monotonicity condition could be the Lasry-Lions monotonicity, the displacement monotonicity, or the anti-monotonicity conditions. In this paper, we investigate all these three types of monotonicity conditions for Mean Field Games of Controls and show their propagation along the solutions to the master equations with common noises. In particular, we extend the displacement monotonicity to semi-monotonicity, whose propagation result is new even for standard mean field games. This is the first step towards the global wellposedness theory for master equations of Mean Field Games of Controls.

preprint2022arXiv

PoseTriplet: Co-evolving 3D Human Pose Estimation, Imitation, and Hallucination under Self-supervision

Existing self-supervised 3D human pose estimation schemes have largely relied on weak supervisions like consistency loss to guide the learning, which, inevitably, leads to inferior results in real-world scenarios with unseen poses. In this paper, we propose a novel self-supervised approach that allows us to explicitly generate 2D-3D pose pairs for augmenting supervision, through a self-enhancing dual-loop learning framework. This is made possible via introducing a reinforcement-learning-based imitator, which is learned jointly with a pose estimator alongside a pose hallucinator; the three components form two loops during the training process, complementing and strengthening one another. Specifically, the pose estimator transforms an input 2D pose sequence to a low-fidelity 3D output, which is then enhanced by the imitator that enforces physical constraints. The refined 3D poses are subsequently fed to the hallucinator for producing even more diverse data, which are, in turn, strengthened by the imitator and further utilized to train the pose estimator. Such a co-evolution scheme, in practice, enables training a pose estimator on self-generated motion data without relying on any given 3D data. Extensive experiments across various benchmarks demonstrate that our approach yields encouraging results significantly outperforming the state of the art and, in some cases, even on par with results of fully-supervised methods. Notably, it achieves 89.1% 3D PCK on MPI-INF-3DHP under self-supervised cross-dataset evaluation setup, improving upon the previous best self-supervised methods by 8.6%. Code can be found at: https://github.com/Garfield-kh/PoseTriplet

preprint2022arXiv

Wellposedness of Second Order Master Equations for Mean Field Games with Nonsmooth Data

In this paper we study second order master equations arising from mean field games with common noise over arbitrary time duration. A classical solution typically requires the monotonicity condition (or small time duration) and sufficiently smooth data. While keeping the monotonicity condition, our goal is to relax the regularity of the data, which is an open problem in the literature. In particular, we do not require any differentiability in terms of the measures, which prevents us from obtaining classical solutions. We shall propose three weaker notions of solutions, named as {\it good solutions}, {\it weak solutions}, and {\it weak-viscosity solutions}, respectively, and establish the wellposedness of the master equation under all three notions. We emphasize that, due to the game nature, one cannot expect comparison principle even for classical solutions. The key for the global (in time) wellposedness is the uniform a priori estimate for the Lipschitz continuity of the solution in the measures. The monotonicity condition is crucial for this uniform estimate and thus is crucial for the existence of the global solution, but is not needed for the uniqueness in such Lipschitz class. To facilitate our analysis, we construct a smooth mollifier for functions on Wasserstein space, which is new in the literature and is interesting in its own right. Following the same approach of our wellposedness results, we prove the convergence of the Nash system, a high dimensional system of PDEs arising from the corresponding $N$-player game, under mild regularity requirements. We shall also prove a propagation of chaos property for the associated optimal trajectories.

preprint2021arXiv

Non-Equivalence of Stochastic Optimal Control Problems with Open and Closed Loop Controls

For an optimal control problem of an Itô's type stochastic differential equation, the control process could be taken as open-loop or closed-loop forms. In the standard literature, provided appropriate regularity, the value functions under these two types of controls are equal and are the unique (viscosity) solution to the corresponding (path-dependent) HJB equation. In this short note, we provide a counterexample in the path dependent setting showing that these value functions can be different in general.

preprint2021arXiv

Path Dependent Feynman-Kac Formula for Forward Backward Stochastic Volterra Integral Equations

This paper is concerned with the relationship between forward-backward stochastic Volterra integral equations (FBSVIEs, for short) and a system of (non-local in time) path dependent partial differential equations (PPDEs, for short). Due to the nature of Volterra type equations, the usual flow property (or semigroup property) does not hold. Inspired by Viens-Zhang \cite{Viens-Zhang-2019} and Wang-Yong \cite{Wang-Yong-2019}, auxiliary processes are introduced so that the flow property of adapted solutions to the FBSVIEs is recovered in a suitable sense, and thus the functional Itô's formula is applicable. Having achieved this stage, a natural PPDE is found so that the adapted solution of the backward SVIEs admits a representation in terms of the solution to the forward SVIE via the solution to a PPDE. On the other hand, the solution of the PPDE admits a representation in terms of adapted solution to the (path dependent) FBSVIE, which is referred to as a Feynman-Kac formula. This leads to the existence and uniqueness of a classical solution to the PPDE, under smoothness conditions on the coefficients of the FBSVIEs. Further, when the smoothness conditions are relaxed with the backward component of FBSVIE being one-dimensional, a new (and suitable) notion of viscosity solution is introduced for the PPDE, for which a comparison principle of the viscosity solutions is established, leading to the uniqueness of the viscosity solution. Finally, some results have been extended to coupled FBSVIEs and type-II BSVIEs, and a representation formula for the path derivatives of PPDE solution is obtained by a closer investigation of linear FBSVIEs.

preprint2021arXiv

Pressure induced superconductivity in WB2 and ReB2 through modifying the B layers

The recent discovery of superconductivity up to 32 K in the pressurized MoB2 reignites the interests in exploring high-Tc superconductors in transition-metal diborides. Inspired by that work, we turn our attention to the 5d transition-metal diborides. Here we systematically investigate the responses of both structural and physical properties of WB2 and ReB2 to external pressure, which possess different types of boron layers. Similar to MoB2, the pressure-induced superconductivity was also observed in WB2 above 60 GPa with a maximum Tc of 15 K at 100 GPa, while no superconductivity was detected in ReB2 in this pressure range. Interestingly, the structures at ambient pressure for both WB2 and ReB2 persist to high pressure without structural phase transitions. Theoretical calculations suggest that the ratio of flat boron layers in this class of transition-metal diborides may be crucial for the appearance of high Tc. The combined theoretical and experimental results highlight the effect of geometry of boron layers on superconductivity and shed light on the exploration of novel high-Tc superconductors in borides.

preprint2020arXiv

Dynamic Set Values for Nonzero Sum Games with Multiple Equilibriums

Nonzero sum games typically have multiple Nash equilibriums (or no equilibrium), and unlike the zero sum case, they may have different values at different equilibriums. Instead of focusing on the existence of individual equilibriums, we study the set of values over all equilibriums, which we call the set value of the game. The set value is unique by nature and always exists (with possible value $\emptyset$). Similar to the standard value function in control literature, it enjoys many nice properties such as regularity, stability, and more importantly the dynamic programming principle. There are two main features in order to obtain the dynamic programming principle: (i) we must use closed-loop controls (instead of open-loop controls); (ii) we must allow for path dependent controls, even if the problem is in a state dependent (Markovian) setting. We shall consider both discrete and continuous time models with finite time horizon. For the latter we will also provide a duality approach through certain standard PDE (or path dependent PDE), which is quite efficient for numerically computing the set value of the game.

preprint2020arXiv

Inference Stage Optimization for Cross-scenario 3D Human Pose Estimation

Existing 3D human pose estimation models suffer performance drop when applying to new scenarios with unseen poses due to their limited generalizability. In this work, we propose a novel framework, Inference Stage Optimization (ISO), for improving the generalizability of 3D pose models when source and target data come from different pose distributions. Our main insight is that the target data, even though not labeled, carry valuable priors about their underlying distribution. To exploit such information, the proposed ISO performs geometry-aware self-supervised learning (SSL) on each single target instance and updates the 3D pose model before making prediction. In this way, the model can mine distributional knowledge about the target scenario and quickly adapt to it with enhanced generalization performance. In addition, to handle sequential target data, we propose an online mode for implementing our ISO framework via streaming the SSL, which substantially enhances its effectiveness. We systematically analyze why and how our ISO framework works on diverse benchmarks under cross-scenario setup. Remarkably, it yields new state-of-the-art of 83.6% 3D PCK on MPI-INF-3DHP, improving upon the previous best result by 9.7%. Code will be released.

preprint2020arXiv

Time-consistent conditional expectation under probability distortion

We introduce a new notion of conditional nonlinear expectation under probability distortion. Such a distorted nonlinear expectation is not sub-additive in general, so it is beyond the scope of Peng's framework of nonlinear expectations. A more fundamental problem when extending the distorted expectation to a dynamic setting is time-inconsistency, that is, the usual "tower property" fails. By localizing the probability distortion and restricting to a smaller class of random variables, we introduce a so-called distorted probability and construct a conditional expectation in such a way that it coincides with the original nonlinear expectation at time zero, but has a time-consistent dynamics in the sense that the tower property remains valid. Furthermore, we show that in the continuous time model this conditional expectation corresponds to a parabolic differential equation whose coefficient involves the law of the underlying diffusion. This work is the first step towards a new understanding of nonlinear expectations under probability distortion, and will potentially be a helpful tool for solving time-inconsistent stochastic optimization problems.