Source author record

Jian-Xun Wang

Jian-Xun Wang appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

10works
12topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

10 published item(s)

preprint2023arXiv

DiffHybrid-UQ: Uncertainty Quantification for Differentiable Hybrid Neural Modeling

The hybrid neural differentiable models mark a significant advancement in the field of scientific machine learning. These models, integrating numerical representations of known physics into deep neural networks, offer enhanced predictive capabilities and show great potential for data-driven modeling of complex physical systems. However, a critical and yet unaddressed challenge lies in the quantification of inherent uncertainties stemming from multiple sources. Addressing this gap, we introduce a novel method, DiffHybrid-UQ, for effective and efficient uncertainty propagation and estimation in hybrid neural differentiable models, leveraging the strengths of deep ensemble Bayesian learning and nonlinear transformations. Specifically, our approach effectively discerns and quantifies both aleatoric uncertainties, arising from data noise, and epistemic uncertainties, resulting from model-form discrepancies and data sparsity. This is achieved within a Bayesian model averaging framework, where aleatoric uncertainties are modeled through hybrid neural models. The unscented transformation plays a pivotal role in enabling the flow of these uncertainties through the nonlinear functions within the hybrid model. In contrast, epistemic uncertainties are estimated using an ensemble of stochastic gradient descent (SGD) trajectories. This approach offers a practical approximation to the posterior distribution of both the network parameters and the physical parameters. Notably, the DiffHybrid-UQ framework is designed for simplicity in implementation and high scalability, making it suitable for parallel computing environments. The merits of the proposed method have been demonstrated through problems governed by both ordinary and partial differentiable equations.

preprint2022arXiv

Deep learning-based surrogate model for 3-D patient-specific computational fluid dynamics

Optimization and uncertainty quantification have been playing an increasingly important role in computational hemodynamics. However, existing methods based on principled modeling and classic numerical techniques have faced significant challenges, particularly when it comes to complex 3D patient-specific shapes in the real world. First, it is notoriously challenging to parameterize the input space of arbitrarily complex 3-D geometries. Second, the process often involves massive forward simulations, which are extremely computationally demanding or even infeasible. We propose a novel deep learning surrogate modeling solution to address these challenges and enable rapid hemodynamic predictions. Specifically, a statistical generative model for 3-D patient-specific shapes is developed based on a small set of baseline patient-specific geometries. An unsupervised shape correspondence solution is used to enable geometric morphing and scalable shape synthesis statistically. Moreover, a simulation routine is developed for automatic data generation by automatic meshing, boundary setting, simulation, and post-processing. An efficient supervised learning solution is proposed to map the geometric inputs to the hemodynamics predictions in latent spaces. Numerical studies on aortic flows are conducted to demonstrate the effectiveness and merit of the proposed techniques.

preprint2022arXiv

Physics-Informed Deep Learning for Solving Phonon Boltzmann Transport Equation with Large Temperature Non-Equilibrium

Phonon Boltzmann transport equation (BTE) is a key tool for modeling multiscale phonon transport, which is critical to the thermal management of miniaturized integrated circuits, but assumptions about the system temperatures (i.e., small temperature gradients) are usually made to ensure that it is computationally tractable. To include the effects of large temperature non-equilibrium, we demonstrate a data-free deep learning scheme, physics-informed neural network (PINN), for solving stationary, mode-resolved phonon BTE with arbitrary temperature gradients. This scheme uses the temperature-dependent phonon relaxation times and learns the solutions in parameterized spaces with both length scale and temperature gradient treated as input variables. Numerical experiments suggest that the proposed PINN can accurately predict phonon transport (from 1D to 3D) under arbitrary temperature gradients. Moreover, the proposed scheme shows great promise in simulating device-level phonon heat conduction efficiently and can be potentially used for thermal design.

preprint2022arXiv

Physics-informed Deep Super-resolution for Spatiotemporal Data

High-fidelity simulation of complex physical systems is exorbitantly expensive and inaccessible across spatiotemporal scales. Recently, there has been an increasing interest in leveraging deep learning to augment scientific data based on the coarse-grained simulations, which is of cheap computational expense and retains satisfactory solution accuracy. However, the major existing work focuses on data-driven approaches which rely on rich training datasets and lack sufficient physical constraints. To this end, we propose a novel and efficient spatiotemporal super-resolution framework via physics-informed learning, inspired by the independence between temporal and spatial derivatives in partial differential equations (PDEs). The general principle is to leverage the temporal interpolation for flow estimation, and then introduce convolutional-recurrent neural networks for learning temporal refinement. Furthermore, we employ the stacked residual blocks with wide activation and sub-pixel layers with pixelshuffle for spatial reconstruction, where feature extraction is conducted in a low-resolution latent space. Moreover, we consider hard imposition of boundary conditions in the network to improve reconstruction accuracy. Results demonstrate the superior effectiveness and efficiency of the proposed method compared with baseline algorithms through extensive numerical experiments.

preprint2022arXiv

Predicting Physics in Mesh-reduced Space with Temporal Attention

Graph-based next-step prediction models have recently been very successful in modeling complex high-dimensional physical systems on irregular meshes. However, due to their short temporal attention span, these models suffer from error accumulation and drift. In this paper, we propose a new method that captures long-term dependencies through a transformer-style temporal attention model. We introduce an encoder-decoder structure to summarize features and create a compact mesh representation of the system state, to allow the temporal model to operate on a low-dimensional mesh representations in a memory efficient manner. Our method outperforms a competitive GNN baseline on several complex fluid dynamics prediction tasks, from sonic shocks to vascular flow. We demonstrate stable rollouts without the need for training noise and show perfectly phase-stable predictions even for very long sequences. More broadly, we believe our approach paves the way to bringing the benefits of attention-based sequence models to solving high-dimensional complex physics tasks.

preprint2021arXiv

Physics-informed graph neural Galerkin networks: A unified framework for solving PDE-governed forward and inverse problems

Despite the great promise of the physics-informed neural networks (PINNs) in solving forward and inverse problems, several technical challenges are present as roadblocks for more complex and realistic applications. First, most existing PINNs are based on point-wise formulation with fully-connected networks to learn continuous functions, which suffer from poor scalability and hard boundary enforcement. Second, the infinite search space over-complicates the non-convex optimization for network training. Third, although the convolutional neural network (CNN)-based discrete learning can significantly improve training efficiency, CNNs struggle to handle irregular geometries with unstructured meshes. To properly address these challenges, we present a novel discrete PINN framework based on graph convolutional network (GCN) and variational structure of PDE to solve forward and inverse partial differential equations (PDEs) in a unified manner. The use of a piecewise polynomial basis can reduce the dimension of search space and facilitate training and convergence. Without the need of tuning penalty parameters in classic PINNs, the proposed method can strictly impose boundary conditions and assimilate sparse data in both forward and inverse settings. The flexibility of GCNs is leveraged for irregular geometries with unstructured meshes. The effectiveness and merit of the proposed method are demonstrated over a variety of forward and inverse computational mechanics problems governed by both linear and nonlinear PDEs.

preprint2020arXiv

Non-intrusive model reduction of large-scale, nonlinear dynamical systems using deep learning

Projection-based model reduction has become a popular approach to reduce the cost associated with integrating large-scale dynamical systems so they can be used in many-query settings such as optimization and uncertainty quantification. For nonlinear systems, significant cost reduction is only possible with an additional layer of approximation to reduce the computational bottleneck of evaluating the projected nonlinear terms. Prevailing methods to approximate the nonlinear terms are code intrusive, potentially requiring years of development time to integrate into an existing codebase, and have been known to lack parametric robustness. This work develops a non-intrusive method to efficiently and accurately approximate the expensive nonlinear terms that arise in reduced nonlinear dynamical system using deep neural networks. The neural network is trained using only the simulation data used to construct the reduced basis and evaluations of the nonlinear terms at these snapshots. Once trained, the neural network-based reduced-order model only requires forward and backward propagation through the network to evaluate the nonlinear term and its derivative, which are used to integrate the reduced dynamical system at a new parameter configuration. We provide two numerical experiments---the dynamical systems result from the semi-discretization of parametrized, nonlinear, hyperbolic partial differential equations---that show, in addition to non-intrusivity, the proposed approach provides more stable and accurate approximations to each dynamical system across a large number of training and testing points than the popular empirical interpolation method.

preprint2020arXiv

Physics-Constrained Bayesian Neural Network for Fluid Flow Reconstruction with Sparse and Noisy Data

In many applications, flow measurements are usually sparse and possibly noisy. The reconstruction of a high-resolution flow field from limited and imperfect flow information is significant yet challenging. In this work, we propose an innovative physics-constrained Bayesian deep learning approach to reconstruct flow fields from sparse, noisy velocity data, where equation-based constraints are imposed through the likelihood function and uncertainty of the reconstructed flow can be estimated. Specifically, a Bayesian deep neural network is trained on sparse measurement data to capture the flow field. In the meantime, the violation of physical laws will be penalized on a large number of spatiotemporal points where measurements are not available. A non-parametric variational inference approach is applied to enable efficient physics-constrained Bayesian learning. Several test cases on idealized vascular flows with synthetic measurement data are studied to demonstrate the merit of the proposed method.

preprint2016arXiv

Inversion of Tsunamis Characteristics from Sediment Deposits Based on Ensemble Kalman Filtering

Sediment deposits are the only leftover records from paleo tsunami events. Therefore, inverse modeling method based on the information contained in the deposit is an indispensable way of deciphering the quantitative characteristics of the tsunamis, e.g., the flow speed and the flow depth. While several models have been proposed to perform tsunami inversion, i.e., to infer the tsunami characteristics based on the sediment deposits, the existing methods lack mathematical rigorousness and are not able to account for uncertainties in the inferred quantities. In this work, we propose an inversion scheme based on Ensemble Kalman Filtering (EnKF) to infer tsunami characteristics from sediment deposits. In contrast to traditional data assimilation methods using EnKF, a novelty of the current work is that we augment the system state to include both the physical variables (sediment fluxes) that are observable and the unknown parameters (flow speed and flow depth) to be inferred. Based on the rigorous Bayesian inference theory, the inversion scheme provides quantified uncertainties on the inferred quantities, which clearly distinguishes the present method with existing schemes for tsunami inversion. Two test cases with synthetic observation data are used to verify the proposed inversion scheme. Numerical results show that the tsunami characteristics inferred from the sediment deposit information have a favorable agreement with the truths, which demonstrated the merits of the proposed tsunami inversion scheme.

preprint2016arXiv

Quantifying Model Form Uncertainty in RANS Simulation of Wing-Body Junction Flow

Wing-body junction flows occur when a boundary layer encounters an airfoil mounted on the surface. The corner flow near the trailing edge is challenging for the linear eddy viscosity Reynolds Averaged Navier-Stokes (RANS) models, due to the interaction of two perpendicular boundary layers which leads to highly anisotropic Reynolds stress at the near wall region. Recently, Xiao et al. proposed a physics-informed Bayesian framework to quantify and reduce the model-form uncertainties in RANS simulations by utilizing sparse observation data. In this work, we extend this framework to incorporate the use of wall function in RANS simulations, and apply the extended framework to the RANS simulation of wing-body junction flow. Standard RANS simulations are performed on a 3:2 elliptic nose and NACA0020 tail cylinder joined at their maximum thickness location. Current results show that both the posterior mean velocity and the Reynolds stress anisotropy show better agreement with the experimental data at the corner region near the trailing edge. On the other hand, the prior velocity profiles at the leading edge indicate the restriction of uncertainty space and the performance of the framework at this region is less effective. By perturbing the orientation of Reynolds stress, the uncertainty range of prior velocity profiles at the leading edge covers the experimental data. It indicates that the uncertainty of RANS predicted velocity field is more related to the uncertainty in the orientation of Reynolds stress at the region with rapid change of mean strain rate. The present work not only demonstrates the capability of Bayesian framework in improving the RANS simulation of wing-body junction flow, but also reveals the major source of model-form uncertainty for this flow, which can be useful in assisting RANS modeling.