Source author record

Heng Xiao

Heng Xiao appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

18works
7topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

18 published item(s)

preprint2022arXiv

A PDE-free, neural network-based eddy viscosity model coupled with RANS equations

Most turbulence models used in Reynolds-averaged Navier-Stokes (RANS) simulations are partial differential equations (PDE) that describe the transport of turbulent quantities. Such quantities include turbulent kinetic energy for eddy viscosity models and the Reynolds stress tensor (or its anisotropy) in differential stress models. However, such models all have limitations in their robustness and accuracy. Inspired by the successes of machine learning in other scientific fields, researchers have developed data-driven turbulence models. Recently, a nonlocal vector-cloud neural network with embedded invariance was proposed, with its capability demonstrated in emulating passive tracer transport in laminar flows. Building upon this success, we use nonlocal neural network mapping to model the transport physics in the k-epsilon model and couple it to RANS solvers, leading to a PDE-free eddy-viscosity model. We demonstrate the robustness and stability of the RANS solver with a neural network-based turbulence model on flows over periodic hills of parameterized geometries. Our work serves as a proof of concept for using a vector-cloud neural network as an alternative to traditional turbulence models in coupled RANS simulations. The success of the coupling paves the way for neural network-based emulation of Reynolds stress transport models.

preprint2022arXiv

Neural Network Based Pore Flow Field Prediction in Porous Media Using Super Resolution

Direct pore-scale simulations of fluid flow through porous media are computationally expensive to perform for realistic systems. Previous works have demonstrated using the geometry of the microstructure of porous media to predict the velocity fields therein based on neural networks. However, such trained neural networks do not perform well for unseen porous media with a large degree of heterogeneity. In this study we propose that incorporating a coarse velocity field in the input of neural networks is an effective way to improve the prediction performance. The coarse velocity field can be simulated with a low computational cost and provides global information to regularize the ill-posedness of the learning problem, which is usually caused by the use of local geometries due to the computational resource constraints. We show that incorporating the coarse-mesh velocity field significantly improves the prediction accuracy of the fine-mesh velocity field by comparison to the prediction that relies on geometric information alone, especially for the porous medium with a large interior vuggy pore space. We also show the flexibility of training the network in using coarse velocity fields with various resolutions. The results suggest that even using coarse velocity field with a very low resolution, the predictions are still enhanced and close to the ground truths. The feasibility of the method is further demonstrated by testing the trained network on real rocks. This study highlights the merits of incorporating a coarse-mesh velocity field into the input for neural networks, which provides global, physics-based information for the model, thereby improving the model's generalization capability.

preprint2021arXiv

Frame invariance and scalability of neural operators for partial differential equations

Partial differential equations (PDEs) play a dominant role in the mathematical modeling of many complex dynamical processes. Solving these PDEs often requires prohibitively high computational costs, especially when multiple evaluations must be made for different parameters or conditions. After training, neural operators can provide PDEs solutions significantly faster than traditional PDE solvers. In this work, invariance properties and computational complexity of two neural operators are examined for transport PDE of a scalar quantity. Neural operator based on graph kernel network (GKN) operates on graph-structured data to incorporate nonlocal dependencies. Here we propose a modified formulation of GKN to achieve frame invariance. Vector cloud neural network (VCNN) is an alternate neural operator with embedded frame invariance which operates on point cloud data. GKN-based neural operator demonstrates slightly better predictive performance compared to VCNN. However, GKN requires an excessively high computational cost that increases quadratically with the increasing number of discretized objects as compared to a linear increase for VCNN.

preprint2021arXiv

Large-eddy simulations of marine boundary-layer clouds associated with cold air outbreaks during the ACTIVATE campaign-part 1: Case setup and sensitivities to large-scale forcings

Large-eddy simulation (LES) is able to capture key boundary-layer (BL) turbulence and cloud processes. Yet, large-scale forcing and surface turbulent fluxes of sensible and latent heat are often poorly prescribed for LES simulations. We derive these quantities from measurements and reanalysis obtained for two cold air outbreak (CAO) events during Phase I of the Aerosol Cloud meTeorology Interactions oVer the western ATlantic Experiment (ACTIVATE) in February-March 2020. We study the two contrasting CAO cases by performing LES and test the sensitivity of BL structure and clouds to large-scale forcings and turbulent heat fluxes. Profiles of atmospheric state and large-scale divergence and surface turbulent heat fluxes obtained from the reanalysis data ERA5 agree reasonably well with those derived from ACTIVATE field measurements for both cases at the sampling time and location. Therefore, we adopt the time evolving heat fluxes, wind and advective tendencies profiles from ERA5 reanalysis data to drive the LES. We find that large-scale thermodynamic advective tendencies and wind relaxations are important for the LES to capture the evolving observed BL meteorological states characterized by the hourly ERA5 reanalysis data and validated by the observations. We show that the divergence (or vertical velocity) is important in regulating the BL growth driven by surface heat fluxes in LES simulations. The evolution of liquid water path is largely affected by the evolution of surface heat fluxes. The liquid water path simulated in LES agrees reasonably well with the ACTIVATE measurements.This study paves the path to investigate aerosol-cloud-meteorology interactions using LES informed and evaluated by ACTIVATE field measurements.

preprint2020arXiv

Convolutional Neural Network for Transition Modeling Based on Linear Stability Theory

Transition prediction is an important aspect of aerodynamic design because of its impact on skin friction and potential coupling with flow separation characteristics. Traditionally, the modeling of transition has relied on correlation-based empirical formulas based on integral quantities such as the shape factor of the boundary layer. However, in many applications of computational fluid dynamics, the shape factor is not straightforwardly available or not well-defined. We propose using the complete velocity profile along with other quantities (e.g., frequency, Reynolds number) to predict the perturbation amplification factor. While this can be achieved with regression models based on a classical fully connected neural network, such a model can be computationally more demanding. We propose a novel convolutional neural network inspired by the underlying physics as described by the stability equations. Specifically, convolutional layers are first used to extract integral quantities from the velocity profiles, and then fully connected layers are used to map the extracted integral quantities, along with frequency and Reynolds number, to the output (amplification ratio). Numerical tests on classical boundary layers clearly demonstrate the merits of the proposed method. More importantly, we demonstrate that, for Tollmien-Schlichting instabilities in two-dimensional, low-speed boundary layers, the proposed network encodes information in the boundary layer profiles into an integral quantity that is strongly correlated to a well-known, physically defined parameter -- the shape factor.

preprint2020arXiv

Evaluation of ensemble methods for quantifying uncertainties in steady-state CFD applications with small ensemble sizes

Bayesian uncertainty quantification (UQ) is of interest to industry and academia as it provides a framework for quantifying and reducing the uncertainty in computational models by incorporating available data. For systems with very high computational costs, for instance, the computational fluid dynamics (CFD) problem, the conventional, exact Bayesian approach such as Markov chain Monte Carlo is intractable. To this end, the ensemble-based Bayesian methods have been used for CFD applications. However, their applicability for UQ has not been fully analyzed and understood thus far. Here, we evaluate the performance of three widely used iterative ensemble-based data assimilation methods, namely ensemble Kalman filter, ensemble randomized maximum likelihood method, and ensemble Kalman filter with multiple data assimilation for UQ problems. We present the derivations of the three ensemble methods from an optimization viewpoint. Further, a scalar case is used to demonstrate the performance of the three different approaches with emphasis on the effects of small ensemble sizes. Finally, we assess the three ensemble methods for quantifying uncertainties in steady-state CFD problems involving turbulent mean flows. Specifically, the Reynolds averaged Navier--Stokes (RANS) equation is considered the forward model, and the uncertainties in the propagated velocity are quantified and reduced by incorporating observation data. The results show that the ensemble methods cannot accurately capture the true posterior distribution, but they can provide a good estimation of the uncertainties even when very limited ensemble sizes are used. Based on the overall performance and efficiency from the comparison, the ensemble randomized maximum likelihood method is identified as the best choice of approximate Bayesian UQ approach~among the three ensemble methods evaluated here.

preprint2020arXiv

Obtaining the mean fields with known Reynolds stresses at steady state

With the rising of modern data science, data--driven turbulence modeling with the aid of machine learning algorithms is becoming a new promising field. Many approaches are able to achieve better Reynolds stress prediction, with much lower modeling error ($ε_M$), than traditional RANS models but they still suffer from numerical error and stability issues when the mean velocity fields are estimated using RANS equations with the predicted Reynolds stresses, illustrating that the error of solving the RANS equations ($ε_P$) is also very important. In the present work, the error $ε_P$ is studied separately by using the Reynolds stresses obtained from direct numerical simulation and we derive the sources of $ε_P$. For the implementations with known Reynolds stresses solely, we suggest to run an adjoint RANS simulation to make first guess on $ν_t^*$ and $S_{ij}^0$. With around 10 iterations, the error could be reduced by about one-order of magnitude in flow over periodic hills. The present work not only provides one robust approach to minimize $ε_P$, which may be very useful for the data-driven turbulence models, but also shows the importance of the nonlinear part of the Reynolds stresses in flow problems with flow separations.

preprint2020arXiv

Regularized Ensemble Kalman Methods for Inverse Problems

Inverse problems are common and important in many applications in computational physics but are inherently ill-posed with many possible model parameters resulting in satisfactory results in the observation space. When solving the inverse problem with adjoint-based optimization, the problem can be regularized by adding additional constraints in the cost function. However, similar regularizations have not been used in ensemble-based methods, where the same optimization is done implicitly through the analysis step rather than through explicit minimization of the cost function. Ensemble-based methods, and in particular ensemble Kalman methods, have gained popularity in practice where physics models typically do not have readily available adjoint capabilities. While the model outputs can be improved by incorporating observations using these methods, the lack of regularization means the inference of the model parameters remains ill-posed. Here we propose a regularized ensemble Kalman method capable of enforcing regularization constraints. Specifically, we derive a modified analysis scheme that implicitly minimizes a cost function with generalized constraints. We demonstrate the method's ability to regularize the inverse problem with three cases of increasing complexity, starting with inferring scalar model parameters. As a final case, we utilize the proposed method to infer the closure field in the Reynolds-averaged Navier--Stokes equations; a problem of significant importance in fluid dynamics and many engineering applications.

preprint2019arXiv

Enforcing Boundary Conditions on Physical Fields in Bayesian Inversion

Inverse problems in computational mechanics consist of inferring physical fields that are latent in the model describing some observable fields. For instance, an inverse problem of interest is inferring the Reynolds stress field in the Navier--Stokes equations describing mean fluid velocity and pressure. The physical nature of the latent fields means they have their own set of physical constraints, including boundary conditions. The inherent ill-posedness of inverse problems, however, means that there exist many possible latent fields that do not satisfy their physical constraints while still resulting in a satisfactory agreement in the observation space. These physical constraints must therefore be enforced through the problem formulation. So far there has been no general approach to enforce boundary conditions on latent fields in inverse problems in computational mechanics, with these constraints often simply ignored. In this work we demonstrate how to enforce boundary conditions in Bayesian inversion problems by choice of the statistical model for the latent fields. Specifically, this is done by modifying the covariance kernel to guarantee that all realizations satisfy known values or derivatives at the boundary. As a test case the problem of inferring the eddy viscosity in the Reynolds-averaged Navier--Stokes equations is considered. The results show that enforcing these constraints results in similar improvements in the output fields but with latent fields that behave as expected at the boundaries.

preprint2019arXiv

Enforcing Statistical Constraints in Generative Adversarial Networks for Modeling Chaotic Dynamical Systems

Simulating complex physical systems often involves solving partial differential equations (PDEs) with some closures due to the presence of multi-scale physics that cannot be fully resolved. Therefore, reliable and accurate closure models for unresolved physics remains an important requirement for many computational physics problems, e.g., turbulence simulation. Recently, several researchers have adopted generative adversarial networks (GANs), a novel paradigm of training machine learning models, to generate solutions of PDEs-governed complex systems without having to numerically solve these PDEs. However, GANs are known to be difficult in training and likely to converge to local minima, where the generated samples do not capture the true statistics of the training data. In this work, we present a statistical constrained generative adversarial network by enforcing constraints of covariance from the training data, which results in an improved machine-learning-based emulator to capture the statistics of the training data generated by solving fully resolved PDEs. We show that such a statistical regularization leads to better performance compared to standard GANs, measured by (1) the constrained model's ability to more faithfully emulate certain physical properties of the system and (2) the significantly reduced (by up to 80%) training time to reach the solution. We exemplify this approach on the Rayleigh-Benard convection, a turbulent flow system that is an idealized model of the Earth's atmosphere. With the growth of high-fidelity simulation databases of physical systems, this work suggests great potential for being an alternative to the explicit modeling of closures or parameterizations for unresolved physics, which are known to be a major source of uncertainty in simulating multi-scale physical systems, e.g., turbulence or Earth's climate.

preprint2016arXiv

CFD-DEM Simulations of Current-Induced Dune Formation and Morphological Evolution

Understanding the fundamental mechanisms of sediment transport, particularly those during the formation and evolution of bedforms, is of critical scientific importance and has engineering relevance. Traditional approaches of sediment transport simulations heavily rely on empirical models, which are not able to capture the physics-rich, regime-dependent behaviors of the process. With the increase of available computational resources in the past decade, CFD-DEM (computational fluid dynamics-discrete element method) has emerged as a viable high-fidelity method for the study of sediment transport. However, a comprehensive, quantitative study of the generation and migration of different sediment bed patterns using CFD-DEM is still lacking. In this work, current-induced sediment transport problems in a wide range of regimes are simulated, including 'flat bed in motion', `small dune', `vortex dune' and suspended transport. Simulations are performed by using SediFoam, an open-source, massively parallel CFD-DEM solver developed by the authors. This is a general-purpose solver for particle-laden flows tailed for particle transport problems. Validation tests are performed to demonstrate the capability of CFD-DEM in the full range of sediment transport regimes. Comparison of simulation results with experimental and numerical benchmark data demonstrates the merits of CFD-DEM approach. In addition, the improvements of the present simulations over existing studies using CFD-DEM are presented. The present solver gives more accurate prediction of sediment transport rate by properly accounting for the influence of particle volume fraction on the fluid flow. In summary, this work demonstrates that CFD-DEM is a promising particle-resolving approach for probing the physics of current-induced sediment transport.

preprint2016arXiv

Inversion of Tsunamis Characteristics from Sediment Deposits Based on Ensemble Kalman Filtering

Sediment deposits are the only leftover records from paleo tsunami events. Therefore, inverse modeling method based on the information contained in the deposit is an indispensable way of deciphering the quantitative characteristics of the tsunamis, e.g., the flow speed and the flow depth. While several models have been proposed to perform tsunami inversion, i.e., to infer the tsunami characteristics based on the sediment deposits, the existing methods lack mathematical rigorousness and are not able to account for uncertainties in the inferred quantities. In this work, we propose an inversion scheme based on Ensemble Kalman Filtering (EnKF) to infer tsunami characteristics from sediment deposits. In contrast to traditional data assimilation methods using EnKF, a novelty of the current work is that we augment the system state to include both the physical variables (sediment fluxes) that are observable and the unknown parameters (flow speed and flow depth) to be inferred. Based on the rigorous Bayesian inference theory, the inversion scheme provides quantified uncertainties on the inferred quantities, which clearly distinguishes the present method with existing schemes for tsunami inversion. Two test cases with synthetic observation data are used to verify the proposed inversion scheme. Numerical results show that the tsunami characteristics inferred from the sediment deposit information have a favorable agreement with the truths, which demonstrated the merits of the proposed tsunami inversion scheme.

preprint2016arXiv

Quantifying Model Form Uncertainty in RANS Simulation of Wing-Body Junction Flow

Wing-body junction flows occur when a boundary layer encounters an airfoil mounted on the surface. The corner flow near the trailing edge is challenging for the linear eddy viscosity Reynolds Averaged Navier-Stokes (RANS) models, due to the interaction of two perpendicular boundary layers which leads to highly anisotropic Reynolds stress at the near wall region. Recently, Xiao et al. proposed a physics-informed Bayesian framework to quantify and reduce the model-form uncertainties in RANS simulations by utilizing sparse observation data. In this work, we extend this framework to incorporate the use of wall function in RANS simulations, and apply the extended framework to the RANS simulation of wing-body junction flow. Standard RANS simulations are performed on a 3:2 elliptic nose and NACA0020 tail cylinder joined at their maximum thickness location. Current results show that both the posterior mean velocity and the Reynolds stress anisotropy show better agreement with the experimental data at the corner region near the trailing edge. On the other hand, the prior velocity profiles at the leading edge indicate the restriction of uncertainty space and the performance of the framework at this region is less effective. By perturbing the orientation of Reynolds stress, the uncertainty range of prior velocity profiles at the leading edge covers the experimental data. It indicates that the uncertainty of RANS predicted velocity field is more related to the uncertainty in the orientation of Reynolds stress at the region with rapid change of mean strain rate. The present work not only demonstrates the capability of Bayesian framework in improving the RANS simulation of wing-body junction flow, but also reveals the major source of model-form uncertainty for this flow, which can be useful in assisting RANS modeling.

preprint2016arXiv

SediFoam: A general-purpose, open-source CFD-DEM solver for particle-laden flow with emphasis on sediment transport

With the growth of available computational resource, CFD-DEM (computational fluid dynamics-discrete element method) becomes an increasingly promising and feasible approach for the study of sediment transport. Several existing CFD-DEM solvers are applied in chemical engineering and mining industry. However, a robust CFD-DEM solver for the simulation of sediment transport is still desirable. In this work, the development of a three-dimensional, massively parallel, and open-source CFD-DEM solver SediFoam is detailed. This solver is built based on open-source solvers OpenFOAM and LAMMPS. OpenFOAM is a CFD toolbox that can perform three-dimensional fluid flow simulations on unstructured meshes; LAMMPS is a massively parallel DEM solver for molecular dynamics. Several validation tests of SediFoam are performed using cases of a wide range of complexities. The results obtained in the present simulations are consistent with those in the literature, which demonstrates the capability of SediFoam for sediment transport applications. In addition to the validation test, the parallel efficiency of SediFoam is studied to test the performance of the code for large-scale and complex simulations. The parallel efficiency tests show that the scalability of SediFoam is satisfactory in the simulations using up to O(10^7) particles.

preprint2016arXiv

Sediment Micromechanics in Sheet Flows Induced by Asymmetric Waves: A CFD-DEM Study

Understanding the sediment transport in oscillatory flows is essential to the investigation of the overall sediment budget for coastal regions. This overall budget is crucial for the prediction of the morphological change of coastline in engineering applications. Since the sediment transport in oscillatory flows is dense particle-laden flow, appropriate modeling of the particle interaction is critical. Although traditional two-fluid approaches have been applied to the study of sediment transport in oscillatory flows, the approaches do not resolve the interaction of the particles. Particle-resolved modeling of sediment transport in oscillatory flows and the study of micromechanics of sediment particles are still lacking. In this work, a parallel CFD-DEM solver that can resolve the inter-particle collision is applied to study the granular micromechanics of sediment particles in oscillatory flows. The results obtained from the CFD-DEM solver are validated by using the experimental data of coarse and medium sands. The comparison with experimental results suggests that the flow velocity, the sediment flux and the net sediment transport rate predicted by are satisfactory. Moreover, the micromechanic quantities of the sediment bed are presented in detail, including Voronoi concentration, coordination number, and particle interaction force. It is demonstrated that variation of these micromechanic quantities at different phases in the oscillatory cycle is significant, which is due to different responses of the sediment bed. To investigate the structural properties of the sediment bed, the correlation of the Voronoi volume fraction and coordination number are compared to the results from the fluidized bed simulations. The consistency in the comparison indicates the structural micromechanics of sediment transport and fluidized bed are similar despite the differences in flow patterns.

preprint2016arXiv

TSUFLIND-EnKF inversion model applied to tsunami deposits for estimation of transient flow depth and speed with quantified uncertainties

Tsunami deposits are recordings of tsunami events that contain information about flow conditions. Deciphering quantitative information from tsunami deposits is especially important for analyzing paleo-tsunami events in which deposits comprise the only leftover physical evidence. The physical meaning of the deciphered quantities depends on the physical assumptions that are applied. The aim of our study is to estimate the characteristics of tsunamis and quantify the errors and uncertainties that inherent within them. To achieve this goal, we apply the TSUFLIND-EnKF inversion model to study the deposition of an idealized deposit created by a single tsunami wave and one real case from 2004 India ocean tsunami. TSUFLIND-EnKF model combines TSUFLIND for the deposition module with the Ensemble Kalman Filtering (EnKF) method. In our modeling, we assume that grain-size distribution and thickness from the idealized deposits at different depths can be used as an observational variable. Our tentative results indicate that sampling methods and sampling frequencies of tsunami deposits influence not only the magnitude of the inverted variables, but also their errors and uncertainties. An interesting result of our technique is that a larger number of samples from a given tsunami deposit does not automatically mean that the inversion results are more robust with smaller errors and decreased uncertainties.

preprint2015arXiv

Diffusion-Based Coarse Graining in Hybrid Continuum-Discrete Solvers: Applications in CFD-DEM

In this work, a coarse-graining method previously proposed by the authors in a companion paper based on solving diffusion equations is applied to CFD-DEM simulations, where coarse graining is used to obtain solid volume fraction, particle phase velocity, and fluid-particle interaction forces. By examining the conservation requirements, the variables to solve diffusion equations for in CFD-DEM simulations are identified. The algorithm is then implemented into a CFD-DEM solver based on OpenFOAM and LAMMPS, the former being a general-purpose, three-dimensional CFD solver based on unstructured meshes. Numerical simulations are performed for a fluidized bed by using the CFD-DEM solver with the diffusion-based coarse-graining algorithm. Converged results are obtained on successively refined meshes, even for meshes with cell sizes comparable to or smaller than the particle diameter. This is a critical advantage of the proposed method over many existing coarse-graining methods, and would be particularly valuable when small cells are required in part of the CFD mesh to resolve certain flow features such as boundary layers in wall bounded flows and shear layers in jets and wakes. Moreover, we demonstrate that the overhead computational costs incurred by the proposed coarse-graining procedure are a small portion of the total costs in typical CFD-DEM simulations as long as the number of particles per cell is reasonably large, although admittedly the computational overhead of the coarse graining often exceeds that of the CFD solver. Other advantages of the present algorithm include more robust and physically realistic results, flexibility and easy implementation in almost any CFD solvers, and clear physical interpretation of the computational parameter needed in the algorithm. In summary, the diffusion-based method is a theoretically elegant and practically viable option for CFD-DEM simulations.

preprint2015arXiv

Diffusion-Based Coarse Graining in Hybrid Continuum-Discrete Solvers: Theoretical Formulation and A Priori Tests

Coarse graining is an important ingredient in many multi-scale continuum-discrete solvers such as CFD--DEM (computational fluid dynamics--discrete element method) solvers for dense particle-laden flows. Although CFD--DEM solvers have become a mature technique that is widely used in multiphase flow research and industrial flow simulations, a flexible and easy-to-implement coarse graining algorithm that can work with CFD solvers of arbitrary meshes is still lacking. In this work, we proposed a new coarse graining algorithm for continuum--discrete solvers for dense particle-laden flows based on solving a transient diffusion equation. Via theoretical analysis we demonstrated that the proposed method is equivalent to the statistical kernel method with a Gaussian kernel, but the current method is much more straightforward to implement in CFD--DEM solvers. \textit{A priori} numerical tests were performed to obtain the solid volume fraction fields based on given particle distributions, the results obtained by using the proposed algorithm were compared with those from other coarse graining methods in the literature (e.g., the particle centroid method, the divided particle volume method, and the two-grid formulation). The numerical tests demonstrated that the proposed coarse graining procedure based on solving diffusion equations is theoretically sound, easy to implement and parallelize in general CFD solvers, and has improved mesh-convergence characteristics compared with existing coarse graining methods. The diffusion-based coarse graining method has been implemented into a CFD--DEM solver, the results of which are presented in a separate work (R. Sun and H. Xiao, Diffusion-based coarse graining in hybrid continuum-discrete solvers: Application in CFD-DEM solvers for particle laden flows).