Source author record

Jiangjiang Zhang

Jiangjiang Zhang appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

5works
3topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

5 published item(s)

preprint2020arXiv

Improving Simulation Efficiency of MCMC for Inverse Modeling of Hydrologic Systems with a Kalman-Inspired Proposal Distribution

Bayesian analysis is widely used in science and engineering for real-time forecasting, decision making, and to help unravel the processes that explain the observed data. These data are some deterministic and/or stochastic transformations of the underlying parameters. A key task is then to summarize the posterior distribution of these parameters. When models become too difficult to analyze analytically, Monte Carlo methods can be used to approximate the target distribution. Of these, Markov chain Monte Carlo (MCMC) methods are particularly powerful. Such methods generate a random walk through the parameter space and, under strict conditions of reversibility and ergodicity, will successively visit solutions with frequency proportional to the underlying target density. This requires a proposal distribution that generates candidate solutions starting from an arbitrary initial state. The speed of the sampled chains converging to the target distribution deteriorates rapidly, however, with increasing parameter dimensionality. In this paper, we introduce a new proposal distribution that enhances significantly the efficiency of MCMC simulation for highly parameterized models. This proposal distribution exploits the cross-covariance of model parameters, measurements and model outputs, and generates candidate states much alike the analysis step in the Kalman filter. We embed the Kalman-inspired proposal distribution in the DREAM algorithm during burn-in, and present several numerical experiments with complex, high-dimensional or multi-modal target distributions. Results demonstrate that this new proposal distribution can greatly improve simulation efficiency of MCMC. Specifically, we observe a speed-up on the order of 10-30 times for groundwater models with more than one-hundred parameters.

preprint2020arXiv

Surrogate-Based Bayesian Inverse Modeling of the Hydrological System: An Adaptive Approach Considering Surrogate Approximation Error

Bayesian inverse modeling is important for a better understanding of hydrological processes. However, this approach can be computationally demanding, as it usually requires a large number of model evaluations. To address this issue, one can take advantage of surrogate modeling techniques. Nevertheless, when approximation error of the surrogate model is neglected, the inversion result will be biased. In this paper, we develop a surrogate-based Bayesian inversion framework that explicitly quantifies and gradually reduces the approximation error of the surrogate. Specifically, two strategies are proposed to quantify the surrogate error. The first strategy works by quantifying the surrogate prediction uncertainty with a Bayesian method, while the second strategy uses another surrogate to simulate and correct the approximation error of the primary surrogate. By adaptively refining the surrogate over the posterior distribution, we can gradually reduce the surrogate approximation error to a small level. Demonstrated with three case studies involving high dimensionality, multimodality, and a real-world application, it is found that both strategies can reduce the bias introduced by surrogate approximation error, while the second strategy that integrates two methods (i.e., polynomial chaos expansion and Gaussian process in this work) that complement each other shows the best performance.

preprint2020arXiv

Using Deep Learning to Improve Ensemble Smoother: Applications to Subsurface Characterization

Ensemble smoother (ES) has been widely used in various research fields to reduce the uncertainty of the system-of-interest. However, the commonly-adopted ES method that employs the Kalman formula, that is, ES$_\text{(K)}$, does not perform well when the probability distributions involved are non-Gaussian. To address this issue, we suggest to use deep learning (DL) to derive an alternative update scheme for ES in complex data assimilation applications. Here we show that the DL-based ES method, that is, ES$_\text{(DL)}$, is more general and flexible. In this new update scheme, a high volume of training data are generated from a relatively small-sized ensemble of model parameters and simulation outputs, and possible non-Gaussian features can be preserved in the training data and captured by an adequate DL model. This new variant of ES is tested in two subsurface characterization problems with or without Gaussian assumptions. Results indicate that ES$_\text{(DL)}$ can produce similar (in the Gaussian case) or even better (in the non-Gaussian case) results compared to those from ES$_\text{(K)}$. The success of ES$_\text{(DL)}$ comes from the power of DL in extracting complex (including non-Gaussian) features and learning nonlinear relationships from massive amounts of training data. Although in this work we only apply the ES$_\text{(DL)}$ method in parameter estimation problems, the proposed idea can be conveniently extended to analysis of model structural uncertainty and state estimation in real-time forecasting studies.

preprint2015arXiv

An Inverse Gaussian Process Monte Carlo algorithm for estimation and uncertainty assessment of hydrologic model parameters

Solving hydrologic inverse problems usually requires repetitive forward simulations. One approach to mitigate the computational cost is to build a surrogate model, i.e., an approximate mapping from model parameters (input) to observable quantities (output), so the forward simulations can be done quickly. Alternatively, if the surrogate is constructed to approximate the inverse mapping from model outputs to parameters, the parameter estimates can be obtained directly by treating measurements as inputs to this inverse surrogate. Moreover, the uncertainties of parameters can be quantified by propagating the measurement uncertainties in a straightforward Monte Carlo manner. Based on this idea, we proposed a novel surrogate-based approach for parameter estimation and uncertainty assessment, i.e., the Inverse Gaussian Process Monte Carlo (IGPMC) algorithm. The Gaussian Process (GP) regression is used to directly approximate the inverse function of the model output-input relationship. For ill-posed problems, i.e., when there exist non-unique sets of input parameters that all produce an identical system output, multiple inverse GP systems are constructed and multiple parameter estimates can be obtained accordingly. The accuracy and efficiency of this IGPMC algorithm were demonstrated through four numerical case studies. Results obtained from the Markov Chain Monte Carlo (MCMC) are used as references to assess our new proposed method. It was shown that, the IGPMC algorithm can generally obtain reliable parameter estimates with an affordable computational cost.

preprint2015arXiv

Inverse iterative simulation: An efficient approach for contaminant source identification

In groundwater contaminant remediation and risk assessment, it is important to identify parameters of the contaminant source and hydraulic conductivity field by solving an inverse problem. However, if the dimensionality of the inverse problem is high, it is usually computationally expensive to obtain accurate estimation and uncertainty assessment of these parameters. This is particularly the case when Markov Chain Monte Carlo (MCMC) sampling is used. In this paper, an efficient approach entitled inverse iterative simulation (iIS) is proposed to efficiently identify the contaminant source characteristics, together with the hydraulic conductivity field. The iIS algorithm utilizes a simple approach borrowed from Ensemble Smother (ES) to update model parameters and an inverse Gaussian process (iGP) approach to improve the accuracy of parameter updating. Two numerical experiments are tested. For the low dimensional case (with 11 parameters), the iIS algorithm can obtain parameter estimation very close to that of MCMC method. For the high dimensional case (with 108 parameters), the iIS algorithm can obtain accurate parameter estimation with very low computational cost.