Source author record

Wing Tat Leung

Wing Tat Leung appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

19works
2topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

19 published item(s)

preprint2022arXiv

Continuous data assimilation for two-phase flow: analysis and simulations

We propose, analyze, and test a novel continuous data assimilation two-phase flow algorithm for reservoir simulation. We show that the solutions of the algorithm, constructed using coarse mesh observations, converge at an exponential rate in time to the corresponding exact reference solution of the two-phase model. More precisely, we obtain a stability estimate which illustrates an exponential decay of the residual error between the reference and approximate solution, until the error hits a threshold depending on the order of data resolution. Numerical computations are included to demonstrate the effectiveness of this approach, as well as variants with data on sub-domains. In particular, we demonstrate numerically that synchronization is achieved for data collected from a small fraction of the domain.

preprint2022arXiv

Multirate partially explicit scheme for multiscale flow problems

For time-dependent problems with high-contrast multiscale coefficients, the time step size for explicit methods is affected by the magnitude of the coefficient parameter. With a suitable construction of multiscale space, one can achieve a stable temporal splitting scheme where the time step size is independent of the contrast. Consider the parabolic equation with heterogeneous diffusion parameter, the flow rates vary significantly in different regions due to the high-contrast features of the diffusivity. In this work, we aim to introduce a multirate partially explicit splitting scheme to achieve efficient simulation with the desired accuracy. We first design multiscale subspaces to handle flow with different speed. For the fast flow, we obtain a low-dimensional subspace with respect to the high-diffusive component and adopt an implicit time discretization scheme. The other multiscale subspace will take care of the slow flow, and the corresponding degrees of freedom are treated explicitly. Then a multirate time stepping is introduced for the two parts. The stability of the multirate methods is analyzed for the partially explicit scheme. Moreover, we derive local error estimators corresponding to the two components of the solutions and provide an upper bound of the errors. An adaptive local temporal refinement framework is then proposed to achieve higher computational efficiency. Several numerical tests are presented to demonstrate the performance of the proposed method.

preprint2022arXiv

Nonlocal transport equations in multiscale media. Modeling, dememorization, and discretizations

In this paper, we consider a class of convection-diffusion equations with memory effects. These equations arise as a result of homogenization or upscaling of linear transport equations in heterogeneous media and play an important role in many applications. First, we present a dememorization technique for these equations. We show that the convection-diffusion equations with memory effects can be written as a system of standard convection-diffusion-reaction equations. This allows removing the memory term and simplifying the computations. We consider a relation between dememorized equations and micro-scale equations, which do not contain memory terms. We note that dememorized equations differ from micro-scale equations and constitute a macroscopic model. Next, we consider both implicit and partially explicit methods. The latter is introduced for problems in multiscale media with high-contrast properties. Because of high contrast, explicit methods are restrictive and require time steps that are very small (scales as the inverse of the contrast). We show that, by appropriately decomposing the space, we can treat only a few degrees of freedom implicitly and the remaining degrees of freedom explicitly. We present a stability analysis. Numerical results are presented that confirm our theoretical findings of partially explicit schemes applied to dememorized systems of equations.

preprint2021arXiv

Contrast-independent partially explicit time discretizations for multiscale wave problems

In this work, we design and investigate contrast-independent partially explicit time discretizations for wave equations in heterogeneous high-contrast media. We consider multiscale problems, where the spatial heterogeneities are at subgrid level and are not resolved. In our previous work, we have introduced contrast-independent partially explicit time discretizations and applied to parabolic equations. The main idea of contrast-independent partially explicit time discretization is to split the spatial space into two components: contrast dependent (fast) and contrast independent (slow) spaces defined via multiscale space decomposition. Using this decomposition, our goal is further appropriately to introduce time splitting such that the resulting scheme is stable and can guarantee contrast-independent discretization under some suitable (reasonable) conditions. In this paper, we propose contrast-independent partially explicitly scheme for wave equations. The splitting requires a careful design. We prove that the proposed splitting is unconditionally stable under some suitable conditions formulated for the second space (slow). This condition requires some type of non-contrast dependent space and is easier to satisfy in the "slow" space. We present numerical results and show that the proposed methods provide results similar to implicit methods with the time step that is independent of the contrast.

preprint2021arXiv

HEI: hybrid explicit-implicit learning for multiscale problems

Splitting is a method to handle application problems by splitting physics, scales, domain, and so on. Many splitting algorithms have been designed for efficient temporal discretization. In this paper, our goal is to use temporal splitting concepts in designing machine learning algorithms and, at the same time, help splitting algorithms by incorporating data and speeding them up. Since the spitting solution usually has an explicit and implicit part, we will call our method hybrid explicit-implict (HEI) learning. We will consider a recently introduced multiscale splitting algorithms. To approximate the dynamics, only a few degrees of freedom are solved implicitly, while others explicitly. In this paper, we use this splitting concept in machine learning and propose several strategies. First, the implicit part of the solution can be learned as it is more difficult to solve, while the explicit part can be computed. This provides a speed-up and data incorporation for splitting approaches. Secondly, one can design a hybrid neural network architecture because handling explicit parts requires much fewer communications among neurons and can be done efficiently. Thirdly, one can solve the coarse grid component via PDEs or other approximation methods and construct simpler neural networks for the explicit part of the solutions. We discuss these options and implement one of them by interpreting it as a machine translation task. This interpretation successfully enables us using the Transformer since it can perform model reduction for multiple time series and learn the connection. We also find that the splitting scheme is a great platform to predict the coarse solution with insufficient information of the target model: the target problem is partially given and we need to solve it through a known problem. We conduct four numerical examples and the results show that our method is stable and accurate.

preprint2021arXiv

Partially Explicit Time Discretization for Nonlinear Time Fractional Diffusion Equations

Nonlinear time fractional partial differential equations are widely used in modeling and simulations. In many applications, there are high contrast changes in media properties. For solving these problems, one often uses coarse spatial grid for spatial resolution. For temporal discretization, implicit methods are often used. For implicit methods, though the time step can be relatively large, the equations are difficult to compute due to the nonlinearity and the fact that one deals with large-scale systems. On the other hand, the discrete system in explicit methods are easier to compute but it requires small time steps. In this work, we propose the partially explicit scheme following earlier works on developing partially explicit methods for nonlinear diffusion equations. In this scheme, the diffusion term is treated partially explicitly and the reaction term is treated fully explicitly. With the appropriate construction of spaces and stability analysis, we find that the required time step in our proposed scheme scales as the coarse mesh size, which creates a great saving in computing. The main novelty of this work is the extension of our earlier works for diffusion equations to time fractional diffusion equations. For the case of fractional diffusion equations, the constraints on time steps are more severe and the proposed methods alleviate this since the time step in partially explicit method scales as the coarse mesh size. We present stability results. Numerical results are presented where we compare our proposed partially explicit methods with a fully implicit approach. We show that our proposed approach provides similar results, while treating many degrees of freedom in nonlinear terms explicitly.

preprint2020arXiv

Explicit and Energy-Conserving Constraint Energy Minimizing Generalized Multiscale Discontinuous Galerkin Method for Wave Propagation in Heterogeneous Media

In this work, we propose a local multiscale model reduction approach for the time-domain scalar wave equation in a heterogenous media. A fine mesh is used to capture the heterogeneities of the coefficient field, and the equation is solved globally on a coarse mesh in the discontinuous Galerkin discretization setting. The main idea of the model reduction approach is to extract dominant modes in local spectral problems for representation of important features, construct multiscale basis functions in coarse oversampled regions by constraint energy minimization problems, and perform a Petrov-Galerkin projection and a symmetrization onto the coarse grid. The method is expicit and energy conserving, and exhibits both coarse-mesh and spectral convergence, provided that the oversampling size is appropriately chosen. We study the stability and convergence of our method. We also present numerical results on the Marmousi model in order to test the performance of the method and verify the theoretical results.

preprint2020arXiv

Learning Algorithms for Coarsening Uncertainty Space and Applications to Multiscale Simulations

In this paper, we investigate and design multiscale simulations for stochastic multiscale PDEs. As for the space, we consider a coarse grid and a known multiscale method, the Generalized Multiscale Finite Element Method (GMsFEM). In order to obtain a small dimensional representation of the solution in each coarse block, the uncertainty space needs to be partitioned (coarsened). This coarsening collects realizations that provide similar multiscale features as outlined in GMsFEM (or other method of choice). This step is known to be computationally demanding as it requires many local solves and clustering based on them. In this paper, we take a different approach and learn coarsening the uncertainty space. Our methods use deep learning techniques in identifying clusters(coarsening) in the uncertainty space. We use convolutional neural networks combined with some techniques in adversary neural networks. We define appropriate loss functions in the proposed neural networks, where the loss function is composed of several parts that includes terms related to clusters and reconstruction of basis functions. We present numerical results for channelized permeability fields in the examples of flows in porous media.

preprint2016arXiv

Generalized multiscale finite element methods for space-time heterogeneous parabolic equations

In this paper, we consider local multiscale model reduction for problems with multiple scales in space and time. We developed our approaches within the framework of the Generalized Multiscale Finite Element Method (GMsFEM) using space-time coarse cells. The main idea of GMsFEM is to construct a local snapshot space and a local spectral decomposition in the snapshot space. Previous research in developing multiscale spaces within GMsFEM focused on constructing multiscale spaces and relevant ingredients in space only. In this paper, our main objective is to develop a multiscale model reduction framework within GMsFEM that uses space-time coarse cells. We construct space-time snapshot and offline spaces. We compute these snapshot solutions by solving local problems. A complete snapshot space will use all possible boundary conditions; however, this can be very expensive. We propose using randomized boundary conditions and oversampling. We construct the local spectral decomposition based on our analysis, as presented in the paper. We present numerical results to confirm our theoretical findings and to show that using our proposed approaches, we can obtain an accurate solution with low dimensional coarse spaces. We remark that the proposed method is a significant extension compared to existing methods, which use coarse cells in space only because of (1) the parabolic nature of cell solutions, (2) extra degrees of freedom associated with space-time cells, and (3) local boundary conditions in space-time cells.

preprint2016arXiv

Online Adaptive Local Multiscale Model Reduction for Heterogeneous Problems in Perforated Domains

In this paper, we develop and analyze an adaptive multiscale approach for heterogeneous problems in perforated domains. In many applications, these problems have a multiscale nature arising because of the perforations, their geometries, the sizes of the perforations, and configurations. In this paper, we present a general offline/online procedure, which can adequately and adaptively represent the local degrees of freedom and derive appropriate coarse-grid equations. The main contributions of this paper are (1) the rigorous analysis of the offline approach (2) the development of the online procedures and their analysis (3) the development of adaptive strategies. We present an online procedure, which allows adaptively incorporating global information and is important for a fast convergence when combined with the adaptivity. Our methodology allows adding and guides constructing new online multiscale basis functions adaptively in appropriate regions. We present the convergence analysis of the online adaptive enrichment algorithm for the Stokes system. In particular, we show that the online procedure has a rapid convergence with a rate related to the number of offline basis functions, and one can obtain fast convergence by a sufficient number of offline basis functions, which are computed in the offline stage. To illustrate the performance of our method, we present numerical results with both small and large perforations. We see that only a few (1 or 2) online iterations can significantly improve the offline solution.

preprint2016arXiv

Re-iterated multiscale model reduction using the GMsFEM

Numerical homogenization and multiscale finite element methods construct effective properties on a coarse grid by solving local problems and extracting the average effective properties from these local solutions. In some cases, the solutions of local problems can be expensive to compute due to scale disparity. In this setting, one can basically apply a homogenization or multiscale method re-iteratively to solve for the local problems. This process is known as re-iterated homogenization and has many variations in the numerical context. Though the process seems to be a straightforward extension of two-level process, it requires some careful implementation and the concept development for problems without scale separation and high contrast. In this paper, we consider the Generalized Multiscale Finite Element Method (GMsFEM) and apply it iteratively to construct its multiscale basis functions. The main idea of the GMsFEM is to construct snapshot functions and then extract multiscale basis functions (called offline space) using local spectral decompositions in the snapshot spaces. The extension of this construction to several levels uses snapshots and offline spaces interchangebly to achieve this goal. At each coarse-grid scale, we assume that the offline space is a good approximation of the solution and use all possible offline functions or randomization as boundary conditions and solve the local problems in the offline space at the previous (finer) level, to construct snapshot space. We present an adaptivity strategy and show numerical results for flows in heterogeneous media and in perforated domains.

preprint2015arXiv

An online generalized multiscale discontinuous Galerkin method (GMsDGM) for flows in heterogeneous media

Offline computation is an essential component in most multiscale model reduction techniques. However, there are multiscale problems in which offline procedure is insufficient to give accurate representations of solutions, due to the fact that offline computations are typically performed locally and global information is missing in these offline information. To tackle this difficulty, we develop an online local adaptivity technique for local multiscale model reduction problems. We design new online basis functions within Discontinuous Galerkin method based on local residuals and some optimally estimates. The resulting basis functions are able to capture the solution efficiently and accurately, and are added to the approximation iteratively. Moreover, we show that the iterative procedure is convergent with a rate independent of physical scales if the initial space is chosen carefully. Our analysis also gives a guideline on how to choose the initial space. We present some numerical examples to show the performance of the proposed method.

preprint2015arXiv

Goal-oriented adaptivity for GMsFEM

In this paper we develop two goal-oriented adaptive strategies for a posteriori error estimation within the generalized multiscale finite element framework. In this methodology, one seeks to determine the number of multiscale basis functions adaptively for each coarse region to efficiently reduce the error in the goal functional. Our first error estimator uses a residual based strategy where local indicators on each coarse neighborhood are the product of local indicators for the primal and dual problems, respectively. In the second approach, viewed as the multiscale extension of the dual weighted residual method (DWR), the error indicators are computed as the pairing of the local H^{-1} residual of the primal problem weighed by a projection into the primal space of the H_0^1 dual solution from an enriched space, over each coarse neighborhood. In both of these strategies, the goal-oriented indicators are then used in place of a standard residual-based indicator to mark coarse neighborhoods of the mesh for further enrichment in the form of additional multiscale basis functions. The method is demonstrated on high-contrast problems with heterogeneous multiscale coefficients, and is seen to outperform the standard residual based strategy with respect to efficient reduction of error in the goal function.

preprint2015arXiv

Mixed GMsFEM for the simulation of waves in highly heterogeneous media

Numerical simulations of waves in highly heterogeneous media have important applications, but direct computations are prohibitively expensive. In this paper, we develop a new generalized multiscale finite element method with the aim of simulating waves at a much lower cost. Our method is based on a mixed Galerkin type method with carefully designed basis functions that can capture various scales in the solution. The basis functions are constructed based on some local snapshot spaces and local spectral problems defined on them. The spectral problems give a natural ordering of the basis functions in the snapshot space and allow systematically enrichment of basis functions. In addition, by using a staggered coarse mesh, our method is energy conserving and has block diagonal mass matrix, which are desirable properties for wave propagation. We will prove that our method has spectral convergence, and present numerical results to show the performance of the method.

preprint2015arXiv

Multiscale stabilization for convection-dominated diffusion in heterogeneous media

We develop a Petrov-Galerkin stabilization method for multiscale convection-diffusion transport systems. Existing stabilization techniques add a limited number of degrees of freedom in the form of bubble functions or a modified diffusion, which may not sufficient to stabilize multiscale systems. We seek a local reduced-order model for this kind of multiscale transport problems and thus, develop a systematic approach for finding reduced-order approximations of the solution. We start from a Petrov-Galerkin framework using optimal weighting functions. We introduce an auxiliary variable to a mixed formulation of the problem. The auxiliary variable stands for the optimal weighting function. The problem reduces to finding a test space (a reduced dimensional space for this auxiliary variable), which guarantees that the error in the primal variable (representing the solution) is close to the projection error of the full solution on the reduced dimensional space that approximates the solution. To find the test space, we reformulate some recent mixed Generalized Multiscale Finite Element Methods. We introduce snapshots and local spectral problems that appropriately define local weight and trial spaces. In particular, we use energy minimizing snapshots and local spectral decompositions in the natural norm associated with the auxiliary variable. The resulting spectral decomposition adaptively identifies and builds the optimal multiscale space to stabilize the system. We discuss the stability and its relation to the approximation property of the test space. We design online basis functions, which accelerate convergence in the test space, and consequently, improve stability. We present several numerical examples and show that one needs a few test functions to achieve an error similar to the projection error in the primal variable irrespective of the Peclet number.

preprint2015arXiv

Residual-driven online Generalized Multiscale Finite Element Methods

The construction of local reduced-order models via multiscale basis functions has been an area of active research. In this paper, we propose online multiscale basis functions which are constructed using the offline space and the current residual. Online multiscale basis functions are constructed adaptively in some selected regions based on our error indicators. We derive an error estimator which shows that one needs to have an offline space with certain properties to guarantee that additional online multiscale basis function will decrease the error. This error decrease is independent of physical parameters, such as the contrast and multiple scales in the problem. The offline spaces are constructed using Generalized Multiscale Finite Element Methods (GMsFEM). We show that if one chooses a sufficient number of offline basis functions, one can guarantee that additional online multiscale basis functions will reduce the error independent of contrast. We note that the construction of online basis functions is motivated by the fact that the offline space construction does not take into account distant effects. Using the residual information, we can incorporate the distant information provided the offline approximation satisfies certain properties. In the paper, theoretical and numerical results are presented. Our numerical results show that if the offline space is sufficiently large (in terms of the dimension) such that the coarse space contains all multiscale spectral basis functions that correspond to small eigenvalues, then the error reduction by adding online multiscale basis function is independent of the contrast. We discuss various ways computing online multiscale basis functions which include a use of small dimensional offline spaces.

preprint2015arXiv

Sparse Generalized Multiscale Finite Element Methods and their applications

In a number of previous papers, local (coarse grid) multiscale model reduction techniques are developed using a Generalized Multiscale Finite Element Method. In these approaches, multiscale basis functions are constructed using local snapshot spaces, where a snapshot space is a large space that represents the solution behavior in a coarse block. In a number of applications (e.g., those discussed in the paper), one may have a sparsity in the snapshot space for an appropriate choice of a snapshot space. More precisely, the solution may only involve a portion of the snapshot space. In this case, one can use sparsity techniques to identify multiscale basis functions. In this paper, we consider two such sparse local multiscale model reduction approaches. In the first approach (which is used for parameter-dependent multiscale PDEs), we use local minimization techniques, such as sparse POD, to identify multiscale basis functions, which are sparse in the snapshot space. These minimization techniques use $l_1$ minimization to find local multiscale basis functions, which are further used for finding the solution. In the second approach (which is used for the Helmholtz equation), we directly apply $l_1$ minimization techniques to solve the underlying PDEs. This approach is more expensive as it involves a large snapshot space; however, in this example, we can not identify a local minimization principle, such as local generalized SVD.

preprint2014arXiv

An adaptive generalized multiscale discontinuous Galerkin method (GMsDGM) for high-contrast flow problems

In this paper, we develop an adaptive Generalized Multiscale Discontinuous Galerkin Method (GMs-DGM) for a class of high-contrast flow problems, and derive a-priori and a-posteriori error estimates for the method. Based on the a-posteriori error estimator, we develop an adaptive enrichment algorithm for our GMsDGM and prove its convergence. The adaptive enrichment algorithm gives an automatic way to enrich the approximation space in regions where the solution requires more basis functions, which are shown to perform well compared with a uniform enrichment. We also discuss an approach that adaptively selects multiscale basis functions by correlating the residual to multiscale basis functions (cf. [4]). The proposed error indicators are L2-based and can be inexpensively computed which makes our approach efficient. Numerical results are presented that demonstrate the robustness of the proposed error indicators.

preprint2013arXiv

Generalized multiscale finite element methods for wave propagation in heterogeneous media

Numerical modeling of wave propagation in heterogeneous media is important in many applications. Due to the complex nature, direct numerical simulations on the fine grid are prohibitively expensive. It is therefore important to develop efficient and accurate methods that allow the use of coarse grids. In this paper, we present a multiscale finite element method for wave propagation on a coarse grid. The proposed method is based on the Generalized Multiscale Finite Element Method (GMsFEM). To construct multiscale basis functions, we start with two snapshot spaces in each coarse-grid block where one represents the degrees of freedom on the boundary and the other represents the degrees of freedom in the interior. We use local spectral problems to identify important modes in each snapshot space. These local spectral problems are different from each other and their formulations are based on the analysis. To our best knowledge, this is the first time where multiple snapshot spaces and multiple spectral problems are used and necessary for efficient computations. Using the dominant modes from local spectral problems, multiscale basis functions are constructed to represent the solution space locally within each coarse block. These multiscale basis functions are coupled via the symmetric interior penalty discontinuous Galerkin method which provides a block diagonal mass matrix, and, consequently, results in fast computations in an explicit time discretiza- tion. Our methods' stability and spectral convergence are rigorously analyzed. Numerical examples are presented to show our methods' performance. We also test oversampling strategies. In particular, we discuss how the modes from different snapshot spaces can affect the proposed methods' accuracy.