Source author record

Yalchin Efendiev

Yalchin Efendiev appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

38works
8topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

38 published item(s)

preprint2022arXiv

Nonlocal transport equations in multiscale media. Modeling, dememorization, and discretizations

In this paper, we consider a class of convection-diffusion equations with memory effects. These equations arise as a result of homogenization or upscaling of linear transport equations in heterogeneous media and play an important role in many applications. First, we present a dememorization technique for these equations. We show that the convection-diffusion equations with memory effects can be written as a system of standard convection-diffusion-reaction equations. This allows removing the memory term and simplifying the computations. We consider a relation between dememorized equations and micro-scale equations, which do not contain memory terms. We note that dememorized equations differ from micro-scale equations and constitute a macroscopic model. Next, we consider both implicit and partially explicit methods. The latter is introduced for problems in multiscale media with high-contrast properties. Because of high contrast, explicit methods are restrictive and require time steps that are very small (scales as the inverse of the contrast). We show that, by appropriately decomposing the space, we can treat only a few degrees of freedom implicitly and the remaining degrees of freedom explicitly. We present a stability analysis. Numerical results are presented that confirm our theoretical findings of partially explicit schemes applied to dememorized systems of equations.

preprint2021arXiv

Contrast-independent partially explicit time discretizations for multiscale wave problems

In this work, we design and investigate contrast-independent partially explicit time discretizations for wave equations in heterogeneous high-contrast media. We consider multiscale problems, where the spatial heterogeneities are at subgrid level and are not resolved. In our previous work, we have introduced contrast-independent partially explicit time discretizations and applied to parabolic equations. The main idea of contrast-independent partially explicit time discretization is to split the spatial space into two components: contrast dependent (fast) and contrast independent (slow) spaces defined via multiscale space decomposition. Using this decomposition, our goal is further appropriately to introduce time splitting such that the resulting scheme is stable and can guarantee contrast-independent discretization under some suitable (reasonable) conditions. In this paper, we propose contrast-independent partially explicitly scheme for wave equations. The splitting requires a careful design. We prove that the proposed splitting is unconditionally stable under some suitable conditions formulated for the second space (slow). This condition requires some type of non-contrast dependent space and is easier to satisfy in the "slow" space. We present numerical results and show that the proposed methods provide results similar to implicit methods with the time step that is independent of the contrast.

preprint2021arXiv

HEI: hybrid explicit-implicit learning for multiscale problems

Splitting is a method to handle application problems by splitting physics, scales, domain, and so on. Many splitting algorithms have been designed for efficient temporal discretization. In this paper, our goal is to use temporal splitting concepts in designing machine learning algorithms and, at the same time, help splitting algorithms by incorporating data and speeding them up. Since the spitting solution usually has an explicit and implicit part, we will call our method hybrid explicit-implict (HEI) learning. We will consider a recently introduced multiscale splitting algorithms. To approximate the dynamics, only a few degrees of freedom are solved implicitly, while others explicitly. In this paper, we use this splitting concept in machine learning and propose several strategies. First, the implicit part of the solution can be learned as it is more difficult to solve, while the explicit part can be computed. This provides a speed-up and data incorporation for splitting approaches. Secondly, one can design a hybrid neural network architecture because handling explicit parts requires much fewer communications among neurons and can be done efficiently. Thirdly, one can solve the coarse grid component via PDEs or other approximation methods and construct simpler neural networks for the explicit part of the solutions. We discuss these options and implement one of them by interpreting it as a machine translation task. This interpretation successfully enables us using the Transformer since it can perform model reduction for multiple time series and learn the connection. We also find that the splitting scheme is a great platform to predict the coarse solution with insufficient information of the target model: the target problem is partially given and we need to solve it through a known problem. We conduct four numerical examples and the results show that our method is stable and accurate.

preprint2021arXiv

Partially Explicit Time Discretization for Nonlinear Time Fractional Diffusion Equations

Nonlinear time fractional partial differential equations are widely used in modeling and simulations. In many applications, there are high contrast changes in media properties. For solving these problems, one often uses coarse spatial grid for spatial resolution. For temporal discretization, implicit methods are often used. For implicit methods, though the time step can be relatively large, the equations are difficult to compute due to the nonlinearity and the fact that one deals with large-scale systems. On the other hand, the discrete system in explicit methods are easier to compute but it requires small time steps. In this work, we propose the partially explicit scheme following earlier works on developing partially explicit methods for nonlinear diffusion equations. In this scheme, the diffusion term is treated partially explicitly and the reaction term is treated fully explicitly. With the appropriate construction of spaces and stability analysis, we find that the required time step in our proposed scheme scales as the coarse mesh size, which creates a great saving in computing. The main novelty of this work is the extension of our earlier works for diffusion equations to time fractional diffusion equations. For the case of fractional diffusion equations, the constraints on time steps are more severe and the proposed methods alleviate this since the time step in partially explicit method scales as the coarse mesh size. We present stability results. Numerical results are presented where we compare our proposed partially explicit methods with a fully implicit approach. We show that our proposed approach provides similar results, while treating many degrees of freedom in nonlinear terms explicitly.

preprint2020arXiv

Explicit and Energy-Conserving Constraint Energy Minimizing Generalized Multiscale Discontinuous Galerkin Method for Wave Propagation in Heterogeneous Media

In this work, we propose a local multiscale model reduction approach for the time-domain scalar wave equation in a heterogenous media. A fine mesh is used to capture the heterogeneities of the coefficient field, and the equation is solved globally on a coarse mesh in the discontinuous Galerkin discretization setting. The main idea of the model reduction approach is to extract dominant modes in local spectral problems for representation of important features, construct multiscale basis functions in coarse oversampled regions by constraint energy minimization problems, and perform a Petrov-Galerkin projection and a symmetrization onto the coarse grid. The method is expicit and energy conserving, and exhibits both coarse-mesh and spectral convergence, provided that the oversampling size is appropriately chosen. We study the stability and convergence of our method. We also present numerical results on the Marmousi model in order to test the performance of the method and verify the theoretical results.

preprint2020arXiv

Learning Algorithms for Coarsening Uncertainty Space and Applications to Multiscale Simulations

In this paper, we investigate and design multiscale simulations for stochastic multiscale PDEs. As for the space, we consider a coarse grid and a known multiscale method, the Generalized Multiscale Finite Element Method (GMsFEM). In order to obtain a small dimensional representation of the solution in each coarse block, the uncertainty space needs to be partitioned (coarsened). This coarsening collects realizations that provide similar multiscale features as outlined in GMsFEM (or other method of choice). This step is known to be computationally demanding as it requires many local solves and clustering based on them. In this paper, we take a different approach and learn coarsening the uncertainty space. Our methods use deep learning techniques in identifying clusters(coarsening) in the uncertainty space. We use convolutional neural networks combined with some techniques in adversary neural networks. We define appropriate loss functions in the proposed neural networks, where the loss function is composed of several parts that includes terms related to clusters and reconstruction of basis functions. We present numerical results for channelized permeability fields in the examples of flows in porous media.

preprint2020arXiv

Splitting methods for solution decomposition in nonstationary problems

In approximating solutions of nonstationary problems, various approaches are used to compute the solution at a new time level from a number of simpler (sub-)problems. Among these approaches are splitting methods. Standard splitting schemes are based on one or another additive splitting of the operator into "simpler" operators that are more convenient/easier for the computer implementation and use inhomogeneous (explicitly-implicit) time approximations. In this paper, a new class of splitting schemes is proposed that is characterized by an additive representation of the solution instead of the operator corresponding to the problem (called problem operator). A specific feature of the proposed splitting is that the resulting coupled equations for individual solution components consist of the time derivatives of the solution components. The proposed approaches are motivated by various applications, including multiscale methods, domain decomposition, and so on, where spatially local problems are solved and used to compute the solution. Unconditionally stable splitting schemes are constructed for a first-order evolution equation, which is considered in a finite-dimensional Hilbert space. In our splitting algorithms, we consider the decomposition of both the main operator of the system and the operator at the time derivative. Our goal is to provide a general framework that combines temporal splitting algorithms and spatial decomposition and its analysis. Applications of the framework will be studied separately.

preprint2019arXiv

Learning macroscopic parameters in nonlinear multiscale simulations using nonlocal multicontinua upscaling techniques

In this work, we present a novel nonlocal nonlinear coarse grid approximation using a machine learning algorithm. We consider unsaturated and two-phase flow problems in heterogeneous and fractured porous media, where mathematical models are formulated as general multicontinuum models. We construct a fine grid approximation using the finite volume method and embedded discrete fracture model. Macroscopic models for these complex nonlinear systems require nonlocal multicontinua approaches, which are developed in earlier works. These rigorous techniques require complex local computations, which involve solving local problems in oversampled regions subject to constraints. The solutions of these local problems can be replaced by solving original problem on a coarse (oversampled) region for many input parameters (boundary and source terms) and computing effective properties derived by nonlinear nonlocal multicontinua approaches. The effective properties depend on many variables (oversampled region and the number of continua), thus their calculations require some type of machine learning techniques. In this paper, our contribution is two fold. First, we present macroscopic models and discuss how to effectively compute macroscopic parameters using deep learning algorithms. The proposed method can be regarded as local machine learning and complements our earlier approaches on global machine learning. We consider a coarse grid approximation using two upscaling techniques with single phase upscaled transmissibilities and nonlocal nonlinear upscaled transmissibilities using a machine learning algorithm. We present results for two model problems in heterogeneous and fractured porous media and show that the presented method is highly accurate and provides fast coarse grid calculations.

preprint2016arXiv

Adaptive multiscale model reduction with Generalized Multiscale Finite Element Methods

In this paper, we discuss a general multiscale model reduction framework based on multiscale finite element methods. We give a brief overview of related multiscale methods. Due to page limitations, the overview focuses on a few related methods and is not intended to be comprehensive. We present a general adaptive multiscale model reduction framework, the Generalized Multiscale Finite Element Method. Besides the method's basic outline, we discuss some important ingredients needed for the method's success. We also discuss several applications. The proposed method allows performing local model reduction in the presence of high contrast and no scale separation.

preprint2016arXiv

Generalized multiscale finite element methods for space-time heterogeneous parabolic equations

In this paper, we consider local multiscale model reduction for problems with multiple scales in space and time. We developed our approaches within the framework of the Generalized Multiscale Finite Element Method (GMsFEM) using space-time coarse cells. The main idea of GMsFEM is to construct a local snapshot space and a local spectral decomposition in the snapshot space. Previous research in developing multiscale spaces within GMsFEM focused on constructing multiscale spaces and relevant ingredients in space only. In this paper, our main objective is to develop a multiscale model reduction framework within GMsFEM that uses space-time coarse cells. We construct space-time snapshot and offline spaces. We compute these snapshot solutions by solving local problems. A complete snapshot space will use all possible boundary conditions; however, this can be very expensive. We propose using randomized boundary conditions and oversampling. We construct the local spectral decomposition based on our analysis, as presented in the paper. We present numerical results to confirm our theoretical findings and to show that using our proposed approaches, we can obtain an accurate solution with low dimensional coarse spaces. We remark that the proposed method is a significant extension compared to existing methods, which use coarse cells in space only because of (1) the parabolic nature of cell solutions, (2) extra degrees of freedom associated with space-time cells, and (3) local boundary conditions in space-time cells.

preprint2016arXiv

Online Adaptive Local Multiscale Model Reduction for Heterogeneous Problems in Perforated Domains

In this paper, we develop and analyze an adaptive multiscale approach for heterogeneous problems in perforated domains. In many applications, these problems have a multiscale nature arising because of the perforations, their geometries, the sizes of the perforations, and configurations. In this paper, we present a general offline/online procedure, which can adequately and adaptively represent the local degrees of freedom and derive appropriate coarse-grid equations. The main contributions of this paper are (1) the rigorous analysis of the offline approach (2) the development of the online procedures and their analysis (3) the development of adaptive strategies. We present an online procedure, which allows adaptively incorporating global information and is important for a fast convergence when combined with the adaptivity. Our methodology allows adding and guides constructing new online multiscale basis functions adaptively in appropriate regions. We present the convergence analysis of the online adaptive enrichment algorithm for the Stokes system. In particular, we show that the online procedure has a rapid convergence with a rate related to the number of offline basis functions, and one can obtain fast convergence by a sufficient number of offline basis functions, which are computed in the offline stage. To illustrate the performance of our method, we present numerical results with both small and large perforations. We see that only a few (1 or 2) online iterations can significantly improve the offline solution.

preprint2016arXiv

Re-iterated multiscale model reduction using the GMsFEM

Numerical homogenization and multiscale finite element methods construct effective properties on a coarse grid by solving local problems and extracting the average effective properties from these local solutions. In some cases, the solutions of local problems can be expensive to compute due to scale disparity. In this setting, one can basically apply a homogenization or multiscale method re-iteratively to solve for the local problems. This process is known as re-iterated homogenization and has many variations in the numerical context. Though the process seems to be a straightforward extension of two-level process, it requires some careful implementation and the concept development for problems without scale separation and high contrast. In this paper, we consider the Generalized Multiscale Finite Element Method (GMsFEM) and apply it iteratively to construct its multiscale basis functions. The main idea of the GMsFEM is to construct snapshot functions and then extract multiscale basis functions (called offline space) using local spectral decompositions in the snapshot spaces. The extension of this construction to several levels uses snapshots and offline spaces interchangebly to achieve this goal. At each coarse-grid scale, we assume that the offline space is a good approximation of the solution and use all possible offline functions or randomization as boundary conditions and solve the local problems in the offline space at the previous (finer) level, to construct snapshot space. We present an adaptivity strategy and show numerical results for flows in heterogeneous media and in perforated domains.

preprint2015arXiv

Adaptive mixed GMsFEM for flows in heterogeneous media

In this paper, we present two adaptive methods for the basis enrichment of the mixed Generalized Multiscale Finite Element Method (GMsFEM) for solving the flow problem in heterogeneous media. We develop an a-posteriori error indicator which depends on the norm of a local residual operator. Based on this indicator, we construct an offline adaptive method to increase the number of basis functions locally in coarse regions with large local residuals. We also develop an online adaptive method which iteratively enriches the function space by adding new functions computed based on the residual of the previous solution and special minimum energy snapshots. We show theoretically and numerically the convergence of the two methods. The online method is, in general, better than the offline method as the online method is able to capture distant effects (at a cost of online computations), and both methods have faster convergence than a uniform enrichment. Analysis shows that the online method should start with certain number of initial basis functions in order to have the best performance. The numerical results confirm this and show further that with correct selection of initial basis functions, the convergence of the online method can be independent of the contrast of the medium. We consider cases with both very high and very low conducting inclusions and channels in our numerical experiments.

preprint2015arXiv

An online generalized multiscale discontinuous Galerkin method (GMsDGM) for flows in heterogeneous media

Offline computation is an essential component in most multiscale model reduction techniques. However, there are multiscale problems in which offline procedure is insufficient to give accurate representations of solutions, due to the fact that offline computations are typically performed locally and global information is missing in these offline information. To tackle this difficulty, we develop an online local adaptivity technique for local multiscale model reduction problems. We design new online basis functions within Discontinuous Galerkin method based on local residuals and some optimally estimates. The resulting basis functions are able to capture the solution efficiently and accurately, and are added to the approximation iteratively. Moreover, we show that the iterative procedure is convergent with a rate independent of physical scales if the initial space is chosen carefully. Our analysis also gives a guideline on how to choose the initial space. We present some numerical examples to show the performance of the proposed method.

preprint2015arXiv

Generalized Multiscale Finite Element Methods for problems in perforated heterogeneous domains

Complex processes in perforated domains occur in many real-world applications. These problems are typically characterized by physical processes in domains with multiple scales (see Figure 1 for the illustration of a perforated domain). Moreover, these problems are intrinsically multiscale and their discretizations can yield very large linear or nonlinear systems. In this paper, we investigate multiscale approaches that attempt to solve such problems on a coarse grid by constructing multiscale basis functions in each coarse grid, where the coarse grid can contain many perforations. In particular, we are interested in cases when there is no scale separation and the perforations can have different sizes. In this regard, we mention some earlier pioneering works [14, 18, 17], where the authors develop multiscale finite element methods. In our paper, we follow Generalized Multiscale Finite Element Method (GMsFEM) and develop a multiscale procedure where we identify multiscale basis functions in each coarse block using snapshot space and local spectral problems. We show that with a few basis functions in each coarse block, one can accurately approximate the solution, where each coarse block can contain many small inclusions. We apply our general concept to (1) Laplace equation in perforated domain; (2) elasticity equation in perforated domain; and (3) Stokes equations in perforated domain. Numerical results are presented for these problems using two types of heterogeneous perforated domains. The analysis of the proposed methods will be presented elsewhere.

preprint2015arXiv

Generalized Multiscale Finite-Element Method (GMsFEM) for elastic wave propagation in heterogeneous, anisotropic media

It is important to develop fast yet accurate numerical methods for seismic wave propagation to characterize complex geological structures and oil and gas reservoirs. However, the computational cost of conventional numerical modeling methods, such as finite-difference method and finite-element method, becomes prohibitively expensive when applied to very large models. We propose a Generalized Multiscale Finite-Element Method (GMsFEM) for elastic wave propagation in heterogeneous, anisotropic media, where we construct basis functions from multiple local problems for both the boundaries and interior of a coarse node support or coarse element. The application of multiscale basis functions can capture the fine scale medium property variations, and allows us to greatly reduce the degrees of freedom that are required to implement the modeling compared with conventional finite-element method for wave equation, while restricting the error to low values. We formulate the continuous Galerkin and discontinuous Galerkin formulation of the multiscale method, both of which have pros and cons. Applications of the multiscale method to three heterogeneous models show that our multiscale method can effectively model the elastic wave propagation in anisotropic media with a significant reduction in the degrees of freedom in the modeling system.

preprint2015arXiv

Hierarchical multiscale modeling for flows in fractured media using Generalized Multiscale Finite Element Method

In this paper, we develop a multiscale finite element method for solving flows in fractured media. Our approach is based on Generalized Multiscale Finite Element Method (GMsFEM), where we represent the fracture effects on a coarse grid via multiscale basis functions. These multiscale basis functions are constructed in the offline stage via local spectral problems following GMsFEM. To represent the fractures on the fine grid, we consider two approaches (1) Discrete Fracture Model (DFM) (2) Embedded Fracture Model (EFM) and their combination. In DFM, the fractures are resolved via the fine grid, while in EFM the fracture and the fine grid block interaction is represented as a source term. In the proposed multiscale method, additional multiscale basis functions are used to represent the long fractures, while short-size fractures are collectively represented by a single basis functions. The procedure is automatically done via local spectral problems. In this regard, our approach shares common concepts with several approaches proposed in the literature as we discuss. Numerical results are presented where we demonstrate how one can adaptively add basis functions in the regions of interest based on error indicators. We also discuss the use of randomized snapshots (\cite{randomized2014}) which reduces the offline computational cost.

preprint2015arXiv

Homogenization of Brinkman flows in heterogeneous dynamic media

In this paper, we study Brinkman's equations with microscale properties that are highly heterogeneous in space and time. The time variations are controlled by a stochastic particle dynamics described by an SDE. The particle dynamics can be thought as particle deposition that often occurs in filter problems. Our main results include the derivation of macroscale equations and showing that the macroscale equations are deterministic. The latter is important for our (also many other) applications as it greatly simplifies the macroscale equations. We use the asymptotic properties of the SDE and the periodicity of the Brinkman's coefficient in the space variable to prove the convergence result. The SDE has a unique invariant measure that is ergodic and strongly mixing. The macro scale equations are derived through an averaging principle of the slow motion (fluid velocity) with respect to the fast motion (particle dynamics) and also by averaging the Brinkman's coefficient with respect to the space variable. Our results can be extended to more general nonlinear diffusion equations with heterogeneous coefficients.

preprint2015arXiv

Multiscale model reduction for shale gas transport in fractured media

In this paper, we develop a multiscale model reduction technique that describes shale gas transport in fractured media. Due to the pore-scale heterogeneities and processes, we use upscaled models to describe the matrix. We follow our previous work \cite{aes14}, where we derived an upscaled model in the form of generalized nonlinear diffusion model to describe the effects of kerogen. To model the interaction between the matrix and the fractures, we use Generalized Multiscale Finite Element Method. In this approach, the matrix and the fracture interaction is modeled via local multiscale basis functions. We developed the GMsFEM and applied for linear flows with horizontal or vertical fracture orientations on a Cartesian fine grid. In this paper, we consider arbitrary fracture orientations and use triangular fine grid and developed GMsFEM for nonlinear flows. Moreover, we develop online basis function strategies to adaptively improve the convergence. The number of multiscale basis functions in each coarse region represents the degrees of freedom needed to achieve a certain error threshold. Our approach is adaptive in a sense that the multiscale basis functions can be added in the regions of interest. Numerical results for two-dimensional problem are presented to demonstrate the efficiency of proposed approach.

preprint2015arXiv

Multiscale stabilization for convection-dominated diffusion in heterogeneous media

We develop a Petrov-Galerkin stabilization method for multiscale convection-diffusion transport systems. Existing stabilization techniques add a limited number of degrees of freedom in the form of bubble functions or a modified diffusion, which may not sufficient to stabilize multiscale systems. We seek a local reduced-order model for this kind of multiscale transport problems and thus, develop a systematic approach for finding reduced-order approximations of the solution. We start from a Petrov-Galerkin framework using optimal weighting functions. We introduce an auxiliary variable to a mixed formulation of the problem. The auxiliary variable stands for the optimal weighting function. The problem reduces to finding a test space (a reduced dimensional space for this auxiliary variable), which guarantees that the error in the primal variable (representing the solution) is close to the projection error of the full solution on the reduced dimensional space that approximates the solution. To find the test space, we reformulate some recent mixed Generalized Multiscale Finite Element Methods. We introduce snapshots and local spectral problems that appropriately define local weight and trial spaces. In particular, we use energy minimizing snapshots and local spectral decompositions in the natural norm associated with the auxiliary variable. The resulting spectral decomposition adaptively identifies and builds the optimal multiscale space to stabilize the system. We discuss the stability and its relation to the approximation property of the test space. We design online basis functions, which accelerate convergence in the test space, and consequently, improve stability. We present several numerical examples and show that one needs a few test functions to achieve an error similar to the projection error in the primal variable irrespective of the Peclet number.

preprint2015arXiv

Residual-driven online Generalized Multiscale Finite Element Methods

The construction of local reduced-order models via multiscale basis functions has been an area of active research. In this paper, we propose online multiscale basis functions which are constructed using the offline space and the current residual. Online multiscale basis functions are constructed adaptively in some selected regions based on our error indicators. We derive an error estimator which shows that one needs to have an offline space with certain properties to guarantee that additional online multiscale basis function will decrease the error. This error decrease is independent of physical parameters, such as the contrast and multiple scales in the problem. The offline spaces are constructed using Generalized Multiscale Finite Element Methods (GMsFEM). We show that if one chooses a sufficient number of offline basis functions, one can guarantee that additional online multiscale basis functions will reduce the error independent of contrast. We note that the construction of online basis functions is motivated by the fact that the offline space construction does not take into account distant effects. Using the residual information, we can incorporate the distant information provided the offline approximation satisfies certain properties. In the paper, theoretical and numerical results are presented. Our numerical results show that if the offline space is sufficiently large (in terms of the dimension) such that the coarse space contains all multiscale spectral basis functions that correspond to small eigenvalues, then the error reduction by adding online multiscale basis function is independent of the contrast. We discuss various ways computing online multiscale basis functions which include a use of small dimensional offline spaces.

preprint2015arXiv

Sparse Generalized Multiscale Finite Element Methods and their applications

In a number of previous papers, local (coarse grid) multiscale model reduction techniques are developed using a Generalized Multiscale Finite Element Method. In these approaches, multiscale basis functions are constructed using local snapshot spaces, where a snapshot space is a large space that represents the solution behavior in a coarse block. In a number of applications (e.g., those discussed in the paper), one may have a sparsity in the snapshot space for an appropriate choice of a snapshot space. More precisely, the solution may only involve a portion of the snapshot space. In this case, one can use sparsity techniques to identify multiscale basis functions. In this paper, we consider two such sparse local multiscale model reduction approaches. In the first approach (which is used for parameter-dependent multiscale PDEs), we use local minimization techniques, such as sparse POD, to identify multiscale basis functions, which are sparse in the snapshot space. These minimization techniques use $l_1$ minimization to find local multiscale basis functions, which are further used for finding the solution. In the second approach (which is used for the Helmholtz equation), we directly apply $l_1$ minimization techniques to solve the underlying PDEs. This approach is more expensive as it involves a large snapshot space; however, in this example, we can not identify a local minimization principle, such as local generalized SVD.

preprint2014arXiv

An adaptive generalized multiscale discontinuous Galerkin method (GMsDGM) for high-contrast flow problems

In this paper, we develop an adaptive Generalized Multiscale Discontinuous Galerkin Method (GMs-DGM) for a class of high-contrast flow problems, and derive a-priori and a-posteriori error estimates for the method. Based on the a-posteriori error estimator, we develop an adaptive enrichment algorithm for our GMsDGM and prove its convergence. The adaptive enrichment algorithm gives an automatic way to enrich the approximation space in regions where the solution requires more basis functions, which are shown to perform well compared with a uniform enrichment. We also discuss an approach that adaptively selects multiscale basis functions by correlating the residual to multiscale basis functions (cf. [4]). The proposed error indicators are L2-based and can be inexpensively computed which makes our approach efficient. Numerical results are presented that demonstrate the robustness of the proposed error indicators.

preprint2014arXiv

Homogenization of the evolution Stokes equation in a perforated domain with a stochastic Fourier boundary condition

The evolution Stokes equation in a perforated domain subject to Fourier boundary condition on the boundaries of the holes is considered. We assume that the dynamic is driven by a stochastic perturbation on the interior of the domain and another stochastic perturbation on the boundaries of the holes. The macroscopic (homogenized) equation is derived as another stochastic partial differential equation, defined in the whole non perforated domain. Here, the initial stochastic perturbation on the boundary becomes part of the homogenized equation as another stochastic force. We use the two-scale convergence method after extending the solution with 0 in the wholes to pass to the limit. By Itô stochastic calculus, we get uniform estimates on the solution in appropriate spaces. In order to pass to the limit on the boundary integrals, we rewrite them in terms of integrals in the whole domain. In particular, for the stochastic integral on the boundary, we combine the previous idea of rewriting it on the whole domain with the assumption that the Brownian motion is of trace class. Due to the particular boundary condition dealt with, we get that the solution of the stochastic homogenized equation is not divergence free. However, it is coupled with the cell problem that has a divergence free solution. This paper represents an extension of the results from of Duan and Wang (Comm. Math. Phys. 275:1508--1527, 2007), where a reaction diffusion equation with a dynamical boundary condition with a noise source term on both the interior of the domain and on the boundary was studied, and through a tightness argument and a pointwise two scale convergence method the homogenized equation was derived.

preprint2014arXiv

Mixed Generalized Multiscale Finite Element Methods and Applications

In this paper, we present a mixed Generalized Multiscale Finite Element Method (GMsFEM) for solving flow in heterogeneous media. Our approach constructs multiscale basis functions following a GMsFEM framework and couples these basis functions using a mixed finite element method, which allows us to obtain a mass conservative velocity field. To construct multiscale basis functions for each coarse edge, we design a snapshot space that consists of fine-scale velocity fields supported in a union of two coarse regions that share the common interface. The snapshot vectors have zero Neumann boundary conditions on the outer boundaries and we prescribe their values on the common interface. We describe several spectral decompositions in the snapshot space motivated by the analysis. In the paper, we also study oversampling approaches that enhance the accuracy of mixed GMsFEM. A main idea of oversampling techniques is to introduce a small dimensional snapshot space. We present numerical results for two-phase flow and transport, without updating basis functions in time. Our numerical results show that one can achieve good accuracy with a few basis functions per coarse edge if one selects appropriate offline spaces.

preprint2014arXiv

Multilevel Markov Chain Monte Carlo Method for High-Contrast Single-Phase Flow Problems

In this paper we propose a general framework for the uncertainty quantification of quantities of interest for high-contrast single-phase flow problems. It is based on the generalized multiscale finite element method (GMsFEM) and multilevel Monte Carlo (MLMC) methods. The former provides a hierarchy of approximations of different resolution, whereas the latter gives an efficient way to estimate quantities of interest using samples on different levels. The number of basis functions in the online GMsFEM stage can be varied to determine the solution resolution and the computational cost, and to efficiently generate samples at different levels. In particular, it is cheap to generate samples on coarse grids but with low resolution, and it is expensive to generate samples on fine grids with high accuracy. By suitably choosing the number of samples at different levels, one can leverage the expensive computation in larger fine-grid spaces toward smaller coarse-grid spaces, while retaining the accuracy of the final Monte Carlo estimate. Further, we describe a multilevel Markov chain Monte Carlo method, which sequentially screens the proposal with different levels of approximations and reduces the number of evaluations required on fine grids, while combining the samples at different levels to arrive at an accurate estimate. The framework seamlessly integrates the multiscale features of the GMsFEM with the multilevel feature of the MLMC methods following the work in \cite{ketelson2013}, and our numerical experiments illustrate its efficiency and accuracy in comparison with standard Monte Carlo estimates.

preprint2014arXiv

Multiscale Empirical Interpolation for Solving Nonlinear PDEs using Generalized Multiscale Finite Element Methods

In this paper, we propose a multiscale empirical interpolation method for solving nonlinear multiscale partial differential equations. The proposed method combines empirical interpolation techniques and local multiscale methods, such as the Generalized Multiscale Finite Element Method (GMsFEM). To solve nonlinear equations, the GMsFEM is used to represent the solution on a coarse grid with multiscale basis functions computed offline. Computing the GMsFEM solution involves calculating the residuals on the fine grid. We use empirical interpolation concepts to evaluate the residuals and the Jacobians of the multiscale system with a computational cost which is proportional to the coarse scale problem rather than the fully-resolved fine scale one. Empirical interpolation methods use basis functions and an inexpensive inversion which are computed in the offline stage for finding the coefficients in the expansion based on a limited number of nonlinear function evaluations. The proposed multiscale empirical interpolation techniques: (1) divide computing the nonlinear function into coarse regions; (2) evaluate contributions of nonlinear functions in each coarse region taking advantage of a reduced-order representation of the solution; and (3) introduce multiscale proper-orthogonal-decomposition techniques to find appropriate interpolation vectors. We demonstrate the effectiveness of the proposed methods on several examples of nonlinear multiscale PDEs that are solved with Newton's methods and fully-implicit time marching schemes. Our numerical results show that the proposed methods provide a robust framework for solving nonlinear multiscale PDEs on a coarse grid with bounded error.

preprint2013arXiv

A multiscale HDG method for second order elliptic equations. Part I. Polynomial and homogenization-based multiscale spaces

We introduce a finite element method for numerical upscaling of second order elliptic equations with highly heterogeneous coefficients. The method is based on a mixed formulation of the problem and the concepts of the domain decomposition and the hybrid discontinuous Galerkin methods. The method utilizes three different scales: (1) the scale of the partition of the domain of the problem, (2) the sale of partition of the boundaries of the subdomains (related to the corresponding space of Lagrange multipliers), and (3) the fine grid scale that is assumed to resolve the scale of the heterogeneous variation of the coefficients. Our proposed method gives a flexible framework that (1) couples independently generated multiscale basis functions in each coarse patch (2) provides a stable global coupling independent of local discretization, physical scales and contrast (3) allows avoiding any constraints on coarse spaces. In this paper, we develop and study a multiscale HDG method that uses polynomial and homogenization-based multiscale spaces. These coarse spaces are designed for problems with scale separation. In our consequent paper, we plan to extend our flexible HDG framework to more challenging multiscale problems with non-separable scales and high contrast and consider enriched coarse spaces that use appropriate local spectral problems.

preprint2013arXiv

An adaptive GMsFEM for high-contrast flow problems

In this paper, we derive an a-posteriori error indicator for the Generalized Multiscale Finite Element Method (GMsFEM) framework. This error indicator is further used to develop an adaptive enrichment algorithm for the linear elliptic equation with multiscale high-contrast coefficients. The GMsFEM, which has recently been introduced in [12], allows solving multiscale parameter-dependent problems at a reduced computational cost by constructing a reduced-order representation of the solution on a coarse grid. The main idea of the method consists of (1) the construction of snapshot space, (2) the construction of the offline space, and (3) the construction of the online space (the latter for parameter-dependent problems). In [12], it was shown that the GMsFEM provides a flexible tool to solve multiscale problems with a complex input space by generating appropriate snapshot, offline, and online spaces. In this paper, we study an adaptive enrichment procedure and derive an a-posteriori error indicator which gives an estimate of the local error over coarse grid regions. We consider two kinds of error indicators where one is based on the $L^2$-norm of the local residual and the other is based on the weighted $H^{-1}$-norm of the local residual where the weight is related to the coefficient of the elliptic equation. We show that the use of weighted $H^{-1}$-norm residual gives a more robust error indicator which works well for cases with high contrast media. The convergence analysis of the method is given. In our analysis, we do not consider the error due to the fine-grid discretization of local problems and only study the errors due to the enrichment. Numerical results are presented that demonstrate the robustness of the proposed error indicators.

preprint2013arXiv

Generalized Multiscale Finite Element Methods (GMsFEM)

In this paper, we propose a general approach called Generalized Multiscale Finite Element Method (GMsFEM) for performing multiscale simulations for problems without scale separation over a complex input space. As in multiscale finite element methods (MsFEMs), the main idea of the proposed approach is to construct a small dimensional local solution space that can be used to generate an efficient and accurate approximation to the multiscale solution with a potentially high dimensional input parameter space. In the proposed approach, we present a general procedure to construct the offline space that is used for a systematic enrichment of the coarse solution space in the online stage. The enrichment in the online stage is performed based on a spectral decomposition of the offline space. In the online stage, for any input parameter, a multiscale space is constructed to solve the global problem on a coarse grid. The online space is constructed via a spectral decomposition of the offline space and by choosing the eigenvectors corresponding to the largest eigenvalues. The computational saving is due to the fact that the construction of the online multiscale space for any input parameter is fast and this space can be re-used for solving the forward problem with any forcing and boundary condition. Compared with the other approaches where global snapshots are used, the local approach that we present in this paper allows us to eliminate unnecessary degrees of freedom on a coarse-grid level. We present various examples in the paper and some numerical results to demonstrate the effectiveness of our method.

preprint2013arXiv

Generalized multiscale finite element methods for wave propagation in heterogeneous media

Numerical modeling of wave propagation in heterogeneous media is important in many applications. Due to the complex nature, direct numerical simulations on the fine grid are prohibitively expensive. It is therefore important to develop efficient and accurate methods that allow the use of coarse grids. In this paper, we present a multiscale finite element method for wave propagation on a coarse grid. The proposed method is based on the Generalized Multiscale Finite Element Method (GMsFEM). To construct multiscale basis functions, we start with two snapshot spaces in each coarse-grid block where one represents the degrees of freedom on the boundary and the other represents the degrees of freedom in the interior. We use local spectral problems to identify important modes in each snapshot space. These local spectral problems are different from each other and their formulations are based on the analysis. To our best knowledge, this is the first time where multiple snapshot spaces and multiple spectral problems are used and necessary for efficient computations. Using the dominant modes from local spectral problems, multiscale basis functions are constructed to represent the solution space locally within each coarse block. These multiscale basis functions are coupled via the symmetric interior penalty discontinuous Galerkin method which provides a block diagonal mass matrix, and, consequently, results in fast computations in an explicit time discretiza- tion. Our methods' stability and spectral convergence are rigorously analyzed. Numerical examples are presented to show our methods' performance. We also test oversampling strategies. In particular, we discuss how the modes from different snapshot spaces can affect the proposed methods' accuracy.

preprint2013arXiv

Generalized Multiscale Finite Element Methods. Nonlinear Elliptic Equations

In this paper we use the GeneralizedMultiscale Finite ElementMethod (GMsFEM) framework, introduced in [20], in order to solve nonlinear elliptic equations with high-contrast coefficients. The proposed solution method involves linearizing the equation so that coarse-grid quantities of previous solution iterates can be regarded as auxiliary parameters within the problem formulation. With this convention, we systematically construct respective coarse solution spaces that lend themselves to either continuous Galerkin (CG) or discontinuous Galerkin (DG) global formulations. Here, we use Symmetric Interior Penalty Discontinuous Galerkin approach. Both methods yield a predictable error decline that depends on the respective coarse space dimension, and we illustrate the effectiveness of the CG and DG formulations by offering a variety of numerical examples.

preprint2013arXiv

Generalized Multiscale Finite Element Methods. Oversampling Strategies

In this paper, we propose oversampling strategies in the Generalized Multiscale Finite Element Method (GMsFEM) framework. The GMsFEM, which has been recently introduced in [12], allows solving multiscale parameter-dependent problems at a reduced computational cost by constructing a reduced-order representation of the solution on a coarse grid. The main idea of the method consists of (1) the construction of snapshot space, (2) the construction of the offline space, and (3) construction of the online space (the latter for parameter-dependent problems). In [12], it was shown that the GMsFEM provides a flexible tool to solve multiscale problems with a complex input space by generating appropriate snapshot, offline, and online spaces. In this paper, we develop oversampling techniques to be used in this context (see [19] where oversampling is introduced for multiscale finite element methods). It is known (see [19]) that the oversampling can improve the accuracy of multiscale methods. In particular, the oversampling technique uses larger regions (larger than the target coarse block) in constructing local basis functions. Our motivation stems from the analysis presented in this paper which show that when using oversampling techniques in the construction of the snapshot space and offline space, GMsFEM will converge independent of small scales and high-contrast under certain assumptions. We consider the use of multiple eigenvalue problem to improve the convergence and discuss their relation to single spectral problems that use oversampled regions. The oversampling procedures proposed in this paper differ from those in [19]. In particular, the oversampling domains are partially used in constructing local spectral problems. We present numerical results and compare various oversampling techniques in order to complement the proposed technique and analysis.

preprint2013arXiv

Mode Decomposition Methods for Flows in High-Contrast Porous Media. Part I. Global Approach

We apply dynamic mode decomposition (DMD) and proper orthogonal decomposition (POD) methods to flows in highly-heterogeneous porous media to extract the dominant coherent structures and derive reduced-order models via Galerkin projection. Permeability fields with high contrast are considered to investigate the capability of these techniques to capture the main flow features and forecast the flow evolution within a certain accuracy. A DMD-based approach shows a better predictive capability due to its ability to accurately extract the information relevant to long-time dynamics, in particular, the slowly-decaying eigenmodes corresponding to largest eigenvalues. Our study enables a better understanding of the strengths and weaknesses of the applicability of these techniques for flows in high-contrast porous media. Furthermore, we discuss the robustness of DMD- and POD-based reduced-order models with respect to variations in initial conditions, permeability fields, and forcing terms.

preprint2013arXiv

Mode Decomposition Methods for Flows in High-Contrast Porous Media. Part II. Local-Global Approach

In this paper, we combine concepts of the generalized multiscale finite element method and mode decomposition methods to construct a robust local-global approach for model reduction of flows in high-contrast porous media. This is achieved by implementing proper orthogonal decomposition (POD) and dynamic mode decomposition (DMD) techniques on a coarse grid. The resulting reduced-order approach enables a significant reduction in the flow problem size while accurately capturing the behavior of fully resolved solutions. We consider a variety of high-contrast coefficients and present the corresponding numerical results to illustrate the effectiveness of the proposed technique. This paper is a continuation of the first part where we examine the applicability of POD and DMD to derive simplified and reliable representations of flows in high-contrast porous media. In the current paper, we discuss how these global model reduction approaches can be combined with local techniques to speed-up the simulations. The speed-up is due to inexpensive, while sufficiently accurate, computations of global snapshots.

preprint2013arXiv

Multi-Level Monte Carlo approaches for numerical homogenization

In this article, we study the application of Multi-Level Monte Carlo (MLMC) approaches to numerical random homogenization. Our objective is to compute the expectation of some functionals of the homogenized coefficients, or of the homogenized solutions. This is accomplished within MLMC by considering different levels of representative volumes (RVE), and, when it comes to homogenized solutions, different levels of coarse-grid meshes. Many inexpensive computations with the smallest RVE size and the largest coarse mesh are combined with fewer expensive computations performed on larger RVEs and smaller coarse meshes. We show that, by carefully selecting the number of realizations at each level, we can achieve a speed-up in the computations in comparison to a standard Monte Carlo method. Numerical results are presented both for one-dimensional and two-dimensional test-cases.

preprint2013arXiv

Upscaling of Nonlinear Forchheimer Flows

In this work we propose upscaling method for nonlinear Forchheimer flow in highly heterogeneous porous media. The generalized Forchheimer law is considered for incompressible and slightly-compressible single-phase flows. We use recently developed analytical results Aulisa et al. (2009) and write the resulting system in terms of a degenerate nonlinear flow equation for the pressure with the nonlinearity that depends on the pressure gradient. The coarse scale parameters for the steady state problem are determined so that the volumetric average of velocity of the flow in the domain on fine scale and on coarse scale are close enough. A flow-based coarsening approach is used, where the equivalent permeability tensor is first evaluated following the streamline of the existing linear cases, and successively modified in order to take into account the nonlinear effects. Compared to previous works Durlofsky and Karimi-Fard (2009) and Peszynska et al. (2009), our approach relies on recent analytical results of Aulisa et al. (2009) and combines it with rigorous mathematical upscaling theory for monotone operators. The developed upscaling algorithm for nonlinear steady state problems is effectively used for variety of heterogeneities in the domain of computation. Direct numerical computations for average velocity and productivity index justify the usage of the coarse scale parameters obtained for the special steady state case in the fully transient problem. Analytical upscaling formulas in stratified domain are obtained for the nonlinear case. They correlate with high accuracy with numerical results.

preprint2012arXiv

Asymptotic expansions for high-contrast elliptic equations

In this paper, we present a high-order expansion for elliptic equations in high-contrast media. The background conductivity is taken to be one and we assume the medium contains high (or low) conductivity inclusions. We derive an asymptotic expansion with respect to the contrast and provide a procedure to compute the terms in the expansion. The computation of the expansion does not depend on the contrast which is important for simulations. The latter allows avoiding increased mesh resolution around high conductivity features. This work is partly motivated by our earlier work in \cite{ge09_1} where we design efficient numerical procedures for solving high-contrast problems. These multiscale approaches require local solutions and our proposed high-order expansion can be used to approximate these local solutions inexpensively. In the case of a large-number of inclusions, the proposed analysis can help to design localization techniques for computing the terms in the expansion. In the paper, we present a rigorous analysis of the proposed high-order expansion and estimate the remainder of it. We consider both high and low conductivity inclusions.