Source author record

Martin Burger

Martin Burger appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

53works
20topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

53 published item(s)

preprint2026arXiv

Multi-Dimensional Opinion Formation

In this paper we propose and investigate a multi-dimensional opinion dynamics model where people are characterised by both opinions and importance weights across these opinions. Opinion changes occur through binary interactions, with a novel coupling mechanism: the change in one topic depends on the weighted similarity across the full opinion vector. We state the kinetic equation for this process and derive its mean-field partial differential equation to describe the overall dynamics. Analytical computations and numerical simulations confirm that this model generates complex stationary states, and we demonstrate that the final opinion structures are critically determined by the peoples' opinion weights.

preprint2022arXiv

A Bregman Learning Framework for Sparse Neural Networks

We propose a learning framework based on stochastic Bregman iterations, also known as mirror descent, to train sparse neural networks with an inverse scale space approach. We derive a baseline algorithm called LinBreg, an accelerated version using momentum, and AdaBreg, which is a Bregmanized generalization of the Adam algorithm. In contrast to established methods for sparse training the proposed family of algorithms constitutes a regrowth strategy for neural networks that is solely optimization-based without additional heuristics. Our Bregman learning framework starts the training with very few initial parameters, successively adding only significant ones to obtain a sparse and expressive network. The proposed approach is extremely easy and efficient, yet supported by the rich mathematical theory of inverse scale space methods. We derive a statistically profound sparse parameter initialization strategy and provide a rigorous stochastic convergence analysis of the loss decay and additional convergence proofs in the convex regime. Using only 3.4% of the parameters of ResNet-18 we achieve 90.2% test accuracy on CIFAR-10, compared to 93.6% using the dense network. Our algorithm also unveils an autoencoder architecture for a denoising task. The proposed framework also has a huge potential for integrating sparse backpropagation and resource-friendly training.

preprint2022arXiv

On multi-species diffusion with size exclusion

We revisit a classical continuum model for the diffusion of multiple species with size-exclusion constraint, which leads to a degenerate nonlinear cross-diffusion system. The purpose of this article is twofold: first, it aims at a systematic study of the question of existence of weak solutions and their long-time asymptotic behaviour. Second, it provides a weak-strong stability estimate for a wide range of coefficients, which had been missing so far. In order to achieve the results mentioned above, we exploit the formal gradient-flow structure of the model with respect to a logarithmic entropy, which leads to best estimates in the full-interaction case, where all cross-diffusion coefficients are non-zero. Those are crucial to obtain the minimal Sobolev regularity needed for a weak-strong stability result. For meaningful cases when some of the coefficients vanish, we provide a novel existence result based on approximation by the full-interaction case.

preprint2022arXiv

Region-of-Interest Prioritised Sampling for Constrained Autonomous Exploration Systems

Goal oriented autonomous operation of space rovers has been known to increase scientific output of a mission. In this work we present an algorithm, called the RoI Prioritised Sampling (RPS), that prioritises Region-of-Interests (RoIs) in an exploration scenario in order to utilise the limited resources of the imaging instrument on the rover effectively. This prioritisation is based on an estimator that evaluates the change in information content at consecutive spatial scales of the RoIs without calculating the finer scale reconstruction. The estimator, called the Refinement Indicator (RI), is motivated and derived. Multi-scale acquisition approaches, based on classical and multilevel compressed sensing, with respect to the single pixel camera architecture are discussed. The performance of the algorithm is verified on remote sensing images and compared with the state-of-the-art multi-resolution reconstruction algorithms. At the considered sub-sampling rates the RPS is shown to better utilise the system resources for reconstructing the RoIs.

preprint2022arXiv

Well-posedness of an integro-differential model for active Brownian particles

We propose a general strategy for solving nonlinear integro-differential evolution problems with periodic boundary conditions, where no direct maximum/minimum principle is available. This is motivated by the study of recent macroscopic models for active Brownian particles with repulsive interactions, consisting of advection-diffusion processes in the space of particle position and orientation. We focus on one of such models, namely a semilinear parabolic equation with a nonlinear active drift term, whereby the velocity depends on the particle orientation and angle-independent overall particle density (leading to a nonlocal term by integrating out the angular variable). The main idea of the existence analysis is to exploit a-priori estimates from (approximate) entropy dissipation. The global existence and uniqueness of weak solutions is shown using a two-step Galerkin approximation with appropriate cutoff in order to obtain nonnegativity, an upper bound on the overall density and preserve a-priori estimates. Our anyalysis naturally includes the case of finite systems, corresponding to the case of a finite number of directions. The Duhamel principle is then used to obtain additional regularity of the solution, namely continuity in time-space. Motivated by the class of initial data relevant for the application, which includes perfectly aligned particles (same orientation), we extend the well-posedness result to very weak solutions allowing distributional initial data with low regularity.

preprint2021arXiv

Gradient Flows and Nonlinear Power Methods for the Computation of Nonlinear Eigenfunctions

This chapter describes how gradient flows and nonlinear power methods in Banach spaces can be used to solve nonlinear eigenvector-dependent eigenvalue problems, and how convergence of (discretized) approximations can be verified. We review several flows from literature, which were proposed to compute nonlinear eigenfunctions, and show that they all relate to normalized gradient flows. Furthermore, we show that the implicit Euler discretization of gradient flows gives rise to a nonlinear power method of the proximal operator and prove their convergence to nonlinear eigenfunctions. Finally, we prove that $Γ$-convergence of functionals implies convergence of their ground states, which is important for discrete approximations.

preprint2021arXiv

Identifying Untrustworthy Predictions in Neural Networks by Geometric Gradient Analysis

The susceptibility of deep neural networks to untrustworthy predictions, including out-of-distribution (OOD) data and adversarial examples, still prevent their widespread use in safety-critical applications. Most existing methods either require a re-training of a given model to achieve robust identification of adversarial attacks or are limited to out-of-distribution sample detection only. In this work, we propose a geometric gradient analysis (GGA) to improve the identification of untrustworthy predictions without retraining of a given model. GGA analyzes the geometry of the loss landscape of neural networks based on the saliency maps of their respective input. To motivate the proposed approach, we provide theoretical connections between gradients' geometrical properties and local minima of the loss function. Furthermore, we demonstrate that the proposed method outperforms prior approaches in detecting OOD data and adversarial attacks, including state-of-the-art and adaptive attacks.

preprint2020arXiv

Coarse graining of a Fokker-Planck equation with excluded volume effects preserving the gradient-flow structure

The propagation of gradient flow structures from microscopic to macroscopic models is a topic of high current interest. In this paper we discuss this propagation in a model for the diffusion of particles interacting via hard-core exclusion or short-range repulsive potentials. We formulate the microscopic model as a high-dimensional gradient flow in the Wasserstein metric for an appropriate free-energy functional. Then we use the JKO approach to identify the asymptotics of the metric and the free-energy functional beyond the lowest order for single particle densities in the limit of small particle volumes by matched asymptotic expansions. While we use a propagation of chaos assumption at far distances, we consider correlations at small distance in the expansion. In this way we obtain a clear picture of the emergence of a macroscopic gradient structure incorporating corrections in the free energy functional due to the volume exclusion.

preprint2020arXiv

Data assimilation in price formation

We consider the problem of estimating the density of buyers and vendors in a nonlinear parabolic price formation model using measurements of the price and the transaction rate. Our approach is based on a work by Puel et al., see \cite{Puel2002}, and results in a optimal control problem. We analyse this problems and provide stability estimates for the controls as well as the unknown density in the presence of measurement errors. Our analytic findings are supported with numerical experiments.

preprint2020arXiv

Delayed Blow-Up for Chemotaxis Models with Local Sensing

The aim of this paper is to analyze a model for chemotaxis based on a local sensing mechanism instead of the gradient sensing mechanism used in the celebrated minimal Keller-Segel model. The model we study has the same entropy as the minimal Keller-Segel model, but a different dynamics to minimize this entropy. Consequently, the conditions on the mass for the existence of stationary solutions or blow-up are the same, however we make the interesting observation that with the local sensing mechanism the blow-up in the case of supercritical mass is delayed to infinite time. Our observation is made rigorous from a mathematical point via a proof of global existence of weak solutions for arbitrary large masses and space dimension. The key difference of our model to the minimal Keller-Segel model is that the structure of the equation allows for a duality estimate that implies a bound on the $(H^1)'$-norm of the solutions, which can only grow with a square-root law in time. This additional $(H^1)'$-bound implies a lower bound on the entropy, which contrasts markedly with the minimal Keller-Segel model for which it is unbounded from below in the supercritical case. Besides, regularity and uniqueness of solutions are also studied.

preprint2020arXiv

Mean-field optimal control and optimality conditions in the space of probability measures

We derive a framework to compute optimal controls for problems with states in the space of probability measures. Since many optimal control problems constrained by a system of ordinary differential equations (ODE) modelling interacting particles converge to optimal control problems constrained by a partial differential equation (PDE) in the mean-field limit, it is interesting to have a calculus directly on the mesoscopic level of probability measures which allows us to derive the corresponding first-order optimality system. In addition to this new calculus, we provide relations for the resulting system to the first-order optimality system derived on the particle level, and the first-order optimality system based on $L^2$-calculus under additional regularity assumptions. We further justify the use of the $L^2$-adjoint in numerical simulations by establishing a link between the adjoint in the space of probability measures and the adjoint corresponding to $L^2$-calculus. Moreover, we prove a convergence rate for the convergence of the optimal controls corresponding to the particle formulation to the optimal controls of the mean-field problem as the number of particles tends to infinity.

preprint2020arXiv

Network structured kinetic models of social interactions

The aim of this paper is to study the derivation of appropriate meso- and macroscopic models for interactions as appearing in social processes. There are two main characteristics the models take into account, namely a network structure of interactions, which we treat by an appropriate mesoscopic description, and a different role of interacting agents. The latter differs from interactions treated in classical statistical mechanics in the sense that the agents do not have symmetric roles, but there is rather an active and a passive agent. We will demonstrate how a certain form of kinetic equations can be obtained to describe such interactions at a mesoscopic level and moreover obtain macroscopic models from monokinetics solutions of those. The derivation naturally leads to systems of nonlocal reaction-diffusion equations (or in a suitable limit local versions thereof), which can explain spatial phase separation phenomena found to emerge from the microscopic interactions. We will highlight the approach in three examples, namely the evolution and coarsening of dialects in human language, the construction of social norms, and the spread of an epidemic.

preprint2019arXiv

An entropic Landweber method for linear ill-posed problems

The aim of this paper is to investigate the use of an entropic projection method for the iterative regularization of linear ill-posed problems. We derive a closed form solution for the iterates and analyze their convergence behaviour both in a case of reconstructing general nonnegative unknowns as well as for the sake of recovering probability distributions. Moreover, we discuss several variants of the algorithm and relations to other methods in the literature. The effectiveness of the approach is studied numerically in several examples.

preprint2019arXiv

Instantaneous control of interacting particle systems in the mean-field limit

Controlling large particle systems in collective dynamics by a few agents is a subject of high practical importance, e.g., in evacuation dynamics. In this paper we study an instantaneous control approach to steer an interacting particle system into a certain spatial region by repulsive forces from a few external agents, which might be interpreted as shepherd dogs leading sheep to their home. We introduce an appropriate mathematical model and the corresponding optimization problem. In particular, we are interested in the interaction of numerous particles, which can be approximated by a mean-field equation. Due to the high-dimensional phase space this will require a tailored optimization strategy. The arising control problems are solved using adjoint information to compute the descent directions. Numerical results on the microscopic and the macroscopic level indicate the convergence of optimal controls and optimal states in the mean-field limit,i.e., for an increasing number of particles.

preprint2016arXiv

A Variational Model for Joint Motion Estimation and Image Reconstruction

The aim of this paper is to derive and analyze a variational model for the joint estimation of motion and reconstruction of image sequences, which is based on a time-continuous Eulerian motion model. The model can be set up in terms of the continuity equation or the brightness constancy equation. The analysis in this paper focuses on the latter for robust motion estimation on sequences of two-dimensional images. We rigorously prove the existence of a minimizer in a suitable function space setting. Moreover, we discuss the numerical solution of the model based on primal-dual algorithms and investigate several examples. Finally, the benefits of our model compared to existing techniques, such as sequential image reconstruction and motion estimation, are shown.

preprint2016arXiv

An optimization approach for well-targeted transcranial direct current stimulation

Transcranial direct current stimulation is a non-invasive brain stimulation technique which modifies neural excitability by providing weak currents through scalp electrodes. The aim of this study is to introduce and analyze a novel optimization method for safe and well-targeted multi-array tDCS. For optimization, we consider an optimal control problem for a Laplace equation with Neumann boundary conditions with control and point-wise gradient state constraints. We prove existence and residual and objective convergence results for the proposed methods and provide computer simulation results in a highly realistic six-compartment geometry-adapted hexahedral head model. For discretization of the proposed minimization problem the finite element method is employed and the existence of at least one minimizer to the discretized optimization problem is shown. For numerical solution of the corresponding discretized problem we employ the alternating direction method of multipliers and comprehensively examine the cortical current flow field with regard to focality, target intensity and orientation. The numerical results reveal that the optimized current flow fields show significantly higher focality and, in most cases, higher directional agreement to the target vector in comparison to standard bipolar electrode montages.

preprint2016arXiv

Balanced growth path solutions of a Boltzmann mean field game model for knowledge growth

In this paper we study balanced growth path solutions of a Boltzmann mean field game model proposed by Lucas et al [13] to model knowledge growth in an economy. Agents can either increase their knowledge level by exchanging ideas in learning events or by producing goods with the knowledge they already have. The existence of balanced growth path solutions implies exponential growth of the overall production in time. We proof existence of balanced growth path solutions if the initial distribution of individuals with respect to their knowledge level satisfies a Pareto-tail condition. Furthermore we give first insights into the existence of such solutions if in addition to production and knowledge exchange the knowledge level evolves by geometric Brownian motion.

preprint2016arXiv

Bregman Cost for Non-Gaussian Noise

One of the tasks of the Bayesian inverse problem is to find a good estimate based on the posterior probability density. The most common point estimators are the conditional mean (CM) and maximum a posteriori (MAP) estimates, which correspond to the mean and the mode of the posterior, respectively. From a theoretical point of view it has been argued that the MAP estimate is only in an asymptotic sense a Bayes estimator for the uniform cost function, while the CM estimate is a Bayes estimator for the means squared cost function. Recently, it has been proven that the MAP estimate is a proper Bayes estimator for the Bregman cost if the image is corrupted by Gaussian noise. In this work we extend this result to other noise models with log-concave likelihood density, by introducing two related Bregman cost functions for which the CM and the MAP estimates are proper Bayes estimators. Moreover, we also prove that the CM estimate outperforms the MAP estimate, when the error is measured in a certain Bregman distance, a result previously unknown also in the case of additive Gaussian noise.

preprint2016arXiv

Simultaneous Reconstruction and Segmentation for Dynamic SPECT Imaging

This work deals with the reconstruction of dynamic images that incorporate characteristic dynamics in certain subregions, as arising for the kinetics of many tracers in emission tomography (SPECT, PET). We make use of a basis function approach for the unknown tracer concentration by assuming that the region of interest can be divided into subregions with spatially constant concentration curves. Applying a regularized variational framework reminiscent of the Chan-Vese model for image segmentation we simultaneously reconstruct both the labelling functions of the subregions as well as the subconcentrations within each region. Our particular focus is on applications in SPECT with Poisson noise model, resulting in a Kullback-Leibler data fidelity in the variational approach. We present a detailed analysis of the proposed variational model and prove existence of minimizers as well as error estimates. The latter apply to a more general class of problems and generalize existing results in literature since we deal with a nonlinear forward operator and a nonquadratic data fidelity. A computational algorithm based on alternating minimization and splitting techniques is developed for the solution of the problem and tested on appropriately designed synthetic data sets. For those we compare the results to those of standard EM reconstructions and investigate the effects of Poisson noise in the data.

preprint2016arXiv

Spectral Decompositions using One-Homogeneous Functionals

This paper discusses the use of absolutely one-homogeneous regularization functionals in a variational, scale space, and inverse scale space setting to define a nonlinear spectral decomposition of input data. We present several theoretical results that explain the relation between the different definitions. Additionally, results on the orthogonality of the decomposition, a Parseval-type identity and the notion of generalized (nonlinear) eigenvectors closely link our nonlinear multiscale decompositions to the well-known linear filtering theory. Numerical results are used to illustrate our findings.

preprint2015arXiv

A Nonlinear Variational Approach to Motion-Corrected Reconstruction of Density Images

The aim of this paper is to establish a nonlinear variational approach to the reconstruction of moving density images from indirect dynamic measurements. Our approach is to model the dynamics as a hyperelastic deformation of an initial density including preservation of mass. Consequently we derive a variational regularization model for the reconstruction, which - besides the usual data fidelity and total variation regularization of the images - also includes a motion constraint and a hyperelastic regularization energy. Under suitable assumptions we prove the existence of a minimizer, which relies on the concept of weak diffeomorphisms for the motion. Moreover, we study natural parameter asymptotics and regularizing properties of the variational model. Finally, we develop a computational solution method based on alternating minimization and splitting techniques, with a particular focus on dynamic PET. The potential improvements of our approach compared to conventional reconstruction techniques are investigated in appropriately designed examples.

preprint2015arXiv

Bregman Distances in Inverse Problems and Partial Differential Equation

The aim of this paper is to provide an overview of recent development related to Bregman distances outside its native areas of optimization and statistics. We discuss approaches in inverse problems and image processing based on Bregman distances, which have evolved to a standard tool in these fields in the last decade. Moreover, we discuss related issues in the analysis and numerical analysis of nonlinear partial differential equations with a variational structure. For such problems Bregman distances appear to be of similar importance, but are currently used only in a quite hidden fashion. We try to work out explicitely the aspects related to Bregman distances, which also lead to novel mathematical questions and may also stimulate further research in these areas.

preprint2015arXiv

Diffuse Interface Methods for Inverse Problems: Case Study for an Elliptic Cauchy Problem

Many inverse problems have to deal with complex, evolving and often not exactly known geometries, e.g. as domains of forward problems modeled by partial differential equations. This makes it desirable to use methods which are robust with respect to perturbed or not well resolved domains, and which allow for efficient discretizations not resolving any fine detail of those geometries. For forward problems in partial differential equations methods based on diffuse interface representations gained strong attention in the last years, but so far they have not been considered systematically for inverse problems. In this work we introduce a diffuse domain method as a tool for the solution of variational inverse problems. As a particular example we study ECG inversion in further detail. ECG inversion is a linear inverse source problem with boundary measurements governed by an anisotropic diffusion equation, which naturally cries for solutions under changing geometries, namely the beating heart. We formulate a regularization strategy using Tikhonov regularization and, using standard source conditions, we prove convergence rates. A special property of our approach is that not only operator perturbations are introduced by the diffuse domain method, but more important we have to deal with topologies which depend on a parameter $\eps$ in the diffuse domain method, i.e. we have to deal with $\eps$-dependent forward operators and $\eps$-dependent norms. In particular the appropriate function spaces for the unknown and the data depend on $\eps$. This prevents to apply some standard convergence techniques for inverse problems, in particular interpreting the perturbations as data errors in the original problem does not yield suitable results. We consequently develop a novel approach based on saddle-point problems.

preprint2015arXiv

Flow Characteristics in a Crowded Transport Model

The aim of this paper is to discuss the appropriate modelling of in- and outflow boundary conditions for nonlinear drift-diffusion models for the transport of particles including size exclusion and their effect on the behaviour of solutions. We use a derivation from a microscopic asymmetric exclusion process and its extension to particles entering or leaving on the boundaries. This leads to specific Robin-type boundary conditions for inflow and outflow, respectively. For the stationary equation we prove the existence of solutions in a suitable setup. Moreover, we investigate the flow characteristics for small diffusion, which yields the occurence of a maximal current phase in addition to well-known one-sided boundary layer effects for linear drift-diffusion problems. In a one-dimensional setup we provide rigorous estimates in terms of $ε$, which confirm three different phases. Finally, we derive a numerical approach to solve the problem also in multiple dimensions. This provides further insight and allows for the investigation of more complicated geometric setups.

preprint2015arXiv

Infimal convolution regularisation functionals of BV and $\mathrm{L}^{p}$ spaces. Part I: The finite $p$ case

We study a general class of infimal convolution type regularisation functionals suitable for applications in image processing. These functionals incorporate a combination of the total variation ($\mathrm{TV}$) seminorm and $\mathrm{L}^{p}$ norms. A unified well-posedness analysis is presented and a detailed study of the one dimensional model is performed, by computing exact solutions for the corresponding denoising problem and the case $p=2$. Furthermore, the dependency of the regularisation properties of this infimal convolution approach to the choice of $p$ is studied. It turns out that in the case $p=2$ this regulariser is equivalent to Huber-type variant of total variation regularisation. We provide numerical examples for image decomposition as well as for image denoising. We show that our model is capable of eliminating the staircasing effect, a well-known disadvantage of total variation regularisation. Moreover as $p$ increases we obtain almost piecewise affine reconstructions, leading also to a better preservation of hat-like structures.

preprint2015arXiv

Infimal Convolution Regularisation Functionals of BV and $\mathrm{L}^{p}$ Spaces. The Case p$=\infty$

In this paper we analyse an infimal convolution type regularisation functional called $\mathrm{TVL}^{\infty}$, based on the total variation ($\mathrm{TV}$) and the $\mathrm{L}^{\infty}$ norm of the gradient. The functional belongs to a more general family of $\mathrm{TVL}^{p}$ functionals ($1<p\le \infty$). We show via analytical and numerical results that the minimisation of the $\mathrm{TVL}^{\infty}$ functional promotes piecewise affine structures in the reconstructed images similar to the state of the art total generalised variation ($\mathrm{TGV}$) but improving upon preservation of hat--like structures. We also propose a spatially adapted version of our model that produces results comparable to $\mathrm{TGV}$ and allows space for further improvement.

preprint2015arXiv

Lane formation by side-stepping

In this paper we study a system of nonlinear partial differential equations, which describes the evolution of two pedestrian groups moving in opposite direction. The pedestrian dynamics are driven by aversion and cohesion, i.e. the tendency to follow individuals from the own group and step aside in the case of contraflow. We start with a 2D lattice based approach, in which the transition rates reflect the described dynamics, and derive the corresponding PDE system by formally passing to the limit in the spatial and temporal discretization. We discuss the existence of special stationary solutions, which correspond to the formation of directional lanes and prove existence of global in time bounded weak solutions. The proof is based on an approximation argument and entropy inequalities. Furthermore we illustrate the behavior of the system with numerical simulations.

preprint2015arXiv

Locally Sparse Reconstruction Using the $\ell^{1,\infty}$-Norm

This paper discusses the incorporation of local sparsity information, e.g. in each pixel of an image, via minimization of the $\ell^{1,\infty}$-norm. We discuss the basic properties of this norm when used as a regularization functional and associated optimization problems, for which we derive equivalent reformulations either more amenable to theory or to numerical computation. Further focus of the analysis is put on the locally 1-sparse case, which is well motivated by some biomedical imaging applications. Our computational approaches are based on alternating direction methods of multipliers (ADMM) and appropriate splittings with augmented Lagrangians. Those are tested for a model scenario related to dynamic positron emission tomography (PET), which is a functional imaging technique in nuclear medicine. The results of this paper provide insight into the potential impact of regularization with the $\ell^{1,\infty}$-norm for local sparsity in appropriate settings. However, it also indicates several shortcomings, possibly related to the non-tightness of the functional as a relaxation of the $\ell^{0,\infty}$-norm.

preprint2015arXiv

Maximum a posteriori probability estimates in infinite-dimensional Bayesian inverse problems

A demanding challenge in Bayesian inversion is to efficiently characterize the posterior distribution. This task is problematic especially in high-dimensional non-Gaussian problems, where the structure of the posterior can be very chaotic and difficult to analyse. Current inverse problem literature often approaches the problem by considering suitable point estimators for the task. Typically the choice is made between the maximum a posteriori (MAP) or the conditional mean (CM) estimate. The benefits of either choice are not well-understood from the perspective of infinite-dimensional theory. Most importantly, there exists no general scheme regarding how to connect the topological description of a MAP estimate to a variational problem. The results by Dashti et. al. (2013) resolve this issue for non-linear inverse problems in Gaussian framework. In this work we improve the current understanding by introducing a novel concept called the weak MAP (wMAP) estimate. We show that any MAP estimate in the sense of Dashti et. al. (2013) is a wMAP estimate and, moreover, how in general infinite-dimensional non-Gaussian problems the wMAP estimate connects to a variational formulation. Such a formulation yields many properties of the estimate that were earlier impossible to study. In a recent work by Burger and Lucka (2014) the MAP estimator was studied in the context of Bayes cost method. Using Bregman distances, proper convex Bayes cost functions were introduced for which the MAP estimator is the Bayes estimator. Here, we generalize these results to the infinite-dimensional setting. Moreover, we discuss the implications of our results for some examples of prior models such as the Besov prior and hierarchical prior.

preprint2015arXiv

Nonlinear Spectral Analysis via One-homogeneous Functionals - Overview and Future Prospects

We present in this paper the motivation and theory of nonlinear spectral representations, based on convex regularizing functionals. Some comparisons and analogies are drawn to the fields of signal processing, harmonic analysis and sparse representations. The basic approach, main results and initial applications are shown. A discussion of open problems and future directions concludes this work.

preprint2015arXiv

On a Boltzmann mean field model for knowledge growth

In this paper we analyze a Boltzmann type mean field game model for knowledge growth, which was proposed by Lucas and Moll. We discuss the underlying mathematical model, which consists of a coupled system of a Boltzmann type equation for the agent density and a Hamilton-Jacobi-Bellman equation for the optimal strategy. We study the analytic features of each equation separately and show local in time existence and uniqueness for the fully coupled system. Furthermore we focus on the construction and existence of special solutions, which relate to exponential growth in time - so called balanced growth path solutions. Finally we illustrate the behavior of solutions for the full system and the balanced growth path equations with numerical simulations.

preprint2015arXiv

On Optical Flow Models for Variational Motion Estimation

The aim of this paper is to discuss and evaluate total variation based regularization methods for motion estimation, with particular focus on optical flow models. In addition to standard $L^2$ and $L^1$ data fidelities we give an overview of different variants of total variation regularization obtained from combination with higher order models and a unified computational optimization approach based on primal-dual methods. Moreover, we extend the models by Bregman iterations and provide an inverse problems perspective to the analysis of variational optical flow models. A particular focus of the paper is the quantitative evaluation of motion estimation, which is a difficult and often underestimated task. We discuss several approaches for quality measures of motion estimation and apply them to compare the previously discussed regularization approaches.

preprint2015arXiv

Regularization with Sparse Vector Fields: From Image Compression to TV-type Reconstruction

This paper introduces a novel variational approach for image compression motivated by recent PDE-based approaches combining edge detection and Laplacian inpainting. The essential feature is to encode the image via a sparse vector field, ideally concentrating on a set of measure zero. An equivalent reformulation of the compression approach leads to a variational model resembling the ROF-model for image denoising, hence we further study the properties of the effective regularization functional introduced by the novel approach and discuss similarities to TV and TGV functionals. Moreover we computationally investigate the behaviour of the model with sparse vector fields for compression in particular for high resolution images and give an outlook towards denoising.

preprint2015arXiv

Second-order edge-penalization in the Ambrosio-Tortorelli functional

We propose and study two variants of the Ambrosio-Tortorelli functional where the first-order penalization of the edge variable $v$ is replaced by a second-order term depending on the Hessian or on the Laplacian of $v$, respectively. We show that both the variants as above provide an elliptic approximation of the Mumford-Shah functional in the sense of $Γ$-convergence. In particular the variant with the Laplacian penalization can be implemented without any difficulties compared to the standard Ambrosio-Tortorelli functional. The computational results indicate several advantages however. First of all, the diffuse approximation of the edge contours appears smoother and clearer for the minimizers of the second-order functional. Moreover, the convergence of alternating minimization algorithms seems improved for the new functional. We also illustrate the findings with several computational results.

preprint2015arXiv

Spectral Representations of One-Homogeneous Functionals

This paper discusses a generalization of spectral representations related to convex one-homogeneous regularization functionals, e.g. total variation or $\ell^1$-norms. Those functionals serve as a substitute for a Hilbert space structure (and the related norm) in classical linear spectral transforms, e.g. Fourier and wavelet analysis. We discuss three meaningful definitions of spectral representations by scale space and variational methods and prove that (nonlinear) eigenfunctions of the regularization functionals are indeed atoms in the spectral representation. Moreover, we verify further useful properties related to orthogonality of the decomposition and the Parseval identity. The spectral transform is motivated by total variation and further developed to higher order variants. Moreover, we show that the approach can recover Fourier analysis as a special case using an appropriate $\ell^1$-type functional and discuss a coupled sparsity example.

preprint2014arXiv

A Stochastic Model for the Normal Tissue Complication Probability (NTCP) in Radiation Treatment of Cancer

The normal tissue complication probability (NTCP) is a measure for the estimated side effects of a given radiation treatment schedule. Here we use a stochastic logistic birth death process to define an organ specific and patient specific NTCP. We emphasise an asymptotic simplification which relates the NTCP to the solution of a logistic differential equation. This framework allows for a direct use of the NTCP model in clinical practice. We formulate, but do not solve, related optimization problems.

preprint2014arXiv

Analysis of the Diffuse Domain Method for second order elliptic boundary value problems

The diffuse domain method for partial differential equations on complicated geometries recently received strong attention in particular from practitioners, but many fundamental issues in the analysis are still widely open. In this paper we study the diffuse domain method for approximating second order elliptic boundary value problems posed on bounded domains, and show convergence and rates of the approximations generated by the diffuse domain method to the solution of the original second order problem when complemented by Robin, Dirichlet or Neumann conditions. The main idea of the diffuse domain method is to relax these boundary conditions by introducing a family of phase-field functions such that the variational integrals of the original problem are replaced by a weighted average of integrals of perturbed domains. From an functional analytic point of view, the phase-field functions naturally lead to weighted Sobolev spaces for which we present trace and embedding results as well as various type of Poincaré inequalities with constants independent of the domain perturbations. Our convergence analysis is carried out in such spaces as well, but allows to draw conclusions also about unweighted norms applied to restrictions on the original domain. Our convergence results are supported by numerical examples.

preprint2014arXiv

Color Bregman TV

In this paper we present a novel iterative procedure for multichannel image and data reconstruction using Bregman distances. With the motivation that multiple channels sharing a common subgradient with respect to a suitable regularization implies desirable properties such as a common edge set (and a common direction of the normals to the level lines) in the case of the total variation (TV), we propose to determine each iterate by regularizing each channel with a weighted linear combination of Bregman distances to all other image channels from the previous iteration. In this sense we generalize the Bregman iteration proposed by Osher et al. to multichannel images. We prove the convergence of the proposed scheme, analyze stationary points and present numerical experiments on color image denoising, which show the superior behavior of our approach in comparison to TV, TV with Bregman iterations on each channel separately, and vectorial TV. Additionally, we propose to use the infimal convolution of Bregman distances to different channels from the previous iteration to obtain the independence of the sign and hence the independence of the direction of the edge. While this work focuses on TV regularization, the proposed scheme can potentially improve any variational multichannel reconstruction method with a 1-homogeneous regularization.

preprint2014arXiv

First order algorithms in variational image processing

Variational methods in imaging are nowadays developing towards a quite universal and flexible tool, allowing for highly successful approaches on tasks like denoising, deblurring, inpainting, segmentation, super-resolution, disparity, and optical flow estimation. The overall structure of such approaches is of the form ${\cal D}(Ku) + α{\cal R} (u) \rightarrow \min_u$ ; where the functional ${\cal D}$ is a data fidelity term also depending on some input data $f$ and measuring the deviation of $Ku$ from such and ${\cal R}$ is a regularization functional. Moreover $K$ is a (often linear) forward operator modeling the dependence of data on an underlying image, and $α$ is a positive regularization parameter. While ${\cal D}$ is often smooth and (strictly) convex, the current practice almost exclusively uses nonsmooth regularization functionals. The majority of successful techniques is using nonsmooth and convex functionals like the total variation and generalizations thereof or $\ell_1$-norms of coefficients arising from scalar products with some frame system. The efficient solution of such variational problems in imaging demands for appropriate algorithms. Taking into account the specific structure as a sum of two very different terms to be minimized, splitting algorithms are a quite canonical choice. Consequently this field has revived the interest in techniques like operator splittings or augmented Lagrangians. Here we shall provide an overview of methods currently developed and recent results as well as some computational studies providing a comparison of different methods and also illustrating their success in applications.

preprint2014arXiv

Maximum-A-Posteriori Estimates in Linear Inverse Problems with Log-concave Priors are Proper Bayes Estimators

A frequent matter of debate in Bayesian inversion is the question, which of the two principle point-estimators, the maximum-a-posteriori (MAP) or the conditional mean (CM) estimate is to be preferred. As the MAP estimate corresponds to the solution given by variational regularization techniques, this is also a constant matter of debate between the two research areas. Following a theoretical argument - the Bayes cost formalism - the CM estimate is classically preferred for being the Bayes estimator for the mean squared error cost while the MAP estimate is classically discredited for being only asymptotically the Bayes estimator for the uniform cost function. In this article we present recent theoretical and computational observations that challenge this point of view, in particular for high-dimensional sparsity-promoting Bayesian inversion. Using Bregman distances, we present new, proper convex Bayes cost functions for which the MAP estimator is the Bayes estimator. We complement this finding by results that correct further common misconceptions about MAP estimates. In total, we aim to rehabilitate MAP estimates in linear inverse problems with log-concave priors as proper Bayes estimators.

preprint2014arXiv

Total Variation Regularisation in Measurement and Image space for PET reconstruction

The aim of this paper is to test and analyze a novel technique for image reconstruction in positron emission tomography, which is based on (total variation) regularization on both the image space and the projection space. We formulate our variational problem considering both total variation penalty terms on the image and on an idealized sinogram to be reconstructed from a given Poisson distributed noisy sinogram. We prove existence, uniqueness and stability results for the proposed model and provide some analytical insight into the structures favoured by joint regularization. For the numerical solution of the corresponding discretized problem we employ the split Bregman algorithm and extensively test the approach in comparison to standard total variation regularization on the image. The numerical results show that an additional penalty on the sinogram performs better on reconstructing images with thin structures.

preprint2014arXiv

Towards Dynamic PET Reconstruction under Flow Conditions: Parameter Identification in a PDE Model

The aim of this paper is to discuss potential advances in PET kinetic models and direct reconstruction of kinetic parameters. As a prominent example we focus on a typical task in perfusion imaging and derive a system of transport-reaction-diffusion equations, which is able to include macroscopic flow properties in addition to the usual exchange between arteries, veins, and tissues. For this system we propose an inverse problem of estimating all relevant parameters from PET data. We interpret the parameter identification as a nonlinear inverse problem, for which we formulate and analyze variational regularization approaches. For the numerical solution we employ gradient-based methods and appropriate splitting methods, which are used to investigate some test cases.

preprint2013arXiv

Mean field games with nonlinear mobilities in pedestrian dynamics

In this paper we present an optimal control approach modeling fast exit scenarios in pedestrian crowds. In particular we consider the case of a large human crowd trying to exit a room as fast as possible. The motion of every pedestrian is determined by minimizing a cost functional, which depends on his/her position, velocity, exit time and the overall density of people. This microscopic setup leads in the mean-field limit to a parabolic optimal control problem. We discuss the modeling of the macroscopic optimal control approach and show how the optimal conditions relate to Hughes model for pedestrian flow. Furthermore we provide results on the existence and uniqueness of minimizers and illustrate the behavior of the model with various numerical results.

preprint2013arXiv

On a Boltzmann type price formation model

In this paper we present a Boltzmann type price formation model, which is motivated by a parabolic free boundary model for the evolution of the prize presented by Lasry and Lions in 2007. We discuss the mathematical analysis of the Boltzmann type model and show that its solutions converge to solutions of the model by Lasry and Lions as the transaction rate tends to infinity. Furthermore we analyse the behaviour of the initial layer on the fast time scale and illustrate the price dynamics with various numerical experiments.

preprint2013arXiv

On the asymptotic behavior of a Boltzmann-type price formation model

In this paper we study the asymptotic behavior of a Boltzmann type price formation model, which describes the trading dynamics in a financial market. In many of these markets trading happens at high frequencies and low transactions costs. This observation motivates the study of the limit as the number of transactions $k$ tends to infinity, the transaction cost $a$ to zero and $ka=const$. Furthermore we illustrate the price dynamics with numerical simulations.

preprint2013arXiv

Stationary States and Asymptotic Behaviour of Aggregation Models with Nonlinear Local Repulsion

We consider a continuum aggregation model with nonlinear local repulsion given by a degenerate power-law diffusion with general exponent. The steady states and their properties in one dimension are studied both analytically and numerically, suggesting that the quadratic diffusion is a critical case. The focus is on finite-size, monotone and compactly supported equilibria. We also investigate numerically the long time asymptotics of the model by simulations of the evolution equation. Issues such as metastability and local/ global stability are studied in connection to the gradient flow formulation of the model.

preprint2012arXiv

A Framework for Automated Cell Tracking in Phase Contrast Microscopic Videos based on Normal Velocities

This paper introduces a novel framework for the automated tracking of cells, with a particular focus on the challenging situation of phase contrast microscopic videos. Our framework is based on a topology preserving variational segmentation approach applied to normal velocity components obtained from optical flow computations, which appears to yield robust tracking and automated extraction of cell trajectories. In order to obtain improved trackings of local shape features we discuss an additional correction step based on active contours and the image Laplacian which we optimize for an example class of transformed renal epithelial (MDCK-F) cells. We also test the framework for human melanoma cells and murine neutrophil granulocytes that were seeded on different types of extracellular matrices. The results are validated with manual tracking results.

preprint2012arXiv

Convergence rates in $\mathbf{\ell^1}$-regularization if the sparsity assumption fails

Variational sparsity regularization based on $\ell^1$-norms and other nonlinear functionals has gained enormous attention recently, both with respect to its applications and its mathematical analysis. A focus in regularization theory has been to develop error estimation in terms of regularization parameter and noise strength. For this sake specific error measures such as Bregman distances and specific conditions on the solution such as source conditions or variational inequalities have been developed and used. In this paper we provide, for a certain class of ill-posed linear operator equations, a convergence analysis that works for solutions that are not completely sparse, but have a fast decaying nonzero part. This case is not covered by standard source conditions, but surprisingly can be treated with an appropriate variational inequality. As a consequence the paper also provides the first examples where the variational inequality approach, which was often believed to be equivalent to appropriate source conditions, can indeed go farther than the latter.

preprint2012arXiv

Exact Relaxation for Classes of Minimization Problems with Binary Constraints

Relying on the co-area formula, an exact relaxation framework for minimizing objectives involving the total variation of a binary valued function (of bounded variation) is presented. The underlying problem class covers many important applications ranging from binary image restoration, segmentation, minimal compliance topology optimization to the optimal design of composite membranes and many more. The relaxation approach turns the binary constraint into a box constraint. It is shown that thresholding a solution of the relaxed problem almost surely yields a solution of the original binary-valued problem. Furthermore, stability of solutions under data perturbations is studied, and, for applications such as structure optimization, the inclusion of volume constraints is considered. For the efficient numerical solution of the relaxed problem, a locally superlinearly convergent algorithm is proposed which is based on an exact penalization technique, Fenchel duality, and a semismooth Newton approach. The paper ends by a report on numerical results for several applications in particular in mathematical image processing.

preprint2012arXiv

Ground States and Singular Vectors of Convex Variational Regularization Methods

Singular value decomposition is the key tool in the analysis and understanding of linear regularization methods. In the last decade nonlinear variational approaches such as $\ell^1$ or total variation regularizations became quite prominent regularization techniques with certain properties being superior to standard methods. In the analysis of those, singular values and vectors did not play any role so far, for the obvious reason that these problems are nonlinear, together with the issue of defining singular values and singular vectors. In this paper however we want to start a study of singular values and vectors for nonlinear variational regularization of linear inverse problems, with particular focus on singular one-homogeneous regularization functionals. A major role is played by the smallest singular value, which we define as the ground state of an appropriate functional combining the (semi-)norm introduced by the forward operator and the regularization functional. The optimality condition for the ground state further yields a natural generalization to higher singular values and vectors involving the subdifferential of the regularization functional. We carry over two main properties from the world of linear regularization. The first one is gaining information about scale, respectively the behavior of regularization techniques at different scales. This also leads to novel estimates at different scales, generalizing the estimates for the coefficients in the linear singular value expansion. The second one is to provide exact solutions for variational regularization methods. We will show that all singular vectors can be reconstructed up to a scalar factor by the standard Tikhonov-type regularization approach even in the presence of (small) noise. Moreover, we will show that they can even be reconstructed without any bias by the recently popularized inverse scale space method.

preprint2012arXiv

Individual based and mean-field modelling of direct aggregation

We introduce two models of biological aggregation, based on randomly moving particles with individual stochasticity depending on the perceived average population density in their neighbourhood. In the first-order model the location of each individual is subject to a density-dependent random walk, while in the second-order model the density-dependent random walk acts on the velocity variable, together with a density-dependent damping term. The main novelty of our models is that we do not assume any explicit aggregative force acting on the individuals; instead, aggregation is obtained exclusively by reducing the individual stochasticity in response to higher perceived density. We formally derive the corresponding mean-field limits, leading to nonlocal degenerate diffusions. Then, we carry out the mathematical analysis of the first-order model, in particular, we prove the existence of weak solutions and show that it allows for measure-valued steady states. We also perform linear stability analysis and identify conditions for pattern formation. Moreover, we discuss the role of the nonlocality for well-posedness of the first-order model. Finally, we present results of numerical simulations for both the first- and second-order model on the individual-based and continuum levels of description.

preprint2012arXiv

Mathematical Modelling of Polarizing GTPases in Developing Axons

The aim of this paper is to contribute to the basic understanding of neuronal polarization mechanisms by developing and studying a reaction-diffusion model for protein activation and inactivation. In particular we focus on a feedback loop between PI3 kinase and certain GTPases, and study its behaviour in dependence of neurite lengths. We find that if an ultrasensitive activation is included, the model can produce polarization at a critical length as observed in experiments. Symmetry breaking to polarization in the longer neurite is found only if active transport of a substance, in our case active PI3 kinase, is included into the model.

preprint2011arXiv

The Iteratively Regularized Gauß-Newton Method with Convex Constraints and Applications in 4Pi-Microscopy

This paper is concerned with the numerical solution of nonlinear ill-posed operator equations involving convex constraints. We study a Newton-type method which consists in applying linear Tikhonov regularization with convex constraints to the Newton equations in each iteration step. Convergence of this iterative regularization method is analyzed if both the operator and the right hand side are given with errors and all error levels tend to zero. Our study has been motivated by the joint estimation of object and phase in 4Pi microscopy, which leads to a semi-blind deconvolution problem with nonnegativity constraints. The performance of the proposed algorithm is illustrated both for simulated and for three-dimensional experimental data.