Source author record

Matthias Langer

Matthias Langer appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

math.SP math.AP math-ph math.FA math.MP Distributed, Parallel, and Cluster Computing Machine Learning

Catalog footprint

What is connected

9works

7topics

4close collaborators

Actions

Connect this record

Open graph Browse works

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

preprint2020arXiv

Distributed Training of Deep Learning Models: A Taxonomic Perspective

Distributed deep learning systems (DDLS) train deep neural network models by utilizing the distributed resources of a cluster. Developers of DDLS are required to make many decisions to process their particular workloads in their chosen environment efficiently. The advent of GPU-based deep learning, the ever-increasing size of datasets and deep neural network models, in combination with the bandwidth constraints that exist in cluster environments require developers of DDLS to be innovative in order to train high quality models quickly. Comparing DDLS side-by-side is difficult due to their extensive feature lists and architectural deviations. We aim to shine some light on the fundamental principles that are at work when training deep neural networks in a cluster of independent machines by analyzing the general properties associated with training deep learning models and how such workloads can be distributed in a cluster to achieve collaborative model training. Thereby we provide an overview of the different techniques that are used by contemporary DDLS and discuss their influence and implications on the training process. To conceptualize and compare DDLS, we group different techniques into categories, thus establishing a taxonomy of distributed deep learning systems.

preprint2020arXiv

Spectral enclosures for a class of block operator matrices

We prove new spectral enclosures for the non-real spectrum of a class of $2\times2$ block operator matrices with self-adjoint operators $A$ and $D$ on the diagonal and operators $B$ and $-B^*$ as off-diagonal entries. One of our main results resembles Gershgorin's circle theorem. The enclosures are applied to $J$-frame operators.

preprint2018arXiv

Spectral enclosures for non-self-adjoint extensions of symmetric operators

The spectral properties of non-self-adjoint extensions $A_{[B]}$ of a symmetric operator in a Hilbert space are studied with the help of ordinary and quasi boundary triples and the corresponding Weyl functions. These extensions are given in terms of abstract boundary conditions involving an (in general non-symmetric) boundary operator $B$. In the abstract part of this paper, sufficient conditions for sectoriality and m-sectoriality as well as sufficient conditions for $A_{[B]}$ to have a non-empty resolvent set are provided in terms of the parameter $B$ and the Weyl function. Special attention is paid to Weyl functions that decay along the negative real line or inside some sector in the complex plane, and spectral enclosures for $A_{[B]}$ are proved in this situation. The abstract results are applied to elliptic differential operators with local and non-local Robin boundary conditions on unbounded domains, to Schrödinger operators with $δ$-potentials of complex strengths supported on unbounded hypersurfaces or infinitely many points on the real line, and to quantum graphs with non-self-adjoint vertex couplings.

preprint2015arXiv

Spectral asymptotics for resolvent differences of elliptic operators with $δ$ and $δ^\prime$-interactions on hypersurfaces

We consider self-adjoint realizations of a second-order elliptic differential expression on ${\mathbb R}^n$ with singular interactions of $δ$ and $δ^\prime$-type supported on a compact closed smooth hypersurface in ${\mathbb R}^n$. In our main results we prove spectral asymptotics formulae with refined remainder estimates for the singular values of the resolvent difference between the standard self-adjoint realizations and the operators with a $δ$ and $δ^\prime$-interaction, respectively. Our technique makes use of general pseudodifferential methods, classical results on spectral asymptotics of $ψ$do's on closed manifolds and Krein-type resolvent formulae.

preprint2015arXiv

Triple Variational Principles for Self-Adjoint Operator Functions

For a very general class of unbounded self-adjoint operator function we prove upper bounds for eigenvalues which lie within arbitrary gaps of the essential spectrum. These upper bounds are given by triple variations. Furthermore, we find conditions which imply that a point is in the resolvent set. For norm resolvent continuous operator functions we show that the variational inequality becomes an equality.

preprint2013arXiv

Essential spectrum of systems of singular differential equations

In this paper we develop a new method to determine the essential spectrum of coupled systems of singular differential equations. Applications to problems from magnetohydrodynamics and astrophysics are given.

preprint2013arXiv

Trace formulae and singular values of resolvent power differences of self-adjoint elliptic operators

In this note self-adjoint realizations of second order elliptic differential expressions with non-local Robin boundary conditions on a domain $Ω\subset\dR^n$ with smooth compact boundary are studied. A Schatten--von Neumann type estimate for the singular values of the difference of the $m$th powers of the resolvents of two Robin realizations is obtained, and for $m>\tfrac{n}{2}-1$ it is shown that the resolvent power difference is a trace class operator. The estimates are slightly stronger than the classical singular value estimates by M. Sh. Birman where one of the Robin realizations is replaced by the Dirichlet operator. In both cases trace formulae are proved, in which the trace of the resolvent power differences in $L^2(Ω)$ is written in terms of the trace of derivatives of Neumann-to-Dirichlet and Robin-to-Neumann maps on the boundary space $L^2(\partialΩ)$.

preprint2012arXiv

Schrödinger operators with delta and delta'-potentials supported on hypersurfaces

Self-adjoint Schrödinger operators with $δ$ and $δ'$-potentials supported on a smooth compact hypersurface are defined explicitly via boundary conditions. The spectral properties of these operators are investigated, regularity results on the functions in their domains are obtained, and analogues of the Birman--Schwinger principle and a variant of Krein's formula are shown. Furthermore, Schatten--von Neumann type estimates for the differences of the powers of the resolvents of the Schrödinger operators with $δ$ and $δ'$-potentials, and the Schrödinger operator without a singular interaction are proved. An immediate consequence of these estimates is the existence and completeness of the wave operators of the corresponding scattering systems, as well as the unitary equivalence of the absolutely continuous parts of the singularly perturbed and unperturbed Schrödinger operators. In the proofs of our main theorems we make use of abstract methods from extension theory of symmetric operators, some algebraic considerations and results on elliptic regularity.

preprint2009arXiv

A remark on Schatten-von Neumann properties of resolvent differences of generalized Robin Laplacians on bounded domains

In this note we investigate the asymptotic behaviour of the $s$-numbers of the resolvent difference of two generalized self-adjoint, maximal dissipative or maximal accumulative Robin Laplacians on a bounded domain $Ω$ with smooth boundary $\partialΩ$. For this we apply the recently introduced abstract notion of quasi boundary triples and Weyl functions from extension theory of symmetric operators together with Krein type resolvent formulae and well-known eigenvalue asymptotics of the Laplace-Beltrami operator on $\partialΩ$. It will be shown that the resolvent difference of two generalized Robin Laplacians belongs to the Schatten-von Neumann class of any order $p$ for which $p>(dimΩ-1)/3$. Moreover, we also give a simple sufficient condition for the resolvent difference of two generalized Robin Laplacians to belong to a Schatten-von Neumann class of arbitrary small order. Our results extend and complement classical theorems due to M.Sh.Birman on Schatten-von Neumann properties of the resolvent differences of Dirichlet, Neumann and self-adjoint Robin Laplacians.