Researcher profile

Karsten Müller

Karsten Müller contributes to research discovery and scholarly infrastructure.

ResearcherAffiliation not importedOpen to collaborate

Trust snapshot

Quick read

Trust 19 - UnverifiedVerification L1Unclaimed author
5works
0followers
10topics
4close collaborators

Actions

Decide how to stay connected

Follow researcher0

Identity and collaboration

How to connect with this researcher

Claiming links this public author record to a researcher profile and unlocks direct collaboration workflows.

Log in to claim

Direct collaboration

Open a focused conversation when the fit is right

Claim this author entity first to unlock direct invitations.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

5 published item(s)

preprint2023arXiv

Characteristic function of M. S. Livšic and triangular models of bounded linear operators

This paper is dedicated to the introduction in a circle of ideas and methods, which are connected with the notion of characteristic function of a non-selfadjoint operator. We start with the consideration of closed and open systems (Subsections 2.1.1-2.1.2). In Subsections 2.1.2-2.1.3 we introduce the notion of operator colligation and define the characteristic function of the operator colligation as transfer function of the corresponding open system. In Section 3 we state three basic properties of the c.o.f.. First (Subsection 3.1), we note that the c.o.f. is the full unitary invariant of the operator colligation. Second (see Theorem 3.4), it turns out that the invariant subspaces of the corresponding operator are associated with left divisors of the c.o.f.. Third, the $J$-property of the c.o.f. (see (3.6)-(3.8)) is a basic property which determines the class of c. o. f. (see Section 4). In Chapter 4 we describe the classes of characteristic functions which play an important role in our considerations. In Chapter 5 we state necessary facts on multiplicative integral. Chapter 6 is devoted to the factorization theorem (Theorem 6.7) for matrix-valued characteristic function. In Chapter 7 we construct a triangular Livšic model of bounded linear operator and as application we obtain some known results on dissipative operators.

preprint2022arXiv

Adaptive Differential Filters for Fast and Communication-Efficient Federated Learning

Federated learning (FL) scenarios inherently generate a large communication overhead by frequently transmitting neural network updates between clients and server. To minimize the communication cost, introducing sparsity in conjunction with differential updates is a commonly used technique. However, sparse model updates can slow down convergence speed or unintentionally skip certain update aspects, e.g., learned features, if error accumulation is not properly addressed. In this work, we propose a new scaling method operating at the granularity of convolutional filters which 1) compensates for highly sparse updates in FL processes, 2) adapts the local models to new data domains by enhancing some features in the filter space while diminishing others and 3) motivates extra sparsity in updates and thus achieves higher compression ratios, i.e., savings in the overall data transfer. Compared to unscaled updates and previous work, experimental results on different computer vision tasks (Pascal VOC, CIFAR10, Chest X-Ray) and neural networks (ResNets, MobileNets, VGGs) in uni-, bidirectional and partial update FL settings show that the proposed method improves the performance of the central server model while converging faster and reducing the total amount of transmitted data by up to 377 times.

preprint2022arXiv

Do algebraic numbers follow Khinchin's Law?

The coefficients of the regular continued fraction for random numbers are distributed by the Gauss-Kuzmin distribution according to Khinchin's law. Their geometric mean converges to Khinchin's constant and their rational approximation speed is Khinchin's speed. It is an open question whether these theorems also apply to algebraic numbers of degree $>2$. Since they apply to almost all numbers it is, however, commonly inferred that it is most likely that non quadratic algebraic numbers also do so. We argue that this inference is not well grounded. There is strong numerical evidence that Khinchin's speed is too fast. For Khinchin's law and Khinchin's constant the numerical evidence is unclear. We apply the Kullback Leibler Divergence (KLD) to show that the Gauss-Kuzmin distribution does not fit well for algebraic numbers of degree $>2$. Our suggestion to truncate the Gauss-Kuzmin distribution for finite parts fits slightly better but its KLD is still much larger than the KLD of a random number. So, if it converges the convergence is non uniform and each algebraic number has its own bound. We conclude that there is no evidence to apply the theorems that hold for random numbers to algebraic numbers.

preprint2022arXiv

FedAUXfdp: Differentially Private One-Shot Federated Distillation

Federated learning suffers in the case of non-iid local datasets, i.e., when the distributions of the clients' data are heterogeneous. One promising approach to this challenge is the recently proposed method FedAUX, an augmentation of federated distillation with robust results on even highly heterogeneous client data. FedAUX is a partially $(ε, δ)$-differentially private method, insofar as the clients' private data is protected in only part of the training it takes part in. This work contributes a fully differentially private modification, termed FedAUXfdp. We further contribute an upper bound on the $l_2$-sensitivity of regularized multinomial logistic regression. In experiments with deep networks on large-scale image datasets, FedAUXfdp with strong differential privacy guarantees performs significantly better than other equally privatized SOTA baselines on non-iid client data in just a single communication round. Full privatization of the modified method results in a negligible reduction in accuracy at all levels of data heterogeneity.

preprint2022arXiv

Roth's Theorem implies a Weakened Version of the ABC Conjecture for Special Cases

Enrico Bombieri proved that the ABC Conjecture implies Roth's theorem in 1994. This paper concerns the other direction. In making use of Bombieri's and Van der Poorten's explicit formula for the coefficients of the regular continued fractions of algebraic numbers, we prove that Roth's theorem implies a weakened non-effective version of the ABC Conjecture in certain cases relating to roots.