BZPEERPapers, people, evidence and research pathsDiscover
Research tools
Network
Opportunities
Account
Source author record
Margalit Glasgow appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.
Catalog footprint
Research graph
Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.
BZPEER is loading the nearby papers, people, topics and institutions for this page.
Published work
Let $A \in \mathbb{R}^{n \times n}$ be the adjacency matrix of an Erdős Rényi graph $G(n, d/n)$ for $d = ω(1)$ and $d \leq 3\log(n)$. We show that as $n$ goes to infinity, with probability that goes to $1$, the adjacency matrix of the $3$-core of $G(n, d/n)$ is invertible.
We study the rank of the adjacency matrix $A$ of a random Erdos Renyi graph $G\sim \mathbb{G}(n,p)$. It is well known that when $p = (\log(n) - ω(1))/n$, with high probability, $A$ is singular. We prove that when $p = ω(1/n)$, with high probability, the corank of $A$ is equal to the number of isolated vertices remaining in $G$ after the Karp-Sipser leaf-removal process, which removes vertices of degree one and their unique neighbor. We prove a similar result for the random matrix $B$, where all entries are independent Bernoulli random variables with parameter $p$. Namely, we show that if $H$ is the bipartite graph with bi-adjacency matrix $B$, then the corank of $B$ is with high probability equal to the max of the number of left isolated vertices and the number of right isolated vertices remaining after the Karp-Sipser leaf-removal process on $H$. Additionally, we show that with high probability, the $k$-core of $\mathbb{G}(n, p)$ is full rank for any $k \geq 3$ and $p = ω(1/n)$. This partially resolves a conjecture of Van Vu for $p = ω(1/n)$. Finally, we give an application of the techniques in this paper to gradient coding, a problem in distributed computing.
Federated Averaging (FedAvg), also known as Local SGD, is one of the most popular algorithms in Federated Learning (FL). Despite its simplicity and popularity, the convergence rate of FedAvg has thus far been undetermined. Even under the simplest assumptions (convex, smooth, homogeneous, and bounded covariance), the best-known upper and lower bounds do not match, and it is not clear whether the existing analysis captures the capacity of the algorithm. In this work, we first resolve this question by providing a lower bound for FedAvg that matches the existing upper bound, which shows the existing FedAvg upper bound analysis is not improvable. Additionally, we establish a lower bound in a heterogeneous setting that nearly matches the existing upper bound. While our lower bounds show the limitations of FedAvg, under an additional assumption of third-order smoothness, we prove more optimistic state-of-the-art convergence results in both convex and non-convex settings. Our analysis stems from a notion we call iterate bias, which is defined by the deviation of the expectation of the SGD trajectory from the noiseless gradient descent trajectory with the same initialization. We prove novel sharp bounds on this quantity, and show intuitively how to analyze this quantity from a Stochastic Differential Equation (SDE) perspective.