Invertibility of the 3-core of Erdos Renyi Graphs with Growing Degree
Let be the adjacency matrix of an Erdős Rényi graph for and . We show that as goes to infinity, with probability that goes to , the adjacency matrix of the -core of is invertible.
Source author record
Margalit Glasgow
Explore this author’s publications, collaborators and research topics. This catalog record has not been claimed by its author.
ResearcherUnclaimed source record
Catalog footprint
Research overview
3works
5topics
4close collaborators
Published work
3 publications
preprint2022arXiv
On the Rank, Kernel, and Core of Sparse Random Graphs
We study the rank of the adjacency matrix A of a random Erdos Renyi graph G∼G(n,p). It is well known that when p=(log(n)−ω(1))/n, with high probability, A is singular. We prove that when p=ω(1/n), with high probability, the corank of A is equal to the number of isolated vertices remaining in G after the Karp-Sipser leaf-removal process, which removes vertices of degree one and their unique neighbor. We prove a similar result for the random matrix B, where all entries are independent Bernoulli random variables with parameter p. Namely, we show that if H is the bipartite graph with bi-adjacency matrix B, then the corank of B is with high probability equal to the max of the number of left isolated vertices and the number of right isolated vertices remaining after the Karp-Sipser leaf-removal process on H. Additionally, we show that with high probability, the k-core of G(n,p) is full rank for any k≥3 and p=ω(1/n). This partially resolves a conjecture of Van Vu for p=ω(1/n). Finally, we give an application of the techniques in this paper to gradient coding, a problem in distributed computing.
Open access
preprint2022arXiv
Sharp Bounds for Federated Averaging (Local SGD) and Continuous Perspective
Federated Averaging (FedAvg), also known as Local SGD, is one of the most popular algorithms in Federated Learning (FL). Despite its simplicity and popularity, the convergence rate of FedAvg has thus far been undetermined. Even under the simplest assumptions (convex, smooth, homogeneous, and bounded covariance), the best-known upper and lower bounds do not match, and it is not clear whether the existing analysis captures the capacity of the algorithm. In this work, we first resolve this question by providing a lower bound for FedAvg that matches the existing upper bound, which shows the existing FedAvg upper bound analysis is not improvable. Additionally, we establish a lower bound in a heterogeneous setting that nearly matches the existing upper bound. While our lower bounds show the limitations of FedAvg, under an additional assumption of third-order smoothness, we prove more optimistic state-of-the-art convergence results in both convex and non-convex settings. Our analysis stems from a notion we call iterate bias, which is defined by the deviation of the expectation of the SGD trajectory from the noiseless gradient descent trajectory with the same initialization. We prove novel sharp bounds on this quantity, and show intuitively how to analyze this quantity from a Stochastic Differential Equation (SDE) perspective.
Open access
Research graph
See the researcher in context
Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.
Building this map preview
BZPEER is loading the nearby papers, people, topics and institutions for this page.