Source author record

Arsalan Sharifnassab

Arsalan Sharifnassab appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Distributed, Parallel, and Cluster Computing Machine Learning Systems and Control

Catalog footprint

What is connected

2works

3topics

2close collaborators

Actions

Connect this record

Open graph Browse works

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

preprint2020arXiv

When do Trajectories have Bounded Sensitivity to Cumulative Perturbations?

We investigate sensitivity to cumulative perturbations for a few dynamical system classes of practical interest. A system is said to have bounded sensitivity to cumulative perturbations (bounded sensitivity, for short) if an additive disturbance leads to a change in the state trajectory that is bounded by a constant multiple of the size of the cumulative disturbance. As our main result, we show that there exist dynamical systems in the form of (negative) gradient field of a convex function that have unbounded sensitivity. We show that the result holds even when the convex potential function is piecewise linear. This resolves a question raised in [1], wherein it was shown that the (negative) (sub)gradient field of a piecewise linear and convex function has bounded sensitivity if the number of linear pieces is finite. Our results establish that the finiteness assumption is indeed necessary. Among our other results, we provide a necessary and sufficient condition for a linear dynamical system to have bounded sensitivity to cumulative perturbations. We also establish that the bounded sensitivity property is preserved, when a dynamical system with bounded sensitivity undergoes certain transformations. These transformations include convolution, time discretization, and spreading of a system (a transformation that captures approximate solutions of a system).

preprint2019arXiv

One-Shot Federated Learning: Theoretical Limits and Algorithms to Achieve Them

We consider distributed statistical optimization in one-shot setting, where there are $m$ machines each observing $n$ i.i.d. samples. Based on its observed samples, each machine sends a $B$-bit-long message to a server. The server then collects messages from all machines, and estimates a parameter that minimizes an expected convex loss function. We investigate the impact of communication constraint, $B$, on the expected error and derive a tight lower bound on the error achievable by any algorithm. We then propose an estimator, which we call Multi-Resolution Estimator (MRE), whose expected error (when $B\ge\log mn$) meets the aforementioned lower bound up to poly-logarithmic factors, and is thereby order optimal. We also address the problem of learning under tiny communication budget, and present lower and upper error bounds when $B$ is a constant. The expected error of MRE, unlike existing algorithms, tends to zero as the number of machines ($m$) goes to infinity, even when the number of samples per machine ($n$) remains upper bounded by a constant. This property of the MRE algorithm makes it applicable in new machine learning paradigms where $m$ is much larger than $n$.