Source author record

Zhuang Wang

Zhuang Wang appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

math.MG Distributed, Parallel, and Cluster Computing Machine Learning math.AP math.FA Networking and Internet Architecture

Catalog footprint

What is connected

5works

6topics

4close collaborators

Actions

Connect this record

Open graph Browse works

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

preprint2022arXiv

ByteComp: Revisiting Gradient Compression in Distributed Training

Gradient compression (GC) is a promising approach to addressing the communication bottleneck in distributed deep learning (DDL). However, it is challenging to find the optimal compression strategy for applying GC to DDL because of the intricate interactions among tensors. To fully unleash the benefits of GC, two questions must be addressed: 1) How to express all compression strategies and the corresponding interactions among tensors of any DDL training job? 2) How to quickly select a near-optimal compression strategy? In this paper, we propose ByteComp to answer these questions. It first designs a decision tree abstraction to express all the compression strategies and develops empirical models to timeline tensor computation, communication, and compression to enable ByteComp to derive the intricate interactions among tensors. It then designs a compression decision algorithm that analyzes tensor interactions to eliminate and prioritize strategies and optimally offloads compression to CPUs. Experimental evaluations show that ByteComp can improve the training throughput over the start-of-the-art compression-enabled system by up to 77% for representative DDL training jobs. Moreover, the computational time needed to select the compression strategy is measured in milliseconds, and the selected strategy is only a few percent from optimal.

preprint2021arXiv

$p$-harmonic mappings between metric spaces

In this paper, we solve the Dirichlet problem for Sobolev maps between singular metric spaces that extends the corresponding result of Guo and Wenger [Comm. Anal. Geom. 2020]. The main new ingredient in our proofs is a suitable extension of the theory of trace for metric valued Sobolev maps developed by Korevaar and Schoen [Comm. Anal. Geom. 1993]. We also develop a theory of trace in the borderline case, which investigates a sharp condition to characterize the existence of traces.

preprint2020arXiv

Characterization of trace spaces on regular trees via dyadic norms

In this paper, we study the traces of Orlicz-Sobolev spaces on a regular rooted tree. After giving a dyadic decomposition of the boundary of the regular tree, we present a characterization on the trace spaces of those first order Orlicz-Sobolev spaces whose Young function is of the form $t^p\log^λ(e+t)$, based on integral averages on dyadic elements of the dyadic decomposition.

preprint2019arXiv

Admissibility versus $A_p$-conditions on regular trees

We show that the combination of doubling and $(1,p)$-Poincare inequality is equivalent to a version of the $A_p$-condition on rooted K-ary trees.

preprint2015arXiv

Fair Packet Scheduling in Network on Chip

Interconnection networks of parallel systems are used for servicing traf- fic generated by different applications, often belonging to different users. When multiple traffic flows contend for channel bandwidth, the scheduling algorithm regulating the access to that channel plays a key role in ensur- ing that each flow obtains the required quality of service. Fairness is a highly desirable property for a scheduling algorithm. We show that using the Relative Fairness Bound as a fairness measure may lead to decrease in throughput and increase in latency. We propose an alternative metric to evaluate the fairness and avoid the drawback of Relative Fairness Bound.