Source author record

Bharat Kaul

Bharat Kaul appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Machine Learning astro-ph.IM astro-ph.SR Distributed, Parallel, and Cluster Computing Neural and Evolutionary Computing Programming Languages

Catalog footprint

What is connected

4works

6topics

4close collaborators

Actions

Connect this record

Open graph Browse works

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

preprint2022arXiv

Measuring frequency and period separations in red-giant stars using machine learning

Asteroseismology is used to infer the interior physics of stars. The \textit{Kepler} and TESS space missions have provided a vast data set of red-giant light curves, which may be used for asteroseismic analysis. These data sets are expected to significantly grow with future missions such as \textit{PLATO}, and efficient methods are therefore required to analyze these data rapidly. Here, we describe a machine learning algorithm that identifies red giants from the raw oscillation spectra and captures \textit{p} and \textit{mixed} mode parameters from the red-giant power spectra. We report algorithmic inferences for large frequency separation ($Δν$), frequency at maximum amplitude ($ν_{max}$), and period separation ($ΔΠ$) for an ensemble of stars. In addition, we have discovered $\sim$25 new probable red giants among 151,000 \textit{Kepler} long-cadence stellar-oscillation spectra analyzed by the method, among which four are binary candidates which appear to possess red-giant counterparts. To validate the results of this method, we selected $\sim$ 3,000 \textit{Kepler} stars, at various evolutionary stages ranging from subgiants to red clumps, and compare inferences of $Δν$, $ΔΠ$, and $ν_{max}$ with estimates obtained using other techniques. The power of the machine-learning algorithm lies in its speed: it is able to accurately extract seismic parameters from 1,000 spectra in $\sim$5 seconds on a modern computer (single core of the Intel Xeon Platinum 8280 CPU).

preprint2020arXiv

K-TanH: Efficient TanH For Deep Learning

We propose K-TanH, a novel, highly accurate, hardware efficient approximation of popular activation function TanH for Deep Learning. K-TanH consists of parameterized low-precision integer operations, such as, shift and add/subtract (no floating point operation needed) where parameters are stored in very small look-up tables that can fit in CPU registers. K-TanH can work on various numerical formats, such as, Float32 and BFloat16. High quality approximations to other activation functions, e.g., Sigmoid, Swish and GELU, can be derived from K-TanH. Our AVX512 implementation of K-TanH demonstrates $>5\times$ speed up over Intel SVML, and it is consistently superior in efficiency over other approximations that use floating point arithmetic. Finally, we achieve state-of-the-art Bleu score and convergence results for training language translation model GNMT on WMT16 data sets with approximate TanH obtained via K-TanH on BFloat16 inputs.

preprint2020arXiv

PolyScientist: Automatic Loop Transformations Combined with Microkernels for Optimization of Deep Learning Primitives

At the heart of deep learning training and inferencing are computationally intensive primitives such as convolutions which form the building blocks of deep neural networks. Researchers have taken two distinct approaches to creating high performance implementations of deep learning kernels, namely, 1) library development exemplified by Intel MKL-DNN for CPUs, 2) automatic compilation represented by the TensorFlow XLA compiler. The two approaches have their drawbacks: even though a custom built library can deliver very good performance, the cost and time of development of the library can be high. Automatic compilation of kernels is attractive but in practice, till date, automatically generated implementations lag expert coded kernels in performance by orders of magnitude. In this paper, we develop a hybrid solution to the development of deep learning kernels that achieves the best of both worlds: the expert coded microkernels are utilized for the innermost loops of kernels and we use the advanced polyhedral technology to automatically tune the outer loops for performance. We design a novel polyhedral model based data reuse algorithm to optimize the outer loops of the kernel. Through experimental evaluation on an important class of deep learning primitives namely convolutions, we demonstrate that the approach we develop attains the same levels of performance as Intel MKL-DNN, a hand coded deep learning library.

preprint2016arXiv

Distributed Deep Learning Using Synchronous Stochastic Gradient Descent

We design and implement a distributed multinode synchronous SGD algorithm, without altering hyper parameters, or compressing data, or altering algorithmic behavior. We perform a detailed analysis of scaling, and identify optimal design points for different networks. We demonstrate scaling of CNNs on 100s of nodes, and present what we believe to be record training throughputs. A 512 minibatch VGG-A CNN training run is scaled 90X on 128 nodes. Also 256 minibatch VGG-A and OverFeat-FAST networks are scaled 53X and 42X respectively on a 64 node cluster. We also demonstrate the generality of our approach via best-in-class 6.5X scaling for a 7-layer DNN on 16 nodes. Thereafter we attempt to democratize deep-learning by training on an Ethernet based AWS cluster and show ~14X scaling on 16 nodes.