Source author record

Shilpak Banerjee

Shilpak Banerjee appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Artificial Intelligence Computer Vision Machine Learning Neural and Evolutionary Computing math.DS

Catalog footprint

What is connected

5works

5topics

4close collaborators

Actions

Connect this record

Open graph Browse works

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

preprint2022arXiv

ErfAct and Pserf: Non-monotonic Smooth Trainable Activation Functions

An activation function is a crucial component of a neural network that introduces non-linearity in the network. The state-of-the-art performance of a neural network depends also on the perfect choice of an activation function. We propose two novel non-monotonic smooth trainable activation functions, called ErfAct and Pserf. Experiments suggest that the proposed functions improve the network performance significantly compared to the widely used activations like ReLU, Swish, and Mish. Replacing ReLU by ErfAct and Pserf, we have 5.68% and 5.42% improvement for top-1 accuracy on Shufflenet V2 (2.0x) network in CIFAR100 dataset, 2.11% and 1.96% improvement for top-1 accuracy on Shufflenet V2 (2.0x) network in CIFAR10 dataset, 1.0%, and 1.0% improvement on mean average precision (mAP) on SSD300 model in Pascal VOC dataset.

preprint2022arXiv

SMU: smooth activation function for deep networks using smoothing maximum technique

Deep learning researchers have a keen interest in proposing two new novel activation functions which can boost network performance. A good choice of activation function can have significant consequences in improving network performance. A handcrafted activation is the most common choice in neural network models. ReLU is the most common choice in the deep learning community due to its simplicity though ReLU has some serious drawbacks. In this paper, we have proposed a new novel activation function based on approximation of known activation functions like Leaky ReLU, and we call this function Smooth Maximum Unit (SMU). Replacing ReLU by SMU, we have got 6.22% improvement in the CIFAR100 dataset with the ShuffleNet V2 model.

preprint2020arXiv

Real-analytic realization of Uniform Circular Systems and some applications

Recently Matthew Foreman and Benjamin Weiss showed in a series of papers that smooth ergodic diffeomorphisms of a compact manifold are unclassifiable up to measure-isomorphism. In this paper we show that the uniform circular systems used in the work of Foreman-Weiss admit real-analytic realizations on the torus. As a consequence we obtain the same anti-classification result for real-analytic ergodic diffeomorphisms on the torus. In another application we show the existence of an uncountable family of pairwise non-Kakutani equivalent real-analytic diffeomorphisms on the torus.

preprint2020arXiv

TanhSoft -- a family of activation functions combining Tanh and Softplus

Deep learning at its core, contains functions that are composition of a linear transformation with a non-linear function known as activation function. In past few years, there is an increasing interest in construction of novel activation functions resulting in better learning. In this work, we propose a family of novel activation functions, namely TanhSoft, with four undetermined hyper-parameters of the form tanh(αx+βe^{γx})ln(δ+e^x) and tune these hyper-parameters to obtain activation functions which are shown to outperform several well known activation functions. For instance, replacing ReLU with xtanh(0.6e^x)improves top-1 classification accuracy on CIFAR-10 by 0.46% for DenseNet-169 and 0.7% for Inception-v3 while with tanh(0.87x)ln(1 +e^x) top-1 classification accuracy on CIFAR-100 improves by 1.24% for DenseNet-169 and 2.57% for SimpleNet model.

preprint2015arXiv

Non-standard real-analytic realizations of some rotations of the circle

We extend some aspects of the smooth approximation by conjugation method to the real-analytic set-up and create examples of zero entropy, uniquely ergodic real-analytic diffeomorphisms of the two dimensional torus metrically isomorphic to some (Liouvillian) irrational rotations of the circle.