Source author record

Ragesh Jaiswal

Explore this author’s publications, collaborators and research topics. This catalog record has not been claimed by its author.

ResearcherUnclaimed source record

Catalog footprint

Research overview

10works
4topics
4close collaborators

Published work

10 publications

preprint2020arXiv

FPT Approximation for Constrained Metric kk-Median/Means

The Metric kk-median problem over a metric space (X,d)(\mathcal{X}, d) is defined as follows: given a set L⊆XL \subseteq \mathcal{X} of facility locations and a set C⊆XC \subseteq \mathcal{X} of clients, open a set F⊆LF \subseteq L of kk facilities such that the total service cost, defined as Φ(F,C)≡∑x∈Cmin⁡f∈Fd(x,f)Φ(F, C) \equiv \sum_{x \in C} \min_{f \in F} d(x, f), is minimised. The metric kk-means problem is defined similarly using squared distances. In many applications there are additional constraints that any solution needs to satisfy. This gives rise to different constrained versions of the problem such as rr-gather, fault-tolerant, outlier kk-means/kk-median problem. Surprisingly, for many of these constrained problems, no constant-approximation algorithm is known. We give FPT algorithms with constant approximation guarantee for a range of constrained kk-median/means problems. For some of the constrained problems, ours is the first constant factor approximation algorithm whereas for others, we improve or match the approximation guarantee of previous works. We work within the unified framework of Ding and Xu that allows us to simultaneously obtain algorithms for a range of constrained problems. In particular, we obtain a (3+ε)(3+\varepsilon)-approximation and (9+ε)(9+\varepsilon)-approximation for the constrained versions of the kk-median and kk-means problem respectively in FPT time. In many practical settings of the kk-median/means problem, one is allowed to open a facility at any client location, i.e., C⊆LC \subseteq L. For this special case, our algorithm gives a (2+ε)(2+\varepsilon)-approximation and (4+ε)(4+\varepsilon)-approximation for the constrained versions of kk-median and kk-means problem respectively in FPT time. Since our algorithm is based on simple sampling technique, it can also be converted to a constant-pass log-space streaming algorithm.

preprint2020arXiv

Streaming PTAS for Constrained k-Means

We generalise the results of Bhattacharya et al. (Journal of Computing Systems, 62(1):93-115, 2018) for the list-kk-means problem defined as -- for a (unknown) partition X1,...,XkX_1, ..., X_k of the dataset X⊆RdX \subseteq \mathbb{R}^d, find a list of kk-center sets (each element in the list is a set of kk centers) such that at least one of kk-center sets {c1,...,ck}\{c_1, ..., c_k\} in the list gives an (1+ε)(1+\varepsilon)-approximation with respect to the cost function min⁡permutation π[∑i=1k∑x∈Xi∣∣x−cπ(i)∣∣2]\min_{\textrm{permutation } π} \left[ \sum_{i=1}^{k} \sum_{x \in X_i} ||x - c_{π(i)}||^2 \right]. The list-kk-means problem is important for the constrained kk-means problem since algorithms for the former can be converted to PTAS for various versions of the latter. Following are the consequences of our generalisations: - Streaming algorithm: Our D2D^2-sampling based algorithm running in a single iteration allows us to design a 2-pass, logspace streaming algorithm for the list-kk-means problem. This can be converted to a 4-pass, logspace streaming PTAS for various constrained versions of the kk-means problem. - Faster PTAS under stability: Our generalisation is also useful in kk-means clustering scenarios where finding good centers becomes easy once good centers for a few "bad" clusters have been chosen. One such scenario is clustering under stability where the number of such bad clusters is a constant. Using the above idea, we significantly improve the running time of the known algorithm from O(dn3)(klog⁡n)poly(1β,1ε)O(dn^3) (k \log{n})^{poly(\frac{1}β, \frac{1}{\varepsilon})} to O(dn3kO~βε(1βε))O \left(dn^3 k^{\tilde{O}_{β\varepsilon}(\frac{1}{β\varepsilon})} \right).

preprint2015arXiv

Faster Algorithms for the Constrained k-means Problem

The classical center based clustering problems such as kk-means/median/center assume that the optimal clusters satisfy the locality property that the points in the same cluster are close to each other. A number of clustering problems arise in machine learning where the optimal clusters do not follow such a locality property. Consider a variant of the kk-means problem that may be regarded as a general version of such problems. Here, the optimal clusters O1,...,OkO_1, ..., O_k are an arbitrary partition of the dataset and the goal is to output kk-centers c1,...,ckc_1, ..., c_k such that the objective function ∑i=1k∑x∈Oi∣∣x−ci∣∣2\sum_{i=1}^{k} \sum_{x \in O_{i}} ||x - c_{i}||^2 is minimized. It is not difficult to argue that any algorithm (without knowing the optimal clusters) that outputs a single set of kk centers, will not behave well as far as optimizing the above objective function is concerned. However, this does not rule out the existence of algorithms that output a list of such kk centers such that at least one of these kk centers behaves well. Given an error parameter ε>0\varepsilon > 0, let ℓ\ell denote the size of the smallest list of kk-centers such that at least one of the kk-centers gives a (1+ε)(1+\varepsilon) approximation w.r.t. the objective function above. In this paper, we show an upper bound on ℓ\ell by giving a randomized algorithm that outputs a list of 2O~(k/ε)2^{\tilde{O}(k/\varepsilon)} kk-centers. We also give a closely matching lower bound of 2Ω~(k/ε)2^{\tildeΩ(k/\sqrt{\varepsilon})}. Moreover, our algorithm runs in time O(nd⋅2O~(k/ε))O \left(n d \cdot 2^{\tilde{O}(k/\varepsilon)} \right). This is a significant improvement over the previous result of Ding and Xu who gave an algorithm with running time O(nd⋅(log⁡n)k⋅2poly(k/ε))O \left(n d \cdot (\log{n})^{k} \cdot 2^{poly(k/\varepsilon)} \right) and output a list of size O((log⁡n)k⋅2poly(k/ε))O \left((\log{n})^k \cdot 2^{poly(k/\varepsilon)} \right).

preprint2015arXiv

Sampling in Space Restricted Settings

Space efficient algorithms play a central role in dealing with large amount of data. In such settings, one would like to analyse the large data using small amount of "working space". One of the key steps in many algorithms for analysing large data is to maintain a (or a small number) random sample from the data points. In this paper, we consider two space restricted settings -- (i) streaming model, where data arrives over time and one can use only a small amount of storage, and (ii) query model, where we can structure the data in low space and answer sampling queries. In this paper, we prove the following results in above two settings: - In the streaming setting, we would like to maintain a random sample from the elements seen so far. We prove that one can maintain a random sample using O(log⁡n)O(\log n) random bits and O(log⁡n)O(\log n) space, where nn is the number of elements seen so far. We can extend this to the case when elements have weights as well. - In the query model, there are nn elements with weights w1,...,wnw_1, ..., w_n (which are ww-bit integers) and one would like to sample a random element with probability proportional to its weight. Bringmann and Larsen (STOC 2013) showed how to sample such an element using nw+1nw +1 space (whereas, the information theoretic lower bound is nwn w). We consider the approximate sampling problem, where we are given an error parameter ε\varepsilon, and the sampling probability of an element can be off by an ε\varepsilon factor. We give matching upper and lower bounds for this problem.

preprint2014arXiv

A tight lower bound instance for k-means++ in constant dimension

The k-means++ seeding algorithm is one of the most popular algorithms that is used for finding the initial kk centers when using the k-means heuristic. The algorithm is a simple sampling procedure and can be described as follows: Pick the first center randomly from the given points. For i>1i > 1, pick a point to be the ithi^{th} center with probability proportional to the square of the Euclidean distance of this point to the closest previously (i−1)(i-1) chosen centers. The k-means++ seeding algorithm is not only simple and fast but also gives an O(log⁡k)O(\log{k}) approximation in expectation as shown by Arthur and Vassilvitskii. There are datasets on which this seeding algorithm gives an approximation factor of Ω(log⁡k)Ω(\log{k}) in expectation. However, it is not clear from these results if the algorithm achieves good approximation factor with reasonably high probability (say 1/poly(k)1/poly(k)). Brunsch and Röglin gave a dataset where the k-means++ seeding algorithm achieves an O(log⁡k)O(\log{k}) approximation ratio with probability that is exponentially small in kk. However, this and all other known lower-bound examples are high dimensional. So, an open problem was to understand the behavior of the algorithm on low dimensional datasets. In this work, we give a simple two dimensional dataset on which the seeding algorithm achieves an O(log⁡k)O(\log{k}) approximation ratio with probability exponentially small in kk. This solves open problems posed by Mahajan et al. and by Brunsch and Röglin.

preprint2013arXiv

A bad 2-dimensional instance for k-means++

The k-means++ seeding algorithm is one of the most popular algorithms that is used for finding the initial kk centers when using the k-means heuristic. The algorithm is a simple sampling procedure and can be described as follows: {quote} Pick the first center randomly from among the given points. For i>1i > 1, pick a point to be the ithi^{th} center with probability proportional to the square of the Euclidean distance of this point to the previously (i−1)(i-1) chosen centers. {quote} The k-means++ seeding algorithm is not only simple and fast but gives an O(log⁡k)O(\log{k}) approximation in expectation as shown by Arthur and Vassilvitskii \cite{av07}. There are datasets \cite{av07,adk09} on which this seeding algorithm gives an approximation factor Ω(log⁡k)Ω(\log{k}) in expectation. However, it is not clear from these results if the algorithm achieves good approximation factor with reasonably large probability (say 1/poly(k)1/poly(k)). Brunsch and Röglin \cite{br11} gave a dataset where the k-means++ seeding algorithm achieves an approximation ratio of (2/3−ε)⋅log⁡k(2/3 - ε)\cdot \log{k} only with probability that is exponentially small in kk. However, this and all other known {\em lower-bound examples} \cite{av07,adk09} are high dimensional. So, an open problem is to understand the behavior of the algorithm on low dimensional datasets. In this work, we give a simple two dimensional dataset on which the seeding algorithm achieves an approximation ratio cc (for some universal constant cc) only with probability exponentially small in kk. This is the first step towards solving open problems posed by Mahajan et al \cite{mnv12} and by Brunsch and Röglin \cite{br11}.

preprint2012arXiv

A simple D^2-sampling based PTAS for k-means and other Clustering Problems

Given a set of points P⊂RdP \subset \mathbb{R}^d, the kk-means clustering problem is to find a set of kk {\em centers} C={c1,...,ck},ci∈Rd,C = \{c_1,...,c_k\}, c_i \in \mathbb{R}^d, such that the objective function ∑x∈Pd(x,C)2\sum_{x \in P} d(x,C)^2, where d(x,C)d(x,C) denotes the distance between xx and the closest center in CC, is minimized. This is one of the most prominent objective functions that have been studied with respect to clustering. D2D^2-sampling \cite{ArthurV07} is a simple non-uniform sampling technique for choosing points from a set of points. It works as follows: given a set of points P⊆RdP \subseteq \mathbb{R}^d, the first point is chosen uniformly at random from PP. Subsequently, a point from PP is chosen as the next sample with probability proportional to the square of the distance of this point to the nearest previously sampled points. D2D^2-sampling has been shown to have nice properties with respect to the kk-means clustering problem. Arthur and Vassilvitskii \cite{ArthurV07} show that kk points chosen as centers from PP using D2D^2-sampling gives an O(log⁡k)O(\log{k}) approximation in expectation. Ailon et. al. \cite{AJMonteleoni09} and Aggarwal et. al. \cite{AggarwalDK09} extended results of \cite{ArthurV07} to show that O(k)O(k) points chosen as centers using D2D^2-sampling give O(1)O(1) approximation to the kk-means objective function with high probability. In this paper, we further demonstrate the power of D2D^2-sampling by giving a simple randomized (1+ε)(1 + ε)-approximation algorithm that uses the D2D^2-sampling in its core.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.