Source author record

Akshay Kulkarni

Akshay Kulkarni appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

9works
6topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

9 published item(s)

preprint2022arXiv

Amplitude Spectrum Transformation for Open Compound Domain Adaptive Semantic Segmentation

Open compound domain adaptation (OCDA) has emerged as a practical adaptation setting which considers a single labeled source domain against a compound of multi-modal unlabeled target data in order to generalize better on novel unseen domains. We hypothesize that an improved disentanglement of domain-related and task-related factors of dense intermediate layer features can greatly aid OCDA. Prior-arts attempt this indirectly by employing adversarial domain discriminators on the spatial CNN output. However, we find that latent features derived from the Fourier-based amplitude spectrum of deep CNN features hold a more tractable mapping with domain discrimination. Motivated by this, we propose a novel feature space Amplitude Spectrum Transformation (AST). During adaptation, we employ the AST auto-encoder for two purposes. First, carefully mined source-target instance pairs undergo a simulation of cross-domain feature stylization (AST-Sim) at a particular layer by altering the AST-latent. Second, AST operating at a later layer is tasked to normalize (AST-Norm) the domain content by fixing its latent to a mean prototype. Our simplified adaptation technique is not only clustering-free but also free from complex adversarial alignment. We achieve leading performance against the prior arts on the OCDA scene segmentation benchmarks.

preprint2022arXiv

Balancing Discriminability and Transferability for Source-Free Domain Adaptation

Conventional domain adaptation (DA) techniques aim to improve domain transferability by learning domain-invariant representations; while concurrently preserving the task-discriminability knowledge gathered from the labeled source data. However, the requirement of simultaneous access to labeled source and unlabeled target renders them unsuitable for the challenging source-free DA setting. The trivial solution of realizing an effective original to generic domain mapping improves transferability but degrades task discriminability. Upon analyzing the hurdles from both theoretical and empirical standpoints, we derive novel insights to show that a mixup between original and corresponding translated generic samples enhances the discriminability-transferability trade-off while duly respecting the privacy-oriented source-free setting. A simple but effective realization of the proposed insights on top of the existing source-free DA approaches yields state-of-the-art performance with faster convergence. Beyond single-source, we also outperform multi-source prior-arts across both classification and semantic segmentation benchmarks.

preprint2022arXiv

Concurrent Subsidiary Supervision for Unsupervised Source-Free Domain Adaptation

The prime challenge in unsupervised domain adaptation (DA) is to mitigate the domain shift between the source and target domains. Prior DA works show that pretext tasks could be used to mitigate this domain shift by learning domain invariant representations. However, in practice, we find that most existing pretext tasks are ineffective against other established techniques. Thus, we theoretically analyze how and when a subsidiary pretext task could be leveraged to assist the goal task of a given DA problem and develop objective subsidiary task suitability criteria. Based on this criteria, we devise a novel process of sticker intervention and cast sticker classification as a supervised subsidiary DA problem concurrent to the goal task unsupervised DA. Our approach not only improves goal task adaptation performance, but also facilitates privacy-oriented source-free DA i.e. without concurrent source-target access. Experiments on the standard Office-31, Office-Home, DomainNet, and VisDA benchmarks demonstrate our superiority for both single-source and multi-source source-free DA. Our approach also complements existing non-source-free works, achieving leading performance.

preprint2021arXiv

Generalize then Adapt: Source-Free Domain Adaptive Semantic Segmentation

Unsupervised domain adaptation (DA) has gained substantial interest in semantic segmentation. However, almost all prior arts assume concurrent access to both labeled source and unlabeled target, making them unsuitable for scenarios demanding source-free adaptation. In this work, we enable source-free DA by partitioning the task into two: a) source-only domain generalization and b) source-free target adaptation. Towards the former, we provide theoretical insights to develop a multi-head framework trained with a virtually extended multi-source dataset, aiming to balance generalization and specificity. Towards the latter, we utilize the multi-head framework to extract reliable target pseudo-labels for self-training. Additionally, we introduce a novel conditional prior-enforcing auto-encoder that discourages spatial irregularities, thereby enhancing the pseudo-label quality. Experiments on the standard GTA5-to-Cityscapes and SYNTHIA-to-Cityscapes benchmarks show our superiority even against the non-source-free prior-arts. Further, we show our compatibility with online adaptation enabling deployment in a sequentially changing environment.

preprint2020arXiv

Data Efficient Stagewise Knowledge Distillation

Despite the success of Deep Learning (DL), the deployment of modern DL models requiring large computational power poses a significant problem for resource-constrained systems. This necessitates building compact networks that reduce computations while preserving performance. Traditional Knowledge Distillation (KD) methods that transfer knowledge from teacher to student (a) use a single-stage and (b) require the whole data set while distilling the knowledge to the student. In this work, we propose a new method called Stagewise Knowledge Distillation (SKD) which builds on traditional KD methods by progressive stagewise training to leverage the knowledge gained from the teacher, resulting in data-efficient distillation process. We evaluate our method on classification and semantic segmentation tasks. We show, across the tested tasks, significant performance gains even with a fraction of the data used in distillation, without compromising on the metric. We also compare our method with existing KD techniques and show that SKD outperforms them. Moreover, our method can be viewed as a generalized model compression technique that complements other model compression methods such as quantization or pruning.

preprint2013arXiv

A new equilibrium torus solution and GRMHD initial conditions

General relativistic magnetohydrodynamic (GRMHD) simulations are providing influential models for black hole spin measurements, gamma ray bursts, and supermassive black hole feedback. Many of these simulations use the same initial condition: a rotating torus of fluid in hydrostatic equilibrium. A persistent concern is that simulation results sometimes depend on arbitrary features of the initial torus. For example, the Bernoulli parameter (which is related to outflows), appears to be controlled by the Bernoulli parameter of the initial torus. In this paper, we give a new equilibrium torus solution and describe two applications for the future. First, it can be used as a more physical initial condition for GRMHD simulations than earlier torus solutions. Second, it can be used in conjunction with earlier torus solutions to isolate the simulation results that depend on initial conditions. We assume axisymmetry, an ideal gas equation of state, constant entropy, and ignore self-gravity. We fix an angular momentum distribution and solve the relativistic Euler equations in the Kerr metric. The Bernoulli parameter, rotation rate, and geometrical thickness of the torus can be adjusted independently. Our torus tends to be more bound and have a larger radial extent than earlier torus solutions. While this paper was in preparation, several GRMHD simulations appeared based on our equilibrium torus. We believe it will continue to provide a more realistic starting point for future simulations.

preprint2011arXiv

Measuring the Spins of Accreting Black Holes

A typical galaxy is thought to contain tens of millions of stellar-mass black holes, the collapsed remnants of once massive stars, and a single nuclear supermassive black hole. Both classes of black holes accrete gas from their environments. The accreting gas forms a flattened orbiting structure known as an accretion disk. During the past several years, it has become possible to obtain measurements of the spins of the two classes of black holes by modeling the X-ray emission from their accretion disks. Two methods are employed, both of which depend upon identifying the inner radius of the accretion disk with the innermost stable circular orbit (ISCO), whose radius depends only on the mass and spin of the black hole. In the Fe K method, which applies to both classes of black holes, one models the profile of the relativistically-broadened iron line with a special focus on the gravitationally redshifted red wing of the line. In the continuum-fitting method, which has so far only been applied to stellar-mass black holes, one models the thermal X-ray continuum spectrum of the accretion disk. We discuss both methods, with a strong emphasis on the continuum-fitting method and its application to stellar-mass black holes. Spin results for eight stellar-mass black holes are summarized. These data are used to argue that the high spins of at least some of these black holes are natal, and that the presence or absence of relativistic jets in accreting black holes is not entirely determined by the spin of the black hole.

preprint2010arXiv

QPO emission from moving hot spots on the surface of neutron stars: a model

We present recent results of 3D magnetohydrodynamic simulations of neutron stars with small misalignment angles, as regards the features in lightcurves produced by regular movements of the hot spots during accretion onto the star. In particular, we show that the variation of position of the hot spot created by the infalling matter, as observed in 3D simulations, can produce high frequency Quasi Periodic Oscillations with frequencies associated with the inner zone of the disk. Previously reported simulations showed that the usual assumption of a fixed hot spot near the polar region is valid only for misalignment angles relatively large. Otherwise, two phenomena challenge the assumption: one is the presence of Rayleigh-Taylor instabilities at the disk-magnetospheric boundary, which produce tongues of accreting matter that can reach the star almost anywhere between the equator and the polar region; the other one is the motion of the hot spot around the magnetic pole during stable accretion. In this paper we start by showing that both phenomena are capable of producing short-term oscillations in the lightcurves. We then use Monte Carlo techniques to produce model lightcurves based on the features of the movements observed, and we show that the main features of kHz QPOs can be reproduced. Finally, we show the behavior of the frequencies of the moving spots as the mass accretion rate changes, and propose a mechanism for the production of double QPO peaks.

preprint2009arXiv

3D MHD Simulations of accreting neutron stars: evidence of QPO emission from the surface

3D Magnetohydrodynamic simulations show that when matter accretes onto neutron stars, in particular if the misalignment angle is small, it does not constantly fall at a fixed spot. Instead, the location at which matter reaches the star moves. These moving hot spots can be produced both during stable accretion, where matter falls near the magnetic poles of the star, and unstable accretion, characterized by the presence of several tongues of matter which fall on the star near the equator, due to Rayleigh-Taylor instabilities. Precise modeling with Monte Carlo simulations shows that those movements could be observed as high frequency Quasi Periodic Oscillations. We performed a number of new simulation runs with a much wider set of parameters, focusing on neutron stars with a small misalignment angle. In most cases we observe oscillations whose frequency is correlated with the mass accretion rate $\dot{M}$. Moreover, in some cases double QPOs appear, each of them showing the same correlation with $\dot{M}$.