Source author record

Mikhail Belyaev

Mikhail Belyaev appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

15works
15topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

15 published item(s)

preprint2022arXiv

Adaptation to CT Reconstruction Kernels by Enforcing Cross-domain Feature Maps Consistency

Deep learning methods provide significant assistance in analyzing coronavirus disease (COVID-19) in chest computed tomography (CT) images, including identification, severity assessment, and segmentation. Although the earlier developed methods address the lack of data and specific annotations, the current goal is to build a robust algorithm for clinical use, having a larger pool of available data. With the larger datasets, the domain shift problem arises, affecting the performance of methods on the unseen data. One of the critical sources of domain shift in CT images is the difference in reconstruction kernels used to generate images from the raw data (sinograms). In this paper, we show a decrease in the COVID-19 segmentation quality of the model trained on the smooth and tested on the sharp reconstruction kernels. Furthermore, we compare several domain adaptation approaches to tackle the problem, such as task-specific augmentation and unsupervised adversarial learning. Finally, we propose the unsupervised adaptation method, called F-Consistency, that outperforms the previous approaches. Our method exploits a set of unlabeled CT image pairs which differ only in reconstruction kernels within every pair. It enforces the similarity of the network hidden representations (feature maps) by minimizing mean squared error (MSE) between paired feature maps. We show our method achieving 0.64 Dice Score on the test dataset with unseen sharp kernels, compared to the 0.56 Dice Score of the baseline model. Moreover, F-Consistency scores 0.80 Dice Score between predictions on the paired images, which almost doubles the baseline score of 0.46 and surpasses the other methods. We also show F-Consistency to better generalize on the unseen kernels and without the specific semantic content, e.g., presence of the COVID-19 lesions.

preprint2022arXiv

Zero-Shot Domain Adaptation in CT Segmentation by Filtered Back Projection Augmentation

Domain shift is one of the most salient challenges in medical computer vision. Due to immense variability in scanners' parameters and imaging protocols, even images obtained from the same person and the same scanner could differ significantly. We address variability in computed tomography (CT) images caused by different convolution kernels used in the reconstruction process, the critical domain shift factor in CT. The choice of a convolution kernel affects pixels' granularity, image smoothness, and noise level. We analyze a dataset of paired CT images, where smooth and sharp images were reconstructed from the same sinograms with different kernels, thus providing identical anatomy but different style. Though identical predictions are desired, we show that the consistency, measured as the average Dice between predictions on pairs, is just 0.54. We propose Filtered Back-Projection Augmentation (FBPAug), a simple and surprisingly efficient approach to augment CT images in sinogram space emulating reconstruction with different kernels. We apply the proposed method in a zero-shot domain adaptation setup and show that the consistency boosts from 0.54 to 0.92 outperforming other augmentation approaches. Neither specific preparation of source domain data nor target domain data is required, so our publicly released FBPAug can be used as a plug-and-play module for zero-shot domain adaptation in any CT-based task.

preprint2020arXiv

First U-Net Layers Contain More Domain Specific Information Than The Last Ones

MRI scans appearance significantly depends on scanning protocols and, consequently, the data-collection institution. These variations between clinical sites result in dramatic drops of CNN segmentation quality on unseen domains. Many of the recently proposed MRI domain adaptation methods operate with the last CNN layers to suppress domain shift. At the same time, the core manifestation of MRI variability is a considerable diversity of image intensities. We hypothesize that these differences can be eliminated by modifying the first layers rather than the last ones. To validate this simple idea, we conducted a set of experiments with brain MRI scans from six domains. Our results demonstrate that 1) domain-shift may deteriorate the quality even for a simple brain extraction segmentation task (surface Dice Score drops from 0.85-0.89 even to 0.09); 2) fine-tuning of the first layers significantly outperforms fine-tuning of the last layers in almost all supervised domain adaptation setups. Moreover, fine-tuning of the first layers is a better strategy than fine-tuning of the whole network, if the amount of annotated data from the new domain is strictly limited.

preprint2020arXiv

Keypoints Localization for Joint Vertebra Detection and Fracture Severity Quantification

Vertebral body compression fractures are reliable early signs of osteoporosis. Though these fractures are visible on Computed Tomography (CT) images, they are frequently missed by radiologists in clinical settings. Prior research on automatic methods of vertebral fracture classification proves its reliable quality; however, existing methods provide hard-to-interpret outputs and sometimes fail to process cases with severe abnormalities such as highly pathological vertebrae or scoliosis. We propose a new two-step algorithm to localize the vertebral column in 3D CT images and then to simultaneously detect individual vertebrae and quantify fractures in 2D. We train neural networks for both steps using a simple 6-keypoints based annotation scheme, which corresponds precisely to current medical recommendation. Our algorithm has no exclusion criteria, processes 3D CT in 2 seconds on a single GPU, and provides an intuitive and verifiable output. The method approaches expert-level performance and demonstrates state-of-the-art results in vertebrae 3D localization (the average error is 1 mm), vertebrae 2D detection (precision is 0.99, recall is 1), and fracture identification (ROC AUC at the patient level is 0.93).

preprint2020arXiv

Multi-domain CT Metal Artifacts Reduction Using Partial Convolution Based Inpainting

Recent CT Metal Artifacts Reduction (MAR) methods are often based on image-to-image convolutional neural networks for adjustment of corrupted sinograms or images themselves. In this paper, we are exploring the capabilities of a multi-domain method which consists of both sinogram correction (projection domain step) and restored image correction (image-domain step). Moreover, we propose a formulation of the first step problem as sinogram inpainting which allows us to use methods of this specific field such as partial convolutions. The proposed method allows to achieve state-of-the-art (-75% MSE) improvement in comparison with a classic benchmark - Li-MAR.

preprint2020arXiv

Universal Loss Reweighting to Balance Lesion Size Inequality in 3D Medical Image Segmentation

Target imbalance affects the performance of recent deep learning methods in many medical image segmentation tasks. It is a twofold problem: class imbalance - positive class (lesion) size compared to negative class (non-lesion) size; lesion size imbalance - large lesions overshadows small ones (in the case of multiple lesions per image). While the former was addressed in multiple works, the latter lacks investigation. We propose a loss reweighting approach to increase the ability of the network to detect small lesions. During the learning process, we assign a weight to every image voxel. The assigned weights are inversely proportional to the lesion volume, thus smaller lesions get larger weights. We report the benefit from our method for well-known loss functions, including Dice Loss, Focal Loss, and Asymmetric Similarity Loss. Additionally, we compare our results with other reweighting techniques: Weighted Cross-Entropy and Generalized Dice Loss. Our experiments show that inverse weighting considerably increases the detection quality, while preserves the delineation quality on a state-of-the-art level. We publish a complete experimental pipeline for two publicly available datasets of CT images: LiTS and LUNA16 (https://github.com/neuro-ml/inverse_weighting). We also show results on a private database of MR images for the task of multiple brain metastases delineation.

preprint2016arXiv

GTApprox: surrogate modeling for industrial design

We describe GTApprox - a new tool for medium-scale surrogate modeling in industrial design. Compared to existing software, GTApprox brings several innovations: a few novel approximation algorithms, several advanced methods of automated model selection, novel options in the form of hints. We demonstrate the efficiency of GTApprox on a large collection of test problems. In addition, we describe several applications of GTApprox to real engineering problems.

preprint2016arXiv

Kernel classification of connectomes based on earth mover's distance between graph spectra

In this paper, we tackle a problem of predicting phenotypes from structural connectomes. We propose that normalized Laplacian spectra can capture structural properties of brain networks, and hence graph spectral distributions are useful for a task of connectome-based classification. We introduce a kernel that is based on earth mover's distance (EMD) between spectral distributions of brain networks. We access performance of an SVM classifier with the proposed kernel for a task of classification of autism spectrum disorder versus typical development based on a publicly available dataset. Classification quality (area under the ROC-curve) obtained with the EMD-based kernel on spectral distributions is 0.71, which is higher than that based on simpler graph embedding methods.

preprint2016arXiv

PICsar: A 2.5D Axisymmetric, Relativistic, Electromagnetic, Particle in Cell Code with a Radiation Absorbing Boundary

We present PICsar -- a new Particle in Cell code geared towards efficiently simulating the magnetosphere of the aligned rotator. PICsar is a special relativistic, electromagnetic, charge conservative code that can be used to simulate arbitrary electromagnetics problems in axisymmetry. It features stretchable body-fitted coordinates that follow the surface of a sphere, simplifying the application of boundary conditions in the case of the aligned rotator; a radiation absorbing outer boundary, which allows a steady state to be set up dynamically and maintained indefinitely from transient initial conditions; and algorithms for injection of charged particles into the simulation domain. The code is parallelized using MPI and scales well to a large number of processors. We discuss the numerical methods used in PICsar and present tests of the code. In particular, we show that PICsar can accurately and efficiently simulate the magnetosphere of the aligned monopole rotator in the force free limit. We present simulations of the aligned dipole rotator in a forthcoming paper.

preprint2015arXiv

The Properties of G-modes in Layered Semi-Convection

We study low frequency waves that propagate in a region of layered semi-convection. Layered semi-convection is predicted to be present in stellar and planetary interiors and can significantly modify the rate of thermal and compositional mixing. We derive a series of analytical dispersion relations for plane-parallel layered semi-convection in the Boussinesq approximation using a matrix transfer formalism. We find that like a continuously stratified medium, a semi-convective staircase -- in which small convective regions are separated by sharp density jumps -- supports internal gravity waves (g-modes). When the wavelength is much longer than the distance between semi-convective steps, these behave nearly like g-modes in a continuously stratified medium. However, the g-mode period spacing in a semi-convective region is systematically {\em smaller} than in a continuously stratified medium, and it decreases with decreasing mode frequency. When the g-mode wavelength becomes comparable to the distance between semi-convective steps, the g-mode frequencies deviate significantly from those of a continuously stratified medium (the frequencies are higher). G-modes with vertical wavelengths smaller than the distance between semi-convective steps are evanescent and do not propagate in the staircase. Thus, there is a lower cutoff frequency for a given horizontal wavenumber. We generalize our results to gravito-inertial waves relevant for rapidly rotating stars and planets. Finally, we assess the prospects for detecting layered semi-convection using astero/planetary seismology.

preprint2014arXiv

Exact Inference for Gaussian Process Regression in case of Big Data with the Cartesian Product Structure

Approximation algorithms are widely used in many engineering problems. To obtain a data set for approximation a factorial design of experiments is often used. In such case the size of the data set can be very large. Therefore, one of the most popular algorithms for approximation - Gaussian Process regression - can be hardly applied due to its computational complexity. In this paper a new approach for Gaussian Process regression in case of factorial design of experiments is proposed. It allows to efficiently compute exact inference and handle large multidimensional data sets. The proposed algorithm provides fast and accurate approximation and also handles anisotropic data.

preprint2012arXiv

A New Way to Conserve Total Energy for Eulerian Hydrodynamic Simulations with Self-Gravity

We propose a new method to conserve the total energy to round-off error in grid-based codes for hydrodynamic simulations with self-gravity. A formula for the energy flux due to the work done by the the self-gravitational force is given, so the change in total energy can be written in conservative form. Numerical experiments with the code Athena show that the total energy is indeed conserved with our new algorithm and the new algorithm is second order accurate. We have performed a set of tests that show the numerical errors in the traditional, non-conservative algorithm can affect the dynamics of the system. The new algorithm only requires one extra solution of the Poisson equation, as compared to the traditional algorithm which includes self-gravity as a source term. If the Poisson solver takes a negligible fraction of the total simulation time, such as when FFTs are used, the new algorithm is almost as efficient as the original method. This new algorithm is useful in Eulerian hydrodynamic simulations with self-gravity, especially when results are sensitive to small energy errors, as for radiation pressure dominated flow.

preprint2011arXiv

Non-Power Law Behavior in Fragmentation Cascades

Collisions resulting in fragmentation are important in shaping the mass spectrum of minor bodies in the asteroid belt, the Kuiper belt, and debris disks. Models of fragmentation cascades typically find that in steady-state, the solution for the particle mass distribution is a power law in the mass. However, previous studies have typically assumed that the mass of the largest fragment produced in a collision with just enough energy to shatter the target and disperse half its mass to infinity is directly proportional to the target mass. We show that if this assumption is not satisfied, then the power law solution for the steady-state particle mass distribution is modified by a multiplicative factor, which is a slowly varying function of the mass. We derive analytic solutions for this correction factor and confirm our results numerically. We find that this correction factor proves important when extrapolating over many orders of magnitude in mass, such as when inferring the number of large objects in a system based on infrared observations. In the course of our work, we have also discovered an unrelated type of non-power law behavior: waves can persist in the mass distribution of objects even in the absence of upper or lower cutoffs to the mass distribution or breaks in the strength law.

preprint2011arXiv

Supersonic Shear Instabilities in Astrophysical Boundary Layers

Disk accretion onto weakly magnetized astrophysical objects often proceeds via a boundary layer that forms near the object's surface, in which the rotation speed of the accreted gas changes rapidly. Here we study the initial stages of formation for such a boundary layer around a white dwarf or a young star by examining the hydrodynamical shear instabilities that may initiate mixing and momentum transport between the two fluids of different densities moving supersonically with respect to each other. We find that an initially laminar boundary layer is unstable to two different kinds of instabilities. One is an instability of a supersonic vortex sheet (implying a discontinuous initial profile of the angular speed of the gas) in the presence of gravity, which we find to have a growth rate of order (but less than) the orbital frequency. The other is a sonic instability of a finite width, supersonic shear layer, which is similar to the Papaloizou-Pringle instability. It has a growth rate proportional to the shear inside the transition layer, which is of order the orbital frequency times the ratio of stellar radius to the boundary layer thickness. For a boundary layer that is thin compared to the radius of the star, the shear rate is much larger than the orbital frequency. Thus, we conclude that sonic instabilities play a dominant role in the initial stages of nonmagnetic boundary layer formation and give rise to very fast mixing between disk gas and stellar fluid in the supersonic regime.

preprint2010arXiv

The Dynamics of Dust Grains in the Outer Solar System

We study the dynamics of large dust grains >1 micron with orbits outside of the heliosphere (beyond 250 AU). Motion of the Solar System through the interstellar medium (ISM) at a velocity of 26 km/s subjects these particles to gas and Coulomb drag (grains are expected to be photoelectrically charged) as well as the Lorentz force and the electric force caused by the induction electric field. We show that to zeroth order the combined effect of these forces can be well described in the framework of the classical Stark problem: particle motion in a Keplerian potential subject to an additional constant force. Based on this analogy, we elucidate the circumstances in which the motion becomes unbound, and show that under local ISM conditions dust grains smaller than ~100 microns originating in the Oort Cloud (e.g. in collisions of comets) beyond 10000 AU are ejected from the Solar System under the action of the electric force. Orbital motion of larger, bound grains is described analytically using the orbit-averaged Hamiltonian approach and consists of orbital plane precession at a fixed semi-major axis, accompanied by the periodic variations of the inclination and eccentricity (the latter may approach unity in some cases). A more detailed analysis of the combined effect of gas and Coulomb drag shows it is possible to reduce particle semi-major axes, but that the degree of orbital decay is limited (a factor of several at best) by passages through atomic and molecular clouds, which easily eject small particles.