Trust snapshot

Quick read

Trust 21 - EmergingVerification L1Unclaimed author
25works
0followers
22topics
4close collaborators

Actions

Decide how to stay connected

Follow researcher0

Identity and collaboration

How to connect with this researcher

Claiming links this public author record to a researcher profile and unlocks direct collaboration workflows.

Log in to claim

Direct collaboration

Open a focused conversation when the fit is right

Claim this author entity first to unlock direct invitations.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

25 published item(s)

preprint2022arXiv

It is useful to analyze correlation graphs

In 1987, we analyzed the changes in correlation graphs between various features of the organism during stress and adaptation. After 33 years of research of many authors, discoveries and rediscoveries, we can say with complete confidence: It is useful to analyze correlation graphs. In addition, we should add that the concept of adaptability ('adaptation energy') introduced by Selye is useful, especially if it is supplemented by 'adaptation entropy' and free energy, as well as an analysis of limiting factors. Our review of these topics, Dynamic and Thermodynamic Adaptation Models" (Phys Life Rev, 2021, arXiv:2103.01959 [q-bio.OT]), attracted many comments from leading experts, with new ideas and new problems, from the dynamics of aging and the training of athletes to single-cell omics. Methodological backgrounds, like free energy analysis, were also discussed in depth. In this article, we provide an analytical overview of twelve commenting papers and some related publications.

preprint2021arXiv

Coloring Panchromatic Nighttime Satellite Images: Comparing the Performance of Several Machine Learning Methods

Artificial light-at-night (ALAN), emitted from the ground and visible from space, marks human presence on Earth. Since the launch of the Suomi National Polar Partnership satellite with the Visible Infrared Imaging Radiometer Suite Day/Night Band (VIIRS/DNB) onboard, global nighttime images have significantly improved; however, they remained panchromatic. Although multispectral images are also available, they are either commercial or free of charge, but sporadic. In this paper, we use several machine learning techniques, such as linear, kernel, random forest regressions, and elastic map approach, to transform panchromatic VIIRS/DBN into Red Green Blue (RGB) images. To validate the proposed approach, we analyze RGB images for eight urban areas worldwide. We link RGB values, obtained from ISS photographs, to panchromatic ALAN intensities, their pixel-wise differences, and several land-use type proxies. Each dataset is used for model training, while other datasets are used for the model validation. The analysis shows that model-estimated RGB images demonstrate a high degree of correspondence with the original RGB images from the ISS database. Yet, estimates, based on linear, kernel and random forest regressions, provide better correlations, contrast similarity and lower WMSEs levels, while RGB images, generated using elastic map approach, provide higher consistency of predictions.

preprint2021arXiv

Dynamic and Thermodynamic Models of Adaptation

The concept of biological adaptation was closely connected to some mathematical, engineering and physical ideas from the very beginning. Cannon in his "The wisdom of the body" (1932) used the engineering vision of regulation. In 1938, Selye enriched this approach by the notion of adaptation energy. This term causes much debate when one takes it literally, i.e. as a sort of energy. Selye did not use the language of mathematics, but the formalization of his phenomenological theory in the spirit of thermodynamics was simple and led to verifiable predictions. In 1980s, the dynamics of correlation and variance in systems under adaptation to a load of environmental factors were studied and the universal effect in ensembles of systems under a load of similar factors was discovered: in a crisis, as a rule, even before the onset of obvious symptoms of stress, the correlation increases together with variance (and volatility). During 30 years, this effect has been supported by many observations of groups of humans, mice, trees, grassy plants, and on financial time series. In the last ten years, these results were supplemented by many new experiments, from gene networks in cardiology and oncology to dynamics of depression and clinical psychotherapy. Several systems of models were developed: the thermodynamic-like theory of adaptation of ensembles and several families of models of individual adaptation. Historically, the first group of models was based on Selye's concept of adaptation energy and used fitness estimates. Two other groups of models are based on the idea of hidden attractor bifurcation and on the advection--diffusion model for distribution of population in the space of physiological attributes. We explore this world of models and experiments, starting with classic works, with particular attention to the results of the last ten years and open questions.

preprint2020arXiv

Handling missing data in large healthcare dataset: a case study of unknown trauma outcomes

Handling of missed data is one of the main tasks in data preprocessing especially in large public service datasets. We have analysed data from the Trauma Audit and Research Network (TARN) database, the largest trauma database in Europe. For the analysis we used 165,559 trauma cases. Among them, there are 19,289 cases (13.19\%) with unknown outcome. We have demonstrated that these outcomes are not missed `completely at random' and, hence, it is impossible just to exclude these cases from analysis despite the large amount of available data. We have developed a system of non-stationary Markov models for the handling of missed outcomes and validated these models on the data of 15,437 patients which arrived into TARN hospitals later than 24 hours but within 30 days from injury. We used these Markov models for the analysis of mortality. In particular, we corrected the observed fraction of death. Two naïve approaches give 7.20\% (available case study) or 6.36\% (if we assume that all unknown outcomes are `alive'). The corrected value is 6.78\%. Following the seminal paper of Trunkey (1983) the multimodality of mortality curves has become a much discussed idea. For the whole analysed TARN dataset the coefficient of mortality monotonically decreases in time but the stratified analysis of the mortality gives a different result: for lower severities the coefficient of mortality is a non-monotonic function of the time after injury and may have maxima at the second and third weeks. The approach developed here can be applied to various healthcare datasets which experience the problem of lost patients and missed outcomes.

preprint2018arXiv

Model reduction in chemical dynamics: slow invariant manifolds, singular perturbations, thermodynamic estimates, and analysis of reaction graph

The paper has two goals: It presents basic ideas, notions, and methods for reduction of reaction kinetics models: quasi-steady-state, quasi-equilibrium, slow invariant manifolds, and limiting steps. It describes briefly the current state of the art and some latest achievements in the broad area of model reduction in chemical and biochemical kinetics, including new results in methods of invariant manifolds, computation singular perturbation, bottleneck methods, asymptotology, tropical equilibration, and reaction mechanism skeletonisation.

preprint2018arXiv

Simple model of complex dynamics of activity patterns in developing networks of neuronal cultures

Living neuronal networks in dissociated neuronal cultures are widely known for their ability to generate highly robust spatiotemporal activity patterns in various experimental conditions. These include neuronal avalanches satisfying the power scaling law and thereby exemplifying self-organized criticality in living systems. A crucial question is how these patterns can be explained and modeled in a way that is biologically meaningful, mathematically tractable and yet broad enough to account for neuronal heterogeneity and complexity. Here we propose a simple model which may offer an answer to this question. Our derivations are based on just few phenomenological observations concerning input-output behavior of an isolated neuron. A distinctive feature of the model is that at the simplest level of description it comprises of only two variables, a network activity variable and an exogenous variable corresponding to energy needed to sustain the activity and modulate the efficacy of signal transmission. Strikingly, this simple model is already capable of explaining emergence of network spikes and bursts in developing neuronal cultures. The model behavior and predictions are supported by empirical observations and published experimental evidence on cultured neurons behavior exposed to oxygen and energy deprivation. At the larger, network scale, introduction of the energy-dependent regulatory mechanism enables the network to balance on the edge of the network percolation transition. Network activity in this state shows population bursts satisfying the scaling avalanche conditions. This network state is self-sustainable and represents a balance between global network-wide processes and spontaneous activity of individual elements.

preprint2018arXiv

The unreasonable effectiveness of small neural ensembles in high-dimensional brain

Despite the widely-spread consensus on the brain complexity, sprouts of the single neuron revolution emerged in neuroscience in the 1970s. They brought many unexpected discoveries, including grandmother or concept cells and sparse coding of information in the brain. In machine learning for a long time, the famous curse of dimensionality seemed to be an unsolvable problem. Nevertheless, the idea of the blessing of dimensionality becomes gradually more and more popular. Ensembles of non-interacting or weakly interacting simple units prove to be an effective tool for solving essentially multidimensional problems. This approach is especially useful for one-shot (non-iterative) correction of errors in large legacy artificial intelligence systems. These simplicity revolutions in the era of complexity have deep fundamental reasons grounded in geometry of multidimensional data spaces. To explore and understand these reasons we revisit the background ideas of statistical physics. In the course of the 20th century they were developed into the concentration of measure theory. New stochastic separation theorems reveal the fine structure of the data clouds. We review and analyse biological, physical, and mathematical problems at the core of the fundamental question: how can high-dimensional brain organise reliable and fast learning in high-dimensional world of data by simple tools? Two critical applications are reviewed to exemplify the approach: one-shot correction of errors in intellectual systems and emergence of static and associative memories in ensembles of single neurons.

preprint2013arXiv

Entropy: The Markov Ordering Approach

The focus of this article is on entropy and Markov processes. We study the properties of functionals which are invariant with respect to monotonic transformations and analyze two invariant "additivity" properties: (i) existence of a monotonic transformation which makes the functional additive with respect to the joining of independent systems and (ii) existence of a monotonic transformation which makes the functional additive with respect to the partitioning of the space of states. All Lyapunov functionals for Markov chains which have properties (i) and (ii) are derived. We describe the most general ordering of the distribution space, with respect to which all continuous-time Markov processes are monotonic (the {\em Markov order}). The solution differs significantly from the ordering given by the inequality of entropy growth. For inference, this approach results in a convex compact set of conditionally "most random" distributions.

preprint2013arXiv

Extremal property of a simple cycle

We study systems with finite number of states $A_i$ ($i=1,..., n$), which obey the first order kinetics (master equation) without detailed balance. For any nonzero complex eigenvalue $λ$ we prove the inequality $\frac{|\Im λ|}{|\Re λ|} \leq \cot\fracπ{n}$. This bound is sharp and it becomes an equality for an eigenvalue of a simple irreversible cycle $A_1 \to A_2 \to... \to A_n \to A_1$ with equal rate constants of all transitions. Therefore, the simple cycle with the equal rate constants has the slowest decay of the oscillations among all first order kinetic systems with the same number of states.

preprint2013arXiv

Maxallent: Maximizers of all Entropies and Uncertainty of Uncertainty

The entropy maximum approach (Maxent) was developed as a minimization of the subjective uncertainty measured by the Boltzmann--Gibbs--Shannon entropy. Many new entropies have been invented in the second half of the 20th century. Now there exists a rich choice of entropies for fitting needs. This diversity of entropies gave rise to a Maxent "anarchism". Maxent approach is now the conditional maximization of an appropriate entropy for the evaluation of the probability distribution when our information is partial and incomplete. The rich choice of non-classical entropies causes a new problem: which entropy is better for a given class of applications? We understand entropy as a measure of uncertainty which increases in Markov processes. In this work, we describe the most general ordering of the distribution space, with respect to which all continuous-time Markov processes are monotonic (the Markov order). For inference, this approach results in a set of conditionally "most random" distributions. Each distribution from this set is a maximizer of its own entropy. This "uncertainty of uncertainty" is unavoidable in analysis of non-equilibrium systems. Surprisingly, the constructive description of this set of maximizers is possible. Two decomposition theorems for Markov processes provide a tool for this description.

preprint2012arXiv

Local Equivalence of Reversible and General Markov Kinetics

We consider continuous--time Markov kinetics with a finite number of states and a given positive equilibrium distribution P*. For an arbitrary probability distribution $P$ we study the possible right hand sides, dP/dt, of the Kolmogorov (master) equations. We describe the cone of possible values of the velocity, dP/dt, as a function of P and P*. We prove that, surprisingly, these cones coincide for the class of all Markov processes with equilibrium P* and for the reversible Markov processes with detailed balance at this equilibrium. Therefore, for an arbitrary probability distribution $P$ and a general system there exists a system with detailed balance and the same equilibrium that has the same velocity dP/dt at point P. The set of Lyapunov functions for the reversible Markov processes coincides with the set of Lyapunov functions for general Markov kinetics. The results are extended to nonlinear systems with the generalized mass action law.

preprint2012arXiv

Simultaneously Dissipative Operators And The Infinitesimal Moore Effect In Interval Spaces

One of shortcomings of stepwise interval methods is the following. The intervals determining the solution of a system are often expanded in the course of time irrespective of the method and step used (the {\em Moore effect}). We introduce the notion of general {\em interval spaces} and study the infinitesimal Moore effect (IME) in these spaces. We obtain the local conditions of absence of the IME in terms of Jacobi matrices field. The relation between the absence of IME and simultaneous dissipativity of the Jacobi matrices is established. We study simultaneously dissipative operators in $\Bbb{R}^n$. A linear operator $A$ is {\em dissipative} with respect to a norm $\|...\|$ if $\| \exp (At) \| \leq 1$ at all $t \geq 0$. For each norm, the dissipative operator form a closed convex cone. An operator $A$ is {\em stable dissipative} if it belongs to the interior of this cone. The family of linear operators $\{A_α\}$ is called {\em simultaneously dissipative}, if there exists a norm with respect to which all the operators are dissipative. We studied general properties of such families. For example, let the family $\{A_α\}$ be finite and generate a nilpotent Lee algebra and let for each $A_α$ there exist a norm with respect to which it is dissipative. Then $\{A_α\}$ is simultaneously dissipative. Let the family $\{A_α\}$ be compact and generate solvable Lee algebra, and let the spectrum of each operator $A_α$ lie in the open left half-plane. Then $\{A_α\}$ is simultaneously stable dissipative, i.e. there exists a norm with respect to which all $A_α$ are stable dissipative. We study the conditions of simultaneous dissipativity of the matrices of rank one and discussed their application to equations of {\em mass action law} kinetics.

preprint2012arXiv

Thermodynamic Tree: The Space of Admissible Paths

Is a spontaneous transition from a state x to a state y allowed by thermodynamics? Such a question arises often in chemical thermodynamics and kinetics. We ask the more formal question: is there a continuous path between these states, along which the conservation laws hold, the concentrations remain non-negative and the relevant thermodynamic potential G (Gibbs energy, for example) monotonically decreases? The obvious necessary condition, G(x)\geq G(y), is not sufficient, and we construct the necessary and sufficient conditions. For example, it is impossible to overstep the equilibrium in 1-dimensional (1D) systems (with n components and n-1 conservation laws). The system cannot come from a state x to a state y if they are on the opposite sides of the equilibrium even if G(x) > G(y). We find the general multidimensional analogue of this 1D rule and constructively solve the problem of the thermodynamically admissible transitions. We study dynamical systems, which are given in a positively invariant convex polyhedron D and have a convex Lyapunov function G. An admissible path is a continuous curve along which $G$ does not increase. For x,y from D, x\geq y (x precedes y) if there exists an admissible path from x to y and x \sim y if x\geq y and y\geq x. The tree of G in D is a quotient space D/~. We provide an algorithm for the construction of this tree. In this algorithm, the restriction of G onto the 1-skeleton of $D$ (the union of edges) is used. The problem of existence of admissible paths between states is solved constructively. The regions attainable by the admissible paths are described.

preprint2012arXiv

Thermodynamics in the Limit of Irreversible Reactions

For many real physico-chemical complex systems detailed mechanism includes both reversible and irreversible reactions. Such systems are typical in homogeneous combustion and heterogeneous catalytic oxidation. Most complex enzyme reactions include irreversible steps. The classical thermodynamics has no limit for irreversible reactions whereas the kinetic equations may have such a limit. We represent the systems with irreversible reactions as the limits of the fully reversible systems when some of the equilibrium concentrations tend to zero. The structure of the limit reaction system crucially depends on the relative rates of this tendency to zero. We study the dynamics of the limit system and describe its limit behavior as $t \to \infty$. If the reversible systems obey the principle of detailed balance then the limit system with some irreversible reactions must satisfy the {\em extended principle of detailed balance}. It is formulated and proven in the form of two conditions: (i) the reversible part satisfies the principle of detailed balance and (ii) the convex hull of the stoichiometric vectors of the irreversible reactions does not intersect the linear span of the stoichiometric vectors of the reversible reactions. These conditions imply the existence of the global Lyapunov functionals and alow an algebraic description of the limit behavior. The thermodynamic theory of the irreversible limit of reversible reactions is illustrated by the analysis of hydrogen combustion.

preprint2011arXiv

Elastic principal manifolds and their practical applications

Principal manifolds serve as useful tool for many practical applications. These manifolds are defined as lines or surfaces passing through "the middle" of data distribution. We propose an algorithm for fast construction of grid approximations of principal manifolds with given topology. It is based on analogy of principal manifold and elastic membrane. The first advantage of this method is a form of the functional to be minimized which becomes quadratic at the step of the vertices position refinement. This makes the algorithm very effective, especially for parallel implementations. Another advantage is that the same algorithmic kernel is applied to construct principal manifolds of different dimensions and topologies. We demonstrate how flexibility of the approach allows numerous adaptive strategies like principal graph constructing, etc. The algorithm is implemented as a C++ package elmap and as a part of stand-alone data visualization tool VidaExpert, available on the web. We describe the approach and provide several examples of its application with speed performance characteristics.

preprint2011arXiv

Extended Detailed Balance for Systems with Irreversible Reactions

The principle of detailed balance states that in equilibrium each elementary process is equilibrated by its reverse process. For many real physico-chemical complex systems (e.g. homogeneous combustion, heterogeneous catalytic oxidation, most enzyme reactions etc), detailed mechanisms include both reversible and irreversible reactions. In this case, the principle of detailed balance cannot be applied directly. We represent irreversible reactions as limits of reversible steps and obtain the principle of detailed balance for complex mechanisms with some irreversible elementary processes. We proved two consequences of the detailed balance for these mechanisms: the structural condition and the algebraic condition that form together the extended form of detailed balance. The algebraic condition is the principle of detailed balance for the reversible part. The structural condition is: the convex hull of the stoichiometric vectors of the irreversible reactions has empty intersection with the linear span of the stoichiometric vectors of the reversible reaction. Physically, this means that the irreversible reactions cannot be included in oriented pathways. The systems with the extended form of detailed balance are also the limits of the reversible systems with detailed balance when some of the equilibrium concentrations (or activities) tend to zero. Surprisingly, the structure of the limit reaction mechanism crucially depends on the relative speeds of this tendency to zero.

preprint2011arXiv

Kinetic Path Summation, Multi--Sheeted Extension of Master Equation, and Evaluation of Ergodicity Coefficient

We study the Master equation with time--dependent coefficients, a linear kinetic equation for the Markov chains or for the monomolecular chemical kinetics. For the solution of this equation a path summation formula is proved. This formula represents the solution as a sum of solutions for simple kinetic schemes (kinetic paths), which are available in explicit analytical form. The relaxation rate is studied and a family of estimates for the relaxation time and the ergodicity coefficient is developed. To calculate the estimates we introduce the multi--sheeted extensions of the initial kinetics. This approach allows us to exploit the internal ("micro")structure of the extended kinetics without perturbation of the base kinetics.

preprint2011arXiv

Principal Graphs and Manifolds

In many physical, statistical, biological and other investigations it is desirable to approximate a system of points by objects of lower dimension and/or complexity. For this purpose, Karl Pearson invented principal component analysis in 1901 and found 'lines and planes of closest fit to system of points'. The famous k-means algorithm solves the approximation problem too, but by finite sets instead of lines and planes. This chapter gives a brief practical introduction into the methods of construction of general principal objects, i.e. objects embedded in the 'middle' of the multidimensional data set. As a basis, the unifying framework of mean squared distance approximation of finite datasets is selected. Principal graphs and manifolds are constructed as generalisations of principal components and k-means principal points. For this purpose, the family of expectation/maximisation algorithms with nearest generalisations is presented. Construction of principal graphs with controlled complexity is based on the graph grammar approach.

preprint2011arXiv

Reciprocal Relations Between Kinetic Curves

We study coupled irreversible processes. For linear or linearized kinetics with microreversibility, $\dot{x}=Kx$, the kinetic operator $K$ is symmetric in the entropic inner product. This form of Onsager's reciprocal relations implies that the shift in time, $\exp (Kt)$, is also a symmetric operator. This generates the reciprocity relations between the kinetic curves. For example, for the Master equation, if we start the process from the $i$th pure state and measure the probability $p_j(t)$ of the $j$th state ($j\neq i$), and, similarly, measure $p_i(t)$ for the process, which starts at the $j$th pure state, then the ratio of these two probabilities $p_j(t)/p_i(t)$ is constant in time and coincides with the ratio of the equilibrium probabilities. We study similar and more general reciprocal relations between the kinetic curves. The experimental evidence provided as an example is from the reversible water gas shift reaction over iron oxide catalyst. The experimental data are obtained using Temporal Analysis of Products (TAP) pulse-response studies. These offer excellent confirmation within the experimental error.

preprint2010arXiv

Asymptotology of Chemical Reaction Networks

The concept of the limiting step is extended to the asymptotology of multiscale reaction networks. Complete theory for linear networks with well separated reaction rate constants is developed. We present algorithms for explicit approximations of eigenvalues and eigenvectors of kinetic matrix. Accuracy of estimates is proven. Performance of the algorithms is demonstrated on simple examples. Application of algorithms to nonlinear systems is discussed.

preprint2010arXiv

Correlations, Risk and Crisis: From Physiology to Finance

We study the dynamics of correlation and variance in systems under the load of environmental factors. A universal effect in ensembles of similar systems under the load of similar factors is described: in crisis, typically, even before obvious symptoms of crisis appear, correlation increases, and, at the same time, variance (and volatility) increases too. This effect is supported by many experiments and observations of groups of humans, mice, trees, grassy plants, and on financial time series. A general approach to the explanation of the effect through dynamics of individual adaptation of similar non-interactive individuals to a similar system of external factors is developed. Qualitatively, this approach follows Selye's idea about adaptation energy.

preprint2010arXiv

Principal manifolds and graphs in practice: from molecular biology to dynamical systems

We present several applications of non-linear data modeling, using principal manifolds and principal graphs constructed using the metaphor of elasticity (elastic principal graph approach). These approaches are generalizations of the Kohonen's self-organizing maps, a class of artificial neural networks. On several examples we show advantages of using non-linear objects for data approximation in comparison to the linear ones. We propose four numerical criteria for comparing linear and non-linear mappings of datasets into the spaces of lower dimension. The examples are taken from comparative political science, from analysis of high-throughput data in molecular biology, from analysis of dynamical systems.

preprint2007arXiv

Dynamical robustness of biological networks with hierarchical distribution of time scales

We propose the concepts of distributed robustness and r-robustness, well adapted to functional genetics. Then we discuss the robustness of the relaxation time using a chemical reaction description of genetic and signalling networks. First, we obtain the following result for linear networks: for large multiscale systems with hierarchical distribution of time scales the variance of the inverse relaxation time (as well as the variance of the stationary rate) is much lower than the variance of the separate constants. Moreover, it can tend to 0 faster than 1/n, where n is the number of reactions. We argue that similar phenomena are valid in the nonlinear case as well. As a numerical illustration we use a model of signalling network that can be applied to important transcription factors such as NFkB.

preprint2004arXiv

Back-propagation of accuracy

In this paper we solve the problem: how to determine maximal allowable errors, possible for signals and parameters of each element of a network proceeding from the condition that the vector of output signals of the network should be calculated with given accuracy? "Back-propagation of accuracy" is developed to solve this problem. The calculation of allowable errors for each element of network by back-propagation of accuracy is surprisingly similar to a back-propagation of error, because it is the backward signals motion, but at the same time it is very different because the new rules of signals transformation in the passing back through the elements are different. The method allows us to formulate the requirements to the accuracy of calculations and to the realization of technical devices, if the requirements to the accuracy of output signals of the network are known.

preprint2004arXiv

Four basic symmetry types in the universal 7-cluster structure of 143 complete bacterial genomic sequences

Coding information is the main source of heterogeneity (non-randomness) in the sequences of bacterial genomes. This information can be naturally modeled by analysing cluster structures in the "in-phase" triplet distributions of relatively short genomic fragments (200-400bp). We found a universal 7-cluster structure in bacterial genomic sequences and explained its properties. We show that codon usage of bacterial genomes is a multi-linear function of their genomic G+C-content with high accuracy. Based on the analysis of 143 completely sequenced bacterial genomes available in Genbank in August 2004, we show that there are four "pure" types of the 7-cluster structure observed. All 143 cluster animated 3D-scatters are collected in a database and is made available on our web-site: http://www.ihes.fr/~zinovyev/7clusters The finding can be readily introduced into any software for gene prediction, sequence alignment or bacterial genomes classification.