BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

A. N. Gorban

A. N. Gorban appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
cond-mat.stat-mechphysics.chem-phphysics.comp-phApplicationsNeural and Evolutionary Computingcond-mat.mtrl-scimath.DSphysics.data-anArtificial Intelligencecond-mat.dis-nnMachine Learningmath-phmath.MPmath.STMolecular NetworksStatistics TheoryBiological PhysicsGeneral LiteratureGenomicsmath.NAmath.OCMethodologyNeurons and Cognitionnlin.AONumerical AnalysisOther Quantitative Biologyphysics.flu-dynphysics.geo-phphysics.soc-phPopulations and Evolutionq-fin.GNq-fin.STQuantitative MethodsTissues and Organs

Catalog footprint

What is connected

47works
34topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

47 published item(s)

preprint2022arXiv

It is useful to analyze correlation graphs

In 1987, we analyzed the changes in correlation graphs between various features of the organism during stress and adaptation. After 33 years of research of many authors, discoveries and rediscoveries, we can say with complete confidence: It is useful to analyze correlation graphs. In addition, we should add that the concept of adaptability ('adaptation energy') introduced by Selye is useful, especially if it is supplemented by 'adaptation entropy' and free energy, as well as an analysis of limiting factors. Our review of these topics, Dynamic and Thermodynamic Adaptation Models" (Phys Life Rev, 2021, arXiv:2103.01959 [q-bio.OT]), attracted many comments from leading experts, with new ideas and new problems, from the dynamics of aging and the training of athletes to single-cell omics. Methodological backgrounds, like free energy analysis, were also discussed in depth. In this article, we provide an analytical overview of twelve commenting papers and some related publications.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Coloring Panchromatic Nighttime Satellite Images: Comparing the Performance of Several Machine Learning Methods

Artificial light-at-night (ALAN), emitted from the ground and visible from space, marks human presence on Earth. Since the launch of the Suomi National Polar Partnership satellite with the Visible Infrared Imaging Radiometer Suite Day/Night Band (VIIRS/DNB) onboard, global nighttime images have significantly improved; however, they remained panchromatic. Although multispectral images are also available, they are either commercial or free of charge, but sporadic. In this paper, we use several machine learning techniques, such as linear, kernel, random forest regressions, and elastic map approach, to transform panchromatic VIIRS/DBN into Red Green Blue (RGB) images. To validate the proposed approach, we analyze RGB images for eight urban areas worldwide. We link RGB values, obtained from ISS photographs, to panchromatic ALAN intensities, their pixel-wise differences, and several land-use type proxies. Each dataset is used for model training, while other datasets are used for the model validation. The analysis shows that model-estimated RGB images demonstrate a high degree of correspondence with the original RGB images from the ISS database. Yet, estimates, based on linear, kernel and random forest regressions, provide better correlations, contrast similarity and lower WMSEs levels, while RGB images, generated using elastic map approach, provide higher consistency of predictions.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Dynamic and Thermodynamic Models of Adaptation

The concept of biological adaptation was closely connected to some mathematical, engineering and physical ideas from the very beginning. Cannon in his "The wisdom of the body" (1932) used the engineering vision of regulation. In 1938, Selye enriched this approach by the notion of adaptation energy. This term causes much debate when one takes it literally, i.e. as a sort of energy. Selye did not use the language of mathematics, but the formalization of his phenomenological theory in the spirit of thermodynamics was simple and led to verifiable predictions. In 1980s, the dynamics of correlation and variance in systems under adaptation to a load of environmental factors were studied and the universal effect in ensembles of systems under a load of similar factors was discovered: in a crisis, as a rule, even before the onset of obvious symptoms of stress, the correlation increases together with variance (and volatility). During 30 years, this effect has been supported by many observations of groups of humans, mice, trees, grassy plants, and on financial time series. In the last ten years, these results were supplemented by many new experiments, from gene networks in cardiology and oncology to dynamics of depression and clinical psychotherapy. Several systems of models were developed: the thermodynamic-like theory of adaptation of ensembles and several families of models of individual adaptation. Historically, the first group of models was based on Selye's concept of adaptation energy and used fitness estimates. Two other groups of models are based on the idea of hidden attractor bifurcation and on the advection--diffusion model for distribution of population in the space of physiological attributes. We explore this world of models and experiments, starting with classic works, with particular attention to the results of the last ten years and open questions.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Handling missing data in large healthcare dataset: a case study of unknown trauma outcomes

Handling of missed data is one of the main tasks in data preprocessing especially in large public service datasets. We have analysed data from the Trauma Audit and Research Network (TARN) database, the largest trauma database in Europe. For the analysis we used 165,559 trauma cases. Among them, there are 19,289 cases (13.19\%) with unknown outcome. We have demonstrated that these outcomes are not missed `completely at random' and, hence, it is impossible just to exclude these cases from analysis despite the large amount of available data. We have developed a system of non-stationary Markov models for the handling of missed outcomes and validated these models on the data of 15,437 patients which arrived into TARN hospitals later than 24 hours but within 30 days from injury. We used these Markov models for the analysis of mortality. In particular, we corrected the observed fraction of death. Two naïve approaches give 7.20\% (available case study) or 6.36\% (if we assume that all unknown outcomes are `alive'). The corrected value is 6.78\%. Following the seminal paper of Trunkey (1983) the multimodality of mortality curves has become a much discussed idea. For the whole analysed TARN dataset the coefficient of mortality monotonically decreases in time but the stratified analysis of the mortality gives a different result: for lower severities the coefficient of mortality is a non-monotonic function of the time after injury and may have maxima at the second and third weeks. The approach developed here can be applied to various healthcare datasets which experience the problem of lost patients and missed outcomes.

0 citations0 reviewsNo code linkedOpen access
preprint2018arXiv

Model reduction in chemical dynamics: slow invariant manifolds, singular perturbations, thermodynamic estimates, and analysis of reaction graph

The paper has two goals: It presents basic ideas, notions, and methods for reduction of reaction kinetics models: quasi-steady-state, quasi-equilibrium, slow invariant manifolds, and limiting steps. It describes briefly the current state of the art and some latest achievements in the broad area of model reduction in chemical and biochemical kinetics, including new results in methods of invariant manifolds, computation singular perturbation, bottleneck methods, asymptotology, tropical equilibration, and reaction mechanism skeletonisation.

0 citations0 reviewsNo code linkedOpen access
preprint2018arXiv

Simple model of complex dynamics of activity patterns in developing networks of neuronal cultures

Living neuronal networks in dissociated neuronal cultures are widely known for their ability to generate highly robust spatiotemporal activity patterns in various experimental conditions. These include neuronal avalanches satisfying the power scaling law and thereby exemplifying self-organized criticality in living systems. A crucial question is how these patterns can be explained and modeled in a way that is biologically meaningful, mathematically tractable and yet broad enough to account for neuronal heterogeneity and complexity. Here we propose a simple model which may offer an answer to this question. Our derivations are based on just few phenomenological observations concerning input-output behavior of an isolated neuron. A distinctive feature of the model is that at the simplest level of description it comprises of only two variables, a network activity variable and an exogenous variable corresponding to energy needed to sustain the activity and modulate the efficacy of signal transmission. Strikingly, this simple model is already capable of explaining emergence of network spikes and bursts in developing neuronal cultures. The model behavior and predictions are supported by empirical observations and published experimental evidence on cultured neurons behavior exposed to oxygen and energy deprivation. At the larger, network scale, introduction of the energy-dependent regulatory mechanism enables the network to balance on the edge of the network percolation transition. Network activity in this state shows population bursts satisfying the scaling avalanche conditions. This network state is self-sustainable and represents a balance between global network-wide processes and spontaneous activity of individual elements.

0 citations0 reviewsNo code linkedOpen access
preprint2018arXiv

The unreasonable effectiveness of small neural ensembles in high-dimensional brain

Despite the widely-spread consensus on the brain complexity, sprouts of the single neuron revolution emerged in neuroscience in the 1970s. They brought many unexpected discoveries, including grandmother or concept cells and sparse coding of information in the brain. In machine learning for a long time, the famous curse of dimensionality seemed to be an unsolvable problem. Nevertheless, the idea of the blessing of dimensionality becomes gradually more and more popular. Ensembles of non-interacting or weakly interacting simple units prove to be an effective tool for solving essentially multidimensional problems. This approach is especially useful for one-shot (non-iterative) correction of errors in large legacy artificial intelligence systems. These simplicity revolutions in the era of complexity have deep fundamental reasons grounded in geometry of multidimensional data spaces. To explore and understand these reasons we revisit the background ideas of statistical physics. In the course of the 20th century they were developed into the concentration of measure theory. New stochastic separation theorems reveal the fine structure of the data clouds. We review and analyse biological, physical, and mathematical problems at the core of the fundamental question: how can high-dimensional brain organise reliable and fast learning in high-dimensional world of data by simple tools? Two critical applications are reviewed to exemplify the approach: one-shot correction of errors in intellectual systems and emergence of static and associative memories in ensembles of single neurons.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Evolution of adaptation mechanisms: adaptation energy, stress, and oscillating death

In 1938, H. Selye proposed the notion of adaptation energy and published "Experimental evidence supporting the conception of adaptation energy". Adaptation of an animal to different factors appears as the spending of one resource. Adaptation energy is a hypothetical extensive quantity spent for adaptation. This term causes much debate when one takes it literally, as a physical quantity, i.e. a sort of energy. The controversial points of view impede the systematic use of the notion of adaptation energy despite experimental evidence. Nevertheless, the response to many harmful factors often has general non-specific form and we suggest that the mechanisms of physiological adaptation admit a very general and nonspecific description. We aim to demonstrate that Selye's adaptation energy is the cornerstone of the top-down approach to modelling of non-specific adaptation processes. We analyse Selye's axioms of adaptation energy together with Goldstone's modifications and propose a series of models for interpretation of these axioms. {\em Adaptation energy is considered as an internal coordinate on the `dominant path' in the model of adaptation}. The phenomena of `oscillating death' and `oscillating remission' are predicted on the base of the dynamical models of adaptation. Natural selection plays a key role in the evolution of mechanisms of physiological adaptation. We use the fitness optimization approach to study of the distribution of resources for neutralization of harmful factors, during adaptation to a multifactor environment, and analyse the optimal strategies for different systems of factors.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Fast Sampling of Evolving Systems with Periodic Trajectories

We propose a novel method for fast and scalable evaluation of periodic solutions of systems of ordinary differential equations for a given set of parameter values and initial conditions. The equations governing the system dynamics are supposed to be of a special class, albeit admitting nonlinear parametrization and state nonlinearities. The method enables to represent a given periodic solution as sums of computable integrals and functions that are explicitly dependent on parameters of interest and initial conditions. This allows invoking parallel computational streams in order to increase speed of calculations. Performance and practical implications of the method are illustrated with examples including classical predator-prey system and models of neuronal cells.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Generalized Mass Action Law and Thermodynamics of Nonlinear Markov Processes

The nonlinear Markov processes are the measure-valued dynamical systems which preserve positivity. They can be represented as the law of large numbers limits of general Markov models of interacting particles. In physics, the kinetic equations allow Lyapunov functionals (entropy, free energy, etc.). This may be considered as a sort of inheritance of the Lyapunov functionals from the microscopic master equations. We study nonlinear Markov processes that inherit thermodynamic properties from the microscopic linear Markov processes. We develop the thermodynamics of nonlinear Markov processes and analyze the asymptotic assumption, which are sufficient for this inheritance.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Computational diagnosis and risk evaluation for canine lymphoma

The canine lymphoma blood test detects the levels of two biomarkers, the acute phase proteins (C-Reactive Protein and Haptoglobin). This test can be used for diagnostics, for screening, and for remission monitoring as well. We analyze clinical data, test various machine learning methods and select the best approach to these problems. Three family of methods, decision trees, kNN (including advanced and adaptive kNN) and probability density evaluation with radial basis functions, are used for classification and risk estimation. Several pre-processing approaches were implemented and compared. The best of them are used to create the diagnostic system. For the differential diagnosis the best solution gives the sensitivity and specificity of 83.5% and 77%, respectively (using three input features, CRP, Haptoglobin and standard clinical symptom). For the screening task, the decision tree method provides the best result, with sensitivity and specificity of 81.4% and >99%, respectively (using the same input features). If the clinical symptoms (Lymphadenopathy) are considered as unknown then a decision tree with CRP and Hapt only provides sensitivity 69% and specificity 83.5%. The lymphoma risk evaluation problem is formulated and solved. The best models are selected as the system for computational lymphoma diagnosis and evaluation the risk of lymphoma as well. These methods are implemented into a special web-accessed software and are applied to problem of monitoring dogs with lymphoma after treatment. It detects recurrence of lymphoma up to two months prior to the appearance of clinical signs. The risk map visualisation provides a friendly tool for explanatory data analysis.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Detailed balance in micro- and macrokinetics and micro-distinguishability of macro-processes

We develop a general framework for the discussion of detailed balance and analyse its microscopic background. We find that there should be two additions to the well-known $T$- or $PT$-invariance of the microscopic laws of motion: 1. Equilibrium should not spontaneously break the relevant $T$- or $PT$-symmetry. 2. The macroscopic processes should be microscopically distinguishable to guarantee persistence of detailed balance in the model reduction from micro- to macrokinetics. We briefly discuss examples of the violation of these rules and the corresponding violation of detailed balance.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Further Results on Lyapunov-Like Conditions of Forward Invariance and Boundedness for a Class of Unstable Systems

We provide several characterizations of convergence to unstable equilibria in nonlinear systems. Our current contribution is three-fold. First we present simple algebraic conditions for establishing local convergence of non-trivial solutions of nonlinear systems to unstable equilibria. The conditions are based on the earlier work (A.N. Gorban, I.Yu. Tyukin, E. Steur, and H. Nijmeijer, SIAM Journal on Control and Optimization, Vol. 51, No. 3, 2013) and can be viewed as an extension of the Lyapunov's first method in that they apply to systems in which the corresponding Jacobian has one zero eigenvalue. Second, we show that for a relevant subclass of systems, persistency of excitation of a function of time in the right-hand side of the equations governing dynamics of the system ensure existence of an attractor basin such that solutions passing through this basin in forward time converge to the origin exponentially. Finally we demonstrate that conditions developed in (A.N. Gorban, I.Yu. Tyukin, E. Steur, and H. Nijmeijer, SIAM Journal on Control and Optimization, Vol. 51, No. 3, 2013) may be remarkably tight.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Nonlinear Quality of Life Index

We present details of the analysis of the nonlinear quality of life index for 171 countries. This index is based on four indicators: GDP per capita by Purchasing Power Parities, Life expectancy at birth, Infant mortality rate, and Tuberculosis incidence. We analyze the structure of the data in order to find the optimal and independent on expert's opinion way to map several numerical indicators from a multidimensional space onto the one-dimensional space of the quality of life. In the 4D space we found a principal curve that goes "through the middle" of the dataset and project the data points on this curve. The order along this principal curve gives us the ranking of countries. Projection onto the principal curve provides a solution to the classical problem of unsupervised ranking of objects. It allows us to find the independent on expert's opinion way to project several numerical indicators from a multidimensional space onto the one-dimensional space of the index values. This projection is, in some sense, optimal and preserves as much information as possible. For computation we used ViDaExpert, a tool for visualization and analysis of multidimensional vectorial data (arXiv:1406.5550).

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

The Michaelis-Menten-Stueckelberg Theorem

We study chemical reactions with complex mechanisms under two assumptions: (i) intermediates are present in small amounts (this is the quasi-steady-state hypothesis or QSS) and (ii) they are in equilibrium relations with substrates (this is the quasiequilibrium hypothesis or QE). Under these assumptions, we prove the generalized mass action law together with the basic relations between kinetic factors, which are sufficient for the positivity of the entropy production but hold even without microreversibility, when the detailed balance is not applicable. Even though QE and QSS produce useful approximations by themselves, only the combination of these assumptions can render the possibility beyond the "rarefied gas" limit or the "molecular chaos" hypotheses. We do not use any a priori form of the kinetic law for the chemical reactions and describe their equilibria by thermodynamic relations. The transformations of the intermediate compounds can be described by the Markov kinetics because of their low density ({\em low density of elementary events}). This combination of assumptions was introduced by Michaelis and Menten in 1913. In 1952, Stueckelberg used the same assumptions for the gas kinetics and produced the remarkable semi-detailed balance relations between collision rates in the Boltzmann equation that are weaker than the detailed balance conditions but are still sufficient for the Boltzmann $H$-theorem to be valid. Our results are obtained within the Michaelis-Menten-Stueckelbeg conceptual framework.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Entropy: The Markov Ordering Approach

The focus of this article is on entropy and Markov processes. We study the properties of functionals which are invariant with respect to monotonic transformations and analyze two invariant "additivity" properties: (i) existence of a monotonic transformation which makes the functional additive with respect to the joining of independent systems and (ii) existence of a monotonic transformation which makes the functional additive with respect to the partitioning of the space of states. All Lyapunov functionals for Markov chains which have properties (i) and (ii) are derived. We describe the most general ordering of the distribution space, with respect to which all continuous-time Markov processes are monotonic (the {\em Markov order}). The solution differs significantly from the ordering given by the inequality of entropy growth. For inference, this approach results in a convex compact set of conditionally "most random" distributions.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Explicit Reduced-Order Integral Formulations of State and Parameter Estimation Problems for a Class of Nonlinear Systems

We propose a technique for reformulation of state and parameter estimation problems as that of matching explicitly computable definite integrals with known kernels to data. The technique applies for a class of systems of nonlinear ordinary differential equations and is aimed to exploit parallel computational streams in order to increase speed of calculations. The idea is based on the classical adaptive observers design. It has been shown that in case the data is periodic it may be possible to reduce dimensionality of the inference problem to that of the dimension of the vector of parameters entering the right-hand side of the model nonlinearly. Performance and practical implications of the method are illustrated on a benchmark model governing dynamics of voltage in generated in barnacle giant muscle.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Extremal property of a simple cycle

We study systems with finite number of states $A_i$ ($i=1,..., n$), which obey the first order kinetics (master equation) without detailed balance. For any nonzero complex eigenvalue $λ$ we prove the inequality $\frac{|\Im λ|}{|\Re λ|} \leq \cot\fracπ{n}$. This bound is sharp and it becomes an equality for an eigenvalue of a simple irreversible cycle $A_1 \to A_2 \to... \to A_n \to A_1$ with equal rate constants of all transitions. Therefore, the simple cycle with the equal rate constants has the slowest decay of the oscillations among all first order kinetic systems with the same number of states.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Geometrical complexity of data approximators

There are many methods developed to approximate a cloud of vectors embedded in high-dimensional space by simpler objects: starting from principal points and linear manifolds to self-organizing maps, neural gas, elastic maps, various types of principal curves and principal trees, and so on. For each type of approximators the measure of the approximator complexity was developed too. These measures are necessary to find the balance between accuracy and complexity and to define the optimal approximations of a given type. We propose a measure of complexity (geometrical complexity) which is applicable to approximators of several types and which allows comparing data approximations of different types.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Grasping Complexity

The century of complexity has come. The face of science has changed. Surprisingly, when we start asking about the essence of these changes and then critically analyse the answers, the result are mostly discouraging. Most of the answers are related to the properties that have been in the focus of scientific research already for more than a century (like non-linearity). This paper is Preface to the special issue "Grasping Complexity" of the journal "Computers and Mathematics with Applications". We analyse the change of era in science, its reasons and main changes in scientific activity and give a brief review of the papers in the issue.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Hilbert's 6th Problem: Exact and Approximate Hydrodynamic Manifolds for Kinetic Equations

The problem of the derivation of hydrodynamics from the Boltzmann equation and related dissipative systems is formulated as the problem of slow invariant manifold in the space of distributions. We review a few instances where such hydrodynamic manifolds were found analytically both as the result of summation of the Chapman--Enskog asymptotic expansion and by the direct solution of the invariance equation. These model cases, comprising Grad's moment systems, both linear and nonlinear, are studied in depth in order to gain understanding of what can be expected for the Boltzmann equation. Particularly, the dispersive dominance and saturation of dissipation rate of the exact hydrodynamics in the short-wave limit and the viscosity modification at high divergence of the flow velocity are indicated as severe obstacles to the resolution of Hilbert's 6th Problem. Furthermore, we review the derivation of the approximate hydrodynamic manifold for the Boltzmann equation using Newton's iteration and avoiding smallness parameters, and compare this to the exact solutions. Additionally, we discuss the problem of projection of the Boltzmann equation onto the approximate hydrodynamic invariant manifold using entropy concepts. Finally, a set of hypotheses is put forward where we describe open questions and set a horizon for what can be derived exactly or proven about the hydrodynamic manifolds for the Boltzmann equation in the future.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Is it possible to predict long-term success with k-NN? Case Study of four market indices (FTSE100, DAX, HANGSENG, NASDAQ)

This case study tests the possibility of prediction for "success" (or "winner") components of four stock & shares market indices in a time period of three years from 02-Jul-2009 to 29-Jun-2012.We compare their performance ain two time frames: initial frame three months at the beginning (02/06/2009-30/09/2009) and the final three month frame (02/04/2012-29/06/2012). To label the components, average price ratio between two time frames in descending order is computed. The average price ratio is defined as the ratio between the mean prices of the beginning and final time period. The "winner" components are referred to the top one third of total components in the same order as average price ratio it means the mean price of final time period is relatively higher than the beginning time period. The "loser" components are referred to the last one third of total components in the same order as they have higher mean prices of beginning time period. We analyse, is there any information about the winner-looser separation in the initial fragments of the daily closing prices log-returns time series. The Leave-One-Out Cross-Validation with k-NN algorithm is applied on the daily log-return of components using a distance and proximity in the experiment. By looking at the error analysis, it shows that for HANGSENG and DAX index, there are clear signs of possibility to evaluate the probability of long-term success. The correlation distance matrix histograms and 2-D/3-D elastic maps generated from ViDaExpert show that the winner components are closer to each other and winner/loser components are separable on elastic maps for HANGSENG and DAX index while for the negative possibility indices, there is no sign of separation.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Maxallent: Maximizers of all Entropies and Uncertainty of Uncertainty

The entropy maximum approach (Maxent) was developed as a minimization of the subjective uncertainty measured by the Boltzmann--Gibbs--Shannon entropy. Many new entropies have been invented in the second half of the 20th century. Now there exists a rich choice of entropies for fitting needs. This diversity of entropies gave rise to a Maxent "anarchism". Maxent approach is now the conditional maximization of an appropriate entropy for the evaluation of the probability distribution when our information is partial and incomplete. The rich choice of non-classical entropies causes a new problem: which entropy is better for a given class of applications? We understand entropy as a measure of uncertainty which increases in Markov processes. In this work, we describe the most general ordering of the distribution space, with respect to which all continuous-time Markov processes are monotonic (the Markov order). For inference, this approach results in a set of conditionally "most random" distributions. Each distribution from this set is a maximizer of its own entropy. This "uncertainty of uncertainty" is unavoidable in analysis of non-equilibrium systems. Surprisingly, the constructive description of this set of maximizers is possible. Two decomposition theorems for Markov processes provide a tool for this description.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Multiscale principal component analysis

Principal component analysis (PCA) is an important tool in exploring data. The conventional approach to PCA leads to a solution which favours the structures with large variances. This is sensitive to outliers and could obfuscate interesting underlying structures. One of the equivalent definitions of PCA is that it seeks the subspaces that maximize the sum of squared pairwise distances between data projections. This definition opens up more flexibility in the analysis of principal components which is useful in enhancing PCA. In this paper we introduce scales into PCA by maximizing only the sum of pairwise distances between projections for pairs of datapoints with distances within a chosen interval of values [l,u]. The resulting principal component decompositions in Multiscale PCA depend on point (l,u) on the plane and for each point we define projectors onto principal components. Cluster analysis of these projectors reveals the structures in the data at various scales. Each structure is described by the eigenvectors at the medoid point of the cluster which represent the structure. We also use the distortion of projections as a criterion for choosing an appropriate scale especially for data with outliers. This method was tested on both artificial distribution of data and real data. For data with multiscale structures, the method was able to reveal the different structures of the data and also to reduce the effect of outliers in the principal component analysis.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Add-ons for Lattice Boltzmann Methods: Regularization, Filtering and Limiters

We describe how regularization of lattice Boltzmann methods can be achieved by modifying dissipation. Classes of techniques used to try to improve regularization of LBMs include flux limiters, enforcing the exact correct production of entropy and manipulating non-hydrodynamic modes of the system in relaxation. Each of these techniques corresponds to an additional modification of dissipation compared with the standard LBGK model. Using some standard 1D and 2D benchmarks including the shock tube and lid driven cavity, we explore the effectiveness of these classes of methods.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Local Equivalence of Reversible and General Markov Kinetics

We consider continuous--time Markov kinetics with a finite number of states and a given positive equilibrium distribution P*. For an arbitrary probability distribution $P$ we study the possible right hand sides, dP/dt, of the Kolmogorov (master) equations. We describe the cone of possible values of the velocity, dP/dt, as a function of P and P*. We prove that, surprisingly, these cones coincide for the class of all Markov processes with equilibrium P* and for the reversible Markov processes with detailed balance at this equilibrium. Therefore, for an arbitrary probability distribution $P$ and a general system there exists a system with detailed balance and the same equilibrium that has the same velocity dP/dt at point P. The set of Lyapunov functions for the reversible Markov processes coincides with the set of Lyapunov functions for general Markov kinetics. The results are extended to nonlinear systems with the generalized mass action law.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Mathematical modeling of microRNA-mediated mechanisms of translation repression

MicroRNAs can affect the protein translation using nine mechanistically different mechanisms, including repression of initiation and degradation of the transcript. There is a hot debate in the current literature about which mechanism and in which situations has a dominant role in living cells. The worst, same experimental systems dealing with the same pairs of mRNA and miRNA can provide ambiguous evidences about which is the actual mechanism of translation repression observed in the experiment. We start with reviewing the current knowledge of various mechanisms of miRNA action and suggest that mathematical modeling can help resolving some of the controversial interpretations. We describe three simple mathematical models of miRNA translation that can be used as tools in interpreting the experimental data on the dynamics of protein synthesis. The most complex model developed by us includes all known mechanisms of miRNA action. It allowed us to study possible dynamical patterns corresponding to different miRNA-mediated mechanisms of translation repression and to suggest concrete recipes on determining the dominant mechanism of miRNA action in the form of kinetic signatures. Using computational experiments and systematizing existing evidences from the literature, we justify a hypothesis about co-existence of distinct miRNA-mediated mechanisms of translation repression. The actually observed mechanism will be that acting on or changing the limiting "place" of the translation process. The limiting place can vary from one experimental setting to another. This model explains the majority of existing controversies reported.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Quasichemical Models of Multicomponent Nonlinear Diffusion

Diffusion preserves the positivity of concentrations, therefore, multicomponent diffusion should be nonlinear if there exist non-diagonal terms. The vast variety of nonlinear multicomponent diffusion equations should be ordered and special tools are needed to provide the systematic construction of the nonlinear diffusion equations for multicomponent mixtures with significant interaction between components. We develop an approach to nonlinear multicomponent diffusion based on the idea of the reaction mechanism borrowed from chemical kinetics. Chemical kinetics gave rise to very seminal tools for the modeling of processes. This is the stoichiometric algebra supplemented by the simple kinetic law. The results of this invention are now applied in many areas of science, from particle physics to sociology. In our work we extend the area of applications onto nonlinear multicomponent diffusion. We demonstrate, how the mechanism based approach to multicomponent diffusion can be included into the general thermodynamic framework, and prove the corresponding dissipation inequalities. To satisfy thermodynamic restrictions, the kinetic law of an elementary process cannot have an arbitrary form. For the general kinetic law (the generalized Mass Action Law), additional conditions are proved. The cell--jump formalism gives an intuitively clear representation of the elementary transport processes and, at the same time, produces kinetic finite elements, a tool for numerical simulation.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Simultaneously Dissipative Operators And The Infinitesimal Moore Effect In Interval Spaces

One of shortcomings of stepwise interval methods is the following. The intervals determining the solution of a system are often expanded in the course of time irrespective of the method and step used (the {\em Moore effect}). We introduce the notion of general {\em interval spaces} and study the infinitesimal Moore effect (IME) in these spaces. We obtain the local conditions of absence of the IME in terms of Jacobi matrices field. The relation between the absence of IME and simultaneous dissipativity of the Jacobi matrices is established. We study simultaneously dissipative operators in $\Bbb{R}^n$. A linear operator $A$ is {\em dissipative} with respect to a norm $\|...\|$ if $\| \exp (At) \| \leq 1$ at all $t \geq 0$. For each norm, the dissipative operator form a closed convex cone. An operator $A$ is {\em stable dissipative} if it belongs to the interior of this cone. The family of linear operators $\{A_α\}$ is called {\em simultaneously dissipative}, if there exists a norm with respect to which all the operators are dissipative. We studied general properties of such families. For example, let the family $\{A_α\}$ be finite and generate a nilpotent Lee algebra and let for each $A_α$ there exist a norm with respect to which it is dissipative. Then $\{A_α\}$ is simultaneously dissipative. Let the family $\{A_α\}$ be compact and generate solvable Lee algebra, and let the spectrum of each operator $A_α$ lie in the open left half-plane. Then $\{A_α\}$ is simultaneously stable dissipative, i.e. there exists a norm with respect to which all $A_α$ are stable dissipative. We study the conditions of simultaneous dissipativity of the matrices of rank one and discussed their application to equations of {\em mass action law} kinetics.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Thermodynamic Tree: The Space of Admissible Paths

Is a spontaneous transition from a state x to a state y allowed by thermodynamics? Such a question arises often in chemical thermodynamics and kinetics. We ask the more formal question: is there a continuous path between these states, along which the conservation laws hold, the concentrations remain non-negative and the relevant thermodynamic potential G (Gibbs energy, for example) monotonically decreases? The obvious necessary condition, G(x)\geq G(y), is not sufficient, and we construct the necessary and sufficient conditions. For example, it is impossible to overstep the equilibrium in 1-dimensional (1D) systems (with n components and n-1 conservation laws). The system cannot come from a state x to a state y if they are on the opposite sides of the equilibrium even if G(x) > G(y). We find the general multidimensional analogue of this 1D rule and constructively solve the problem of the thermodynamically admissible transitions. We study dynamical systems, which are given in a positively invariant convex polyhedron D and have a convex Lyapunov function G. An admissible path is a continuous curve along which $G$ does not increase. For x,y from D, x\geq y (x precedes y) if there exists an admissible path from x to y and x \sim y if x\geq y and y\geq x. The tree of G in D is a quotient space D/~. We provide an algorithm for the construction of this tree. In this algorithm, the restriction of G onto the 1-skeleton of $D$ (the union of edges) is used. The problem of existence of admissible paths between states is solved constructively. The regions attainable by the admissible paths are described.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Thermodynamics in the Limit of Irreversible Reactions

For many real physico-chemical complex systems detailed mechanism includes both reversible and irreversible reactions. Such systems are typical in homogeneous combustion and heterogeneous catalytic oxidation. Most complex enzyme reactions include irreversible steps. The classical thermodynamics has no limit for irreversible reactions whereas the kinetic equations may have such a limit. We represent the systems with irreversible reactions as the limits of the fully reversible systems when some of the equilibrium concentrations tend to zero. The structure of the limit reaction system crucially depends on the relative rates of this tendency to zero. We study the dynamics of the limit system and describe its limit behavior as $t \to \infty$. If the reversible systems obey the principle of detailed balance then the limit system with some irreversible reactions must satisfy the {\em extended principle of detailed balance}. It is formulated and proven in the form of two conditions: (i) the reversible part satisfies the principle of detailed balance and (ii) the convex hull of the stoichiometric vectors of the irreversible reactions does not intersect the linear span of the stoichiometric vectors of the reversible reactions. These conditions imply the existence of the global Lyapunov functionals and alow an algebraic description of the limit behavior. The thermodynamic theory of the irreversible limit of reversible reactions is illustrated by the analysis of hydrogen combustion.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

A Statistical Model of Aggregates Fragmentation

A statistical model of fragmentation of aggregates is proposed, based on the stochastic propagation of cracks through the body. The propagation rules are formulated on a lattice and mimic two important features of the process -- a crack moves against the stress gradient and its energy depletes as it grows. We perform numerical simulations of the model for two-dimensional lattice and reveal that the mass distribution for small and intermediate-size fragments obeys a power-law, F(m)\propto m^(-3/2), in agreement with experimental observations. We develop an analytical theory which explains the detected power-law and demonstrate that the overall fragment mass distribution in our model agrees qualitatively with that, observed in experiments.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

Elastic principal manifolds and their practical applications

Principal manifolds serve as useful tool for many practical applications. These manifolds are defined as lines or surfaces passing through "the middle" of data distribution. We propose an algorithm for fast construction of grid approximations of principal manifolds with given topology. It is based on analogy of principal manifold and elastic membrane. The first advantage of this method is a form of the functional to be minimized which becomes quadratic at the step of the vertices position refinement. This makes the algorithm very effective, especially for parallel implementations. Another advantage is that the same algorithmic kernel is applied to construct principal manifolds of different dimensions and topologies. We demonstrate how flexibility of the approach allows numerous adaptive strategies like principal graph constructing, etc. The algorithm is implemented as a C++ package elmap and as a part of stand-alone data visualization tool VidaExpert, available on the web. We describe the approach and provide several examples of its application with speed performance characteristics.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

Extended Detailed Balance for Systems with Irreversible Reactions

The principle of detailed balance states that in equilibrium each elementary process is equilibrated by its reverse process. For many real physico-chemical complex systems (e.g. homogeneous combustion, heterogeneous catalytic oxidation, most enzyme reactions etc), detailed mechanisms include both reversible and irreversible reactions. In this case, the principle of detailed balance cannot be applied directly. We represent irreversible reactions as limits of reversible steps and obtain the principle of detailed balance for complex mechanisms with some irreversible elementary processes. We proved two consequences of the detailed balance for these mechanisms: the structural condition and the algebraic condition that form together the extended form of detailed balance. The algebraic condition is the principle of detailed balance for the reversible part. The structural condition is: the convex hull of the stoichiometric vectors of the irreversible reactions has empty intersection with the linear span of the stoichiometric vectors of the reversible reaction. Physically, this means that the irreversible reactions cannot be included in oriented pathways. The systems with the extended form of detailed balance are also the limits of the reversible systems with detailed balance when some of the equilibrium concentrations (or activities) tend to zero. Surprisingly, the structure of the limit reaction mechanism crucially depends on the relative speeds of this tendency to zero.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

Kinetic Path Summation, Multi--Sheeted Extension of Master Equation, and Evaluation of Ergodicity Coefficient

We study the Master equation with time--dependent coefficients, a linear kinetic equation for the Markov chains or for the monomolecular chemical kinetics. For the solution of this equation a path summation formula is proved. This formula represents the solution as a sum of solutions for simple kinetic schemes (kinetic paths), which are available in explicit analytical form. The relaxation rate is studied and a family of estimates for the relaxation time and the ergodicity coefficient is developed. To calculate the estimates we introduce the multi--sheeted extensions of the initial kinetics. This approach allows us to exploit the internal ("micro")structure of the extended kinetics without perturbation of the base kinetics.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

Possibility and Impossibility of the Entropy Balance in Lattice Boltzmann Collisions

We demonstrate that in the space of distributions operated on by lattice Boltzmann methods that there exists a vicinity of the equilibrium where collisions with entropy balance are possible and, at the same time, there exist an area of nonequilibrium distributions where such collisions are impossible. We calculate and graphically represent these areas for some simple entropic equilibria using single relaxation time models. Therefore it is shown that the definition of an entropic LBM is incomplete without a strategy to deal with certain highly nonequilibrium states. Such strategies should be explicitly stated as they may result in the production of additional entropy.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

Principal Graphs and Manifolds

In many physical, statistical, biological and other investigations it is desirable to approximate a system of points by objects of lower dimension and/or complexity. For this purpose, Karl Pearson invented principal component analysis in 1901 and found 'lines and planes of closest fit to system of points'. The famous k-means algorithm solves the approximation problem too, but by finite sets instead of lines and planes. This chapter gives a brief practical introduction into the methods of construction of general principal objects, i.e. objects embedded in the 'middle' of the multidimensional data set. As a basis, the unifying framework of mean squared distance approximation of finite datasets is selected. Principal graphs and manifolds are constructed as generalisations of principal components and k-means principal points. For this purpose, the family of expectation/maximisation algorithms with nearest generalisations is presented. Construction of principal graphs with controlled complexity is based on the graph grammar approach.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

Reciprocal Relations Between Kinetic Curves

We study coupled irreversible processes. For linear or linearized kinetics with microreversibility, $\dot{x}=Kx$, the kinetic operator $K$ is symmetric in the entropic inner product. This form of Onsager's reciprocal relations implies that the shift in time, $\exp (Kt)$, is also a symmetric operator. This generates the reciprocity relations between the kinetic curves. For example, for the Master equation, if we start the process from the $i$th pure state and measure the probability $p_j(t)$ of the $j$th state ($j\neq i$), and, similarly, measure $p_i(t)$ for the process, which starts at the $j$th pure state, then the ratio of these two probabilities $p_j(t)/p_i(t)$ is constant in time and coincides with the ratio of the equilibrium probabilities. We study similar and more general reciprocal relations between the kinetic curves. The experimental evidence provided as an example is from the reversible water gas shift reaction over iron oxide catalyst. The experimental data are obtained using Temporal Analysis of Products (TAP) pulse-response studies. These offer excellent confirmation within the experimental error.

0 citations0 reviewsNo code linkedOpen access
preprint2010arXiv

Asymptotology of Chemical Reaction Networks

The concept of the limiting step is extended to the asymptotology of multiscale reaction networks. Complete theory for linear networks with well separated reaction rate constants is developed. We present algorithms for explicit approximations of eigenvalues and eigenvectors of kinetic matrix. Accuracy of estimates is proven. Performance of the algorithms is demonstrated on simple examples. Application of algorithms to nonlinear systems is discussed.

0 citations0 reviewsNo code linkedOpen access
preprint2010arXiv

Correlations, Risk and Crisis: From Physiology to Finance

We study the dynamics of correlation and variance in systems under the load of environmental factors. A universal effect in ensembles of similar systems under the load of similar factors is described: in crisis, typically, even before obvious symptoms of crisis appear, correlation increases, and, at the same time, variance (and volatility) increases too. This effect is supported by many experiments and observations of groups of humans, mice, trees, grassy plants, and on financial time series. A general approach to the explanation of the effect through dynamics of individual adaptation of similar non-interactive individuals to a similar system of external factors is developed. Qualitatively, this approach follows Selye's idea about adaptation energy.

0 citations0 reviewsNo code linkedOpen access
preprint2010arXiv

Principal manifolds and graphs in practice: from molecular biology to dynamical systems

We present several applications of non-linear data modeling, using principal manifolds and principal graphs constructed using the metaphor of elasticity (elastic principal graph approach). These approaches are generalizations of the Kohonen's self-organizing maps, a class of artificial neural networks. On several examples we show advantages of using non-linear objects for data approximation in comparison to the linear ones. We propose four numerical criteria for comparing linear and non-linear mappings of datasets into the spaces of lower dimension. The examples are taken from comparative political science, from analysis of high-throughput data in molecular biology, from analysis of dynamical systems.

0 citations0 reviewsNo code linkedOpen access
preprint2007arXiv

Dynamical robustness of biological networks with hierarchical distribution of time scales

We propose the concepts of distributed robustness and r-robustness, well adapted to functional genetics. Then we discuss the robustness of the relaxation time using a chemical reaction description of genetic and signalling networks. First, we obtain the following result for linear networks: for large multiscale systems with hierarchical distribution of time scales the variance of the inverse relaxation time (as well as the variance of the stationary rate) is much lower than the variance of the separate constants. Moreover, it can tend to 0 faster than 1/n, where n is the number of reactions. We argue that similar phenomena are valid in the nonlinear case as well. As a numerical illustration we use a model of signalling network that can be applied to important transcription factors such as NFkB.

0 citations0 reviewsNo code linkedOpen access
preprint2007arXiv

Stable simulation of fluid flow with high-Reynolds number using Ehrenfests' steps

The Navier--Stokes equations arise naturally as a result of Ehrenfests' coarse-graining in phase space after a period of free-flight dynamics. This point of view allows for a very flexible approach to the simulation of fluid flow for high-Reynolds number. We construct regularisers for lattice Boltzmann computational models. These regularisers are based on Ehrenfests' coarse-graining idea and could be applied to schemes with either entropic or non-entropic quasiequilibria. We give a numerical scheme which gives good results for the standard test cases of the shock tube and the flow past a square cylinder.

0 citations0 reviewsNo code linkedOpen access
preprint2005arXiv

Quasi-Equilibrium Closure Hierarchies for The Boltzmann Equation

In this paper, explicit method of constructing approximations (the Triangle Entropy Method) is developed for nonequilibrium problems. This method enables one to treat any complicated nonlinear functionals that fit best the physics of a problem (such as, for example, rates of processes) as new independent variables. The work of the method was demonstrated on the Boltzmann's--type kinetics. New macroscopic variables are introduced (moments of the Boltzmann collision integral, or scattering rates). They are treated as independent variables rather than as infinite moment series. This approach gives the complete account of rates of scattering processes. Transport equations for scattering rates are obtained (the second hydrodynamic chain), similar to the usual moment chain (the first hydrodynamic chain). Various examples of the closure of the first, of the second, and of the mixed hydrodynamic chains are considered for the hard spheres model. It is shown, in particular, that the complete account of scattering processes leads to a renormalization of transport coefficients. The method gives the explicit solution for the closure problem, provides thermodynamic properties of reduced models, and can be applied to any kinetic equation with a thermodynamic Lyapunov function.

0 citations0 reviewsNo code linkedOpen access
preprint2004arXiv

Back-propagation of accuracy

In this paper we solve the problem: how to determine maximal allowable errors, possible for signals and parameters of each element of a network proceeding from the condition that the vector of output signals of the network should be calculated with given accuracy? "Back-propagation of accuracy" is developed to solve this problem. The calculation of allowable errors for each element of network by back-propagation of accuracy is surprisingly similar to a back-propagation of error, because it is the backward signals motion, but at the same time it is very different because the new rules of signals transformation in the passing back through the elements are different. The method allows us to formulate the requirements to the accuracy of calculations and to the realization of technical devices, if the requirements to the accuracy of output signals of the network are known.

0 citations0 reviewsNo code linkedOpen access
preprint2004arXiv

Four basic symmetry types in the universal 7-cluster structure of 143 complete bacterial genomic sequences

Coding information is the main source of heterogeneity (non-randomness) in the sequences of bacterial genomes. This information can be naturally modeled by analysing cluster structures in the "in-phase" triplet distributions of relatively short genomic fragments (200-400bp). We found a universal 7-cluster structure in bacterial genomic sequences and explained its properties. We show that codon usage of bacterial genomes is a multi-linear function of their genomic G+C-content with high accuracy. Based on the analysis of 143 completely sequenced bacterial genomes available in Genbank in August 2004, we show that there are four "pure" types of the 7-cluster structure observed. All 143 cluster animated 3D-scatters are collected in a database and is made available on our web-site: http://www.ihes.fr/~zinovyev/7clusters The finding can be readily introduced into any software for gene prediction, sequence alignment or bacterial genomes classification.

0 citations0 reviewsNo code linkedOpen access
preprint2003arXiv

Invariant grids for reaction kinetics

In this paper, we review the construction of low-dimensional manifolds of reduced description for equations of chemical kinetics from the standpoint of the method of invariant manifold (MIM). MIM is based on a formulation of the condition of invariance as an equation, and its solution by Newton iterations. A grid-based version of MIM is developed. Generalizations to open systems are suggested. The set of methods covered makes it possible to effectively reduce description in chemical kinetics. The most essential new element of this paper is the systematic consideration of a discrete analogue of the slow (stable) positively invariant manifolds for dissipative systems, {\it invariant grids}. We describe the Newton method and the relaxation method for the invariant grids construction. The problem of the grid correction is fully decomposed into the problems of the grid's nodes correction. The edges between the nodes appears only in the calculation of the tangent spaces. This fact determines high computational efficiency of the invariant grids method.

0 citations0 reviewsNo code linkedOpen access