BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

Rudolf Hanel

Rudolf Hanel appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
cond-mat.stat-mechphysics.soc-phmath-phmath.MPMolecular NetworksPopulations and Evolutionnlin.AOphysics.class-phApplicationsInformation Theorymath.ITphysics.data-anCell BehaviorComputation and Languagecond-mat.dis-nncond-mat.othermath.DSq-fin.GNQuantitative MethodsSocial and Information Networks

Catalog footprint

What is connected

29works
20topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

29 published item(s)

preprint2026arXiv

Gardner volumes and self-organization in a minimal model of complex ecosystems

We study self-organization in a minimally nonlinear model of large random ecosystems. Populations evolve over time according to a piecewise linear system of ordinary differential equations subject to a non-negativity constraint resulting in discrete time extinction and revival events. The dynamics are generated by a random elliptic community matrix with tunable correlation strength. We show that, independent of the correlation strength, solutions of the system are confined to subsets of the phase space that can be cast as time-varying Gardner volumes from the theory of learning in neural networks. These volumes decrease with the diversity (i.e. the fraction of extant species) and become exponentially small in the long-time limit. Using standard results from random matrix theory, the changing diversity is then linked to a sequence of contractions and expansions in the spectrum of the community matrix over time, resulting in a sequence of May-type stability problems determining whether the total population evolves toward complete extinction or unbounded growth. In the case of unbounded growth, we show the model allows for a particularly simple nonlinear extension in which the solutions instead evolve towards a new attractor.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Equivalence of information production and generalized entropies in complex processes

Complex systems that are characterized by strong correlations and fat-tailed distribution functions have been argued to be incompatible within the framework of Boltzmann-Gibbs entropy. As an alternative, so-called generalized entropies were proposed and intensively studied. Here we show that this incompatibility is a misconception. For a broad class of processes, Boltzmann entropy the log multiplicity remains the valid entropy concept, however, for non-i.i.d., non-multinomial, and non-ergodic processes, Boltzmann entropy is not of Shannon form. The correct form of Boltzmann entropy can be shown to be identical with generalized entropies. We derive this result for all processes that can be mapped reversibly to adjoint representations where processes are i.i.d.. In these representations the information production is given by the Shannon entropy. We proof that over the original sampling space this yields functionals that are identical to generalized entropies. The problem of constructing adequate context-sensitive entropy functionals therefore can be translated into the much simpler problem of finding adjoint representations. The method provides a comprehensive framework for a statistical physics of strongly correlated systems and complex processes.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

The typical set and entropy in stochastic systems with arbitrary phase space growth

The existence of the {\em typical set} is key for data compression strategies and for the emergence of robust statistical observables in macroscopic physical systems. Standard approaches derive its existence from a restricted set of dynamical constraints. However, given the enormous consequences for the understanding of the system's dynamics, and its role underlying the presence of stable, almost deterministic statistical patterns, a question arises whether typical sets exist in much more general scenarios. We demonstrate here that the typical set can be defined and characterized from general forms of entropy for a much wider class of stochastic processes than it was previously thought. This includes processes showing arbitrary path dependence, long range correlations or dynamic sampling spaces; suggesting that typicality is a generic property of stochastic processes, regardless of their complexity. Our results impact directly in the understanding of the stability of complex systems, open the door to new data compression strategies and points to the existence of statistical mechanics-like approaches to systems arbitrarily away from equilibrium with dynamic phase spaces. We argue that the potential emergence of robust properties in complex stochastic systems provided by the existence of typical sets has special relevance to biological systems.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Thermodynamics of structure-forming systems

Structure-forming systems are ubiquitous in nature, ranging from atoms building molecules to self-assembly of colloidal amphibolic particles. The understanding of the underlying thermodynamics of such systems remains an important problem. Here we derive the entropy for structure-forming systems that differs from Boltzmann-Gibbs entropy by a term that explicitly captures clustered states. For large systems and low concentrations, the approach is equivalent to the grand-canonical ensemble; for small systems, we find significant deviations. We derive the detailed fluctuation theorem and Crooks' work fluctuation theorem for structure-forming systems. The connection to the theory of particle self-assembly is discussed. We apply the results to several physical systems. We present the phase diagram for patchy particles described by the Kern-Frenkel potential. We show that the Curie-Weiss model with molecule structures exhibits a first-order phase transition.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Boosting test-efficiency by pooled testing strategies for SARS-CoV-2

In the current COVID19 crisis many national healthcare systems are confronted with an acute shortage of tests for confirming SARS-CoV-2 infections. For low overall infection levels in the population, pooling of samples can drastically amplify the testing efficiency. Here we present a formula to estimate the optimal pooling size, the efficiency gain (tested persons per test), and the expected upper bound of missed infections in the pooled testing, all as a function of the populationwide infection levels and the false negative/positive rates of the currently used PCR tests. Assuming an infection level of 0.1 % and a false negative rate of 2 %, the optimal pool size is about 32, the efficiency gain is about 15 tested persons per test. For an infection level of 1 % the optimal pool size is 11, the efficiency gain is 5.1 tested persons per test. For an infection level of 10 % the optimal pool size reduces to about 4, the efficiency gain is about 1.7 tested persons per test. For infection levels of 30 % and higher there is no more benefit from pooling. To see to what extent replicates of the pooled tests improve the estimate of the maximal number of missed infections, we present all results for 1, 3, and 5 replicates.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Information geometry of scaling expansions of non-exponentially growing configuration spaces

Many stochastic complex systems are characterized by the fact that their configuration space doesn't grow exponentially as a function of the degrees of freedom. The use of scaling expansions is a natural way to measure the asymptotic growth of the configuration space volume in terms of the scaling exponents of the system. These scaling exponents can, in turn, be used to define universality classes that uniquely determine the statistics of a system. Every system belongs to one of these classes. Here we derive the information geometry of scaling expansions of sample spaces. In particular, we present the deformed logarithms and the metric in a systematic and coherent way. We observe a phase transition for the curvature. The phase transition can be well measured by the characteristic length r, corresponding to a ball with radius 2r having the same curvature as the statistical manifold. Increasing characteristic length with respect to the size of the system is associated with sub-exponential sample space growth is associated with strongly constrained and correlated complex systems. Decreasing of the characteristic length corresponds to super-exponential sample space growth that occurs for example in systems that develop structure as they evolve. Constant curvature means exponential sample space growth that is associated with multinomial statistics, and traditional Boltzmann-Gibbs, or Shannon statistics applies. This allows us to characterize transitions between statistical manifolds corresponding to different families of probability distributions.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

The effect of social balance on social fragmentation

With the availability of cell phones, internet, social media etc. the interconnectedness of people within most societies has increased drastically over the past three decades. Across the same timespan, we are observing the phenomenon of increasing levels of fragmentation in society into relatively small and isolated groups that have been termed filter bubbles, or echo chambers. These pose a number of threats to open societies, in particular, a radicalisation in political, social or cultural issues, and a limited access to facts. In this paper we show that these two phenomena might be tightly related. We study a simple stochastic co-evolutionary model of a society of interacting people. People are not only able to update their opinions within their social context, but can also update their social links from collaborative to hostile, and vice versa. The latter is implemented such that social balance is realised. We find that there exists a critical level of interconnectedness, above which society fragments into small sub-communities that are positively linked within and hostile towards other groups. We argue that the existence of a critical communication density is a universal phenomenon in all societies that exhibit social balance. The necessity arises from the underlying mathematical structure of a phase transition phenomenon that is known from the theory of a kind of disordered magnets called spin glasses. We discuss the consequences of this phase transition for social fragmentation in society.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Why are most COVID-19 infection curves linear?

Many countries have passed their first COVID-19 epidemic peak. Traditional epidemiological models describe this as a result of non-pharmaceutical interventions that pushed the growth rate below the recovery rate. In this new phase of the pandemic many countries show an almost linear growth of confirmed cases for extended time-periods. This new containment regime is hard to explain by traditional models where infection numbers either grow explosively until herd immunity is reached, or the epidemic is completely suppressed (zero new cases). Here we offer an explanation of this puzzling observation based on the structure of contact networks. We show that for any given transmission rate there exists a critical number of social contacts, $D_c$, below which linear growth and low infection prevalence must occur. Above $D_c$ traditional epidemiological dynamics takes place, as e.g. in SIR-type models. When calibrating our corresponding model to empirical estimates of the transmission rate and the number of days being contagious, we find $D_c\sim 7.2$. Assuming realistic contact networks with a degree of about 5, and assuming that lockdown measures would reduce that to household-size (about 2.5), we reproduce actual infection curves with a remarkable precision, without fitting or fine-tuning of parameters. In particular we compare the US and Austria, as examples for one country that initially did not impose measures and one that responded with a severe lockdown early on. Our findings question the applicability of standard compartmental models to describe the COVID-19 containment phase. The probability to observe linear growth in these is practically zero.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Analytical computation of frequency distributions of path-dependent processes by means of a non-multinomial maximum entropy approach

Path-dependent stochastic processes are often non-ergodic and observables can no longer be computed within the ensemble picture. The resulting mathematical difficulties pose severe limits to the analytical understanding of path-dependent processes. Their statistics is typically non-multinomial in the sense that the multiplicities of the occurrence of states is not a multinomial factor. The maximum entropy principle is tightly related to multinomial processes, non-interacting systems, and to the ensemble picture; It loses its meaning for path-dependent processes. Here we show that an equivalent to the ensemble picture exists for path-dependent processes, such that the non-multinomial statistics of the underlying dynamical process, by construction, is captured correctly in a functional that plays the role of a relative entropy. We demonstrate this for self-reinforcing Pólya urn processes, which explicitly generalise multinomial statistics. We demonstrate the adequacy of this constructive approach towards non-multinomial pendants of entropy by computing frequency and rank distributions of Pólya urn processes. We show how microscopic update rules of a path-dependent process allow us to explicitly construct a non-multinomial entropy functional, that, when maximized, predicts the time-dependent distribution function.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Systemic stability, cell differentiation, and evolution - A dynamical systems perspective

Species or population that proliferate faster than others become dominant in numbers. Catalysis allows catalytic sets within a molecular reaction network to dominate the non catalytic parts of the network by processing most of the available substrate. As a consequence one may consider a 'catalytic fitness' of sets of molecular species. The fittest sets emerge as the expressed chemical backbone or sub-network of larger chemical reaction networks employed by organisms. However, catalytic fitness depends on the systemic context and the stability of systemic dynamics. Unstable reaction networks would easily be reshaped or destroyed by fluctuations of the chemical environment. In this paper we therefore focus on recognizing systemic stability as an evolutionary selection criterion. In fact, instabilities of regulatory systems dynamics become predictive for associated evolutionary forces driving the emergence large reaction networks that avoid or control inherent instabilities. Systemic instabilities can be identified and analyzed using relatively simple mathematical random networks models of complex regulatory systems. Using a statistical ensemble approach one can identify fundamental causes of instable dynamics, infer evolutionary preferred network properties, and predict evolutionary emergent control mechanisms and their entanglement with cell differentiation processes. Surprisingly, what systemic stability tells us here is that cells (or other non-linear regulatory systems) never had to learn how to differentiate, but rather how to avoid and control differentiation. For example, in this framework we can predict that regulatory systems will evolutionary favor networks where the number of catalytic enhancers is not larger than the number of suppressors.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Understanding scaling through history-dependent processes with collapsing sample space

History-dependent processes are ubiquitous in natural and social systems. Many such stochastic processes, especially those that are associated with complex systems, become more constrained as they unfold, meaning that their sample-space, or their set of possible outcomes, reduces as they age. We demonstrate that these sample-space reducing (SSR) processes necessarily lead to Zipf's law in the rank distributions of their outcomes. We show that by adding noise to SSR processes the corresponding rank distributions remain exact power-laws, $p(x)\sim x^{-λ}$, where the exponent directly corresponds to the mixing ratio of the SSR process and noise. This allows us to give a precise meaning to the scaling exponent in terms of the degree to how much a given process reduces its sample-space as it unfolds. Noisy SSR processes further allow us to explain a wide range of scaling exponents in frequency distributions ranging from $α= 2$ to $\infty$. We discuss several applications showing how SSR processes can be used to understand Zipf's law in word frequencies, and how they are related to diffusion processes in directed networks, or ageing processes such as in fragmentation processes. SSR processes provide a new alternative to understand the origin of scaling in complex systems without the recourse to multiplicative, preferential, or self-organised critical processes.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Understanding Zipf's law of word frequencies through sample-space collapse in sentence formation

The formation of sentences is a highly structured and history-dependent process. The probability of using a specific word in a sentence strongly depends on the 'history' of word-usage earlier in that sentence. We study a simple history-dependent model of text generation assuming that the sample-space of word usage reduces along sentence formation, on average. We first show that the model explains the approximate Zipf law found in word frequencies as a direct consequence of sample-space reduction. We then empirically quantify the amount of sample-space reduction in the sentences of ten famous English books, by analysis of corresponding word-transition tables that capture which words can follow any given word in a text. We find a highly nested structure in these transition tables and show that this `nestedness' is tightly related to the power law exponents of the observed word frequency distributions. With the proposed model it is possible to understand that the nestedness of a text can be the origin of the actual scaling exponent, and that deviations from the exact Zipf law can be understood by variations of the degree of nestedness on a book-by-book basis. On a theoretical level we are able to show that in case of weak nesting, Zipf's law breaks down in a fast transition. Unlike previous attempts to understand Zipf's law in language the sample-space reducing model is not based on assumptions of multiplicative, preferential, or self-organised critical mechanisms behind language formation, but simply used the empirically quantifiable parameter 'nestedness' to understand the statistics of word frequencies.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

How multiplicity determines entropy and the derivation of the maximum entropy principle for complex systems

The maximum entropy principle (MEP) is a method for obtaining the most likely distribution functions of observables from statistical systems, by maximizing entropy under constraints. The MEP has found hundreds of applications in ergodic and Markovian systems in statistical mechanics, information theory, and statistics. For several decades there exists an ongoing controversy whether the notion of the maximum entropy principle can be extended in a meaningful way to non-extensive, non-ergodic, and complex statistical systems and processes. In this paper we start by reviewing how Boltzmann-Gibbs-Shannon entropy is related to multiplicities of independent random processes. We then show how the relaxation of independence naturally leads to the most general entropies that are compatible with the first three Shannon-Khinchin axioms, the (c,d)-entropies. We demonstrate that the MEP is a perfectly consistent concept for non-ergodic and complex statistical systems if their relative entropy can be factored into a generalized multiplicity and a constraint term. The problem of finding such a factorization reduces to finding an appropriate representation of relative entropy in a linear basis. In a particular example we show that path-dependent random processes with memory naturally require specific generalized entropies. The example is the first exact derivation of a generalized entropy from the microscopic properties of a path-dependent random process.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Generalized (c,d)-entropy and aging random walks

Complex systems are often inherently non-ergodic and non-Markovian for which Shannon entropy loses its applicability. In particular accelerating, path-dependent, and aging random walks offer an intuitive picture for these non-ergodic and non-Markovian systems. It was shown that the entropy of non-ergodic systems can still be derived from three of the Shannon-Khinchin axioms, and by violating the fourth -- the so-called composition axiom. The corresponding entropy is of the form $S_{c,d} \sim \sum_i Γ(1+d,1-c\ln p_i)$ and depends on two system-specific scaling exponents, $c$ and $d$. This entropy contains many recently proposed entropy functionals as special cases, including Shannon and Tsallis entropy. It was shown that this entropy is relevant for a special class of non-Markovian random walks. In this work we generalize these walks to a much wider class of stochastic systems that can be characterized as `aging' systems. These are systems whose transition rates between states are path- and time-dependent. We show that for particular aging walks $S_{c,d}$ is again the correct extensive entropy. Before the central part of the paper we review the concept of $(c,d)$-entropy in a self-contained way.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Reconstructing protein binding patterns from ChIP time-series

Motivation Gene transcription requires the orchestrated binding of various proteins to the promoter of a gene. The binding times and binding order of proteins allow to draw conclusions about the proteins' exact function in the recruitment process. Time-resolved ChIP experiments are being used to analyze the order of protein binding for these processes. However, these ChIP signals do not represent the exact protein binding patterns. Results We show that for promoter complexes that follow sequential recruitment dynamics the ChIP signal can be understood as a convoluted signal and propose the application of deconvolution methods to recover the protein binding patterns from experimental ChIP time-series. We analyze the suitability of four deconvolution methods: two non-blind deconvolution methods, Wiener deconvolution and Lucy-Richardson deconvolution, and two blind deconvolution methods, blind Lucy-Richardson deconvolution and binary blind deconvolution. We apply these methods to infer the protein binding pattern from ChIP time-series for the pS2 gene.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Statistical detection of systematic election irregularities

Democratic societies are built around the principle of free and fair elections, that each citizen's vote should count equal. National elections can be regarded as large-scale social experiments, where people are grouped into usually large numbers of electoral districts and vote according to their preferences. The large number of samples implies certain statistical consequences for the polling results which can be used to identify election irregularities. Using a suitable data collapse, we find that vote distributions of elections with alleged fraud show a kurtosis of hundred times more than normal elections on certain levels of data aggregation. As an example we show that reported irregularities in recent Russian elections are indeed well explained by systematic ballot stuffing and develop a parametric model quantifying to which extent fraudulent mechanisms are present. We show that if specific statistical properties are present in an election, the results do not represent the will of the people. We formulate a parametric test detecting these statistical properties in election results. Remarkably, this technique produces similar outcomes irrespective of the data resolution and thus allows for cross-country comparisons.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

The Transformation-Groupoid Structure of the q-Gaussian Family

The q-Gaussian function emerges naturally in various applications of statistical mechanics of non-ergodic and complex systems. In particular it was shown that in the theory of binary processes with correlations, the q-Gaussian can appear as a limiting distribution. Further, there exist several problems and situations where, depending on procedural or algorithmic details of data-processing, q-Gaussian distributions may yield distinct values of q, where one value is larger, the other smaller than one. To relate such pairs of q-Gaussians it would be convenient to map such distributions onto one another, ideally in a way, that any value of q can be mapped uniquely to any other value q'. So far a (duality) map from q -> q'=(7-5q)/(5-3q) was found, mapping q from the interval q\in [-\infty, 1] -> q'\in [1, 5/3]. Here we complete the theory of transformations of q-Gaussians by deriving a general map γ_{qq'}, that transforms normalizable q-Gaussian distributions onto one another for which q and q' are in the range of [1,3). By combining this with the previous result, a mapping from any value of q \in [-\infty,3) is possible to any other value q'\in [-\infty,3). We show that the action of γ_{qq'} on the set of q-Gaussian distributions is a transformation groupoid.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

A self-organized model for cell-differentiation based on variations of molecular decay rates

Systemic properties of living cells are the result of molecular dynamics governed by so-called genetic regulatory networks (GRN). These networks capture all possible features of cells and are responsible for the immense levels of adaptation characteristic to living systems. At any point in time only small subsets of these networks are active. Any active subset of the GRN leads to the expression of particular sets of molecules (expression modes). The subsets of active networks change over time, leading to the observed complex dynamics of expression patterns. Understanding of this dynamics becomes increasingly important in systems biology and medicine. While the importance of transcription rates and catalytic interactions has been widely recognized in modeling genetic regulatory systems, the understanding of the role of degradation of biochemical agents (mRNA, protein) in regulatory dynamics remains limited. Recent experimental data suggests that there exists a functional relation between mRNA and protein decay rates and expression modes. In this paper we propose a model for the dynamics of successions of sequences of active subnetworks of the GRN. The model is able to reproduce key characteristics of molecular dynamics, including homeostasis, multi-stability, periodic dynamics, alternating activity, differentiability, and self-organized critical dynamics. Moreover the model allows to naturally understand the mechanism behind the relation between decay rates and expression modes. The model explains recent experimental observations that decay-rates (or turnovers) vary between differentiated tissue-classes at a general systemic level and highlights the role of intracellular decay rate control mechanisms in cell differentiation.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Generalized entropies and logarithms and their duality relations

For statistical systems that violate one of the four Shannon-Khinchin axioms, entropy takes a more general form than the Boltzmann-Gibbs entropy. The framework of superstatistics allows one to formulate a maximum entropy principle with these generalized entropies, making them useful for understanding distribution functions of non-Markovian or non-ergodic complex systems. For such systems where the composability axiom is violated there exist only two ways to implement the maximum entropy principle, one using escort probabilities, the other not. The two ways are connected through a duality. Here we show that this duality fixes a unique escort probability, which allows us to derive a complete theory of the generalized logarithms that naturally arise from the violation of this axiom. We then show how the functional forms of these generalized logarithms are related to the asymptotic scaling behavior of the entropy.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

Generalized entropies and the transformation group of superstatistics

Superstatistics describes statistical systems that behave like superpositions of different inverse temperatures $β$, so that the probability distribution is $p(ε_i) \propto \int_{0}^{\infty} f(β) e^{-βε_i}dβ$, where the `kernel' $f(β)$ is nonnegative and normalized ($\int f(β)d β=1$). We discuss the relation between this distribution and the generalized entropic form $S=\sum_i s(p_i)$. The first three Shannon-Khinchin axioms are assumed to hold. It then turns out that for a given distribution there are two different ways to construct the entropy. One approach uses escort probabilities and the other does not; the question of which to use must be decided empirically. The two approaches are related by a duality. The thermodynamic properties of the system can be quite different for the two approaches. In that connection we present the transformation laws for the superstatistical distributions under macroscopic state changes. The transformation group is the Euclidean group in one dimension.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

What do generalized entropies look like? An axiomatic approach for complex, non-ergodic systems

Shannon and Khinchin showed that assuming four information theoretic axioms the entropy must be of Boltzmann-Gibbs type, $S=-\sum_i p_i \log p_i$. Here we note that in physical systems one of these axioms may be violated. For non-ergodic systems the so called separation axiom (Shannon-Khinchin axiom 4) will in general not be valid. We show that when this axiom is violated the entropy takes a more general form, $S_{c,d}\propto \sum_i ^W Γ(d+1, 1- c \log p_i)$, where $c$ and $d$ are scaling exponents and $Γ(a,b)$ is the incomplete gamma function. The exponents $(c,d)$ define equivalence classes for all interacting and non interacting systems and unambiguously characterize any statistical system in its thermodynamic limit. The proof is possible because of two newly discovered scaling laws which any entropic form has to fulfill, if the first three Shannon-Khinchin axioms hold. $(c,d)$ can be used to define equivalence classes of statistical systems. A series of known entropies can be classified in terms of these equivalence classes. We show that the corresponding distribution functions are special forms of Lambert-${\cal W}$ exponentials containing -- as special cases -- Boltzmann, stretched exponential and Tsallis distributions (power-laws). In the derivation we assume trace form entropies, $S=\sum_i g(p_i)$, with $g$ some function, however more general entropic forms can be classified along the same scaling analysis.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

When do generalized entropies apply? How phase space volume determines entropy

We show how the dependence of phase space volume $Ω(N)$ of a classical system on its size $N$ uniquely determines its extensive entropy. We give a concise criterion when this entropy is not of Boltzmann-Gibbs type but has to assume a {\em generalized} (non-additive) form. We show that generalized entropies can only exist when the dynamically (statistically) relevant fraction of degrees of freedom in the system vanishes in the thermodynamic limit. These are systems where the bulk of the degrees of freedom is frozen and is practically statistically inactive. Systems governed by generalized entropies are therefore systems whose phase space volume effectively collapses to a lower-dimensional 'surface'. We explicitly illustrate the situation for binomial processes and argue that generalized entropies could be relevant for self organized critical systems such as sand piles, for spin systems which form meta-structures such as vortices, domains, instantons, etc., and for problems associated with anomalous diffusion.

0 citations0 reviewsNo code linkedOpen access
preprint2010arXiv

A comprehensive classification of complex statistical systems and an ab-initio derivation of their entropy and distribution functions

To characterize strongly interacting statistical systems within a thermodynamical framework - complex systems in particular - it might be necessary to introduce generalized entropies, $S_g$. A series of such entropies have been proposed in the past, mainly to accommodate important empirical distribution functions to a maximum ignorance principle. Until now the understanding of the fundamental origin of these entropies and its deeper relations to complex systems is limited. Here we explore this questions from first principles. We start by observing that the 4th Khinchin axiom (separability axiom) is violated by strongly interacting systems in general and ask about the consequences of violating the 4th axiom while assuming the first three Khinchin axioms (K1-K3) to hold and $S_g=\sum_ig(p_i)$. We prove by simple scaling arguments that under these requirements {\em each} statistical system is uniquely characterized by a distinct pair of scaling exponents $(c,d)$ in the large size limit. The exponents define equivalence classes for all interacting and non interacting systems. This allows to derive a unique entropy, $S_{c,d}\propto \sum_i Γ(d+1, 1- c \ln p_i)$, which covers all entropies which respect K1-K3 and can be written as $S_g=\sum_ig(p_i)$. Known entropies can now be classified within these equivalence classes. The corresponding distribution functions are special forms of Lambert-$W$ exponentials containing as special cases Boltzmann, stretched exponential and Tsallis distributions (power-laws) -- all widely abundant in nature. This is, to our knowledge, the first {\em ab initio} justification for the existence of generalized entropies. Even though here we assume $S_g=\sum_ig(p_i)$, we show that more general entropic forms can be classified along the same lines.

0 citations0 reviewsNo code linkedOpen access
preprint2010arXiv

Living on the edge of chaos: minimally nonlinear models of genetic regulatory dynamics

Linearized catalytic reaction equations modeling e.g. the dynamics of genetic regulatory networks under the constraint that expression levels, i.e. molecular concentrations of nucleic material are positive, exhibit nontrivial dynamical properties, which depend on the average connectivity of the reaction network. In these systems the inflation of the edge of chaos and multi-stability have been demonstrated to exist. The positivity constraint introduces a nonlinearity which makes chaotic dynamics possible. Despite the simplicity of such minimally nonlinear systems, their basic properties allow to understand fundamental dynamical properties of complex biological reaction networks. We analyze the Lyapunov spectrum, determine the probability to find stationary oscillating solutions, demonstrate the effect of the nonlinearity on the effective in- and out-degree of the active interaction network and study how the frequency distributions of oscillatory modes of such system depend on the average connectivity.

0 citations0 reviewsNo code linkedOpen access
preprint2010arXiv

Peer-review in a world with rational scientists: Toward selection of the average

One of the virtues of peer review is that it provides a self-regulating selection mechanism for scientific work, papers and projects. Peer review as a selection mechanism is hard to evaluate in terms of its efficiency. Serious efforts to understand its strengths and weaknesses have not yet lead to clear answers. In theory peer review works if the involved parties (editors and referees) conform to a set of requirements, such as love for high quality science, objectiveness, and absence of biases, nepotism, friend and clique networks, selfishness, etc. If these requirements are violated, what is the effect on the selection of high quality work? We study this question with a simple agent based model. In particular we are interested in the effects of rational referees, who might not have any incentive to see high quality work other than their own published or promoted. We find that a small fraction of incorrect (selfish or rational) referees can drastically reduce the quality of the published (accepted) scientific standard. We quantify the fraction for which peer review will no longer select better than pure chance. Decline of quality of accepted scientific work is shown as a function of the fraction of rational and unqualified referees. We show how a simple quality-increasing policy of e.g. a journal can lead to a loss in overall scientific quality, and how mutual support-networks of authors and referees deteriorate the system.

0 citations0 reviewsNo code linkedOpen access
preprint2009arXiv

Evolutionary dynamics from a variational principle

We demonstrate with a thought experiment that fitness-based population dynamical approaches to evolution are not able to make quantitative, falsifiable predictions about the long-term behavior of evolutionary systems. A key characteristic of evolutionary systems is the ongoing endogenous production of new species. These novel entities change the conditions for already existing species. Even {\em Darwin's Demon}, a hypothetical entity with exact knowledge of the abundance of all species and their fitness functions at a given time, could not pre-state the impact of these novelties on established populations. We argue that fitness is always {\it a posteriori} knowledge -- it measures but does not explain why a species has reproductive success or not. To overcome these conceptual limitations, a variational principle is proposed in a spin-model-like setup of evolutionary systems. We derive a functional which is minimized under the most general evolutionary formulation of a dynamical system, i.e. evolutionary trajectories causally emerge as a minimization of a functional. This functional allows the derivation of analytic solutions of the asymptotic diversity for stochastic evolutionary systems within a mean-field approximation. We test these approximations by numerical simulations of the corresponding model and find good agreement in the position of phase transitions in diversity curves. The model is further able to reproduce stylized facts of timeseries from several man-made and natural evolutionary systems. Light will be thrown on how species and their fitness landscapes dynamically co-evolve.

0 citations0 reviewsNo code linkedOpen access
preprint2009arXiv

Limit distributions of scale-invariant probabilistic models of correlated random variables with the q-Gaussian as an explicit example

Extremization of the Boltzmann-Gibbs (BG) entropy under appropriate norm and width constraints yields the Gaussian distribution. Also, the basic solutions of the standard Fokker-Planck (FP) equation (related to the Langevin equation with additive noise), as well as the Central Limit Theorem attractors, are Gaussians. The simplest stochastic model with such features is N to infinity independent binary random variables, as first proved by de Moivre and Laplace. What happens for strongly correlated random variables? Such correlations are often present in physical situations as e.g. systems with long range interactions or memory. Frequently q-Gaussians become observed. This is typically so if the Langevin equation includes multiplicative noise, or the FP equation to be nonlinear. Scale-invariance, i.e. exchangeable binary stochastic processes, allow a systematical analysis of the relation between correlations and non-Gaussian distributions. In particular, a generalized stochastic model yielding q-Gaussians for all q (including q>1) was missing. This is achieved here by using the Laplace-de Finetti representation theorem, which embodies strict scale-invariance of interchangeable random variables. We demonstrate that strict scale invariance together with q-Gaussianity mandates the associated extensive entropy to be BG.

0 citations0 reviewsNo code linkedOpen access
preprint2009arXiv

Schumpeterian economic dynamics as a quantifiable minimum model of evolution

We propose a simple quantitative model of Schumpeterian economic dynamics. New goods and services are endogenously produced through combinations of existing goods. As soon as new goods enter the market they may compete against already existing goods, in other words new products can have destructive effects on existing goods. As a result of this competition mechanism existing goods may be driven out from the market - often causing cascades of secondary defects (Schumpeterian gales of destruction). The model leads to a generic dynamics characterized by phases of relative economic stability followed by phases of massive restructuring of markets - which could be interpreted as Schumpeterian business `cycles'. Model timeseries of product diversity and productivity reproduce several stylized facts of economics timeseries on long timescales such as GDP or business failures, including non-Gaussian fat tailed distributions, volatility clustering etc. The model is phrased in an open, non-equilibrium setup which can be understood as a self organized critical system. Its diversity dynamics can be understood by the time-varying topology of the active production networks.

0 citations0 reviewsNo code linkedOpen access
preprint2008arXiv

To how many politicians should government be left?

The quality of governance of institutions, corporations and countries depends on the ability of efficient decision making within the respective boards or cabinets. Opinion formation processes within groups are size dependent. It is often argued - as now e.g. in the discussion of the future size of the European Commission - that decision making bodies of a size beyond 20 become strongly inefficient. We report empirical evidence that the performance of national governments declines with increasing membership and undergoes a qualitative change in behavior at a particular group size. We use recent UNDP, World Bank and CIA data on overall government efficacy, i.e. stability, the quality of policy formulation as well as human development indices of individual countries and relate it to the country's cabinet size. We are able to understand our findings through a simple physical model of opinion dynamics in groups.

0 citations0 reviewsNo code linkedOpen access