Source author record

Erik M. Bollt

Erik M. Bollt appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

18works
17topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

18 published item(s)

preprint2026arXiv

Empirical Discovery of Multi-Scale Transfer of Information in Dynamical Systems

In this work, we quantify the time scales and information flow associated with multiscale energy transfer in a weakly turbulent system. This is done through a greedy optimization algorithm which finds the maximum conditional-mutual information across lagged embeddings of time series localized by wavenumber. For our chosen weakly turbulent system, the algorithm finds asymmetries in the information flow across wavenumbers, reflecting what are typically described as forward and inverse cascades. However, our approach goes beyond typical heuristic arguments and provides quantitative insight into the intricate multi-wave mixing dynamics necessary to maintain the steady statistical state characterizing weak turbulence. Our work then provides a novel, detailed, and fully nonlinear statistical analysis of a weakly turbulent system. The flexibility of our approach points to broader applicability in real-world data coming from chaotic or turbulent dynamical systems.

preprint2022arXiv

Recurrent Neural Networks for Dynamical Systems: Applications to Ordinary Differential Equations, Collective Motion, and Hydrological Modeling

Classical methods of solving spatiotemporal dynamical systems include statistical approaches such as autoregressive integrated moving average, which assume linear and stationary relationships between systems' previous outputs. Development and implementation of linear methods are relatively simple, but they often do not capture non-linear relationships in the data. Thus, artificial neural networks (ANNs) are receiving attention from researchers in analyzing and forecasting dynamical systems. Recurrent neural networks (RNN), derived from feed-forward ANNs, use internal memory to process variable-length sequences of inputs. This allows RNNs to applicable for finding solutions for a vast variety of problems in spatiotemporal dynamical systems. Thus, in this paper, we utilize RNNs to treat some specific issues associated with dynamical systems. Specifically, we analyze the performance of RNNs applied to three tasks: reconstruction of correct Lorenz solutions for a system with a formulation error, reconstruction of corrupted collective motion trajectories, and forecasting of streamflow time series possessing spikes, representing three fields, namely, ordinary differential equations, collective motion, and hydrological modeling, respectively. We train and test RNNs uniquely in each task to demonstrate the broad applicability of RNNs in reconstruction and forecasting the dynamics of dynamical systems.

preprint2022arXiv

Spanning Trees of Recursive Scale-Free Graphs

We present a link-by-link rule-based method for constructing all members of the ensemble of spanning trees for any recursively generated, finitely articulated graph, such as the DGM net. The recursions allow for many large-scale properties of the ensemble of spanning trees to be analytically solved exactly. We show how a judicious application of the prescribed growth rules selects for certain subsets of the spanning trees with particular desired properties (small-world or extended diameter, degree distribution, etc.), and thus provides solutions to several optimization problems. The analysis of spanning trees enhances the usefulness of recursive graphs as sophisticated models for everyday life complex networks.

preprint2022arXiv

Stability analysis of intralayer synchronization in time-varying multilayer networks with generic coupling functions

The stability analysis of synchronization patterns on generalized network structures is of immense importance nowadays. In this article, we scrutinize the stability of intralayer synchronous state in temporal multilayer hypernetworks, where each dynamic units in a layer communicate with others through various independent time-varying connection mechanisms. Here, dynamical units within and between layers may be interconnected through arbitrary generic coupling functions. We show that intralayer synchronous state exists as an invariant solution. Using fast switching stability criteria, we derive the condition for stable coherent state in terms of associated time-averaged network structure, and in some instances we are able to separate the transverse subspace optimally. Using simultaneous block diagonalization of coupling matrices, we derive the synchronization stability condition without considering time-averaged network structure. Finally, we verify our analytically derived results through a series of numerical simulations on synthetic and real-world neuronal networked systems.

preprint2022arXiv

The Essential Synchronization Backbone Problem

Network optimization strategies for the process of synchronization have generally focused on the re-wiring or re-weighting of links in order to: (1) expand the range of coupling strengths that achieve synchronization, (2) expand the basin of attraction for the synchronization manifold, or (3) lower the average time to synchronization. A new optimization goal is proposed in seeking the minimum subset of the edge set of the original network that enables the same essential ability to synchronize in that the synchronization manifolds have conjugate stability. We call this type of minimal spanning subgraph an Essential Synchronization Backbone (ESB) of the original system, and we present two algorithms: one is a strategy for an exhaustive search for a true solution, while the other is a method of approximation for this combinatorial problem. The solution spaces that result from different choices of dynamical systems and coupling schemes vary with the level of hierarchical structure present and also the number of interwoven central cycles. Applications can include the important problem in civil engineering of power grid hardening, where new link creation may be costly, and the defense of certain key links to the functional process may be prioritized.

preprint2020arXiv

On Geometry of Information Flow for Causal Inference

Causal inference is perhaps one of the most fundamental concepts in science, beginning originally from the works of some of the ancient philosophers, through today, but also weaved strongly in current work from statisticians, machine learning experts, and scientists from many other fields. This paper takes the perspective of information flow, which includes the Nobel prize winning work on Granger-causality, and the recently highly popular transfer entropy, these being probabilistic in nature. Our main contribution will be to develop analysis tools that will allow a geometric interpretation of information flow as a causal inference indicated by positive transfer entropy. We will describe the effective dimensionality of an underlying manifold as projected into the outcome space that summarizes information flow. Therefore contrasting the probabilistic and geometric perspectives, we will introduce a new measure of causal inference based on the fractal correlation dimension conditionally applied to competing explanations of future forecasts, which we will write $GeoC_{y\rightarrow x}$. This avoids some of the boundedness issues that we show exist for the transfer entropy, $T_{y\rightarrow x}$. We will highlight our discussions with data developed from synthetic models of successively more complex nature: then include the Hénon map example, and finally a real physiological example relating breathing and heart rate function. Keywords: Causal Inference; Transfer Entropy; Differential Entropy; Correlation Dimension; Pinsker's Inequality; Frobenius-Perron operator.

preprint2019arXiv

Manifold Learning for Organizing Unstructured Sets of Process Observations

Data mining is routinely used to organize ensembles of short temporal observations so as to reconstruct useful, low-dimensional realizations of an underlying dynamical system. In this paper, we use manifold learning to organize unstructured ensembles of observations ("trials") of a system's response surface. We have no control over where every trial starts; and during each trial operating conditions are varied by turning "agnostic" knobs, which change system parameters in a systematic but unknown way. As one (or more) knobs "turn" we record (possibly partial) observations of the system response. We demonstrate how such partial and disorganized observation ensembles can be integrated into coherent response surfaces whose dimension and parametrization can be systematically recovered in a data-driven fashion. The approach can be justified through the Whitney and Takens embedding theorems, allowing reconstruction of manifolds/attractors through different types of observations. We demonstrate our approach by organizing unstructured observations of response surfaces, including the reconstruction of a cusp bifurcation surface for Hydrogen combustion in a Continuous Stirred Tank Reactor. Finally, we demonstrate how this observation-based reconstruction naturally leads to informative transport maps between input parameter space and output/state variable spaces.

preprint2016arXiv

Inference of Causal Information Flow in Collective Animal Behavior

Understanding and even defining what constitutes animal interactions remains a challenging problem. Correlational tools may be inappropriate for detecting communication between a set of many agents exhibiting nonlinear behavior. A different approach is to define coordinated motions in terms of an information theoretic channel of direct causal information flow. In this work, we consider time series data obtained by an experimental protocol of optical tracking of the insect species Chironomus riparius. The data constitute reconstructed 3-D spatial trajectories of the insects' flight trajectories and kinematics. We present an application of the optimal causation entropy (oCSE) principle to identify direct causal relationships or information channels among the insects. The collection of channels inferred by oCSE describes a network of information flow within the swarm. We find that information channels with a long spatial range are more common than expected under the assumption that causal information flows should be spatially localized. The tools developed herein are general and applicable to the inference and study of intercommunication networks in a wide variety of natural settings.

preprint2015arXiv

Causal Network Inference by Optimal Causation Entropy

The broad abundance of time series data, which is in sharp contrast to limited knowledge of the underlying network dynamic processes that produce such observations, calls for a rigorous and efficient method of causal network inference. Here we develop mathematical theory of causation entropy, an information-theoretic statistic designed for model-free causality inference. For stationary Markov processes, we prove that for a given node in the network, its causal parents forms the minimal set of nodes that maximizes causation entropy, a result we refer to as the optimal causation entropy principle. Furthermore, this principle guides us to develop computational and data efficient algorithms for causal network inference based on a two-step discovery and removal algorithm for time series data for a network-couple dynamical system. Validation in terms of analytical and numerical results for Gaussian processes on large random networks highlight that inference by our algorithm outperforms previous leading methods including conditioned Granger causality and transfer entropy. Interestingly, our numerical results suggest that the number of samples required for accurate inference depends strongly on network characteristics such as the density of links and information diffusion rate and not necessarily on the number of nodes.

preprint2015arXiv

Causation entropy from symbolic representations of dynamical systems

Identification of causal structures and quantification of direct information flows in complex systems is a challenging yet important task, with practical applications in many fields. Data generated by dynamical processes or large-scale systems are often symbolized, either because of the finite resolution of the measurement apparatus, or because of the need of statistical estimation. By algorithmic application of causation entropy, we investigated the effects of symbolization on important concepts such as Markov order and causal structure of the tent map. We uncovered that these quantities depend nonmontonically and, most of all, sensitively on the choice of symbolization. Indeed, we show that Markov order and causal structure do not necessarily converge to their original analog counterparts as the resolution of the partitioning becomes finer.

preprint2015arXiv

Causation Entropy Identifies Indirect Influences, Dominance of Neighbors and Anticipatory Couplings

Inference of causality is central in nonlinear time series analysis and science in general. A popular approach to infer causality between two processes is to measure the information flow between them in terms of transfer entropy. Using dynamics of coupled oscillator networks, we show that although transfer entropy can successfully detect information flow in two processes, it often results in erroneous identification of network connections under the presence of indirect interactions, dominance of neighbors, or anticipatory couplings. Such effects are found to be profound for time-dependent networks. To overcome these limitations, we develop a measure called causation entropy and show that its application can lead to reliable identification of true couplings.

preprint2015arXiv

Editorial Comment on the Special Issue of "Information in Dynamical Systems and Complex Systems"

This special issue collects contributions from the participants of the "Information in Dynamical Systems and Complex Systems" workshop, which cover a wide range of important problems and new approaches that lie in the intersection of information theory and dynamical systems. The contributions include theoretical characterization and understanding of the different types of information flow and causality in general stochastic processes, inference and identification of coupling structure and parameters of system dynamics, rigorous coarse-grain modeling of network dynamical systems, and exact statistical testing of fundamental information-theoretic quantities such as the mutual information. The collective efforts reported herein reflect a modern perspective of the intimate connection between dynamical systems and information flow, leading to the promise of better understanding and modeling of natural complex systems and better/optimal design of engineering systems.

preprint2014arXiv

Identifying Coupling Structure in Complex Systems through the Optimal Causation Entropy Principle

Inferring the coupling structure of complex systems from time series data in general by means of statistical and information-theoretic techniques is a challenging problem in applied science. The reliability of statistical inferences requires the construction of suitable information-theoretic measures that take into account both direct and indirect influences, manifest in the form of information flows, between the components within the system. In this work, we present an application of the optimal causation entropy (oCSE) principle to identify the coupling structure of a synthetic biological system, the repressilator. Specifically, when the system reaches an equilibrium state, we use a stochastic perturbation approach to extract time series data that approximate a linear stochastic process. Then, we present and jointly apply the aggregative discovery and progressive removal algorithms based on the oCSE principle to infer the coupling structure of the system from the measured data. Finally, we show that the success rate of our coupling inferences not only improves with the amount of available data, but it also increases with a higher frequency of sampling and is especially immune to false positives.

preprint2012arXiv

Relatively Coherent Sets as a Hierarchical Partition Method

Finite time coherent sets [8] have recently been defined by a measure based objective function describing the degree that sets hold together, along with a Frobenius-Perron transfer operator method to produce optimally coherent sets. Here we present an extension to generalize the concept to hierarchially defined relatively coherent sets based on adjusting the finite time coherent sets to use relative mesure restricted to sets which are developed iteratively and hierarchically in a tree of partitions. Several examples help clarify the meaning and expectation of the techniques, as they are the nonautonomous double gyre, the standard map, an idealized stratospheric flow, and empirical data from the Mexico Gulf during the 2010 oil spill. Also for sake of analysis of computational complexity, we include an appendic concerning the computational complexity of developing the Ulam-Galerkin matrix extimates of the Frobenius-Perron operator centrally used here.

preprint2011arXiv

A Mathematical Model for the Dynamics and Synchronization of Cows

We formulate a mathematical model for daily activities of a cow (eating, lying down, and standing) in terms of a piecewise affine dynamical system. We analyze the properties of this bovine dynamical system representing the single animal and develop an exact integrative form as a discrete-time mapping. We then couple multiple cow "oscillators" together to study synchrony and cooperation in cattle herds. We comment on the relevant biology and discuss extensions of our model. With this abstract approach, we not only investigate equations with interesting dynamics but also develop interesting biological predictions. In particular, our model illustrates that it is possible for cows to synchronize \emph{less} when the coupling is increased.

preprint2010arXiv

Judging Model Reduction of Chaotic Systems via Optimal Shadowing Criteria

A common goal in the study of high dimensional and complex system is to model the system by a low order representation. In this letter we propose a general approach for assessing the quality of a reduced order model for high dimensional chaotic systems. The key of this approach is the use of optimal shadowing, combined with dimensionality reduction techniques. Rather than quantify the quality of a model based on the quality of predictions, which can be irrelevant for chaotic systems since even excellent models can do poorly, we suggest that a good model should allow shadowing by modeled data for long times; this principle leads directly to an optimal shadowing criterion of model reduction. This approach overcomes the usual difficulties encountered by traditional methods which either compare systems of the same size by normed-distance in the functional space, or measure how close an orbit generated by a model is to the observed data. Examples include interval arithmetic computations to validate the optimal shadowing.

preprint2008arXiv

Synchronization Stability of Coupled Near-Identical Oscillator Network

We derive variational equations to analyze the stability of synchronization for coupled near-identical oscillators. To study the effect of parameter mismatch on the stability in a general fashion, we define master stability equations and associated master stability functions, which are independent of the network structure. In particular, we present several examples of coupled near-identical Lorenz systems configured in small networks (a ring graph and sequence networks) with a fixed parameter mismatch and a large Barabasi-Albert scale-free network with random parameter mismatch. We find that several different network architectures permit similar results despite various mismatch patterns.

preprint2007arXiv

Graph Compression -- Save Information by Exploiting Redundancy

In this paper we raise the question of how to compress sparse graphs. By introducing the idea of redundancy, we find a way to measure the overlap of neighbors between nodes in networks. We exploit symmetry and information by making use of the overlap in neighbors and analyzing how information is reduced by shrinking the network and using the specific data structure we created, we generalize the problem of compression as an optimization problem on the possible choices of orbits. To find a reasonably good solution to this problem we use a greedy algorithm to determine the orbit of symmetry identifications, to achieve compression. Some example implementations of our algorithm are illustrated and analyzed.