Source author record

Zedong Bi

Zedong Bi appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

cond-mat.dis-nn Neurons and Cognition Computer Science and Game Theory cond-mat.stat-mech Information Theory math.IT physics.soc-ph

Catalog footprint

What is connected

5works

7topics

4close collaborators

Actions

Connect this record

Open graph Browse works

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

preprint2020arXiv

Understanding the computation of time using neural network models

To maximize future rewards in this ever-changing world, animals must be able to discover the temporal structure of stimuli and then anticipate or act correctly at the right time. How the animals perceive, maintain, and use time intervals ranging from hundreds of milliseconds to multi-seconds in working memory? How temporal information is processed concurrently with spatial information and decision making? Why there are strong neuronal temporal signals in tasks in which temporal information is not required? A systematic understanding of the underlying neural mechanisms is still lacking. Here, we addressed these problems using supervised training of recurrent neural network models. We revealed that neural networks perceive elapsed time through state evolution along stereotypical trajectory, maintain time intervals in working memory in the monotonic increase or decrease of the firing rates of interval-tuned neurons, and compare or produce time intervals by scaling state evolution speed. Temporal and non-temporal information are coded in subspaces orthogonal with each other, and the state trajectories with time at different non-temporal information are quasi-parallel and isomorphic. Such coding geometry facilitates the decoding generalizability of temporal and non-temporal information across each other. The network structure exhibits multiple feedforward sequences that mutually excite or inhibit depending on whether their preferences of non-temporal information are similar or not. We identified four factors that facilitate strong temporal signals in non-timing tasks, including the anticipation of coming events. Our work discloses fundamental computational principles of temporal processing, and is supported by and gives predictions to a number of experimental phenomena.

preprint2020arXiv

Understanding the computational difficulty of a binary-weight perceptron and the advantage of input sparseness

Limited precision of synaptic weights is a key aspect of both biological and hardware implementation of neural networks. To assign low-precise weights during learning is a non-trivial task, but may benefit from representing to-be-learned items using sparse code. However, the computational difficulty resulting from low weight precision and the advantage of sparse coding remain not fully understood. Here, we study a perceptron model, which associates binary (0 or 1) input patterns with outputs using binary (0 or 1) weights, modeling a single neuron receiving excitatory inputs. We considered a decimation process, where every time step, marginal probabilities of unfixed weights were evaluated, then the most polarized weight was fixed at its preferred value. We showed that decimation is a process approaching the dense solution region in weight configuration space. In two efficient algorithms (SBPI and rBP) for solving binary-weight perceptron, most time steps are spent on determining values of the weights fixed late in decimation. This algorithmic difficult point may result from strong cross-correlation between late-decimation-fixed weights in the solution subspace where early-decimation-fixed weights take their fixed values, and is related to solution condensation in this subspace during decimation. Input sparseness reduces the time steps that SBPI and rBP need to find solutions, by reducing time steps used to assign values to late-decimation-fixed weights, due to the reduction of cross-correlation between late-decimation-fixed weights. Our work suggests that the computational difficulty of constraint satisfaction problem originates from the subspace of late-decimation-fixed variables. Our work highlights the heterogeneity of learning dynamics of weights, which may help understand axonal pruning in brain development, and inspire more efficient algorithms to train artificial neural networks.

preprint2015arXiv

Spike Pattern Structure Influences Efficacy Variability under STDP and Synaptic Homeostasis

In neural systems, synaptic plasticity is usually driven by spike trains. Due to the inherent noises of neurons, synapses and networks, spike trains typically exhibit externally uncontrollable variability such as spatial heterogeneity and temporal stochasticity, resulting in variability of synapses, which we call efficacy variability. Spike patterns with the same population rate but inducing different efficacy variability may result in neuronal networks with sharply different structures and functions. However, how the variability of spike trains influences the efficacy variability remains unclear. Here, we systematically study this influence when spike patterns possess four aspects of statistical features, i.e. synchronous firing, auto-temporal structure, heterogeneity of rates and heterogeneity of cross-correlations, under spike-timing dependent plasticity (STDP) after dynamically bounding the mean strength of plastic synapses into or out of a neuron (synaptic homeostasis). We then show the functional importance of efficacy variability on the encoding and maintenance of connection patterns and on the early development of primary visual systems driven by retinal waves. We anticipate our work brings a fresh perspective to the understanding of the interaction between synaptic plasticity and dynamical spike patterns in functional processes of neural systems.

preprint2014arXiv

Optimal cooperation-trap strategies for the iterated Rock-Paper-Scissors game

In an iterated non-cooperative game, if all the players act to maximize their individual accumulated payoff, the system as a whole usually converges to a Nash equilibrium that poorly benefits any player. Here we show that such an undesirable destiny is avoidable in an iterated Rock-Paper-Scissors (RPS) game involving two players X and Y. Player X has the option of proactively adopting a cooperation-trap strategy, which enforces complete cooperation from the rational player Y and leads to a highly beneficial as well as maximally fair situation to both players. That maximal degree of cooperation is achievable in such a competitive system with cyclic dominance of actions may stimulate creative thinking on how to resolve conflicts and enhance cooperation in human societies.

preprint2011arXiv

Partition Function Expansion on Region-Graphs and Message-Passing Equations

Disordered and frustrated graphical systems are ubiquitous in physics, biology, and information science. For models on complete graphs or random graphs, deep understanding has been achieved through the mean-field replica and cavity methods. But finite-dimensional `real' systems persist to be very challenging because of the abundance of short loops and strong local correlations. A statistical mechanics theory is constructed in this paper for finite-dimensional models based on the mathematical framework of partition function expansion and the concept of region-graphs. Rigorous expressions for the free energy and grand free energy are derived. Message-passing equations on the region-graph, such as belief-propagation and survey-propagation, are also derived rigorously.