Source author record

Fred Wolf

Fred Wolf appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

14works
5topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

14 published item(s)

preprint2020arXiv

Lyapunov spectra of chaotic recurrent neural networks

Brains process information through the collective dynamics of large neural networks. Collective chaos was suggested to underlie the complex ongoing dynamics observed in cerebral cortical circuits and determine the impact and processing of incoming information streams. In dissipative systems, chaotic dynamics takes place on a subset of phase space of reduced dimensionality and is organized by a complex tangle of stable, neutral and unstable manifolds. Key topological invariants of this phase space structure such as attractor dimension, and Kolmogorov-Sinai entropy so far remained elusive. Here we calculate the complete Lyapunov spectrum of recurrent neural networks. We show that chaos in these networks is extensive with a size-invariant Lyapunov spectrum and characterized by attractor dimensions much smaller than the number of phase space dimensions. We find that near the onset of chaos, for very intense chaos, and discrete-time dynamics, random matrix theory provides analytical approximations to the full Lyapunov spectrum. We show that a generalized time-reversal symmetry of the network dynamics induces a point-symmetry of the Lyapunov spectrum reminiscent of the symplectic structure of chaotic Hamiltonian systems. Fluctuating input reduces both the entropy rate and the attractor dimension. For trained recurrent networks, we find that Lyapunov spectrum analysis provides a quantification of error propagation and stability achieved. Our methods apply to systems of arbitrary connectivity, and we describe a comprehensive set of controls for the accuracy and convergence of Lyapunov exponents. Our results open a novel avenue for characterizing the complex dynamics of recurrent neural networks and the geometry of the corresponding chaotic attractors. They also highlight the potential of Lyapunov spectrum analysis as a diagnostic for machine learning applications of recurrent networks.

preprint2015arXiv

Impact of membrane bistability on dynamical response of neuronal populations

Neurons in many brain areas can develop pronounced depolarized state of membrane potential (up state) in addition to the normal hyperpolarized down state near the resting potential. The influence of the up state on signal encoding, however, is not well investigated. Here we construct a one-dimensional bistable neuron model and calculate the linear response to noisy oscillatory inputs analytically. We find that with the appearance of an up state, the transmission function is enhanced by the emergence of a local maximum at some optimal frequency and the phase lag relative to the input signal is reduced. We characterize the dependence of the enhancement of frequency response on intrinsic dynamics and on the occupancy of the up state.

preprint2015arXiv

Random wiring, ganglion cell mosaics, and the functional architecture of the visual cortex

The architecture of iso-orientation domains in the primary visual cortex of placental carnivores and primates apparently follows species invariant quantitative laws. Dynamical optimization models assuming that neurons coordinate their stimulus preferences throughout cortical circuits linking millions of cells specifically predict these invariants. This might indicate that V1's intrinsic connectome and its functional architecture adhere to a single optimization principle with high precision and robustness. To validate this hypothesis, it is critical to closely examine the quantitative predictions of alternative candidate theories. Random feedforward wiring within the retino-cortical pathway represents a conceptually appealing alternative to dynamical circuit optimization because random dimension-expanding projections are believed to generically exhibit computationally favorable properties for stimulus representations. Here, we ask whether the quantitative invariants of V1 architecture can be explained as a generic emergent property of random wiring. We generalize and examine the stochastic wiring model proposed by Ringach and coworkers, in which iso-orientation domains in the visual cortex arise through random feedforward connections between semi-regular mosaics of retinal ganglion cells (RGCs) and visual cortical neurons. We derive closed-form expressions for cortical receptive fields and domain layouts predicted by the model for perfectly hexagonal RGC mosaics [...] We conclude that V1 layout invariants are specific quantitative signatures of visual cortical optimization, which cannot be explained by generic random feedforward-wiring models. *See pdf for the full abstract.*

preprint2013arXiv

Continuous Dynamic Photostimulation - inducing in-vivo-like fluctuating conductances with Channelrhodopsins

Central neurons operate in a regime of constantly fluctuating conductances, induced by thousands of presynaptic cells. Channelrhodopsins have been almost exclusively used to imprint a fixed spike pattern by sequences of brief depolarizations. Here we introduce continuous dynamic photostimulation (CoDyPs), a novel approach to mimic in-vivo like input fluctuations noninvasively in cells transfected with the weakly inactivating channelrhodopsin variant ChIEF. Even during long-term experiments, cultured neurons subjected to CoDyPs generate seemingly random, but reproducible spike patterns. In voltage clamped cells CoDyPs induced highly reproducible current waveforms that could be precisely predicted from the light-conductance transfer function of ChIEF. CoDyPs can replace the conventional, flash-evoked imprinting of spike patterns in in-vivo and in-vitro studies, preserving natural activity. When combined with non-invasive spike-detection, CoDyPs allows the acquisition of order of magnitudes larger data sets than previously possible, for studies of dynamical response properties of many individual neurons.

preprint2012arXiv

Coordinated optimization of visual cortical maps (I) Symmetry-based analysis

In the primary visual cortex of primates and carnivores, functional architecture can be characterized by maps of various stimulus features such as orientation preference (OP), ocular dominance (OD), and spatial frequency. It is a long-standing question in theoretical neuroscience whether the observed maps should be interpreted as optima of a specific energy functional that summarizes the design principles of cortical functional architecture. A rigorous evaluation of this optimization hypothesis is particularly demanded by recent evidence that the functional architecture of OP columns precisely follows species invariant quantitative laws. Because it would be desirable to infer the form of such an optimization principle from the biological data, the optimization approach to explain cortical functional architecture raises the following questions: i) What are the genuine ground states of candidate energy functionals and how can they be calculated with precision and rigor? ii) How do differences in candidate optimization principles impact on the predicted map structure and conversely what can be learned about an hypothetical underlying optimization principle from observations on map structure? iii) Is there a way to analyze the coordinated organization of cortical maps predicted by optimization principles in general? To answer these questions we developed a general dynamical systems approach to the combined optimization of visual cortical maps of OP and another scalar feature such as OD or spatial frequency preference.

preprint2012arXiv

Coordinated optimization of visual cortical maps (II) Numerical studies

It is an attractive hypothesis that the spatial structure of visual cortical architecture can be explained by the coordinated optimization of multiple visual cortical maps representing orientation preference (OP), ocular dominance (OD), spatial frequency, or direction preference. In part (I) of this study we defined a class of analytically tractable coordinated optimization models and solved representative examples in which a spatially complex organization of the orientation preference map is induced by inter-map interactions. We found that attractor solutions near symmetry breaking threshold predict a highly ordered map layout and require a substantial OD bias for OP pinwheel stabilization. Here we examine in numerical simulations whether such models exhibit biologically more realistic spatially irregular solutions at a finite distance from threshold and when transients towards attractor states are considered. We also examine whether model behavior qualitatively changes when the spatial periodicities of the two maps are detuned and when considering more than 2 feature dimensions. Our numerical results support the view that neither minimal energy states nor intermediate transient states of our coordinated optimization models successfully explain the spatially irregular architecture of the visual cortex. We discuss several alternative scenarios and additional factors that may improve the agreement between model solutions and biological observations.

preprint2011arXiv

Coverage, Continuity and Visual Cortical Architecture

The primary visual cortex of many mammals contains a continuous representation of visual space, with a roughly repetitive aperiodic map of orientation preferences superimposed. It was recently found that orientation preference maps (OPMs) obey statistical laws which are apparently invariant among species widely separated in eutherian evolution. Here, we examine whether one of the most prominent models for the optimization of cortical maps, the elastic net (EN) model, can reproduce this common design. The EN model generates representations which optimally trade of stimulus space coverage and map continuity. While this model has been used in numerous studies, no analytical results about the precise layout of the predicted OPMs have been obtained so far. We present a mathematical approach to analytically calculate the cortical representations predicted by the EN model for the joint mapping of stimulus position and orientation. We find that in all previously studied regimes, predicted OPM layouts are perfectly periodic. An unbiased search through the EN parameter space identifies a novel regime of aperiodic OPMs with pinwheel densities lower than found in experiments. In an extreme limit, aperiodic OPMs quantitatively resembling experimental observations emerge. Stabilization of these layouts results from strong nonlocal interactions rather than from a coverage-continuity-compromise. Our results demonstrate that optimization models for stimulus representations dominated by nonlocal suppressive interactions are in principle capable of correctly predicting the common OPM design. They question that visual cortical feature representations can be explained by a coverage-continuity-compromise.

preprint2011arXiv

Dynamic effective connectivity of inter-areal brain circuits

Anatomic connections between brain areas affect information flow between neuronal circuits and the synchronization of neuronal activity. However, such structural connectivity does not coincide with effective connectivity, related to the more elusive question "Which areas cause the present activity of which others?". Effective connectivity is directed and depends flexibly on contexts and tasks. Here we show that a dynamic effective connectivity can emerge from transitions in the collective organization of coherent neural activity. Integrating simulation and semi-analytic approaches, we study mesoscale network motifs of interacting cortical areas, modeled as large random networks of spiking neurons or as simple rate units. Through a causal analysis of time-series of model neural activity, we show that different dynamical states generated by a same structural connectivity motif correspond to distinct effective connectivity motifs. Such effective motifs can display a dominant directionality, due to spontaneous symmetry breaking and effective entrainment between local brain rhythms, although all connections in the considered structural motifs are reciprocal [...] Finally, we analyze how the information encoded in spiking patterns of a local neuronal population is propagated across a fixed structural connectivity motif, demonstrating that changes in the active effective connectivity regulate both the efficiency and the directionality of information transfer [...] Going beyond these early proposals, we advance here that dynamic interactions between brain rhythms provide as well the basis for the self-organized control of this "communication-through-coherence", making thus possible a fast "on-demand" reconfiguration of global information routing modalities.

preprint2011arXiv

Reservoirs of Stability: Flux Tubes in the Dynamics of Cortical Circuits

Triggering a single additional spike in a cerebral cortical neuron was recently demonstrated to cause a cascade of extra spikes in the network that is likely to rapidly decorrelate the network's microstate. The mechanisms involved in this extreme sensitivity of cortical networks are currently not well understood. Here, we show in a minimal model of cortical circuit dynamics that exponential state separation after single spike and even single synapse perturbations coexists with dynamical stability to infinitesimal state perturbations. We propose a unifying picture of exponentially separating flux tubes enclosing unique stable trajectories composing the networks' state spaces.

preprint2011arXiv

Spike Onset Dynamics and Response Speed in Neuronal Populations

Recent studies of cortical neurons driven by fluctuating currents revealed cutoff frequencies for action potential encoding of several hundred Hz. Theoretical studies of biophysical neuron models have predicted a much lower cutoff frequency of the order of average firing rate or the inverse membrane time constant. The biophysical origin of the observed high cutoff frequencies is thus not well understood. Here we introduce a neuron model with dynamical action potential generation, in which the linear response can be analytically calculated for uncorrelated synaptic noise. We find that the cutoff frequencies increase to very large values when the time scale of action potential initiation becomes short.

preprint2010arXiv

Dynamical Entropy Production in Spiking Neuron Networks in the Balanced State

We demonstrate deterministic extensive chaos in the dynamics of large sparse networks of theta neurons in the balanced state. The analysis is based on numerically exact calculations of the full spectrum of Lyapunov exponents, the entropy production rate and the attractor dimension. Extensive chaos is found in inhibitory networks and becomes more intense when an excitatory population is included. We find a strikingly high rate of entropy production that would limit information representation in cortical spike patterns to the immediate stimulus response.

preprint2009arXiv

Correlations and Synchrony in Threshold Neuron Models

We study how threshold model neurons transfer temporal and interneuronal input correlations to correlations of spikes. We find that the low common input regime is governed by firing rate dependent spike correlations which are sensitive to the detailed structure of input correlation functions. In the high common input regime the spike correlations are insensitive to the firing rate and exhibit a universal peak shape independent of input correlations. Rate heterogeneous pairs driven by common inputs in general exhibit asymmetric spike correlations. All predictions are confirmed in in vitro experiments with cortical neurons driven by synthesized fluctuating input currents.

preprint2009arXiv

Pinwheel stabilization by ocular dominance segregation

We present an analytical approach for studying the coupled development of ocular dominance and orientation preference columns. Using this approach we demonstrate that ocular dominance segregation can induce the stabilization and even the production of pinwheels by their crystallization in two types of periodic lattices. Pinwheel crystallization depends on the overall dominance of one eye over the other, a condition that is fulfilled during early cortical development. Increasing the strength of inter-map coupling induces a transition from pinwheel-free stripe solutions to intermediate and high pinwheel density states.

preprint2008arXiv

Inter-areal coordination of columnar architectures during visual cortical development

The occurrence of a critical period of plasticity in the visual cortex has long been established, yet its function in normal development is not fully understood. Here we show that as the late phase of the critical period unfolds, different areas of cat visual cortex develop in a coordinated manner. Orientation columns in areas V1 and V2 become matched in size in regions that are mutually connected. The same age trend is found for such regions in the left and right brain hemisphere. Our results indicate that a function of critical period plasticity is to progressively coordinate the functional architectures of different cortical areas - even across hemispheres.