Neutral Stability, Rate Propagation, and Critical Branching in Feedforward Networks

  title={Neutral Stability, Rate Propagation, and Critical Branching in Feedforward Networks},
  author={N. Alex Cayco-Gajic and Eric Shea-Brown},
  journal={Neural Computation},
Recent experimental and computational evidence suggests that several dynamical properties may characterize the operating point of functioning neural networks: critical branching, neutral stability, and production of a wide range of firing patterns. We seek the simplest setting in which these properties emerge, clarifying their origin and relationship in random, feedforward networks of McCullochs-Pitts neurons. Two key parameters are the thresholds at which neurons fire spikes and the overall… 

Intrinsic Neuronal Properties Switch the Mode of Information Transmission in Networks

This work investigates the potential role of experimentally observed changes in intrinsic neuronal properties in determining the ability of cortical networks to propagate waves of activity, and suggests a role for background synaptic noise in switching the mode of information transmission.

Propagating synchrony in feed-forward networks

This work analytically and numerically investigates under which conditions diluted feed-forward chains may exhibit synchrony propagation and identifies how non-additive coupling relaxes the conditions on connectivity such that it enables synchronous propagation at connectivities substantially lower than required for linearly coupled chains.

Reaction-diffusion-like formalism for plastic neural networks reveals dissipative solitons at criticality.

A reaction-diffusion-like formalism for plastic feed-forward networks of nonlinear rate-based model neurons with a correlation sensitive learning rule inspired by and being qualitatively similar to STDP is derived.

Oscillation-Induced Signal Transmission and Gating in Neural Circuits

It is found that for standard, additive couplings and a net excitatory effect of oscillations, robust propagation of synchrony is enabled in less prominent feed-forward structures than in systems without oscillations and that the oscillations may serve to stabilize the replay.

Nearly Extensive Sequential Memory Lifetime Achieved by Coupled Nonlinear Neurons

This work demonstrates that it is possible to achieve a memory lifetime almost proportional to the network size, “an extensive memory lifetime,” when the nonlinearity of neurons is appropriately used.

Signal denoising through topographic modularity of neural circuits

It is demonstrated that the sharpness of topographic projections acts as a bifurcation parameter, controlling the macroscopic dynamics and representational precision across a modular network, and shifting the balance of excitation and inhibition gradually increases task performance and improves the signal-to-noise ratio across the system.

Hub-activated signal transmission in complex networks.

It is proposed that hubs in neural circuits may activate local signal transmission along sequences of specific subnetworks to induce the propagation of specific pulse and rate signals in neuronal and other communication networks.

A Direct Self-Constructing Neural Controller Design for a Class of Nonlinear Systems

A direct self-constructing neural controller (DSNC) is designed so that unknown nonlinearities can be approximated and the closed-loop system is stable and the tracking error is guaranteed to uniformly asymptotically converge to zero with the aid of an additional robustifying control term.

Coordinated neural activity: Mechanistic origins and impact on stimulus coding

Coordinated neural activity: Mechanistic origins and impact on stimulus coding and its role in stimulus coding is studied.

Neural Networks with Nonlinear Couplings

Dendritic nonlinearities enable robust signal propagation in networks with biologically plausible topology, and synaptic efficiencies in the biologically observed range, and this phenomenon of hub-activated signal transmission further relaxes the requirement for a prominent feed-forward anatomy.



Signal Propagation and Logic Gating in Networks of Integrate-and-Fire Neurons

This work investigates the factors affecting transmission and shows that multiple signals can propagate simultaneously along different pathways and shows how different types of logic gates can arise within the architecture of the random network through the strengthening of specific synapses.

On the Transmission of Rate Code in Long Feedforward Networks with Excitatory–Inhibitory Balance

It is concluded that the transmission of rate code in feedforward networks is highly unlikely because neurons in a given layer tend to synchronize partially with each other because of shared inputs.

Neuronal Avalanches in Neocortical Circuits

This work shows that propagation of spontaneous activity in cortical networks is described by equations that govern avalanches, and suggests that “neuronal avalanches” may be a generic property of cortical networks, and represent a mode of activity that differs profoundly from oscillatory, synchronized, or wave-like network states.

Stable propagation of synchronous spiking in cortical neural networks

The results indicate that a combinatorial neural code, based on rapid associations of groups of neurons co-ordinating their activity at the single spike level, is possible within a cortical-like network.

Conditions for Propagating Synchronous Spiking and Asynchronous Firing Rates in a Cortical Network Model

This work shows that by modeling synapses as conductance transients, rather than current sources, it is possible to embed and propagate transient synchrony in the FFN, without destabilizing the background network dynamics.

Functional consequences of correlated excitatory and inhibitory conductances in cortical networks

Neurons in the neocortex receive a large number of excitatory and inhibitory synaptic inputs. Excitation and inhibition dynamically balance each other, with inhibition lagging excitation by only few

Synchronous Firing and Higher-Order Interactions in Neuron Pool

A simple model in which neurons receive common overlapping inputs is analyzed and it is proved that such a model can have a widespread distribution of activity, generating higher-order stochastic interactions.

Spiking activity propagation in neuronal networks: reconciling different perspectives on neural coding

The dichotomy of asynchronous and synchronous propagation in FFNs is reviewed, their integration into a single extended conceptual framework is proposed and experimental strategies to test the hypothesis are suggested.

Noise Tolerance of Attractor and Feedforward Memory Models

Comparing the performance of two prominent classes of memory networks, feedback-based attractor networks and feedforward networks, in conveying information about the amplitude of a briefly presented stimulus in the presence of gaussian noise suggests conditions under which attractor or feed forward networks may be best suited to storing information about previous stimuli.

Weak pairwise correlations imply strongly correlated network states in a neural population

It is shown, in the vertebrate retina, that weak correlations between pairs of neurons coexist with strongly collective behaviour in the responses of ten or more neurons, and it is found that this collective behaviour is described quantitatively by models that capture the observed pairwise correlations but assume no higher-order interactions.