Neural coding

Uses your system voice; voice and rate in settings.

Snapshot

≈ 7 min read

Names in other languages

No names in other languages are held for this entry yet.

Article bodies are English and are not machine-translated. A name in another language is not a translation of the article.

Neural coding (or neural representation) refers to the relationship between a stimulus and its respective neuronal responses, and the signalling relationships among networks of neurons in an ensemble. Action potentials, which act as the primary carrier of information in biological neural networks, are generally uniform regardless of the type of stimulus or the specific type of neuron. The simplicity of action potentials as a methodology of encoding information factored with the indiscriminate process of summation is seen as discontiguous with the specification capacity that neurons demonstrate at the presynaptic terminal, as well as the broad ability for complex neuronal processing and regional specialisation for which the brain-wide integration of such is seen as fundamental to complex derivations; such as intelligence, consciousness, complex social interaction, reasoning and motivation. As such, theoretical frameworks that describe encoding mechanisms of action potential sequences in relationship to observed patterns are seen as fundamental to neuroscientific understanding.

Neural coding (or neural representation) refers to the relationship between a stimulus and its respective neuronal responses, and the signalling relationships among networks of neurons in an ensemble. Action potentials, which act as the primary carrier of information in biological neural networks, are generally uniform regardless of the type of stimulus or the specific type of neuron. The simplicity of action potentials as a methodology of encoding information factored with the indiscriminate process of summation is seen as discontiguous with the specification capacity that neurons demonstrate at the presynaptic terminal, as well as the broad ability for complex neuronal processing and regional specialisation for which the brain-wide integration of such is seen as fundamental to complex derivations; such as intelligence, consciousness, complex social interaction, reasoning and motivation. As such, theoretical frameworks that describe encoding mechanisms of action potential sequences in relationship to observed patterns are seen as fundamental to neuroscientific understanding. The spike-count rate, also referred to as temporal average, is obtained by counting the number of spikes that appear during a trial and dividing by the duration of trial. The length T of the time window is set by the experimenter and depends on the type of neuron recorded from and to the stimulus. In practice, to get sensible averages, several spikes should occur within the time window. Typical values are T = 100 ms or T = 500 ms, but the duration may also be longer or shorter (Chapter 1.5 in the textbook 'Spiking Neuron Models' ). The spike-count rate can be determined from a single trial, but at the expense of losing all temporal resolution about variations in neural response during the course of the trial. Temporal averaging can work well in cases where the stimulus is constant or slowly varying and does not require a fast reaction of the organism — and this is the situation usually encountered in experimental protocols. Real-world input, however, is hardly stationary, but often changing on a fast time scale. For example, even when viewing a static image, humans perform saccades, rapid changes of the direction of gaze. The image projected onto the retinal photoreceptors changes therefore every few hundred milliseconds (Chapter 1.5 in ) Despite its shortcomings, the concept of a spike-count rate code is widely used not only in experiments, but also in models of neural networks. It has led to the idea that a neuron transforms information about a single input variable (the stimulus strength) into a single continuous output variable (the firing rate). There is a growing body of evidence that in Purkinje neurons, at least, information is not simply encoded in firing but also in the timing and duration of non-firing, quiescent periods. There is also evidence from retinal cells, that information is encoded not only in the firing rate but also in spike timing. More generally, whenever a rapid response of an organism is required a firing rate defined as a spike-count over a few hundred milliseconds is simply too slow.

Correlation coding

The correlation coding model of neuronal firing claims that correlations between action potentials, or "spikes", within a spike train may carry additional information above and beyond the simple timing of the spikes. Early work suggested that correlation between spike trains can only reduce, and never increase, the total mutual information present in the two spike trains about a stimulus feature. However, this was later demonstrated to be incorrect. Correlation structure can increase information content if noise and signal correlations are of opposite sign. Correlations can also carry information not present in the average firing rate of two pairs of neurons. A good example of this exists in the pentobarbital-anesthetized marmoset auditory cortex, in which a pure tone causes an increase in the number of correlated spikes, but not an increase in the mean firing rate, of pairs of neurons. More formally, given a k-dimensional set of real-numbered input vectors \vec{\xi }\in \mathbb{R}^{k} , the goal of sparse coding is to determine n k-dimensional basis vectors \vec{b_1}, \ldots, \vec{b_n} \in \mathbb{R}^{k} , corresponding to neuronal receptive fields, along with a sparse n-dimensional vector of weights or coefficients \vec{s} \in \mathbb{R}^{n} for each input vector, so that a linear combination of the basis vectors with proportions given by the coefficients results in a close approximation to the input vector: \vec{\xi} \approx \sum_{j=1}^{n} s_{j}\vec{b}_{j} . The codings generated by algorithms implementing a linear generative model can be classified into codings with soft sparseness and those with hard sparseness. These refer to the distribution of basis vector coefficients for typical inputs. A coding with soft sparseness has a smooth Gaussian-like distribution, but peakier than Gaussian, with many zero values, some small absolute values, fewer larger absolute values, and very few very large absolute values. Thus, many of the basis vectors are active. Hard sparseness, on the other hand, indicates that there are many zero values, no or hardly any small absolute values, fewer larger absolute values, and very few very large absolute values, and thus few of the basis vectors are active. This is appealing from a metabolic perspective: less energy is used when fewer neurons are firing. Another measure of coding is whether it is critically complete or overcomplete. If the number of basis vectors n is equal to the dimensionality k of the input set, the coding is said to be critically complete. In this case, smooth changes in the input vector result in abrupt changes in the coefficients, and the coding is not able to gracefully handle small scalings, small translations, or noise in the inputs. If, however, the number of basis vectors is larger than the dimensionality of the input set, the coding is overcomplete. Overcomplete codings smoothly interpolate between input vectors and are robust under input noise. The human primary visual cortex is estimated to be overcomplete by a factor of 500, so that, for example, a 14 x 14 patch of input (a 196-dimensional space) is coded by roughly 100,000 neurons. Other models are based on matching pursuit, a sparse approximation algorithm which finds the "best matching" projections of multidimensional data, and dictionary learning, a representation learning method which aims to find a sparse matrix representation of the input data in the form of a linear combination of basic elements as well as those basic elements themselves.

Text derived from https://en.wikipedia.org/w/index.php?oldid=1374681090 under CC BY-SA 4.0; modifications have been made.

Sources cited in this revision

23 named source(s) extracted from the cited revision. A source with no author is shown by its publication; nothing is invented.