BCM theory

Last updated

BCM theory, BCM synaptic modification, or the BCM rule, named for Elie Bienenstock, Leon Cooper, and Paul Munro, is a physical theory of learning in the visual cortex developed in 1981. The BCM model proposes a sliding threshold for long-term potentiation (LTP) or long-term depression (LTD) induction, and states that synaptic plasticity is stabilized by a dynamic adaptation of the time-averaged postsynaptic activity. According to the BCM model, when a pre-synaptic neuron fires, the post-synaptic neurons will tend to undergo LTP if it is in a high-activity state (e.g., is firing at high frequency, and/or has high internal calcium concentrations), or LTD if it is in a lower-activity state (e.g., firing in low frequency, low internal calcium concentrations). [1] This theory is often used to explain how cortical neurons can undergo both LTP or LTD depending on different conditioning stimulus protocols applied to pre-synaptic neurons (usually high-frequency stimulation, or HFS, for LTP, or low-frequency stimulation, LFS, for LTD). [2]

Contents

Development

In 1949, Donald Hebb proposed a working mechanism for memory and computational adaption in the brain now called Hebbian learning, or the maxim that cells that fire together, wire together. [3] This notion is foundational in the modern understanding of the brain as a neural network, and though not universally true, remains a good first approximation supported by decades of evidence. [3] [4]

However, Hebb's rule has problems, namely that it has no mechanism for connections to get weaker and no upper bound for how strong they can get. In other words, the model is unstable, both theoretically and computationally. Later modifications gradually improved Hebb's rule, normalizing it and allowing for decay of synapses, where no activity or unsynchronized activity between neurons results in a loss of connection strength. New biological evidence brought this activity to a peak in the 1970s, where theorists formalized various approximations in the theory, such as the use of firing frequency instead of potential in determining neuron excitation, and the assumption of ideal and, more importantly, linear synaptic integration of signals. That is, there is no unexpected behavior in the adding of input currents to determine whether or not a cell will fire.

These approximations resulted in the basic form of BCM below in 1979, but the final step came in the form of mathematical analysis to prove stability and computational analysis to prove applicability, culminating in Bienenstock, Cooper, and Munro's 1982 paper.

Since then, experiments have shown evidence for BCM behavior in both the visual cortex and the hippocampus, the latter of which plays an important role in the formation and storage of memories. Both of these areas are well-studied experimentally, but both theory and experiment have yet to establish conclusive synaptic behavior in other areas of the brain. It has been proposed that in the cerebellum, the parallel-fiber to Purkinje cell synapse follows an "inverse BCM rule", meaning that at the time of parallel fiber activation, a high calcium concentration in the Purkinje cell results in LTD, while a lower concentration results in LTP. [2] Furthermore, the biological implementation for synaptic plasticity in BCM has yet to be established. [5]

Theory

The basic BCM rule takes the form

where:

This model is a modified form of the Hebbian learning rule, , and requires a suitable choice of function to avoid the Hebbian problems of instability.

Bienenstock at al. [6] rewrite as a function where is the time average of . With this modification and discarding the uniform decay the rule takes the vectorial form:

The conditions for stable learning are derived rigorously in BCM noting that with and with the approximation of the average output , it is sufficient that

or equivalently, that the threshold , where and are fixed positive constants. [6]

When implemented, the theory is often taken such that

where is a time constant of selectivity.

The model has drawbacks, as it requires both long-term potentiation and long-term depression, or increases and decreases in synaptic strength, something which has not been observed in all cortical systems. Further, it requires a variable activation threshold and depends strongly on stability of the selected fixed points and . However, the model's strength is that it incorporates all these requirements from independently derived rules of stability, such as normalizability and a decay function with time proportional to the square of the output. [7]

Example

This example is a particular case of the one at chapter "Mathematical results" of Bienenstock at al. [6] work, assuming and . With these values and we decide that fulfills the stability conditions said in previous chapter.

Assume two presynaptic neurons that provides inputs and , its activity a repetitive cycle with half of time and remainder time . time average will be the average of value in first and second half of a cycle.

Let initial value of weights . In the first half of time and , the weighted sum is equal to 0.095 and we use same value as initial average . That means , , . Adding 10% of the derivative to the weights we obtain new ones .

In next half of time, inputs are and weights . That means , of full cycle is 0.075, , , . Adding 10% of the derivative to the weights we obtain new ones .

Repeating previous cycle we obtain, after several hundred of iterations, that stability is reached with , (first half) and (remainder time), , , and .

Note how, as predicted, the final weight vector has become orthogonal to one of the input patterns, being the final values of in both intervals zeros of the function .

Experiment

The first major experimental confirmation of BCM came in 1992 in investigating LTP and LTD in the hippocampus. Serena Dudek's experimental work showed qualitative agreement with the final form of the BCM activation function. [8] This experiment was later replicated in the visual cortex, which BCM was originally designed to model. [9] This work provided further evidence of the necessity for a variable threshold function for stability in Hebbian-type learning (BCM or others).

Experimental evidence has been non-specific to BCM until Rittenhouse et al. confirmed BCM's prediction of synapse modification in the visual cortex when one eye is selectively closed. Specifically,

where describes the variance in spontaneous activity or noise in the closed eye and is time since closure. Experiment agreed with the general shape of this prediction and provided an explanation for the dynamics of monocular eye closure (monocular deprivation) versus binocular eye closure. [10] The experimental results are far from conclusive, but so far have favored BCM over competing theories of plasticity.

Applications

While the algorithm of BCM is too complicated for large-scale parallel distributed processing, it has been put to use in lateral networks with some success. [11] Furthermore, some existing computational network learning algorithms have been made to correspond to BCM learning. [12]

Related Research Articles

Spherical coordinate system 3-dimensional coordinate system

In mathematics, a spherical coordinate system is a coordinate system for three-dimensional space where the position of a point is specified by three numbers: the radial distance of that point from a fixed origin, its polar angle measured from a fixed zenith direction, and the azimuthal angle of its orthogonal projection on a reference plane that passes through the origin and is orthogonal to the zenith, measured from a fixed reference direction on that plane. It can be seen as the three-dimensional version of the polar coordinate system.

In linear algebra, two vectors in an inner product space are orthonormal if they are orthogonal unit vectors. A set of vectors form an orthonormal set if all vectors in the set are mutually orthogonal and all of unit length. An orthonormal set which forms a basis is called an orthonormal basis.

Spherical harmonics Special mathematical functions defined on the surface of a sphere

In mathematics and physical science, spherical harmonics are special functions defined on the surface of a sphere. They are often employed in solving partial differential equations in many scientific fields.

The Klein–Gordon equation is a relativistic wave equation, related to the Schrödinger equation. It is second-order in space and time and manifestly Lorentz-covariant. It is a quantized version of the relativistic energy–momentum relation. Its solutions include a quantum scalar or pseudoscalar field, a field whose quanta are spinless particles. Its theoretical relevance is similar to that of the Dirac equation. Electromagnetic interactions can be incorporated, forming the topic of scalar electrodynamics, but because common spinless particles like the pions are unstable and also experience the strong interaction the practical utility is limited.

Linear elasticity is a mathematical model of how solid objects deform and become internally stressed due to prescribed loading conditions. It is a simplification of the more general nonlinear theory of elasticity and a branch of continuum mechanics.

Hebbian theory is a neuroscientific theory claiming that an increase in synaptic efficacy arises from a presynaptic cell's repeated and persistent stimulation of a postsynaptic cell. It is an attempt to explain synaptic plasticity, the adaptation of brain neurons during the learning process. It was introduced by Donald Hebb in his 1949 book The Organization of Behavior. The theory is also called Hebb's rule, Hebb's postulate, and cell assembly theory. Hebb states it as follows:

Let us assume that the persistence or repetition of a reverberatory activity tends to induce lasting cellular changes that add to its stability. ... When an axon of cell A is near enough to excite a cell B and repeatedly or persistently takes part in firing it, some growth process or metabolic change takes place in one or both cells such that A’s efficiency, as one of the cells firing B, is increased.

In neuroscience, synaptic plasticity is the ability of synapses to strengthen or weaken over time, in response to increases or decreases in their activity. Since memories are postulated to be represented by vastly interconnected neural circuits in the brain, synaptic plasticity is one of the important neurochemical foundations of learning and memory.

In neurophysiology, long-term depression (LTD) is an activity-dependent reduction in the efficacy of neuronal synapses lasting hours or longer following a long patterned stimulus. LTD occurs in many areas of the CNS with varying mechanisms depending upon brain region and developmental progress.

This is a list of some vector calculus formulae for working with common curvilinear coordinate systems.

The solar zenith angle is the angle between the sun’s rays and the vertical direction. It is closely related to the solar altitude angle, which is the angle between the sun’s rays and a horizontal plane. Since these two angles are complementary, the cosine of either one of them equals the sine of the other. They can both be calculated with the same formula, using results from spherical trigonometry. At solar noon, the zenith angle is at a minimum and is equal to latitude minus solar declination angle. This is the basis by which ancient mariners navigated the oceans.

Electric flux Measure of electric field through surface

In electromagnetism, electric flux is the measure of the electric field through a given surface, although an electric field in itself cannot flow. It is a way of describing the electric field strength at any distance from the charge causing the field.

Schaffer collaterals are axon collaterals given off by CA3 pyramidal cells in the hippocampus. These collaterals project to area CA1 of the hippocampus and are an integral part of memory formation and the emotional network of the Papez circuit, and of the hippocampal trisynaptic loop. It is one of the most studied synapses in the world and named after the Hungarian anatomist-neurologist Károly Schaffer.

Metaplasticity is a term originally coined by W.C. Abraham and M.F. Bear to refer to the plasticity of synaptic plasticity. Until that time synaptic plasticity had referred to the plastic nature of individual synapses. However this new form referred to the plasticity of the plasticity itself, thus the term meta-plasticity. The idea is that the synapse's previous history of activity determines its current plasticity. This may play a role in some of the underlying mechanisms thought to be important in memory and learning such as long-term potentiation (LTP), long-term depression (LTD) and so forth. These mechanisms depend on current synaptic "state", as set by ongoing extrinsic influences such as the level of synaptic inhibition, the activity of modulatory afferents such as catecholamines, and the pool of hormones affecting the synapses under study. Recently, it has become clear that the prior history of synaptic activity is an additional variable that influences the synaptic state, and thereby the degree, of LTP or LTD produced by a given experimental protocol. In a sense, then, synaptic plasticity is governed by an activity-dependent plasticity of the synaptic state; such plasticity of synaptic plasticity has been termed metaplasticity. There is little known about metaplasticity, and there is much research currently underway on the subject, despite its difficulty of study, because of its theoretical importance in brain and cognitive science. Most research of this type is done via cultured hippocampus cells or hippocampal slices.

The magnitude condition is a constraint that is satisfied by the locus of points in the s-plane on which closed-loop poles of a system reside. In combination with the angle condition, these two mathematical expressions fully determine the root locus.

In special functions, a topic in mathematics, spin-weighted spherical harmonics are generalizations of the standard spherical harmonics and—like the usual spherical harmonics—are functions on the sphere. Unlike ordinary spherical harmonics, the spin-weighted harmonics are U(1) gauge fields rather than scalar fields: mathematically, they take values in a complex line bundle. The spin-weighted harmonics are organized by degree l, just like ordinary spherical harmonics, but have an additional spin weights that reflects the additional U(1) symmetry. A special basis of harmonics can be derived from the Laplace spherical harmonics Ylm, and are typically denoted by sYlm, where l and m are the usual parameters familiar from the standard Laplace spherical harmonics. In this special basis, the spin-weighted spherical harmonics appear as actual functions, because the choice of a polar axis fixes the U(1) gauge ambiguity. The spin-weighted spherical harmonics can be obtained from the standard spherical harmonics by application of spin raising and lowering operators. In particular, the spin-weighted spherical harmonics of spin weight s = 0 are simply the standard spherical harmonics:

In geometry, various formalisms exist to express a rotation in three dimensions as a mathematical transformation. In physics, this concept is applied to classical mechanics where rotational kinematics is the science of quantitative description of a purely rotational motion. The orientation of an object at a given instant is described with the same tools, as it is defined as an imaginary rotation from a reference placement in space, rather than an actually observed rotation from a previous placement in space.

In neuroscience and computer science, synaptic weight refers to the strength or amplitude of a connection between two nodes, corresponding in biology to the amount of influence the firing of one neuron has on another. The term is typically used in artificial and biological neural network research.

The multiphase particle-in-cell method (MP-PIC) is a numerical method for modeling particle-fluid and particle-particle interactions in a computational fluid dynamics (CFD) calculation. The MP-PIC method achieves greater stability than its particle-in-cell predecessor by simultaneously treating the solid particles as computational particles and as a continuum. In the MP-PIC approach, the particle properties are mapped from the Lagrangian coordinates to an Eulerian grid through the use of interpolation functions. After evaluation of the continuum derivative terms, the particle properties are mapped back to the individual particles. This method has proven to be stable in dense particle flows, computationally efficient, and physically accurate. This has allowed the MP-PIC method to be used as particle-flow solver for the simulation of industrial-scale chemical processes involving particle-fluid flows.

Linear optical quantum computing or linear optics quantum computation (LOQC) is a paradigm of quantum computation, allowing universal quantum computation. LOQC uses photons as information carriers, mainly uses linear optical elements, or optical instruments to process quantum information, and uses photon detectors and quantum memories to detect and store quantum information.

The Peierls substitution method, named after the original work by Rudolf Peierls is a widely employed approximation for describing tightly-bound electrons in the presence of a slowly varying magnetic vector potential.

References

  1. Izhikevich, Eugene M.; Desai, Niraj S. (2003-07-01). "Relating STDP to BCM". Neural Computation. 15 (7): 1511–1523. doi:10.1162/089976603321891783. ISSN   0899-7667. PMID   12816564. S2CID   1919612.
  2. 1 2 Coesmans, Michiel; Weber, John T.; Zeeuw, Chris I. De; Hansel, Christian (2004). "Bidirectional Parallel Fiber Plasticity in the Cerebellum under Climbing Fiber Control". Neuron. 44 (4): 691–700. doi: 10.1016/j.neuron.2004.10.031 . PMID   15541316. S2CID   9061314.
  3. 1 2 Principles of neural science. Kandel, Eric R. (5th ed.). New York. 2013. ISBN   978-0-07-139011-8. OCLC   795553723.{{cite book}}: CS1 maint: others (link)
  4. Markram, Henry; Gerstner, Wulfram; Sjöström, Per Jesper (2012). "Spike-Timing-Dependent Plasticity: A Comprehensive Overview". Frontiers in Synaptic Neuroscience. 4: 2. doi: 10.3389/fnsyn.2012.00002 . ISSN   1663-3563. PMC   3395004 . PMID   22807913.
  5. Cooper, L.N. (2000). "Memories and memory: A physicist's approach to the brain" (PDF). International Journal of Modern Physics A. 15 (26): 4069–4082. doi:10.1142/s0217751x0000272x . Retrieved 2007-11-11.
  6. 1 2 3 Bienenstock, Elie L.; Leon Cooper; Paul Munro (January 1982). "Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex" (PDF). The Journal of Neuroscience. 2 (1): 32–48. doi:10.1523/JNEUROSCI.02-01-00032.1982. PMC   6564292 . PMID   7054394 . Retrieved 2007-11-11.
  7. Intrator, Nathan (2006–2007). "The BCM theory of synaptic plasticity". Neural Computation. School of Computer Science, Tel-Aviv University. Retrieved 2007-11-11.
  8. Dudek, Serena M.; Mark Bear (1992). "Homosynaptic long-term depression in area CA1 of hippocampus and effects of N-methyl-D-aspartate receptor blockade" (PDF). Proc. Natl. Acad. Sci. 89 (10): 4363–4367. Bibcode:1992PNAS...89.4363D. doi: 10.1073/pnas.89.10.4363 . PMC   49082 . PMID   1350090 . Retrieved 2007-11-11.
  9. Kirkwood, Alfredo; Marc G. Rioult; Mark F. Bear (1996). "Experience-dependent modification of synaptic plasticity in rat visual cortex". Nature . 381 (6582): 526–528. Bibcode:1996Natur.381..526K. doi:10.1038/381526a0. PMID   8632826. S2CID   2705694.
  10. Rittenhouse, Cynthia D.; Harel Z. Shouval; Michael A. Paradiso; Mark F. Bear (1999). "Monocular deprivation induces homosynaptic long-term depression in visual cortex". Nature . 397 (6717): 347–50. Bibcode:1999Natur.397..347R. doi:10.1038/16922. PMID   9950426. S2CID   4302032.
  11. Intrator, Nathan (2006–2007). "BCM Learning Rule, Comp Issues" (PDF). Neural Computation. School of Computer Science, Tel-Aviv University. Retrieved 2007-11-11.
  12. Baras, Dorit; Ron Meir (2007). "Reinforcement Learning, Spike-Time-Dependent Plasticity, and the BCM Rule" (PDF). Neural Computation. 19 (8): 2245–2279. CiteSeerX   10.1.1.119.395 . doi:10.1162/neco.2007.19.8.2245. PMID   17571943. S2CID   40872097. 2561. Archived from the original (PDF) on 2011-07-21. Retrieved 2007-11-11.