The theta model (otherwise known as the Ermentrout-Kopell canonical model) is a "biological neuron model" originally used to model neurons in the animal Aplysia, but later became useful in various fields of computational neuroscience. The model is particularly well suited to (mathematically) describe a process involving a rapid change in membrane potential, known as bursts. Bursts are often found in neurons that are responsible for controlling and maintaining steady rhythms; for example, breathing is controlled by a small network of bursting neurons in the brain stem. Of the three main classes of bursting neurons (square wave bursting, parabolic bursting, and elliptic bursting),[1][2] the theta model describes parabolic bursting. Parabolic bursting is characterized by a series of bursts that are modulated by a slower, underlying oscillation,[3] where the slower oscillation periodically inhibits bursting so that bursts are separated by periods of quiescence.
The model has just one state variable, as opposed to four in the Hodgkin-Huxley model and two in the Morris-Lecar model.[4] This single state variable and the simple equations that govern its behavior make it relatively easy to produce analytic, or closed-form, solutions (including an explicit expression for the phase response curve). The dynamics of the model take place on the unit circle and are governed by two cosine functions and a real-valued input function.[5]
Similar models include the quadratic integrate and fire (QIF) model, which differs from the theta model by only by a change of variables[6][7][8][9][10] and Plant's model,[11] which consists of Hodkin-Huxley type equations and differs from the theta model by a series of coordinate transformations.[12]
Despite its simplicity, the theta model offers enough complexity in its dynamics that it has been used for theoretical neuroscience research[13][14] as well as in research beyond biology, such as in artificial intelligence.[15]
Contents |
Bursting is "an oscillation in which an observable [part] of the system, such as voltage or chemical concentration, changes periodically between an active phase of rapid spike oscillations (the fast sub-system) and a phase of quiescence".[16] Bursting comes in three distinct forms: square wave bursting, parabolic bursting, and elliptic bursting.[17][18] There exist some models that do not fit neatly into these categories by qualitative observation, but it is possible to sort such models by their topology (i.e. such models can be sorted "by the structure of the fast subsystem").[19]
All three forms of bursting are capable of beating and periodic bursting.[20] Periodic bursting (or just bursting) is of more interest because many phenomena are controlled by, or arise from, bursting. For example, bursting due to a changing membrane potential is common in various neurons, including but not limited to cortical chattering neurons, thalamacortical neurons,[21] and pacemaker neurons. Pacemakers in general are known to burst and synchronize as a population, thus generating a robust rhythm that can maintain repetitive tasks like breathing, walking, and eating.[22][23] Beating occurs when a cell bursts continuously with no periodic quiescent periods,[24] but beating is often considered to be an extreme case and is rarely of primary interest.
Bursting cells are important for motor generation and synchronization.[25] For example, the pre-Bötzinger complex in the mammalian brain stem contains many bursting neurons that control autonomous breathing rhythms.[26][27] Various [[Neocortex|neocortical neurons (i.e. cells of the neocortex) are capable of bursting, which "contribute significantly to [the] network behavior [of neocortical neurons]".[28] The R15 neuron of the abdominal ganglion in Aplyisa, hypothesized to be a [pneurosecretory[] cell (i.e. a cell that produces hormones), is known to produce bursts characteristic of neurosecretory cells.[29] In particular, it is known to produce parabolic bursts.
Since many biological processes involve bursting behavior, there is a wealth of various bursting models in scientific literature. For instance, there exist several models for interneurons[30] and cortical spiking neurons.[31] However, the literature on parabolic bursting models is relatively scarce.
Parabolic bursting models are mathematical models that mimic parabolic bursting in real biological systems. Each burst of a parabolic burster has a characteristic feature in the burst structure itself - the frequency at the beginning and end of the burst is low relative to the frequency in the middle of the burst.[32] A frequency plot of one burst resembles a parabola, hence the name "parabolic burst". Furthermore, unlike elliptic or square-wave bursting, there is a slow modulating wave which, at its peak, excites the cell enough to generate a burst and inhibits the cell in regions near its minimum. As a result, the neuron periodically transitions between bursting and quiescence.
Parabolic bursting has been studied most extensively in the R15 neuron, which is one of six types of neurons of the Aplysia abdominal ganglion[33] and one of thirty neurons comprising the abdominal ganglion.[34] The Aplysia abdominal ganglion was studied and extensively characterized because its relatively large neurons and proximity of the neurons to the surface of the ganglion made it an ideal and "valuable preparation for cellular electrophysical studies".[35]
Early attempts to model parabolic bursting were for specific applications, often related to studies of the R15 neuron. This is especially true of R. E. Plant[36][37] and Carpenter,[38] whose combined works comprise the bulk of parabolic bursting models prior to Ermentrout and Kopell's canonical model.
Though there was no specific mention of the term "parabolic bursting" in Plant's papers, Plant's model(s) do involve a slow, modulating oscillation which control bursting in the model(s).[39][40] This is, by definition, parabolic bursting. Both of Plant's papers on the topic involve a model derived from the Hodgkin-Huxley equations and include extra conductances, which only add to the complexity of the model.
Carpenter developed her model primarily for a square wave burster.[41] The model was capable of producing a small variety of square wave bursts and produced parabolic bursts as a consequence of adding an extra conductance. However, the model applied to only spacial propagation down axons and not situations where oscillations are limited to a small region in space (i.e. it was not suited for "space-clamped" situations).
The lack of a simple, generalizable, space-clamped, parabolic bursting model motivated Ermentrout and Kopell to develop the theta model.
It is possible to describe very many types of parabolic bursting cells by deriving a very simple mathematical model, called a canonical model. Derivation of the Ermentrout and Kopell canonical model will begin with the general form for parabolic bursting, and notation will be fixed to clarify the discussion. The letters , , , are reserved for functions; , , for state variables (which may be vectors whose entries are state variables); and , , and other letters for scalars.
In the following generalized system of equations for parabolic bursting, the values of describe the membrane potential and ion channels, typical of many conductance-based biological neuron models. Slow oscillations are controlled by (and so ultimately controlled by ). These slow oscillations can be, for example, slow fluctuations in calcium concentration inside a cell. The function couples to , thereby allowing the second system, , to influence the behavior of the first system, . In more succinct terms, " generates the spikes and generates the slow waves".[42] The equations are:
,
,
where is a vector with entries (i.e. ), is a vector with entries (i.e. ), is small and positive, and , , are smooth (i.e. infinitely differentiable).[43] Additional constraints are required to guarantee parabolic bursting. First, must produce a circle in phase space that is invariant, meaning it does not change under certain transformations. This circle must also be attracting in with a critical point located at . The second criterion requires that when , there exists a stable limit cycle solution. These criteria can be summarized by the following points:
Under these assumptions, the generalized system of equations for parabolic bursters converge to the theta model.
The theta model is a reduction of the generalized system from the previous section and takes the form
.
This model is one of the simplest excitable neuron models.[45] The state variable represents the angle in radians, and the input function, , is typically periodic. Whenever is at a particular angle (namely ), the model produces a spike.[46][47]
The theta model is capable of a single [[Saddle-node_bifurcation|saddle-node] bifurcation and can be shown to be the "normal form for the saddle-node on a limit cycle bifurcation" (SNIC).[48] When , the system is excitable (i.e. given an appriate perturbation the system will produce a spike). When viewed in the [pPlane_(geometry)|plane]] (), the unstable critical point is actually a saddle point because is attracting in . On the other hand, when , is also positive, and the system will give rise to a limit cycle. Therefore, the bifurcation point is located at .
Near the bifurcation point, the theta model resembles the quadratic integrate-and-fire model:
.
For I > 0, the solutions "blow up" rather quickly. By resetting the trajectory to when it reaches , the total period is then
.
Therefore, the period diverges as and the frequency converges to zero.[49]
When is some slow wave which can be both negative and positive, the system is capable of producing parabolic bursts. Consider the simple example , where is relatively small. Then for , is strictly positive and makes multiple passes through the angle , resulting in multiple bursts. Note that whenever is near zero or , the theta neuron will spike at relatively a low frequency, and whenever is near the neuron will spike with very high frequency. When , the frequency of spikes is zero since the period is infinite since can no longer pass through . Finally, for , the neuron is excitable and will no longer burst. This qualitative description highlights the characteristics that make the theta model a parabolic bursting model. Not only does the model have periods of quiescence between bursts which are modulated by a slow wave, but the frequency of spikes at the beginning and end of each burst is high relative to the frequency at the middle of the burst.
The derivation comes in the form of two lemmas in Ermentrout and Kopell (1986). Lemma 1, in summary, states that when viewing the general equations above in a subset , the equations take the form:
,
.
By lemma 2 in Ermentrout and Kopell 1986, "There exists a change of coordinates... and a constant, c, such that in new coordinates, the two equations above converge pointwise as to the equations
,
,
for all . Convergence is uniform except near ." (Ermentrout and Kopell, 1986). By letting , resemblance to the theta model is obvious.
In general, given a scalar phase model of the form
,
where represents the purturbation current, it is possible to derive a closed form solution for the phase response curve (PRC).
The theta model is a special case of such an oscillator, so it is easy to produce a closed-form solution for the PRC. The theta model is recovered by defining and as
,
.
In the appendix of Ermentrout 1996, the PRC is shown to be .
The authors of Soto-Treviño et. al. (1996) discuss in great detail the similarities between Plant's (1976) model and the theta model. At first glance, the mechanisms of bursting in both systems are very different: In Plant's model, there are two slow oscillations - one for conductance of a specific current and one for the concentration of calcium. The calcium oscillations are active only when the membrane potential is capable of oscillating. This contrasts heavily against the theta model in which one slow wave modulates the burst of the neuron and the slow wave has no dependence upon the bursts. Despite these differences, the theta model is shown to have the same "mathematical mechanics" as Plant's (1976) model by a series of coordinate transformations. In the process, Soto-Trevino, et al. discovered that the theta model was more general than originally believed.
The quadratic integrate-and-fire (QIF) model was created by Latham et. al. in 2000 to explore the many questions related to networks of neurons with low firing rates.[50] It was unclear to Latham et. al. why networks of neurons with "standard" parameters were unable to generate sustained low frequency firing rates, while networks with low firing rates were often seen in biological systems.
According to Gerstner and Kistler (2002), the quadratic integrate-and-fire (QIF) model is given by the following differential equation:
,
where is a strictly positive scalar, is the membrane potential, is the resting potential is the minimum potential necessary for the membrane to produce an action potential, is the membrane resistance, the membrane time constant and .[51] When there is no input current (i.e. ), the membrane potential quickly returns to rest following a perturbation. When the input current, , is large enough, the membrane potential () surpasses its firing threshold and rises rapidly (indeed, it reaches arbitrarily large values in finite time); this represents the peak of the action potential. To simulate the recovery after the action potential, the membrane voltage is then reset to a lower value . To avoid dealing with arbitrarily large values in simulation, researchers will often set an upper limit on the membrane potential, above which the membrane potential will be reset; for exampel Latham et. al. (2000) reset the voltage from mV to mV.[52] This voltage reset constitutes an action potential.
The theta model is very similar to the QIF model since the theta model differs from the QIF model by means of a simple coordinate transform.[53][54] By scaling the voltage appropriately and letting be the change in current from the minimum current required to elicit a spike, the QIF model can be rewritten in the form
.
Similarly, the theta model can be rewritten as
.
The following proof will show that the QIF model becomes the theta model given an appropriate choice for the coordinate transform.
Define . Recall that , so taking the derivative yields
.
An additional substitution and rearranging in terms of yields
.
Using the trigonometric identities , and as defined above, we have that
.
Therefore, there exists a change of coordinates, namely , which transforms the QIF model into the theta model. The reverse transformation also exists, and is attained by taking the inverse of the first transformation.
Though the theta model was originally used to model slow cytoplasmic oscillations that modulate fast membrane oscillations in a single cell, Ermentrout and Kopell found that the theta model could be applied just as easily to systems of two electrically coupled cells such that the slow oscillations of one cell modulates the bursts of the other.[55] Such cells serve as the central pattern generator (CPG) of the pyloric system in the lobster stomatograstic ganglion.[56] In such a system, a slow oscillator, called the anterior burster (AB) cell, modulates the bursting cell called the pyloric dilator (PD), resulting in parabolic bursts.[57]
A group lead by Boergers,[58] used the theta model to explain why exposure to multiple simultaneous stimuli can reduce the response of the visual cortex below the normal response from a single (preferred) stimulus. Their computational results showed that this may happen due to strong stimulation of a large group of inhibitory neurons. This effect not only inhibits neighboring populations, but has the extra consequence of leaving the inhibitory neurons in disarray, thus increasing the effectiveness of inhibition.
Osan et. al. (2002) found that in a network of theta neurons, there exist two different types of waves that propagate smoothly over the network, given a sufficiently large coupling strength.[59] Such traveling waves are of interest because they are frequently observed in pharmacologically treated brain slices, but are hard to measure in intact animals brains.[60] The authors used a network of theta models in favor of a network of leaky integrate-and-fire (LIF) models due to two primary advantages: first, the theta model is continuous, and second, the theta model retains information about "the delay between the crossing of the spiking threshold and the actual firing of an action potential". The LIF fails to satisfy both conditions.
The theta model can also be applied to research beyond the ream of biology. McKennoch et. al. (2008) derived a steepest gradient descent [Association_rule_learning|learning rule]] based on theta neuron dynamics.[61] Their model is based on the assumption that "intrinsic neuron dynamics are sufficient to achieve consistent time coding, with no need to involve the precise shape of postsynaptic currents..." contrary to similar models like SpikeProp and Tempotron, which depend heavily on the shape of the postsynaptic potential (PSP). Not only could the multilayer theta network perform just about as well as Tempotron learning, but the rule trained the multilayer theta network to perform certain tasks neither SpikeProp nor Tempotron were capable of.
According to Kopell and Ermentrout (2004), a limitation of the theta lies in its relative difficulty in electrically coupling two theta neurons. It is possible to create large networks of theta neurons - and much research has been done with such networks - but it may be advantageous to use Quadratic Integrate-and-Fire (QIF) neurons, which allow for electrical coupling in a "straightforward way".[62]