Search PubMed⌕ Search

Biomedical subjects

P R Montague

Publications and source records attributed to P R Montague.

At least 19 recordsLinked to original sources

Predictability modulates human brain response to reward.

Certain classes of stimuli, such as food and drugs, are highly effective in activating reward regions. We show in humans that activity in these regions can be modulated by the predictability of the sequenced delivery of two mildly pleasurable stimuli, orally delivered fruit juice and water. Using functional magnetic resonance imaging, the activity for rewarding stimuli in both the nucleus accumbens and medial orbitofrontal cortex was greatest when the stimuli were unpredictable. Moreover, the subjects' stated preference for either juice or water was not directly correlated with activity in reward regions but instead was correlated with activity in sensorimotor cortex. For pleasurable stimuli, these findings suggest that predictability modulates the response of human reward regions, and subjective preference can be dissociated from this response.

Adolescent↗

LTD induction in adult visual cortex: role of stimulus timing and inhibition.

One Hertz stimulation of afferents for 15 min with constant interstimulus intervals (regular stimulation) can induce long-term depression (LTD) of synaptic strength in the neocortex. However, it is unknown whether natural patterns of low-frequency afferent spike activity induce LTD. Although neurons in the neocortex can fire at overall rates as low as 1 Hz, the intervals between spikes are irregular. This irregular spike activity (and thus, presumably, irregular activation of the synapses of that neuron onto postsynaptic targets) can be approximated by stimulation with Poisson-distributed interstimulus intervals (Poisson stimulation). Therefore, if low-frequency presynaptic spike activity in the intact neocortex is sufficient to induce a generalized LTD of synaptic transmission, then Poisson stimulation, which mimics this spike activity, should induce LTD in slices. We tested this hypothesis by comparing changes in the strength of synapses onto layer 2/3 pyramidal cells induced by regular and Poisson stimulation in slices from adult visual cortex. We find that regular stimulation induces LTD of excitatory synaptic transmission as assessed by field potentials and intracellular postsynaptic potentials (PSPs) with inhibition absent. However, Poisson stimulation does not induce a net LTD of excitatory synaptic transmission. When the PSP contained an inhibitory component, neither Poisson nor regular stimulation induced LTD. We propose that the short bursts of synaptic activity that occur during a Poisson train have potentiating effects that offset the induction of LTD that is favored with regular stimulation. Thus, natural (i.e., irregular) low-frequency activity in the adult neocortex in vivo should not consistently induce LTD.

Action Potentials↗

Extracellular calcium depletion as a mechanism of short-term synaptic depression.

Recent experiments have demonstrated that normal neural activity can cause significant decrements in external calcium levels, and that these decrements mediate a form of short-term synaptic depression. These findings raise the possibility that certain forms of short-term synaptic depression at glutamatergic synapses throughout the mammalian CNS may be influenced by similar changes in external calcium. We use a computational model of the extracellular space, combined with experimental data on calcium consumption, to show that such short-term depression can be accounted for by changes in calcium just outside active synapses, provided that external calcium diffusion is restricted. Remarkably, the model suggests the novel possibility that synapses may possess private pools of external calcium that enforce some forms of short-term depression in a synapse-specific manner.

Animals↗

Learning and selective attention.

Selective attention involves the differential processing of different stimuli, and has widespread psychological and neural consequences. Although computational modeling should offer a powerful way of linking observable phenomena at different levels, most work has focused on the relatively narrow issue of constraints on processing resources. By contrast, we consider statistical and informational aspects of selective attention, divorced from resource constraints, which are evident in animal conditioning experiments involving uncertain predictions and unreliable stimuli. Neuromodulatory systems and limbic structures are known to underlie attentional effects in such tasks.

Animals↗

Dendritic spikes and their influence on extracellular calcium signaling.

Extracellular calcium is critical for many neural functions, including neurotransmission, cell adhesion, and neural plasticity. Experiments have shown that normal neural activity is associated with changes in extracellular calcium, which has motivated recent computational work that employs such fluctuations in an information-bearing role. This possibility suggests that a new style of computing is taking place in the mammalian brain in addition to current 'circuit' models that use only neurons and connections. Previous computational models of rapid external calcium changes used only rough approximations of calcium channel dynamics to compute the expected calcium decrements in the extracellular space. Using realistic calcium channel models, experimentally measured back-propagating action potentials, and a model of the extracellular space, we computed the fluctuations in external calcium that accrue during neural activity. In this realistic setting, we showed that rapid, significant changes in local external calcium can occur when dendrites are invaded by back-propagating spikes, even in the presence of an extracellular calcium buffer. We further showed how different geometric arrangements of calcium channels or dendrites prolong or amplify these fluctuations. Finally, we computed the influence of experimentally measured synaptic input on peridendritic calcium fluctuations. Remarkably, appropriately timed synaptic input can amplify significantly the decrement in external calcium. The model shows that the extracellular space and the calcium channels that access it provide a medium that naturally integrates coincident spike activity from different dendrites that intersect the same tissue volume.

Algorithms↗

Calcium dynamics in the extracellular space of mammalian neural tissue.

In the brain, hundreds of intracellular processes are known to depend on calcium influx; hence any substantial fluctuation in external calcium ([Ca2+]o) is likely to engender important functional effects. Employing the known scales and parameters of mammalian neural tissue, we introduce and justify a computational approach to the hypothesis that large changes in local [Ca2+]o will be part of normal neural activity. Using this model, we show that the geometry of the extracellular space in combination with the rapid movement of calcium through ionic channels can cause large external calcium fluctuations, up to 100% depletion in many cases. The exact magnitude of a calcium fluctuation will depend on 1) the size of the consumption zone, 2) the local diffusion coefficient of calcium, and 3) the geometrical arrangement of the consuming elements. Once we have shown that using biologically relevant parameters leads to calcium changes, we focus on the signaling capacity of such concentration fluctuations. Given the sensitivity of neurotransmitter release to [Ca2+]o, the exact position and timing of neural activity will delimit the terminals that are able to release neurotransmitter. Our results indicate that mammalian neural tissue is engineered to generate significant changes in external calcium concentrations during normal activity. This design suggests that such changes play a role in neural information processing.

Animals↗

Computational properties of peri-dendritic calcium fluctuations.

Using a model of the extracellular space, we show how external calcium fluctuations, engendered during normal neural activity, can act as a rapid information-bearing signal in nervous systems. We demonstrate that action potentials propagating along a dendrite can induce large peri-dendritic calcium fluctuations, lowering significantly the external calcium available to overlying presynaptic terminals. The geometrical distribution of active calcium sinks critically influences the time and spatial extent of fluctuations in external calcium. In particular, clusters of coactive dendrites can prolong and amplify an external calcium fluctuation. This latter effect provides a natural substrate for a computational mechanism that locates specific volumes of neural tissue on rapid time scales. Such an interpretation suggests that the detailed structure of the extracellular space, in combination with the three-dimensional distribution of active calcium sinks, may play a role in neural information processing.

Action Potentials↗

A computational role for dopamine delivery in human decision-making.

Recent work suggests that fluctuations in dopamine delivery at target structures represent an evaluation of future events that can be used to direct learning and decision-making. To examine the behavioral consequences of this interpretation, we gave simple decision-making tasks to 66 human subjects and to a network based on a predictive model of mesencephalic dopamine systems. The human subjects displayed behavior similar to the network behavior in terms of choice allocation and the character of deliberation times. The agreement between human and model performances suggests a direct relationship between biases in human decision strategies and fluctuating dopamine delivery. We also show that the model offers a new interpretation of deficits that result when dopamine levels are increased or decreased through disease or pharmacological interventions. The bottom-up approach presented here also suggests that a variety of behavioral strategies may result from the expression of relatively simple neural mechanisms in different behavioral contexts.

Cerebral Cortex↗

Influences on the global structure of cortical maps.

Cortical maps often contain global spatial structure: however, theoretical accounts for their development have generally concentrated on reproducing only local structure. We show that the elastic net model of cortical map formation can closely approximate the global structure of the ocular dominance column map observed in macaque primary visual cortex. A key component is the assumption of spatially non-uniform and anisotropic correlations in the retina. This work shows how genetic and epigenetic effects could combine to establish characteristic global structure in cortical maps.

Animals↗

A neural substrate of prediction and reward.

The capacity to predict future events permits a creature to detect, model, and manipulate the causal structure of its interactions with its environment. Behavioral experiments suggest that learning is driven by changes in the expectations about future salient events such as rewards and punishments. Physiological work has recently complemented these studies by identifying dopaminergic neurons in the primate whose fluctuating output apparently signals changes or errors in the predictions of future salient and rewarding events. Taken together, these findings can be understood through quantitative theories of adaptive optimizing control.

Algorithms↗

The resource consumption principle: attention and memory in volumes of neural tissue.

In the cerebral cortex, the small volume of the extracellular space in relation to the volume enclosed by synapses suggests an important functional role for this relationship. It is well known that there are atoms and molecules in the extracellular space that are absolutely necessary for synapses to function (e.g., calcium). I propose here the hypothesis that the rapid shift of these atoms and molecules from extracellular to intrasynaptic compartments represents the consumption of a shared, limited resource available to local volumes of neural tissue. Such consumption results in a dramatic competition among synapses for resources necessary for their function. In this paper, I explore a theory in which this resource consumption plays a critical role in the way local volumes of neural tissue operate. On short time scales, this principle of resource consumption permits a tissue volume to choose those synapses that function in a particular context and thereby helps to integrate the many neural signals that impinge on a tissue volume at any given moment. On longer time scales, the same principle aids in the stable storage and recall of information. The theory provides one framework for understanding how cerebral cortical tissue volumes integrate, attend to, store, and recall information. In this account, the capacity of neural tissue to attend to stimuli is intimately tied to the way tissue volumes are organized at fine spatial scales.

Animals↗

A framework for mesencephalic dopamine systems based on predictive Hebbian learning.

We develop a theoretical framework that shows how mesencephalic dopamine systems could distribute to their targets a signal that represents information about future expectations. In particular, we show how activity in the cerebral cortex can make predictions about future receipt of reward and how fluctuations in the activity levels of neurons in diffuse dopamine systems above and below baseline levels would represent errors in these predictions that are delivered to cortical and subcortical targets. We present a model for how such errors could be constructed in a real brain that is consistent with physiological results for a subset of dopaminergic neurons located in the ventral tegmental area and surrounding dopaminergic neurons. The theory also makes testable predictions about human choice behavior on a simple decision-making task. Furthermore, we show that, through a simple influence on synaptic plasticity, fluctuations in dopamine release can act to change the predictions in an appropriate manner.

Animals↗

General properties of the resource consumption principle of neural function.

It has been proposed that volumes of neural tissue may represent important processing elements. This viewpoint suggests one way that populations of synaptic elements cooperate to implement important computational capacities. I extend this view by proposing a set of computational functions for the extracellular space shared by a local population of synapses. The critical hypothesis is the existence of a hypothetical 'fluid' resource present outside synapses that must be internalized in order for a synapse to function. I outline some of the consequences of assuming that such a resource is in limited supply on short time scales.

Animals↗

Bee foraging in uncertain environments using predictive hebbian learning.

Recent work has identified a neuron with widespread projections to odour processing regions of the honeybee brain whose activity represents the reward value of gustatory stimuli. We have constructed a model of bee foraging in uncertain environments based on this type of neuron and a predictive form of hebbian synaptic plasticity. The model uses visual input from a simulated three-dimensional world and accounts for a wide range of experiments on bee learning during foraging, including risk aversion. The predictive model shows how neuromodulatory influences can be used to bias actions and control synaptic plasticity in a way that goes beyond standard correlational mechanisms. Although several behavioural models of conditioning in bees have been proposed, this model is based on the neural substrate and was tested in a simulation of bee flight.

Animals↗