Biomedical subjects

E T Rolls

Publications and source records attributed to E T Rolls.

At least 19 recordsLinked to original sources

PubMed2006

Learning movement sequences with a delayed reward signal in a hierarchical model of motor function.

A key problem in reinforcement learning is how an animal is able to learn a sequence of movements when the reward signal only occurs at the end of the sequence. We describe how a hierarchical dynamical model of motor function is able to solve the problem of delayed reward in learning movement sequences using associative (Hebbian) learning. At the lowest level, the motor system encodes simple movements or primitives, while at higher levels the system encodes sequences of primitives. During training, the network is able to learn a high level motor program composed of a specific temporal sequence of motor primitives. The network is able to achieve this despite the fact that the reward signal, which indicates whether or not the desired motor program has been performed correctly, is received only at the end of each trial during learning. Use of a continuous attractor network in the architecture enables the network to generate the motor outputs required to produce the continuous movements necessary to implement the motor sequence.

Animals↗

PubMed2005

Learning invariant object recognition in the visual system with continuous transformations.

The cerebral cortex utilizes spatiotemporal continuity in the world to help build invariant representations. In vision, these might be representations of objects. The temporal continuity typical of objects has been used in an associative learning rule with a short-term memory trace to help build invariant object representations. In this paper, we show that spatial continuity can also provide a basis for helping a system to self-organize invariant representations. We introduce a new learning paradigm "continuous transformation learning" which operates by mapping spatially similar input patterns to the same postsynaptic neurons in a competitive learning system. As the inputs move through the space of possible continuous transforms (e.g. translation, rotation, etc.), the active synapses are modified onto the set of postsynaptic neurons. Because other transforms of the same stimulus overlap with previously learned exemplars, a common set of postsynaptic neurons is activated by the new transforms, and learning of the new active inputs onto the same postsynaptic neurons is facilitated. We demonstrate that a hierarchical model of cortical processing in the ventral visual system can be trained with continuous transform learning, and highlight differences in the learning of invariant representations to those achieved by trace learning.

Computer Simulation↗

PubMed2005

The primate amygdala: Neuronal representations of the viscosity, fat texture, temperature, grittiness and taste of foods.

The primate amygdala is implicated in the control of behavioral responses to foods and in stimulus-reinforcement learning, but only its taste representation of oral stimuli has been investigated previously. Of 1416 macaque amygdala neurons recorded, 44 (3.1%) responded to oral stimuli. Of the 44 orally responsive neurons, 17 (39%) represent the viscosity of oral stimuli, tested using carboxymethyl-cellulose in the range 1-10,000 cP. Two neurons (5%) responded to fat in the mouth by encoding its texture (shown by the responses of these neurons to a range of fats, and also to non-fat oils such as silicone oil ((Si(CH(3))(2)O)(n)) and mineral oil (pure hydrocarbon), but no or small responses to the cellulose viscosity series or to the fatty acids linoleic acid and lauric acid). Of the 44 neurons, three (7%) responded to gritty texture (produced by microspheres suspended in cellulose). Eighteen neurons (41%) responded to the temperature of liquid in the mouth. Some amygdala neurons responded to capsaicin, and some to fatty acids (but not to fats in the mouth). Some amygdala neurons respond to taste, texture and temperature unimodally, but others combine these inputs. These results provide fundamental evidence about the information channels used to represent the texture and flavor of food in a part of the brain important in appetitive responses to food and in learning associations to reinforcing oral stimuli, and are relevant to understanding the physiological and pathophysiological processes related to food intake, food selection, and the effects of variety of food texture in combination with taste and other inputs on food intake.

Action Potentials↗

PubMed2005

The primate amygdala and reinforcement: a dissociation between rule-based and associatively-mediated memory revealed in neuronal activity.

To investigate the role of the primate amygdala in stimulus-reinforcement association learning, the activity of single amygdala neurons was recorded in macaques during two memory tasks. In a visual discrimination task, a population of neurons (17/659) was analyzed which responded differentially to a visual stimulus which always indicated that the primary reinforcer fruit juice could be obtain if the monkey licked, and a different visual stimulus that indicated that the primary reinforcer aversive saline would be obtained if the monkey licked. Most (16/17) of these neurons responded more to the reward-related than the aversive visual stimulus. In a recognition memory task, the majority (12/14 analyzed) of these neurons responded equally well to the trial unique stimuli when they were shown as novel and the monkey had to not lick in order to avoid saline, and when they were shown a second time as familiar and the monkey used the rule that if he licked, fruit juice would be obtained. The responses of these amygdala neurons thus reflect the direct associations of stimuli with reinforcement, but do not reflect the reward value of the stimuli when this must be assessed based on a rule (in the recognition memory task, that a stimulus will be punished the first time it is shown, and rewarded the second). This finding also shows that these amygdala neurons respond to relatively novel stimuli in the same way as they do to stimuli that have become rewarding by stimulus-reinforcement association learning. This provides a neural basis for relatively novel stimuli to be treated as rewarding, and approached.

Acoustic Stimulation↗

PubMed2005

Self-organizing continuous attractor network models of hippocampal spatial view cells.

Single neuron recording studies have demonstrated the existence of hippocampal spatial view neurons which encode information about the spatial location at which a primate is looking in the environment. These neurons are able to maintain their firing even in the absence of visual input. The standard neuronal network approach to model networks with memory that represent continuous spaces is that of continuous attractor networks. It has recently been shown how idiothetic (self-motion) inputs could update the activity packet of neuronal firing for a one-dimensional case (head direction cells), and for a two-dimensional case (place cells which represent the place where a rat is located). In this paper, we describe three models of primate hippocampal spatial view cells, which not only maintain their spatial firing in the absence of visual input, but can also be updated in the dark by idiothetic input. The three models presented in this paper represent different ways in which a continuous attractor network could integrate a number of different kinds of velocity signal (e.g., head rotation and eye movement) simultaneously. The first two models use velocity information from head angular velocity and from eye velocity cells, and make use of a continuous attractor network to integrate this information. A fundamental feature of the first two models is their use of a 'memory trace' learning rule which incorporates a form of temporal average of recent cell activity. Rules of this type are able to build associations between different patterns of neural activities that tend to occur in temporal proximity, and are incorporated in the model to enable the recent change in the continuous attractor to be associated with the contemporaneous idiothetic input. The third model uses positional information from head direction cells and eye position cells to update the representation of where the agent is looking in the dark. In this case the integration of idiothetic velocity signals is performed in the earlier layer of head direction cells.

Action Potentials↗

PubMed2004

Impulsivity, time perception, emotion and reinforcement sensitivity in patients with orbitofrontal cortex lesions.

Damage to the orbitofrontal cortex (OFC) in humans has been associated with disinhibited or socially inappropriate behaviour and emotional changes. Some of the changes may be related to difficulty in responding correctly to rewards and punishers, in that these patients have difficulty in learning to correct their choice of a visual stimulus when it is no longer associated with reward. We extend this fundamental approach by investigating the relationship between frontal dysfunction and impulsive behaviour, the behavioural, emotional and personality changes seen in patients with prefrontal cortex damage, and thus in addition illuminate the cognitive and biological processes that are impaired in impulsive people. OFC patients (n = 23) performed more impulsively on both self-report and cognitive/behavioural tests of impulsivity, reported more inappropriate 'frontal' behaviours, and performed worse on a stimulus-reinforcement association reversal task, than non-OFC prefrontal cortex lesion control (n = 20) and normal control (n = 39) participants. Further, OFC patients experienced more subjective anger than non-OFC and normal participants, and less subjective happiness than normals; and had a faster subjective sense of time (overestimated and underproduced time intervals) than normal controls, while non-OFC patients did not differ from normals. Finally, both OFC and non-OFC patients were less open to experience than normal participants. There were no differences between OFC patients, non-OFC lesion patients and normal controls on all other personality traits, most notably extraversion. In a spatial working memory task, the non-OFC group, most of whom had dorsolateral prefrontal cortex lesions, were impaired in that they repeatedly returned to previously chosen empty locations ('within errors'), whereas OFC patients were not impaired on this measure. Thus there is a dissociation between the effects of OFC damage which does not affect this measure of spatial working memory but does affect impulsive and inappropriate behaviour, reversal, personality, time perception and emotion; and dorsolateral prefrontal cortex damage which does affect this measure of spatial working memory, but not impulsive and inappropriate behaviour, reversal, personality, time perception and emotion. The effects of OFC damage on impulsive and related behaviours described here have implications for understanding impulsive behaviour.

Adolescent↗

PubMed2004

Orbitofrontal cortex: neuronal representation of oral temperature and capsaicin in addition to taste and texture.

The primate orbitofrontal cortex is a site of convergence of information from primary taste, olfactory and somatosensory cortical areas. We describe the discovery of a population of single neurons in the macaque orbitofrontal cortex that responds to the temperature of a liquid in the mouth. The temperature stimuli consisted of water at 10 degrees C, 23 degrees C, 37 degrees C and 42 degrees C. Twenty-six of the 1149 neurons analyzed (2.3%) responded to oral temperature. The tuning profiles of the neurons to temperature showed that some of the neurons had graded responses to increasing temperature (27%), others responded to cold (10 degrees C) stimuli (27%), and others were tuned to temperature (46%). The neuronal responses were also measured to taste stimuli, viscosity stimuli (carboxymethyl-cellulose in the range 1-10,000 cP), and capsaicin (10 microM). Of 70 neurons with responses to any of these stimuli, 7.1% were unimodal temperature; 11.3% were temperature and taste-sensitive; 7.1% were temperature and viscosity-sensitive; and 11.3% were temperature, taste and viscosity sensitive. Capsaicin activated 15.7% of the population of responsive neurons tested. These results provide the first evidence of how the temperature of what is in the mouth is represented at the neuronal level in the orbitofrontal cortex and the first evidence for any primate cortical area that in some cases this information converges onto single neurons with inputs produced by other sensory properties of food, including taste and texture. The results provide a basis for understanding how particular combinations of oral temperature, taste, and texture can influence the palatability of foods.

Action Potentials↗

PubMed2004

Self-organising continuous attractor networks with multiple activity packets, and the representation of space.

'Continuous attractor' neural networks can maintain a localised packet of neuronal activity representing the current state of an agent in a continuous space without external sensory input. In applications such as the representation of head direction or location in the environment, only one packet of activity is needed. For some spatial computations a number of different locations, each with its own features, must be held in memory. We extend previous approaches to continuous attractor networks (in which one packet of activity is maintained active) by showing that a single continuous attractor network can maintain multiple packets of activity simultaneously, if each packet is in a different state space or map. We also show how such a network could by learning self-organise to enable the packets in each space to be moved continuously in that space by idiothetic (motion) inputs. We show how such multi-packet continuous attractor networks could be used to maintain different types of feature (such as form vs colour) simultaneously active in the correct location in a spatial representation. We also show how high-order synapses can improve the performance of these networks, and how the location of a packet could be read by motor networks. The multiple packet continuous attractor networks described here may be used for spatial representations in brain areas such as the parietal cortex and hippocampus.

Brain↗

PubMed2004

Reward-related reversal learning after surgical excisions in orbito-frontal or dorsolateral prefrontal cortex in humans.

Neurophysiological studies in primates and neuroimaging studies in humans suggest that the orbito-frontal cortex is involved in representing the reward value of stimuli and in the rapid learning and relearning of associations between visual stimuli and rewarding or punishing outcomes. In the present study, we tested patients with circumscribed surgical lesions in different regions of the frontal lobe on a new visual discrimination reversal test, which, in an fMRI study (O'Doherty, Kringelbach, Rolls, Hornak, & Andrews, 2001), produced bilateral orbito-frontal cortex activation in normal subjects. In this task, touching one of two simultaneously presented patterns produced reward or loss of imaginary money delivered on a probabilistic basis to minimize the usefulness of verbal strategies. A number of types of feedback were present on the screen. The main result was that the group of patients with bilateral orbito-frontal cortex lesions were severely impaired at the reversal task, in that they accumulated less money. These patients often failed to switch their choice of stimulus after a large loss and often did switch their choice although they had just received a reward. The investigation showed that bilateral lesions were required for this deficit, since patients with unilateral orbito-frontal cortex (or medial prefrontal cortex) lesions were not impaired in the probabilistic reversal task. The task ruled out a simple motor disinhibition as an explanation of the deficit in the bilateral orbito-frontal cortex patients, in that the patients were required to choose one of two stimuli on each trial. A comparison group of patients with dorsolateral prefrontal cortex lesions was in some cases able to do the task, and in other cases, was impaired. Posttest debriefing showed that all the dorsolateral prefrontal patients who were impaired at the task had failed to pay attention to the crucial feedback provided on the screen after each trial about the amount won or lost on each trial. In contrast, all dorsolateral patients who paid attention to this crucial feedback performed normally on the reversal task. Further, it was confirmed that the bilateral orbito-frontal cortex patients had also paid attention to this crucial feedback, but in contrast had still performed poorly at the task. The results thus show that the orbital prefrontal cortex is required bilaterally for monitoring changes in the reward value of stimuli and using this to guide behavior in the task; whereas the dorsolateral prefrontal cortex, if it produces deficits in the task, does so for reasons related to executive functions, such as the control of attention. Thus, the ability to determine which information is relevant when making a choice of pattern can be disrupted by a dorsolateral lesion on either side, whereas the ability to use this information to guide behavior is not disrupted by a unilateral lesion in either the left or the right orbito-frontal cortex, but is severely impaired by a bilateral lesion in this region. Because both abilities are important in many of the tasks and decisions that arise in the course of daily life, the present results are relevant to understanding the difficulties faced by patients after surgical excisions in different frontal brain regions.

Adult↗

PubMed2003

Changes in emotion after circumscribed surgical lesions of the orbitofrontal and cingulate cortices.

To analyse the functions of different parts of the prefrontal cortex in emotion, patients with different prefrontal surgical excisions were compared on four measures of emotion: voice and face emotional expression identification, social behaviour, and the subjective experience of emotion. Some patients with bilateral lesions of the orbitofrontal cortex (OFC) had deficits in voice and face expression identification, and the group had impairments in social behaviour and significant changes in their subjective emotional state. Some patients with unilateral damage restricted to the OFC also had deficits in voice expression identification, and the group did not have significant changes in social behaviour or in their subjective emotional state. Patients with unilateral lesions of the antero-ventral part of the anterior cingulate cortex (ACC) and/or medial Brodmann area (BA) 9 were, in some cases, impaired on voice and face expression identification, had some change in social behaviour, and had significant changes in their subjective emotional state. Patients with unilateral lesions of the OFC and of the ACC and/or medial BA 9 were, in some cases, impaired on voice and face expression identification, had some changes in social behaviour, and had significant changes in their subjective emotional state. Patients with dorsolateral prefrontal cortex lesions or with medial lesions outside ACC and medial BA 9 areas (dorsolateral/other medial group) were unimpaired on any of these measures of emotion. In all cases in which voice expression identification was impaired, there were no deficits in control tests of the discrimination of unfamiliar voices and the recognition of environmental sounds. Thus bilateral or unilateral lesions circumscribed surgically within the OFC can impair emotional voice and/or face expression identification, but significant changes in social behaviour and in subjective emotional state are related to bilateral lesions. Importantly, unilateral lesions of the ACC (including some of medial BA 9) can produce voice and/or face expression identification deficits, and marked changes in subjective emotional state. These findings with surgically circumscribed lesions show that within the prefrontal cortex, both the OFC and the ACC/medial BA 9 region are involved in a number of aspects of emotion in humans including emotion identification, social behaviour and subjective emotional state, and that the dorsolateral prefrontal areas are not involved in emotion in these ways.

Adult↗

PubMed2003

Self-organizing continuous attractor networks and motor function.

Motor skill learning may involve training a neural system to automatically perform sequences of movements, with the training signals provided by a different system, used mainly during training to perform the movements, that operates under visual sensory guidance. We use a dynamical systems perspective to show how complex motor sequences could be learned by the automatic system. The network uses a continuous attractor network architecture to perform path integration on an efference copy of the motor signal to keep track of the current state, and selection of which motor cells to activate by a movement selector input where the selection depends on the current state being represented in the continuous attractor network. After training, the correct motor sequence may be selected automatically by a single movement selection signal. A feature of the model presented is the use of 'trace' learning rules which incorporate a form of temporal average of recent cell activity. This form of temporal learning underlies the ability of the networks to learn temporal sequences of behaviour. We show that the continuous attractor network models developed here are able to demonstrate the key features of motor function. That is, (i) the movement can occur at arbitrary speeds; (ii) the movement can occur with arbitrary force; (iii) the agent spends the same relative proportions of its time in each part of the motor sequence; (iv) the agent applies the same relative force in each part of the motor sequence; and (v) the actions always occur in the same sequence.

Excitatory Postsynaptic Potentials↗

PubMed2003

Activation of the human orbitofrontal cortex to a liquid food stimulus is correlated with its subjective pleasantness.

Single-neuron recording studies in non-human primates indicate that orbitofrontal cortex neurons represent the reward value of the sight, smell and taste of food, and even changes in the relative reward value, but provide no direct evidence on brain activity that is correlated with subjective reports of the pleasantness of food. In this fMRI investigation we report a significant correlation between the activation of a region of the human orbitofrontal cortex and the decrease in subjective pleasantness when a liquid food is eaten to satiety. Moreover, a cluster of voxels in the orbitofrontal cortex showed a decrease in its activation that was specific to the particular liquid food consumed in a meal, providing a neural correlate of sensory-specific satiety to a liquid whole food in humans. This sensory-specific reduction in activation of the orbitofrontal cortex correlating with subjective pleasantness is consistent with an important role for the orbitofrontal cortex in human emotion and motivation, and associated subjective states.

Adult↗

PubMed2003

Representations of pleasant and painful touch in the human orbitofrontal and cingulate cortices.

The cortical areas that represent affectively positive and negative aspects of touch were investigated using functional magnetic resonance imaging (fMRI) by comparing activations produced by pleasant touch, painful touch produced by a stylus, and neutral touch, to the left hand. It was found that regions of the orbitofrontal cortex were activated more by pleasant touch and by painful stimuli than by neutral touch and that different areas of the orbitofrontal cortex were activated by the pleasant and painful touches. The orbitofrontal cortex activation was related to the affective aspects of the touch, in that the somatosensory cortex (SI) was less activated by the pleasant and painful stimuli than by the neutral stimuli. This dissociation was highly significant for both the pleasant touch (P < 0.006) and for the painful stimulus (P < 0.02). Further, it was found that a rostral part of the anterior cingulate cortex was activated by the pleasant stimulus and that a more posterior and dorsal part was activated by the painful stimulus. Regions of the somatosensory cortex, including SI and part of SII in the mid-insula, were activated more by the neutral touch than by the pleasant and painful stimuli. Part of the posterior insula was activated only in the pain condition and different parts of the brainstem, including the central grey, were activated in the pain, pleasant and neutral touch conditions. The results provide evidence that different areas of the human orbitofrontal cortex are involved in representing both pleasant touch and pain, and that dissociable parts of the cingulate cortex are involved in representing pleasant touch and pain.

Adult↗

PubMed2003

Representation of umami taste in the human brain.

Umami taste stimuli, of which an exemplar is monosodium glutamate (MSG) and which capture what is described as the taste of protein, were shown using functional MRI (fMRI) to activate similar cortical regions of the human taste system to those activated by a prototypical taste stimulus, glucose. These taste regions included the insular/opercular cortex and the caudolateral orbitofrontal cortex. A part of the rostral anterior cingulate cortex (ACC) was also activated. When the nucleotide 0.005 M inosine 5'-monophosphate (IMP) was added to MSG (0.05 M), the blood oxygenation-level dependent (BOLD) signal in an anterior part of the orbitofrontal cortex showed supralinear additivity; this may reflect the subjective enhancement of umami taste that has been described when IMP is added to MSG. These results extend to humans previous studies in macaques showing that single neurons in these taste cortical areas can be tuned to umami stimuli.

Brain↗

PubMed2002

Invariant recognition of feature combinations in the visual system.

The operation of a hierarchical competitive network model (VisNet) of invariance learning in the visual system is investigated to determine how this class of architecture can solve problems that require the spatial binding of features. First, we show that VisNet neurons can be trained to provide transform-invariant discriminative responses to stimuli which are composed of the same basic alphabet of features, where no single stimulus contains a unique feature not shared by any other stimulus. The investigation shows that the network can discriminate stimuli consisting of sets of features which are subsets or supersets of each other. Second, a key feature-binding issue we address is how invariant representations of low-order combinations of features in the early layers of the visual system are able to uniquely specify the correct spatial arrangement of features in the overall stimulus and ensure correct stimulus identification in the output layer. We show that output layer neurons can learn new stimuli if the lower layers are trained solely through exposure to simpler feature combinations from which the new stimuli are composed. Moreover, we show that after training on the low-order feature combinations which are common to many objects, this architecture can--after training with a whole stimulus in some locations--generalise correctly to the same stimulus when it is shown in a new location. We conclude that this type of hierarchical model can solve feature-binding problems to produce correct invariant identification of whole stimuli.

Animals↗

PubMed2002

Self-organizing continuous attractor networks and path integration: one-dimensional models of head direction cells.

Some neurons encode information about the orientation or position of an animal, and can maintain their response properties in the absence of visual input. Examples include head direction cells in rats and primates, place cells in rats and spatial view cells in primates. 'Continuous attractor' neural networks model these continuous physical spaces by using recurrent collateral connections between the neurons which reflect the distance between the neurons in the state space (e.g. head direction space) of the animal. These networks maintain a localized packet of neuronal activity representing the current state of the animal. We show how the synaptic connections in a one-dimensional continuous attractor network (of for example head direction cells) could be self-organized by associative learning. We also show how the activity packet could be moved from one location to another by idiothetic (self-motion) inputs, for example vestibular or proprioceptive, and how the synaptic connections could self-organize to implement this. The models described use 'trace' associative synaptic learning rules that utilize a form of temporal average of recent cell activity to associate the firing of rotation cells with the recent change in the representation of the head direction in the continuous attractor. We also show how a nonlinear neuronal activation function that could be implemented by NMDA receptors could contribute to the stability of the activity packet that represents the current state of the animal.

Animals↗

PubMed2002

Self-organizing continuous attractor networks and path integration: two-dimensional models of place cells.

Single-neuron recording studies have demonstrated the existence of neurons in the hippocampus which appear to encode information about the place where a rat is located, and about the place at which a macaque is looking. We describe 'continuous attractor' neural network models of place cells with Gaussian spatial fields in which the recurrent collateral synaptic connections between the neurons reflect the distance between two places. The networks maintain a localized packet of neuronal activity that represents the place where the animal is located. We show for two related models how the representation of the two-dimensional space in the continuous attractor network of place cells could self-organize by modifying the synaptic connections between the neurons, and also how the place being represented can be updated by idiothetic (self-motion) signals in a neural implementation of path integration.

Animals↗

PubMed2001

Selective perceptual impairments after perirhinal cortex ablation.

It has been suggested that the primate perirhinal cortex contributes exclusively to memory. However, recent studies in macaque monkeys have implied that the perirhinal cortex may also contribute to object perception. To investigate whether the perirhinal cortex does contribute to perception, we devised several perceptual oddity tasks in which monkeys had to choose which stimulus of several presented concurrently on a touch screen was different. Macaques with bilateral perirhinal cortex ablations were selectively impaired relative to controls at perceptually discriminating the odd stimulus when the odd stimulus was a different object and when the discrimination could not be done on the basis of simple differences in features between the stimuli. They remained unimpaired relative to controls on discriminating the odd stimulus when the odd stimulus was a different color, a different shape, or a different size even when these discriminations were extremely difficult. They were also impaired on human and monkey face oddity tasks and oddity tasks with scenes containing objects. Therefore, we reject the notion that the macaque perirhinal cortex has a role exclusive to memory and conclude that the macaque perirhinal cortex does contribute to perception. We argue that the perirhinal cortex is neither specialized for perception nor memory processes alone, but rather, is specialized for processing stimuli that require processing at a more abstract level such as at the level of an object and that the perirhinal cortex contributes to both memory and perception of such stimuli.

Animals↗