Search PubMed⌕ Search

SEARCH · Search PubMed

Results for “Reversal Learning”

Search indexed PubMed citations on genomics, clinical trials, systematic reviews and public health. Explore titles, authors and supplied subject terms, then open the PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3Linked to original sources

Differential effects of M1 muscarinic receptor blockade and nicotinic receptor blockade in the dorsomedial striatum on response reversal learning.

The present studies determined whether blockade of M(1)-like muscarinic or nicotinic cholinergic receptors in the dorsomedial striatum affects acquisition or reversal learning of a response discrimination. Testing occurred in a modified cross-maze across two consecutive sessions. In the acquisition phase, a rat learned to turn to the left or to the right. In the reversal learning phase, a rat learned to turn in the opposite direction as required during acquisition. Experiment 1 investigated the effects of the M(1)-like muscarinic receptor antagonist, pirenzepine infused into the dorsomedial striatum on acquisition and reversal learning. Experiment 2 examined the effects of the nicotinic cholinergic antagonist, mecamylamine injected into the dorsomedial striatum on acquisition and reversal learning. Bilateral injections of pirenzepine at 10 microg, but not 1 microg, selectively impaired reversal learning. Analysis of the errors indicated that pirenzepine treatment did not impair the initial shift, but increased reversions back to the original response choice following the initial shift. Bilateral injections of mecamylamine, 6 or 18 microg, did not affect acquisition or reversal learning. The results suggest that activation of M(1) muscarinic cholinergic receptors, but not nicotinic cholinergic receptors, in the dorsomedial striatum is important for facilitating the flexible shifting of response patterns.

Animals↗

Normal olfactory discrimination learning set and facilitation of reversal learning after medial-temporal damage in rats: implications for an account of preserved learning abilities in amnesia.

Recent evidence of preserved skill learning in patients with "global" amnesia has led to the postulation of a qualitative distinction between functionally separate memory systems, one of which may remain preserved when the other is profoundly impaired. On one account, the separate memory systems support either the learning of declarative knowledge, i.e., facts and associations, or the learning of procedural knowledge, i.e., knowledge that permits the expression of skilled performance without reference to specific facts or associations. In an effort to develop a rodent model of amnesia that illustrates the same distinction between memory systems, rats were trained in a series of discrimination and reversal problems using olfaction, a sensory modality in which they rapidly learn new associations. Rats with bilateral fornix, amygdala, or combined fornix and amygdala damage learned successive two-odor discriminations as quickly as normal and sham-operated control subjects. Furthermore, all groups rapidly acquired the skills of discrimination as revealed in the development of a learning set. Subsequent presentation of a reversal of one discrimination elicited a marked dissociation among groups: Normal rats and rats with amygdala lesions required many more trials to acquire the reversal than to acquire a new discrimination problem, whereas rats with fornix lesions learned the reversal rather easily. A detailed analysis of response strategies suggested that normal rats and rats with amygdala lesions first extinguished the prior response tendencies and then abandoned the learning set skills and treated the reversal much as they did the initial discrimination problem.(ABSTRACT TRUNCATED AT 250 WORDS)

Amnesia↗

Dynamic changes in acetylcholine output in the medial striatum during place reversal learning.

The present studies explored the role of the medial striatum in learning when task contingencies change. Experiment 1 examined whether the medial striatum is involved in place reversal learning. Testing occurred in a modified cross-maze across two consecutive sessions. Injections of the local anesthetic, bupivacaine, into the medial striatum, did not impair place acquisition, but impaired place reversal learning. The reversal-learning deficit was due to an inability to maintain the new choice pattern following the initial shift. Experiment 2 determined whether changes in acetylcholine (ACh) output occur during the acquisition or reversal learning of a place discrimination. Extracellular ACh output from the medial striatum was assessed in samples collected at 6-min intervals using in vivo microdialysis during behavioral testing. ACh output did not change from basal levels during place acquisition. During reversal learning, ACh output significantly increased as rats began to learn the new choice pattern, and returned to near basal levels as a rat reliably executed the new place strategy. The present results suggest that the medial striatum may be critical for flexible adaptations involving spatial information, and that ACh actions in this area enable the shifting of choice patterns when environmental conditions change.

Acetylcholine↗

Neural correlates of a reversal learning task with an affectively neutral baseline: an event-related fMRI study.

Reversal learning may conceptually be dissected into acquiring stimulus-reinforcement associations and subsequently altering behavior by switching to new associations as stimulus-reinforcement contingencies reverse (i.e., affective switching). Previous imaging studies have found regions of the ventrolateral and orbitofrontal cortex (OFC) to be involved in both subprocesses. However, these studies did not contain an affectively neutral baseline, which precluded adequate assessment of main effects of reward, punishment, and affective switching. We aimed to determine the neural substrate of these main effects, and of common and dissociable regions for reward and punishment. Furthermore, we aimed to discriminate between stimulus-punishment association and affective switching, i.e., to assess affective switching proper. To this end, we implemented a reversal learning task with an affectively neutral baseline condition that matched the experimental task in visual complexity and motor demands. Interestingly, we found dorsolateral prefrontal cortex (DLPFC) and anterior PFC to be engaged in affective switching, a finding that has not been reported before to our knowledge. Enhanced responses in these areas may represent their involvement in cognitive set shifting per se unrelated to the affective context in a reversal learning design. In addition, OFC, insular and medial prefrontal cortex regions were involved in affective switching. Left medial and lateral OFC were shown to be common areas for feedback processing, whereas left ventral striatum and left lateral OFC were specifically activated by reward and punishment, respectively. These results extend our understanding of the neural substrate of reversal learning in humans.

Adult↗

Spatial reversal learning in preclinical scrapie-inoculated mice.

Acquisition and reversal of a two-choice spatial discrimination were tested in scrapie-inoculated mice. Both acquisition and reversal were normal in mice tested 138 and 103 days prior to the onset of clinical symptoms. At 65 days before onset of clinical symptoms, scrapie-inoculated mice required more trails to criterion in reversal learning, but this effect was not significant in a second experiment (68 days preclinical) and was transient: no effect was seen 33 days before symptoms. However, the course of reversal learning was abnormal in all three late preclinical groups (68, 65 and 33 days before symptoms). Reversal learning in these three groups was characterized by a rapid extinction of the original discrimination, followed by a period, absent in controls, during which performance showed no further improvement. This effect corresponds in time of onset to the appearance of characteristic neuropathological features.

Animals↗

Size and reversal learning in the beagle dog as a measure of executive function and inhibitory control in aging.

Several studies converge on the idea that executive processes age earlier than other cognitive processes. As part of a larger effort to investigate age-related changes in executive processes in the dog, inhibitory control was measured in young, middle-aged, old, and senior dogs using size discrimination learning and reversal procedures. Compared to young and middle-aged dogs, old and senior dogs were impaired on both the initial learning of the size task and the reversal of original reward contingencies. Impaired performance in the two aged groups was characterized as a delay in learning the correct stimulus-reward contingencies and, among the senior dogs in particular, an increase in perseverative responding. These separate patterns of reversal impairments in the old and senior dogs may reflect different rates of aging in subregions of the frontal cortex.

Aging↗

Serial spatial reversal learning in rats: comparison of instrumental and automaintenance procedures.

Serial reversals of a spatial discrimination were trained in rats under automaintenance conditions, in which food reward occurred regardless of responding. This automaintained reversal learning was compared to instrumental reversal learning in other rats trained under a similar procedure which required responding for reward. In the automaintenance (AU) procedure, rats received food after every retraction of a "positive" response lever (S+); retraction of a second, "neutral" lever (So) was not paired with food delivery. Responses to the S+ were elicited at fairly constant rates during daily 100-trial conditioning sessions. Responses to the So occurred early in each session but rapidly diminished across trials. When the valences of the levers were reversed, responding shifted to the new S+ and diminished on the new So. Criterion for reversal was defined as a discrimination ratio (DR) of at least 90% responding to the S+ in two consecutive 10-trial blocks. With repeated reversals, acquisition of criterion performance occurred with increasing rapidity, reaching an asymptote below that required for the original discrimination. A second group of rats was trained on a similar instrumental schedule, in which at least one response to the S+ was required for food delivery. Response rates in this instrumental (IN) group were approximately double those of the AU group. However, ratios of S+ to So response rates were similar to those of the AU group, and the serial reversal curves generated were qualitatively similar. Thus rats can show improvement across serial reversals of a spatial discrimination based entirely on pairings of stimulus events (automaintenance), in a manner similar to that observed in instrumental procedures, in which reward is contingent upon correct responding.

Animals↗

The effect of N-methyl-D-aspartate receptor blockade on acetylcholine efflux in the dorsomedial striatum during response reversal learning.

Separate experiments found that activation of N-methyl-d-aspartate (NMDA) receptors or increased acetylcholine (ACh) efflux in the rat dorsomedial striatum is critical for learning when conditions require a shift in strategies. Increasing evidence indicates that NMDA receptor activity affects cholinergic efflux in the basal ganglia. The present studies determined whether NMDA receptor blockade in the dorsomedial striatum with dl-2-amino-5-phosphonopentanoic acid (AP-5) affects dorsomedial striatal ACh output in a resting condition, as well as during response reversal learning. Experiment 1 investigated the effects of AP-5 (12.5, 25 or 50 muM) infused into the dorsomedial striatum on ACh output in a resting condition. AP-5 infusion at 25 and 50 muM led to a 20% and 40% decrease in dorsomedial striatal ACh output, respectively. AP-5 (12.5 muM) infusion did not change dorsomedial striatal ACh output from basal levels. Experiment 2 determined whether dorsomedial striatal ACh efflux increases during response reversal learning and whether AP-5, at a dose that does not affect basal levels, modifies response reversal learning and ACh efflux. Following acquisition of a response discrimination, rats had microdialysis probes bilaterally inserted into the dorsomedial striatum prior to the reversal learning test. After baseline samples, rats received a response reversal learning test for 30 min. Control rats rapidly improved in the reversal learning session while simultaneously exhibiting an approximately 40% increase in ACh output compared with baseline levels. AP-5 (12.5 muM) treatment during testing significantly impaired response reversal learning while concomitantly blocking an increase in ACh output. These findings suggest that NMDA receptor activation in the dorsomedial striatum may facilitate a shift in response patterns, in part, by increasing ACh efflux.

2-Amino-5-phosphonovalerate↗

Color-reversal learning: effects after lesions of thalamic visual structures in pigeons.

The performance of pigeons on a color-reversal learning task was assessed after thalamic lesions disrupting the thalamofugal and tectofugal visual pathways. Successful performance of a simultaneous color discrimination was accomplished after surgery, and a series of reversals of the original discrimination followed during which the positive and negative consequences associated with the stimuli were interchanged. Shimizu and Hodos (1989) had reported that lesions of two laminae in the visual wulst (IHA and HD), both targets of the avian thalamofugal pathway, resulted in increased errors in a color-reversal learning task in pigeons. This finding suggested that the thalamofugal pathway might play a role in visual discrimination involving stimulus context changes. In the present study, lesions of the OPT complex (the thalamic source of afferents to IHA and HD) were found to have no effect on color-reversal learning performance. Instead, we found that damage to nucleus rotundus (the thalamic component of the tectofugal pathway) resulted in deficits that were far in excess of those that had been obtained after IHA and HD lesions. We suggest that the color-reversal learning deficits after Wulst lesions are not due to the Wulst's connections with the thalamofugal pathway, but rather to its connections with the tectofugal pathway.

Animals↗

Serotonergic modulation of prefrontal cortex during negative feedback in probabilistic reversal learning.

This study used functional magnetic resonance imaging to examine the effects of acute tryptophan (TRP) depletion (ATD), a well-recognized method for inducing transient cerebral serotonin depletion, on brain activity during probabilistic reversal learning. Twelve healthy male volunteers received a TRP-depleting drink or a balanced amino-acid drink (placebo) in a double-blind crossover design. At 5 h after drink ingestion, subjects were scanned while performing a probabilistic reversal learning task and while viewing a flashing checkerboard. The probabilistic reversal learning task enabled the separate examination of the effects of ATD on behavioral reversal following negative feedback and negative feedback per se that was not followed by behavioral adaptation. Consistent with previous findings, behavioral reversal was accompanied by significant signal change in the right ventrolateral prefrontal cortex (PFC) and the dorsomedial prefrontal cortex. ATD enhanced reversal-related signal change in the dorsomedial PFC, but did not modulate the ventrolateral PFC response. The ATD-induced signal change in the dorsomedial PFC during behavioral reversal learning extended to trials where subjects received negative feedback but did not change their behavior. These data suggest that ATD affects reversal learning and the processing of aversive signals by modulation of the dorsomedial PFC.

Adolescent↗

D-cycloserine, a partial NMDA receptor-associated glycine-B site agonist, enhances reversal learning, but a cholinesterase inhibitor and nicotine has no effect.

The present study examined the efficacy of single and combined treatments with an anticholinesterase, tetrahydroaminoacridine, nicotine and a glycine-B site partial agonist, D-cycloserine, in alleviating the water maze reversal learning defect induced by a medial septal lesion. D-cycloserine (3 and 10 mg/kg) improved reversal learning. Tetrahydroaminoacridine (1 and 3 mg/kg) and nicotine (0.1 and 0.3 mg/kg) had no effect on reversal learning. A combination of tetrahydroaminoacridine 3 mg/kg or nicotine 0.3 mg/kg and D-cycloserine 10 mg/kg was not more effective than D-cycloserine 10 mg/kg alone in improving reversal learning. This suggests that stimulation of NMDA mechanisms may more effectively improve in medial septal-lesioned rats reversal learning processes than stimulation of cholinergic activity.

Alzheimer Disease↗

L-DOPA disrupts activity in the nucleus accumbens during reversal learning in Parkinson's disease.

Evidence indicates that dopaminergic medication in Parkinson's disease may impair certain aspects of cognitive function, such as reversal learning. We used functional magnetic resonance imaging in patients with mild Parkinson's disease to investigate the neural site at which L-DOPA acts during reversal learning. Patients were scanned both ON and OFF their normal dopamine-enhancing L-DOPA medication during the performance of a probabilistic reversal learning task. We demonstrate that L-DOPA modulated reversal-related activity in the nucleus accumbens, but not in the dorsal striatum or the prefrontal cortex. These data concur with evidence from studies with experimental animals and indicate an important role for the human nucleus accumbens in the dopaminergic modulation of reversal learning.

Aged↗

Reversal learning deficits in young monkeys exposed to lead.

The reversal learning capacity of young rhesus monkeys in visual discrimination tasks was examined during daily exposure to dietary lead acetate throughout the first year of life. While not affected in physical development, all lead-treated monkeys showed performance deficits on reversal learning tasks. These deficits were independent of lead-induced changes in motivation. Over a series of problems, the overall learning rate of monkeys with blood lead concentrations in the range of 70-90 microgram/dl was retarded, which resulted partly from a pronounced difficulty in attaining criterion on the first of a series of reversals within a given problem. This latter deficit resulted from an increase in errors, balks, and total trials to criterion on the first reversal. Monkeys exposed to blood lead concentrations of 40-60 microgram/dl required significantly more trials to finish all problems, but did not show the first-reversal deficit. Theoretical implications of these data were discussed.

Aging↗

An analysis of visual object reversal learning in the marmoset after amphetamine and haloperidol.

The effect of amphetamine and haloperidol pretreatment on visual object reversal learning was assessed in the marmoset. Amphetamine induced perseverative responding demonstrated by high reversal learning scores and worse than chance performance in the early stages of reversal. This perseverative responding was prevented by pretreatment with haloperidol. Haloperidol, either alone or in conjunction with amphetamine caused a mild, non-perseverative impairment on reversal learning only.

Amphetamine↗

Ventromedial frontal cortex mediates affective shifting in humans: evidence from a reversal learning paradigm.

How do the frontal lobes support behavioural flexibility? One key element is the ability to adjust responses when the reinforcement value of stimuli change. In monkeys, this ability--a form of affective shifting known as reversal learning--depends on orbitofrontal cortex. The present study examines the anatomical bases of reversal learning in humans. Subjects with lesions of the ventromedial prefrontal cortex were compared with a group with dorsolateral frontal lobe damage, as well as with normal controls on a simple reversal learning task. Neither form of frontal damage affected initial stimulus-reinforcement learning; ventromedial frontal damage selectively impaired reversal learning.

Adult↗

The neuropsychology of ventral prefrontal cortex: decision-making and reversal learning.

Converging evidence from human lesion, animal lesion, and human functional neuroimaging studies implicates overlapping neural circuitry in ventral prefrontal cortex in decision-making and reversal learning. The ascending 5-HT and dopamine neurotransmitter systems have a modulatory role in both processes. There is accumulating evidence that measures of decision-making and reversal learning may be useful as functional markers of ventral prefrontal cortex integrity in psychiatric and neurological disorders. Whilst existing measures of decision-making may have superior sensitivity, reversal learning may offer superior selectivity, particularly within prefrontal cortex. Effective decision-making on existing measures requires the ability to adapt behaviour on the basis of changes in emotional significance, and this may underlie the shared neural circuitry with reversal learning.

Animals↗

Dopamine D2 receptors mediate reversal learning in male C57BL/6J mice.

Dopamine is critical for directing goal-oriented behavior. We investigated dopamine D2 receptor involvement in reversal learning and reinforcement efficacy in mice lacking functional dopamine D2 receptors and their heterozygous and wild-type littermates. Mice discriminated between two odors to receive a food reinforcer. One odor signaled a reinforcer (S+); the other odor signaled no reinforcer (S-). After mice learned the S+/S- relationship, we inverted the reinforcement contingencies. The necessary number of trials to relearn the new reinforcement contingencies served as our index of reversal learning. Mice lacking functional dopamine D2 receptors repeatedly failed to inhibit previously reinforced responses during reversal trials. In a separate experiment, mice responded for reinforcers on a progressive ratio schedule of reinforcement. Mice lacking functional dopamine D2 receptors earned significantly fewer reinforcers than did heterozygous mice. Our results suggest that dopamine D2 receptors regulate reversal learning and influence the reinforcing efficacy of natural rewards.

Analysis of Variance↗