Search PubMed⌕ Search

SEARCH · Search PubMed

Results for “REINFORCEMENT”

Search indexed PubMed citations on genomics, clinical trials, systematic reviews and public health. Explore titles, authors and supplied subject terms, then open the PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,027 records · Page 57Linked to original sources

The primate amygdala and reinforcement: a dissociation between rule-based and associatively-mediated memory revealed in neuronal activity.

To investigate the role of the primate amygdala in stimulus-reinforcement association learning, the activity of single amygdala neurons was recorded in macaques during two memory tasks. In a visual discrimination task, a population of neurons (17/659) was analyzed which responded differentially to a visual stimulus which always indicated that the primary reinforcer fruit juice could be obtain if the monkey licked, and a different visual stimulus that indicated that the primary reinforcer aversive saline would be obtained if the monkey licked. Most (16/17) of these neurons responded more to the reward-related than the aversive visual stimulus. In a recognition memory task, the majority (12/14 analyzed) of these neurons responded equally well to the trial unique stimuli when they were shown as novel and the monkey had to not lick in order to avoid saline, and when they were shown a second time as familiar and the monkey used the rule that if he licked, fruit juice would be obtained. The responses of these amygdala neurons thus reflect the direct associations of stimuli with reinforcement, but do not reflect the reward value of the stimuli when this must be assessed based on a rule (in the recognition memory task, that a stimulus will be punished the first time it is shown, and rewarded the second). This finding also shows that these amygdala neurons respond to relatively novel stimuli in the same way as they do to stimuli that have become rewarding by stimulus-reinforcement association learning. This provides a neural basis for relatively novel stimuli to be treated as rewarding, and approached.

Acoustic Stimulation↗

Verbally reinforcing pain reports: an experimental test of the operant model of chronic pain.

Effective treatments for chronic pain have been based on the operant model for chronic pain, which holds that pain behaviours can be operantly controlled by various reinforcers. Support for the operant model comes primarily from treatment/outcome studies which report significant reductions in pain behaviours in chronic pain patients, but fail to demonstrate the underlying operant thesis that various reinforcers play a significant role in the establishment and maintenance of pain behaviours. In an experimental test of this hypothesis, the pain reports of forty-six healthy undergraduate students were measured over two sets of fifteen trials, in which the pressure from a blood-pressure cuff applied to their arm either remained stable or decreased over time. Half of the subjects received positive verbal reinforcement from the experimenter after each trial if their report of pain intensity exceeded that of the previous trial. Overall, the mean pain reports of reinforced subjects were significantly greater than those of the non-reinforced subjects both when the intensity of the cuff was stable over trials, and when it decreased, as expected. These results provide support for the operant model of chronic pain. The clinical and theoretical implications of these results for the operant model of chronic pain are discussed, and suggestions for future research are made.

Adult↗

The role of mesolimbic dopamine in the development and maintenance of ethanol reinforcement.

The neurobiological processes by which ethanol seeking and consumption are established and maintained are thought to involve areas of the brain that mediate motivated behavior, such as the mesolimbic dopamine system. The mesolimbic dopamine system is comprised of cells that originate in the ventral tegmental area (VTA) and project to several forebrain regions, including a prominent terminal area, the nucleus accumbens (NAcc). The NAcc has been subdivided into core and shell subregions. Both areas receive converging excitatory input from the cortex and amygdala and dopamine input from the VTA, with the accumbal medium spiny neuron situated to integrate the signals. Although forced ethanol administration enhances dopamine activity in the NAcc, conclusions regarding the role of mesolimbic dopamine in ethanol reinforcement cannot be made from these experiments. Behavioral experiments consistently show that pharmacological manipulations of the dopamine transmission in the NAcc alter responding for ethanol, although ethanol reinforcement is maintained after lesions of the accumbal dopamine system. Additionally, extracellular dopamine increases in the NAcc during operant self-administration of ethanol, which is consistent with a role of dopamine in ethanol reinforcement. Behavioral studies that distinguish appetitive responding from ethanol consumption show that dopamine is important in ethanol-seeking behavior, whereas neurochemical studies suggest that accumbal dopamine is also important during ethanol consumption before pharmacological effects occur. Cellular studies suggest that ethanol alters synaptic plasticity in the mesolimbic system, possibly through dopaminergic mechanisms, and this may underlie the development of ethanol reinforcement. Thus, anatomical, pharmacological, neurochemical, cellular, and behavioral studies are more clearly defining the role of mesolimbic dopamine in ethanol reinforcement.

Alcohol Drinking↗

Reinforcing aspects of androgens.

Are androgens reinforcing? Androgenic-anabolic steroids (AAS) are drugs of abuse. They are taken in large quantities by athletes and others to increase performance, often with negative long-term health consequences. As a result, in 1991, testosterone was declared a controlled substance. Recently, Brower [K.J. Brower, Anabolic steroid abuse and dependence. Curr. Psychiatry Rep. 4 (2002) 377-387.] proposed a two-stage model of AAS dependence. Users initiate steroid use for their anabolic effects on muscle growth. With continued exposure, dependence on the psychoactive effects of AAS develops. However, it is difficult in humans to separate direct psychoactive effects of AAS from the user's psychological dependence on the anabolic effects of AAS. Thus, studies in laboratory animals are useful to explore androgen reinforcement. Testosterone induces a conditioned place preference in rats and mice, and is voluntarily consumed through oral, intravenous, and intracerebroventricular self-administration in hamsters. Active, gonad-intact male and female hamsters will deliver 1 microg/microl testosterone into the lateral ventricles. Indeed, some individuals self-administer testosterone intracerebroventricularly to the point of death. Male rats develop a conditioned place preference to testosterone injections into the nucleus accumbens, an effect blocked by dopamine receptor antagonists. These data suggest that androgen reinforcement is mediated by the brain. Moreover, testosterone appears to act through the mesolimbic dopamine system, a common substrate for drugs of abuse. Nonetheless, androgen reinforcement is not comparable to that of cocaine or heroin. Instead, testosterone resembles other mild reinforcers, such as caffeine, nicotine, or benzodiazepines. The potential for androgen addiction remains to be determined.

Administration, Oral↗

A method for evaluating parameters of reinforcement during parent-child interactions.

We conducted functional analyses and identified reinforcers for problem behavior for three individuals with developmental disabilities. Based on results of the functional analysis, we evaluated the rate, probability, delay, and duration of reinforcement for problem and appropriate behavior during descriptive parent-child observations. Results showed that parameters of reinforcement, including rate, probability, delay, and duration may interact, and that evaluations of a single reinforcement parameter may be insufficient in describing response allocation. Hence, this study represents a movement toward a method for analyzing reinforcer dimensions, other than rate and probability, in a descriptive analysis.

Aggression↗

An examination of nucleus accumbens cell firing during extinction and reinstatement of water reinforcement behavior in rats.

Electrophysiological recording procedures were used to examine nucleus accumbens (Acb) cell firing in rats (n = 13) during water reinforcement sessions consisting of three phases. During phase one (maintenance), a lever press resulted in water reinforcement (fixed ratio 1; 0.05 ml/press) paired with an auditory stimulus (0.5 s). Of 128 Acb neurons recorded during maintenance, 40 cells (31%) exhibited one of three types of neuronal firing patterns described previously [J. Neurosci. 14 (12) (1994) 7735-7746; J. Neurosci. 20 (11) (2000) 4255-4266]. Briefly, Acb neurons exhibited increases in firing rate within seconds preceding the reinforced response (type PR) or increases (type RFe) or decreases (type RFi) in activity seconds following response completion. In phase two (extinction), subsequent lever pressing had no programmed consequences (i.e., water reinforcement and the auditory stimulus were not presented). After 30 min of no responding, animals were given water reinforcement/auditory stimulus 'primes' to reestablish lever pressing behavior during the third phase (reinstatement). Results indicated that all types of phasic neurons (PR, RFe and RFi) exhibited an attenuated firing rate during extinction, and in some cases recovery of patterned discharges were observed during reinstatement. No significant changes in cell firing were observed for any cell type during presentation of the stimulus prime used to reestablish operant responding following extinction. These findings are discussed in terms of how Acb neurons process information related to 'natural' reinforcers versus drugs of abuse.

Acoustic Stimulation↗

Ethanol-reinforced behaviour in the rat: effects of naltrexone.

It has been repeatedly reported that endogenous opioid pathways play an important role in ethanol drinking behaviour. In line with these findings, a non-selective opioid receptor antagonist, naltrexone, seems to reduce relapse rates in detoxified alcoholics. The aim of the present study was to evaluate the effects of naltrexone on (i) ethanol self-administration; (ii) extinction of responding for ethanol; (iii) reinstatement of ethanol-seeking induced by non-contingent presentations of ethanol-associated stimuli. Male Wistar rats were trained to lever-press for 8% ethanol in an operant procedure where ethanol was introduced in the presence of sucrose. The selectivity of naltrexone's actions was assessed by studying its effects on water-reinforced behaviour in separate control experiments. Acute injections of naltrexone (1 or 3 mg/kg) did not alter ethanol self-administration. Repeated treatment with naltrexone (3 mg/kg, before three consecutive self-administration sessions) progressively reduced ethanol intake. In the extinction procedure, acute administration of 3 mg/kg naltrexone suppressed responding previously reinforced with ethanol. Similarly, naltrexone (1-3 mg/kg) potently and dose-dependently inhibited reinstatement of ethanol-seeking produced by non-contingent deliveries of the liquid dipper filled with 8% ethanol. In the control experiments, lower doses of naltrexone (1-3 mg/kg) did not exert any effect on either reinforced or non-reinforced (extinction) lever-pressing for water. These results indicate that: (i) subchronic treatment with naltrexone leads to progressive reduction of ethanol self-administration; (ii) single doses of naltrexone may increase extinction and attenuate cue-induced reinstatement of ethanol-reinforced behaviour.

Alcohol Drinking↗

Effects of deprivation on hedonics and reinforcing value of food.

Eating is influenced by both the hedonic preferences and reinforcing value of food. Incentive salience theory predicts these are separate influences. This study tested whether hedonics reliably change as a function of increasing the reinforcing value of food by deprivation in 17 non-obese, non-dietary restrained females. Baseline measures of hedonics for pleasant (chocolate milk), unpleasant (lemon juice) and neutral (water) tastes were determined under deprived conditions. Participants were then randomly assigned to fed or maintained in deprived conditions, and after food consumption, a second determination of hedonics was obtained, followed by assessing the reinforcing value of food. Hedonics was measured by subjective ratings and behavioral observations in a taste reactivity paradigm. Results showed food was more reinforcing for the deprived than the fed group, but no influences of group were observed for the subjective or objective hedonic measures. These results suggest that hedonics and the reinforcing value of food are separate processes in humans, and they may independently influence eating behavior.

Adult↗

BTCP is a potent reinforcer in rats: comparison of behavior maintained on fixed- and progressive-ratio schedules.

N-[1-(2-benzo[b]thiophenyl)cyclohexyl]piperidine (BTCP) is a phencyclidine (PCP) derivative that acts as a potent dopamine (DA) reuptake inhibitor. Earlier studies have shown that BTCP can substitute for the reinforcing effects of cocaine. Therefore, the aim of the study was to further characterize the reinforcing effects of BTCP. The reinforcing actions of BTCP were compared to those of cocaine at equimolar concentrations in drug-naïve rats. Two groups of animals were implanted with jugular catheters and trained to intravenously self-administer BTCP or cocaine (0.25 mg/infusion) on a fixed-ratio five schedule (FR 5) of reinforcement. Both BTCP and cocaine produced comparable inverted U-shaped dose-effect curves on this schedule over doses of 0.03, 0.06, 0.125, and 0.25 mg/infusion. Two doses (0.125 and 0.25 mg/infusion) that produced reliable self-administration in all the animals for cocaine and BTCP were then tested on a progressive-ratio schedule. At each dose, BTCP supported higher breaking points (BPs) than cocaine. The results demonstrate that rats readily acquire responding maintained by BTCP and suggest that BTCP may have greater reinforcing effects than cocaine at equimolar concentrations.

Animals↗

Reinforcing effects of the neurosteroid allopregnanolone in rats.

The GABA(A) receptor positive modulator allopregnanolone (3alpha-hydroxy-5alpha-pregnan-20-one) is a potent neurosteroid with behavioral and biochemical characteristics similar to ethanol, barbiturates, and benzodiazepines. This suggests that neurosteroids may provide an alternative class of sedative/hypnotic, anticonvulsant, and anxiolytic pharmacotherapies. However, there is evidence from animal models that neurosteroids may be susceptible to abuse by humans. Thus, the present study evaluated the reinforcing effects of orally administered allopregnanolone in rats. In the first experiment, male Long-Evans rats (n=9) were allowed to voluntarily consume a 50-microg/ml allopregnanolone (50A) solution or water in an unlimited-access two-bottle choice procedure for 10 days. Subsequently, the same animals were trained to lever-press to receive a 50A solution in daily 30-min operant sessions using a sucrose substitution procedure. In the two-bottle choice procedure, rats consumed significantly more allopregnanolone than water, suggesting that allopregnanolone was serving as a reinforcer. In the operant self-administration procedure, allopregnanolone did not maintain levels of responding that were different from water, suggesting that allopregnanolone did not function as a reinforcer in this procedure. These results suggest that orally administered allopregnanolone possesses reinforcing properties; however, additional studies are necessary to determine whether operant oral self-administration will be a viable index of allopregnanolone's reinforcing effects.

Animals↗

Concurrent positive and negative goalbox events produce runway behaviors comparable to those of cocaine-reinforced rats.

Rats traversing a straight-alley for reinforcing stimuli typically exhibit faster running times as training proceeds. In previous work from this laboratory, animals running for a reinforcement consisting of intravenous infusions of cocaine, unexpectedly demonstrated a progressive increased time to enter the goalbox over trials. Closer observation revealed that the animals were exhibiting a unique retreat behavior (i.e., stopping their forward advance toward the goalbox and returning toward the startbox). It was hypothesized that the retreat behavior reflected an inherent conflict that originated from concurrent positive and negative associations with the goalbox. Such associations were attributed to cocaine's dual and well documented reinforcing and anxiogenic effects. To test this idea, the present study compared the runway behavior of animals that concurrently received food and mild foot shock in the goalbox to the behavior of the other animals running for cocaine. Results demonstrated that food + shock reinforced animals took longer to enter the goalbox and made more retreats than a control group that received only food in the goalbox. Both these effects were reversed by pretreatment with the anticonflict, anxiolytic drug, diazepam. The behavior pattern of animals that received the combination of food and footshock was found to strongly resemble that of IV cocaine-reinforced rats, a result consistent with the notion that chronic cocaine administration has both positive and negative consequences.

Analysis of Variance↗

Reinforcement value of gustatory stimuli determined by progressive ratio performance.

The progressive ratio schedule provides a means to determine reinforcement value that is independent of response rate. This is achieved by increasing the number of lever presses for each successive reinforcement until, eventually, the subject fails to respond within a designated time limit. The number of responses in the final completed ratio defines the break point. When tested with appetitive gustatory stimuli (sucrose and saccharin), rats showed a concentration-dependent increase in break point when food deprived (Experiment 1A and, for sucrose only, Experiments 1B and IC) but not when water deprived (Experiment 1A). For aversive gustatory stimuli (sodium chloride, citric acid, and quinine) break point declined as concentration increased (Experiment 1A). In Experiment 1C, reinforcement duration had a significant, although relatively small, influence on break point for each of three concentrations of sucrose. Experiment 2 found a dose-dependent effect of the neuroleptic drug haloperidol (0.025, 0.05, and 0.1 mg/kg) on break point for sucrose reinforcement. The present study demonstrates that the progressive ratio schedule provides a valuable method to assess the influence of manipulations that might affect the perceived reinforcement value of gustatory stimuli.

Animals↗

A cautionary note on interpreting the effects of partial reinforcement on place learning performance in the water maze.

The effects of partial reinforcement on dry land and swimming pool place learning tasks have recently been compared and it has been suggested that they differ fundamentally [8]. That is, partial reinforcement impairs performance in the water maze, but not on dry land. However, other evidence suggests that partial reinforcement may have the opposite effect in the water maze, strengthening the accuracy and persistence of spatial responses. We discuss how the discrepancy may depend on 'levels' of negative reinforcement (e.g. escaping to a submerged platform before complete removal from the pool) and how experimental procedures may set up competitive contingencies that reinforce alternative behaviors. Finally, we consider data from past lesion studies and suggest ways to improve the design of future water maze experiments.

Animals↗

Partial reinforcement across trials impairs escape performance but spares place learning in the water maze.

We studied the effects of partial reinforcement on escape performance and place learning in the water maze. Rats given 50% reinforcement across trials (i.e. the escape platform was present only on odd trials) were compared to controls given 100% reinforcement (platform present on all trials). Control groups either received 8 or 4 trials per day, which was equal to either the total number of trials (100%-8) or reinforced escapes (100%-4) of the 50% group. Analysis of escape performance (latency) revealed that the 50% group was impaired relative to the 100%-8 group, but not the 100%-4 group, during the first 5 days of acquisition. The 50% group was impaired relative to both control groups on days 6-10 of overtraining. However, analyses of within-trial behavior (target annulus preference and thigmotaxis) on nonreinforced trials suggest that the 50% group did learn the location of the hidden platform (place information), in addition to a wall-based thigmotactic response. By dividing the 60s nonreinforced trials into three 20-s time bins, we were able to detect a significant preference for the target annulus early in the trial (bin 1 of trial 40 and bins 1-2 of trial 80). Further, there was a significant increase in time spent in the periphery of the pool, near the wall, in the last time bin of trial 40. Because the platform was in the middle zone, this behavior competed with a place response. We conclude that across-trial partial reinforcement procedures may promote response competition and mask evidence of place learning in addition to weakening escape performance late in training.

Animals↗

The role of reinforcement in reactive self-monitoring.

The role of reinforcement in reactive self-monitoring was investigated. Subjects for this study were three mentally retarded adults employed in a sheltered workshop. Changes in productivity rates in a party hat assembly task across experimental conditions (reinforcements, self-monitoring, and self-monitoring plus reinforcement) were evaluated. Findings showed that while reinforcement alone increased productivity, it was to a lesser degree and with less consistency than when combined with self-monitoring. In addition, self-monitoring alone did not increase productivity. These results support the Rachlin and Nelson and Hayes hypotheses that reactive effects of self-monitoring are dependent upon environmental contingencies. The results also showed that self-monitoring increases the salience of reinforcement.

Adult↗

Behavioral reinforcement of long-term potentiation in rat dentate gyrus in vivo is protein synthesis-dependent.

A transient, protein synthesis-independent long-term potentiation (early-LTP, <4 h) can be reinforced into a maintained protein synthesis-dependent late-LTP (>4 h) by specific electrical stimulation of limbic structures (J. Neurosci. 21 (2001) 3697). Similarly, LTP-modulation can be obtained by behavioral stimuli with strong motivational content. However, the requirement of protein synthesis during behavioral reinforcement has not been shown so far. Thus, we have studied here this specific question using a behavioral reinforcement protocol, i.e. allowing water-deprived animals to drink 15 min after induction of early-LTP. This procedure transformed early-LTP into late-LTP. Anisomycin, a reversible protein synthesis inhibitor, abolished behavioral LTP-reinforcement. These results demonstrate that behavioral reinforcement depends on protein synthesis.

Action Potentials↗

Nucleus accumbens dopamine depletions make animals highly sensitive to high fixed ratio requirements but do not impair primary food reinforcement.

It has been suggested that dopamine in nucleus accumbens is involved in the process of enabling organisms to overcome work-related response costs. One way of controlling work costs with operant schedules is to use fixed ratio schedules with different ratio requirements. In the present study, the effects of nucleus accumbens dopamine depletions were investigated using six schedules: fixed ratio 5, 20, 50, 100, 200, and 300. In the first three schedules the food reinforcement consisted of one 45 mg food pellet per ratio completed. In the remaining schedules the food reinforcement per ratio completed was increased to two pellets for fixed ratio 100, four pellets for fixed ratio 200, and six pellets for fixed ratio 300. All rats were trained extensively prior to surgery, and rats were able to maintain high levels of responding on all schedules up to the fixed ratio 300. After training, rats were injected with either ascorbate vehicle or 6-hydroxydopamine into the nucleus accumbens. Rats were tested post-surgically on each of the schedules, with 3 days of testing per schedule. Rats with nucleus accumbens dopamine depletions exhibited behavioral deficits that were highly dependent upon the ratio value. There were small and transient effects of dopamine depletion on fixed ratio 5 lever pressing, but as the ratio value got larger the impairment became greater. On the fixed ratio 20 and 50 schedules, response rates were partially reduced in dopamine-depleted rats. Responding on the fixed ratio 200 and 300 schedules was severely impaired, and on the last day of fixed ratio 300 testing no dopamine-depleted rats obtained a single reinforcer. These data are consistent with previous reports that accumbens dopamine depletions enhance 'ratio strain', making rats more sensitive to high ratio values. The induction of ratio strain by dopamine depletions does not appear to be related to a loss of appetite, and seems to be relatively independent of the baseline rate of responding and the overall density of food reinforcement across the session. We conclude that dopamine in nucleus accumbens may be important for enabling rats to overcome behavioral constraints such as work-related response costs, and may be critical for the behavioral organization and conditioning processes that enable animals to emit large numbers of responses in the absence of primary reinforcement.

Animal Feed↗

Reinforcement learning by Hebbian synapses with adaptive thresholds.

A central problem in learning theory is how the vertebrate brain processes reinforcing stimuli in order to master complex sensorimotor tasks. This problem belongs to the domain of supervised learning, in which errors in the response of a neural network serve as the basis for modification of synaptic connectivity in the network and thereby train it on a computational task. The model presented here shows how a reinforcing feedback can modify synapses in a neuronal network according to the principles of Hebbian learning. The reinforcing feedback steers synapses towards long-term potentiation or depression by critically influencing the rise in postsynaptic calcium, in accordance with findings on synaptic plasticity in mammalian brain. An important feature of the model is the dependence of modification thresholds on the previous history of reinforcing feedback processed by the network. The learning algorithm trained networks successfully on a task in which a population vector in the motor output was required to match a sensory stimulus vector presented shortly before. In another task, networks were trained to compute coordinate transformations by combining different visual inputs. The model continued to behave well when simplified units were replaced by single-compartment neurons equipped with several conductances and operating in continuous time. This novel form of reinforcement learning incorporates essential properties of Hebbian synaptic plasticity and thereby shows that supervised learning can be accomplished by a learning rule similar to those used in physiologically plausible models of unsupervised learning. The model can be crudely correlated to the anatomy and electrophysiology of the amygdala, prefrontal and cingulate cortex and has predictive implications for further experiments on synaptic plasticity and learning processes mediated by these areas.

Adaptation, Physiological↗