Search PubMed⌕ Search

SEARCH · Search PubMed

Results for “REINFORCEMENT”

Search indexed PubMed citations on genomics, clinical trials, systematic reviews and public health. Explore titles, authors and supplied subject terms, then open the PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,063 records · Page 59Linked to original sources

Response-reinforcement learning is dependent on N-methyl-D-aspartate receptor activation in the nucleus accumbens core.

The nucleus accumbens, a site within the ventral striatum, is best known for its prominent role in mediating the reinforcing effects of drugs of abuse such as cocaine, alcohol, and nicotine. Indeed, it is generally believed that this structure subserves motivated behaviors, such as feeding, drinking, sexual behavior, and exploratory locomotion, which are elicited by natural rewards or incentive stimuli. A basic rule of positive reinforcement is that motor responses will increase in magnitude and vigor if followed by a rewarding event. It is likely, therefore, that the nucleus accumbens may serve as a substrate for reinforcement learning. However, there is surprisingly little information concerning the neural mechanisms by which appetitive responses are learned. In the present study, we report that treatment of the nucleus accumbens core with the selective competitive N-methyl-D-aspartate (NMDA) antagonist 2-amino-5-phosphonopentanoic acid (AP-5; 5 nmol/0.5 microl bilaterally) impairs response-reinforcement learning in the acquisition of a simple lever-press task to obtain food. Once the rats learned the task, AP-5 had no effect, demonstrating the requirement of NMDA receptor-dependent plasticity in the early stages of learning. Infusion of AP-5 into the accumbens shell produced a much smaller impairment of learning. Additional experiments showed that AP-5 core-treated rats had normal feeding and locomotor responses and were capable of acquiring stimulus-reward associations. We hypothesize that stimulation of NMDA receptors within the accumbens core is a key process through which motor responses become established in response to reinforcing stimuli. Further, this mechanism, may also play a critical role in the motivational and addictive properties of drugs of abuse.

2-Amino-5-phosphonovalerate↗

Effects of reinforcement schedules on rats' choice behavior in extinction.

The effects of reinforcement schedules on rats' choice behavior in extinction were studied. In a free-operant chamber equipped with two retractable bars, the experimental animals were trained to press the bars separately for a food reward. One bar delivered the reward on a continuous reinforcement (CRF) schedule, and the other delivered the reward on a partial reinforcement (PRF) schedule. Control animals earned the reward from both bars with the same reinforcement schedule, either a CRF or a PRF. When both bars were simultaneously available during extinction, the experimental animals responded more frequently to the CRF than to the PRF alternative, demonstrating a reversed within-subjects partial reinforcement extinction effect (PREE). A conventional between-subjects PREE was replicated in the control subjects. The results of this study were inconsistent with both Amsel's (1962, 1967) frustration hypothesis and Capaldi's (1966, 1967) sequential hypotheses.

Animals↗

The effects of traumatic brain injury on reporting and responding to causal relations: an investigation of sensitivity to reinforcement contingencies.

Impairments in judging and responding to consequences that follow behaviour are often attributed to changes in various cognitive processes. An alternative conceptualization is that impairments may produce a reduction in sensitivity to reinforcement contingencies. The present investigation employed a methodology commonly used in research on judgements of causality to examine the effects of TBI on sensitivity to reinforcement contingencies. Participants were non-injured control subjects and adults with TBI. The experimental task required subjects to press a response key under a series of concurrent response-reinforcer contingencies that periodically delivered money for responding and not responding. Afterwards, subjects provided a judgement about each response-reinforcer contingency by reporting the amount of money earned for responding and for not responding. Results suggest that TBI reduced the sensitivity of judgements and responding under select contingencies. These results lend some support to the view that TBI may reduce sensitivity to reinforcement contingencies. Furthermore, the investigation highlights the potential benefits of employing methods commonly used in human and animal operant research for the study of TBI.

Adult↗

Superconditioning from a reduced reinforcer.

In four autoshaping experiments pigeons received conditioned inhibition training of the form A++, AB-, where ++ is a strong reinforcer and - is nonreinforcement. Subsequent AB+ training, in which + is a moderate reinforcer, resulted in enhanced conditioning of A, relative to an A stimulus receiving no treatment, one receiving A+ treatment, and one receiving A++ treatment. This enhancement of conditioning to A constitutes a demonstration of "superconditioning". The presence of the inhibitory B sufficiently enhanced the reinforcing power of the moderate reinforcer (+) that it was able to further increase the excitation controlled by A. This occurred even though A had previously been paired with a stronger reinforcer (++). Superconditioning was also observed when A and B were extinguished prior to treatment with + or were originally neutral stimuli followed by + in the presence of an inhibitor trained elsewhere.

Animals↗

Acquisition of instrumental conditioned reinforcement is resistant to the devaluation of the unconditioned stimulus.

The associative mechanisms responsible for the efficacy of Pavlovian stimuli during first- and second-order conditioning have been extensively studied, but little is known about the representations underlying instrumental conditioned reinforcement. The present study investigated the associative structure underlying conditioned reinforcement, by employing an unconditioned stimulus (US) devaluation procedure on a commonly used instrumental task: the acquisition of a new response with conditioned reinforcement. Whilst US-directed behaviour was abolished following devaluation, the conditioned stimulus acting as a conditioned reinforcer supported the acquisition of instrumental responding. In this preparation then, the conditioned reinforcer appears to be impervious to devaluation of its associated US, suggesting that the underlying representation maintaining behaviour is independent of the current value of the US and may reflect the activation of a central appetitive motivational state.

Animals↗

Choice between delayed reinforcers in a discrete-trials schedule: the effect of deprivation level.

Choice between two reinforcers differing in magnitude and delay was investigated in rats using a discrete-trials schedule in which the two reinforcers were associated with two levers (A and B); in each session 5 free-choice trials (A and B both available) were interspersed among 44 forced-choice trials (A alone, 22 trials; B alone, 22 trials). In Experiment 1, preference for the more concentrated of two sucrose solutions declined as the delay to that reinforcer was progressively increased. In Experiment 2, progressively increasing the delay to both reinforcers by the same amount resulted in a shift in preference away from the less concentrated solution. In Experiment 3, it was found that the decline in preference for the more concentrated solution as a function of the delay to that reinforcer was steeper when the rats were maintained at 90% than when they were maintained at 80% of their free-feeding body weights. This effect of deprivation level on choice is inconsistent with some current models of "self-control".

Animals↗

The relationship of task reinforcement to personal loss themes revealed in earliest memories of elderly subjects.

Institutionalization of the aged has been viewed as an environmental stressor, producing covert negative affect which is manifest as personal loss themes in the individual's earliest memories. It was hypothesized that reinforcement given for a cognitive task would produce a positive emotional response in the individual and result in decreased personal loss feelings. Subjects were 64 elderly persons (aged 65-88); half of each sex, half nursing home and half community residents, half receiving reinforcement and half receiving none. Subjects' earliest memories were scored for personal loss themes. Significant findings were that among subjects who were reinforced, those in the community had higher loss scores than those in the nursing home; there was no difference in loss scores between community and nursing residents who had not been reinforced. Among community subjects, those who were reinforced had significantly higher loss scores than those who were not; the opposite tendency was observed in nursing home subjects.

Aged↗

Age-related preferences for paced and unpaced tasks in chained schedules of reinforcement.

Younger and older men were studied on chained operant schedules. A response in the initial link produced a terminal link where a sequence of 10 key presses was reinforced with money. In different conditions, the time available for each key press was varied from .5 sec to an unlimited amount, and the speed with which the men produced the terminal links containing the paced and unpaced sequences was taken as an index of preference for the terminal link conditions. When the men had difficulty adjusting to pacing, initial link speed was directly related to reinforcement rate in the terminal link: the greater the reinforcement, the faster the speed. This effect was stronger among the older men, who had more difficulty adjusting to pacing. With continued exposure to pacing, however, men of both ages adjusted more readily and the speed-reinforcement relationship decreased. These results suggest that the role of monetary reinforcement in determining task preferences is moderated by other factors such as task difficulty.

Adolescent↗

Sex differences in the subjective and reinforcing effects of visual and olfactory cigarette smoke stimuli.

Although nicotine intake clearly reinforces cigarette smoking behavior, non-nicotine smoke stimuli may become conditioned reinforcers of smoking. In Study 1, we compared the acute subjective and reinforcing effects of cigarette smoking in men and women under two conditions: blockade of visual and olfactory/taste smoke stimuli vs. no blockade. Subjective hedonic ratings of 'like puffs' and 'satisfying', but not 'strength', 'high in nicotine', or CO boost, were significantly reduced under the blockade vs. no blockade conditions. During subsequent ad lib puffing, significantly fewer puffs were self-administered under the blockade condition, particularly among women. In Study 2, we examined the influences of these stimuli separately and found that olfactory/taste stimuli, but not visual stimuli, reduced hedonic ratings and puff self-administration in women but not in men. In Study 3, procedures similar to those in Study 1 were used to examine whether this sex difference in responses to conditioned stimuli generalizes to a non-drug consummatory behavior, eating (pizza). However, hedonic ratings and ad lib consumption of pizza were substantially reduced in both men and women following blockade of visual and olfactory/taste food stimuli. These results indicate that the presumably conditioned stimuli of olfactory/taste from cigarette smoke may influence subjective hedonic ratings and reinforcement from smoking more in women than in men. However, this sex difference may not generalize beyond smoking or other drug reinforcement.

Adult↗

Partial reinforcement in appetitive Pavlovian conditioning with rats.

Four experiments examined the effects of a partial reinforcement schedule on extinction using appetitive Pavlovian conditioning. Extinction was slower after partial than after continuous reinforcement when the schedules were administered to different groups (Experiment 1). The opposite result was found in Experiments 2 and 3 when both schedules were presented to the same group in the same context. When the schedules were presented to the same group in different contexts, then extinction was again slower after partial reinforcement (Experiment 3). Experiment 4 demonstrated that a change of context facilitates extinction to a greater extent after conditioning with a partial reinforcement schedule than with a continuous one. The results are explained by assuming that the nonreinforced trials of a partial reinforcement schedule create an internal state that serves as a contextual cue.

Analysis of Variance↗

Reinforcement without awareness: I. Voice level.

Although some studies have reported that reinforcement can strengthen people's behaviour without their awareness, most studies that have incorporated adequate procedures for assessing awareness have been unsuccessful. Using rigorous procedures, we report two studies designed to provide more scope for learning without awareness by making the reinforcement contingency as unobtrusive as possible. Subjects were told that the experiment was on ESP, and that they were to say which of two words the experimenter was thinking about. In fact, reinforcement was contingent on the loudness of the subject's voice when responding. Even though subjects reported no awareness of a relationship between trial outcomes and their behaviour, the probability of the reinforced responses increased significantly over trials in both experiments. These results support the view that reinforcement can occur without awareness.

Adult↗

Modeling and reinforcement of the sick role during childhood predicts adult illness behavior.

Previous studies suggest that the ways in which parents respond to children's health complaints (reinforcement) and the ways in which they cope with their own illnesses (modeling) influence the frequency of symptoms, disability days, and health care visits made by these children when they grow up. However, previous studies have not controlled for the mediating influence of stress, neuroticism, and physical examination findings. This study investigated the influence of childhood social learning on adult illness behavior in 383 women aged 20 to 40 years. Illness behavior was measured prospectively for 12 months by the frequency of symptoms, disability days, and physician visits for menstrual, bowel, and cold (upper respiratory) symptoms. Childhood reinforcement and modeling was measured retrospectively by validated questionnaires. Other independent variables were stress, neuroticism, and selected demographic variables. Multiple regression analysis was used to assess the relative contribution of each independent variable to each category of illness behavior. The principal findings were as follows. First, childhood reinforcement of menstrual illness behavior significantly predicted adult menstrual symptoms and disability days, and childhood reinforcement of cold illness behavior significantly predicted adult cold symptoms and disability days. These effects were independent of stress and neuroticism. Second, childhood reinforcement scales were useful to predict which functional disorders (dysmenorrhea or irritable bowel syndrome) these subjects had even after we controlled for stress and neuroticism.

Adaptation, Psychological↗

Molecular mechanisms of the positive reinforcing effect of nicotine.

Animal models of nicotine dependence are fundamental experimental tools for the understanding of the neurobiological and molecular processes underlying smoking behaviour. Substance use is controlled by four main processes: positive reinforcing effects, aversive effects, discriminative effects and stimulus-conditioned effects of the drug. In this article, the molecular and neural bases of the positive reinforcing effects of nicotine are summarized, focusing on data obtained in experiments including unambiguous and objective measurements of the reinforcing properties of nicotine. Operant behaviour paradigms, in particular intravenous nicotine self-administration, offer such a possibility within a solid theoretical framework. Nicotine self-administration produces changes in the mesocorticolimbic DA system, a key component of the reward system, as do other addictive drugs. The role of the mesocorticolimbic DA system as the main substrate of the reinforcing properties of nicotine is supported by converging experiments, including the evidence that nicotine self-administration is attenuated in mutant mice lacking the beta2 subunit of neural acetylcholine nicotinic receptor. The long-term adaptive molecular changes in the target neurons of the terminal fields of the mesocorticolimbic DA system, including transcriptional regulation mediated by c-fos family gene products on other genes, suggest that the mesolimbic DA projection to the nucleus accumbens is mainly involved in the stimulus-reward learning process. These data represent an initial set of information only, which may help to develop a more complete and reliable model of the molecular dynamics underlying the reinforcing effects of nicotine.

Animals↗

Sex differences in the acute effects of cigarette smoking on the reinforcing value of alcohol.

Alcohol consumption acutely increases smoking behavior, but the reverse relationship, the acute effects of smoking on alcohol intake, largely has been ignored. We examined whether smoking acutely increases the reinforcing value of alcohol, first in the absence of recent alcohol intake and then following an alcohol pre-load. Healthy, social-drinking smokers (n = 11 men, 14 women) engaged in a computerized task involving concurrent schedules of reinforcement for beer (FR10, 3 oz (90 ml) per reinforcement) or money (FR5 to FR30, $0.20 per reinforcement) during two sessions, one following day-long ad lib smoking and the other following overnight smoking abstinence. During each session, subjects performed the task in two sets of trials, one before and one after consumption of an alcohol pre-load, with 60 min between sets. To standardize the alcohol pre-load, all subjects were led to believe that they had earned 9 oz (270 ml) of beer after the first trial set, which they then consumed before the second set of trials. Compared to responding during the abstinent session, responding for alcohol during the smoking session was no different before the alcohol pre-load (trial set one) but was significantly greater following the alcohol pre-load (trial set two), although only in men and not women. Subjective sedation after the alcohol pre-load was attenuated during the smoking session in both men and women, but attenuated sedation due to smoking was related to subsequent alcohol-reinforced responding only in men. Additional research is needed to determine the extent to which these effects in men are pharmacological in nature or are conditioned responses to smoking or to consuming a preferred alcoholic beverage.

Adult↗

Opiate reinforcement processes: re-assembling multiple mechanisms.

Opiate reinforcement processes can be described within the context of operant conditioning theory. Both positive and negative reinforcing effects may motivate drug-taking behavior, although the strongest evidence attributes drug-taking to a simple positive reinforcement process. Empirical research has focused largely on a positive reinforcement mechanism involving the ventral tegmental dopamine system, but three additional reinforcement mechanisms can be argued on logical grounds. These other mechanisms involve neuroadaptive changes produced by chronic opiate administration and may contribute to the strong motivational impact of opiates following long-term drug use.

Animals↗

Visual learning for an auditory secondary reinforcer by macaques is intact after uncinate fascicle section: indirect evidence for the involvement of the corpus striatum.

Three cynomolgus monkeys (Macaca fascicularis) were trained preoperatively in visual discrimination learning for an auditory secondary reinforcer. Each new discrimination problem was solved on the basis of the secondary reinforcer, and primary reinforcement (food reward) was given only after a new problem had been solved. The animals learned 50 new problems in each daily session and it was therefore possible to assess accurately their average rate of learning new discrimination problems in this procedure. After the learning rate had stabilized preoperatively the animals were operated upon to transect the uncinate fascicle, the cortico-cortical pathway from visual association cortex in the temporal lobe to prefrontal cortex. The animals' learning rate was unchanged after uncinate fascicle section. A previous experiment has shown that visual learning for an auditory secondary reinforcer is unaffected by disconnection of visual association cortex from the amygdala and the fornix. Taken together, this negative evidence points strongly to the conclusion that visual learning for an auditory secondary reinforcer depends upon interaction of temporal lobe visual association cortex with the corpus striatum, since other possibilities have been excluded.

Acoustic Stimulation↗

The acquisition of responding with conditioned reinforcement: effects of cocaine, (+)-amphetamine and pipradrol.

1 A procedure for examining the acquisition of a lever-pressing operant with conditioned reinforcement was used to compare the effects of three psychomotor stimulants. 2 Hungry rats were trained to associated and auditory tone (i.e., conditioned reinforcer) with food. Preference for the tone was then measured after treatment with pipradol (5, 10, 15 mg/kg), cocaine (1, 5, 10 mg/kg) or (+)-amphetamine (0.5, 1.5, 5.0 mg/kg). 3 In agreement with previous data, 10 mg/kg of pipradrol enhanced the effect of conditioned reinforcement whereas animals treated with any of the doses of (+)-amphetamine showed no effect. 4 Rats treated with cocaine (1 or 5 mg/kg) showed an effect of conditioned reinforcement but the effect was not significantly greater than in controls. 5 The present data suggest important differences in enhancement of responding for conditioned reinforcement by various drugs in the psychomotor stimulant class. These differences in turn may be related to the pharmacological actions of these compounds on release of catecholamines from different storage pools.

Animals↗

Neural mechanisms of drug reinforcement.

The brain substrates involved in the effect of cocaine on brain stimulation reward, in the psychomotor activation associated with cocaine, and in cocaine self-administration appear to be focused on the medial forebrain bundle and its connections with the basal forebrain, notably the nucleus accumbens. Chronic access to cocaine produces a withdrawal state as reflected in increases in brain stimulation reward thresholds, and this change in reward threshold appears to be opposite to the actions of the drug administered acutely. These effects are thought to reflect a change in the activity of reward elements in the medial forebrain bundle and may be responsible for the negative reinforcing state associated with the anhedonia of cocaine withdrawal. Opiate receptors particularly sensitive to the reinforcing effects of heroin also appear to be located in the region of the nucleus accumbens and the ventral tegmental area. There is good evidence for both dopamine-dependent and dopamine-independent opioid interactions in the ventral tegmental-nucleus accumbens connection. In addition, the opiate receptors in the region of the nucleus accumbens may become sensitized during the course of opiate withdrawal and thus become responsible for the aversive stimulus effects of opiate dependence. Reliable measures of the acute reinforcing effects of ethanol have been established in rat models, and substantial evidence exists to show that non-deprived rats will orally self-administer pharmacologically relevant amounts of ethanol in lever-press choice situations. Neuropharmacological studies of ethanol reinforcement in non-dependent rats suggest important roles for serotonin, GABA and dopamine. A role for opioid peptides in ethanol reinforcement may reflect more general actions of opioid peptides in consummatory behavior. Studies of ethanol dependence have implicated brain GABAergic and CRF systems in the more motivational aspects of withdrawal. Future studies will need to focus on the common neurobiologic changes associated with all these drugs, particularly regarding their hedonic and motivational properties.

Animals↗