Search PubMed⌕ Search

SEARCH · Search PubMed

Results for “REINFORCEMENT”

Search indexed PubMed citations on genomics, clinical trials, systematic reviews and public health. Explore titles, authors and supplied subject terms, then open the PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41Linked to original sources

Investigating retrospective influences on induction in rats' responding for 1% sucrose when food-pellet reinforcement is upcoming.

When rats lever press for 1% sucrose reinforcement in the first half of a 50-min session, response rates are higher when food-pellet reinforcement will be available in the second half than when 1% sucrose will be available. Results of past research have suggested that, under some conditions, this induction effect is prospective in nature (i.e., controlled by the conditions of reinforcement in the present session). However, that research did not rule out the possibility that, under other conditions, retrospective factors (i.e., the conditions of reinforcement in the previous session[s]) could contribute. In the present study, rats responded in two types of session, one in which 1% sucrose reinforcement was available in both halves of the session and one in which 1% sucrose and food-pellet reinforcement were available in the first and second halves, respectively. Which type of session was in effect unsignaled and session type alternated every session (Experiment 1), every second session (Experiment 2), or after at least 20 consecutive sessions of one type (Experiment 3). Across experiments, the results indicated that it takes several sessions of one type for observable retrospective effects to occur, but those effects are short lived. These results allow the authors to identify the mechanisms that must underlie induction. The authors also discuss induction as an animal model of anticipation.

Animal Feed↗

Concurrent-chain performance in transition: effects of terminal-link duration and individual reinforcers.

Pigeons responded on concurrent-chain schedules with variable-interval initial links and equal delays as terminal links. The terminal-link delays were 1 sec in some conditions and 20 sec in other conditions. The percentages of reinforcers delivered for responses on the left key were 10%, 30%, 70%, or 90%, and this percentage was switched every five to nine sessions. The rate of change in the pigeons' response percentages after a switch was the same whether the terminal-link delays were 1 sec or 20 sec. Analysis of the effects of individual reinforcers showed that after a response on one key had been reinforced, response percentages on that key were higher for at least the next 100 responses. Small effects of individual reinforcers were evident after eight or nine additional reinforcers had been delivered. The effects of individual reinforcers were about equally large during times of transition and during periods in which overall response percentages were relatively stable.

Animals↗

Concurrent schedules of wheel-running reinforcement: choice between different durations of opportunity to run in rats.

How do animals choose between opportunities to run of different durations? Are longer durations preferred over shorter durations because they permit a greater number of revolutions? Are shorter durations preferred because they engender higher rates of running? Will longer durations be chosen because running is less constrained? The present study reports on three experiments that attempted to address these questions. In the first experiment, five male Wistar rats chose between 10-sec and 50-sec opportunities to run on modified concurrent variable-interval (VI) schedules. Across conditions, the durations associated with the alternatives were reversed. Response, time, and reinforcer proportions did not vary from indifference. In a second experiment, eight female Long-Evans rats chose between opportunities to run of equal (30 sec) and unequal durations (10 sec and 50 sec) on concurrent variable-ratio (VR) schedules. As in Experiment 1, between presentations of equal duration conditions, 10-sec and 50-sec durations were reversed. Results showed that response, time, and reinforcer proportions on an alternative did not vary with reinforcer duration. In a third experiment, using concurrent VR schedules, durations were systematically varied to decrease the shorter duration toward 0 sec. As the shorter duration decreased, response, time, and reinforcer proportions shifted toward the longer duration. In summary, differences in durations of opportunities to run did not affect choice behavior in a manner consistent with the assumption that a longer reinforcer is a larger reinforcer.

Animals↗

Effects of selective 5-hydroxytryptamine-2 and nonselective 5-hydroxytryptamine antagonists on the differential-reinforcement-of-low-rate 72-second schedule.

The effects of antidepressant drugs, administered with and without a 5-hydroxytryptamine (5-HT) antagonist that is not selective for 5-HT receptor subtypes, were assessed in rats responding under a differential-reinforcement-of-low-rate 72-second (DRL 72-s) schedule of reinforcement. The increases in reinforcement rate seen after low dose tricyclic antidepressant drug administration were antagonized by the 5-HT antagonist methysergide. Methysergide did not antagonize either the increases in reinforcement rate or the decreases in response rate induced by the atypical antidepressant trazodone or the putative antidepressant clenbuterol. In addition, the effects of 5-HT receptor antagonists with varying selectivity for the 5-HT2 relative to the 5-HT1 receptor subtypes were assessed when administered alone. The rank order potency series for the maximal increase in the reinforcement rate after administration of the 5-HT antagonists was ketanserin greater than pipamperone greater than trazodone greater than cyproheptadine greater than cinanserin greater than metergoline greater than methysergide, in close agreement with the selectivity of these drugs for the 5-HT2 relative to the 5-HT1 receptor subtypes. In addition, the specificity of the DRL 72-s schedule was further assessed with the alpha adrenergic antagonists phentolamine and phenoxybenzamine which both decreased the response rate but did not increase the reinforcement rate as do antidepressant drugs. These results suggest that the therapeutic effect of atypical antidepressants such as trazodone and mianserin may be related to selective antagonism of 5-HT2 receptors. Furthermore, agonist action at a 5-HT1 receptor and antagonist action at 5-HT2 receptors both appear to contribute to antidepressant-like activity on the DRL 72-s schedule.

Adrenergic alpha-Antagonists↗

Treatment of self-injurious behavior by a combination of reinforcement for incompatible behavior and overcorrection.

In two related studies, a combination of reinforcement for incompatible behavior and positive practice overcorrection was applied to the elimination of head-slapping and head-banging behavior exhibited, respectively, by two profoundly retarded boys. The design for both studies also included a period in which only reinforcement for incompatible behavior was applied. The results from Study 1 indicated that, while reinforcement had little effect in reducing the frequency of the learner's head slapping, the combination of reinforcement and overcorrection had an immediate effect in significantly reducing and eventually eliminating that behavior. A 4-month follow-up indicated no significant recurrence of the behavior. In Study 2, on the other hand, both reinforcement and the combination of reinforcement and overcorrection resulted in a significant increase in the frequency of the learner's head-banging behavior. Discussion centered on several research questions left unanswered by the differing effects of the procedures applied in both studies.

Adolescent↗

Accumbens activity during a multiple schedule for water and sucrose reinforcement in rats.

Electrophysiological recording procedures were used to examine nucleus accumbens (Acb) cell firing during operant responding for water reinforcement vs. a highly palatable sweet solution (0.6 M sucrose). Rats (n = 8) were trained on a multiple schedule to press one lever for water (fixed ratio 1, FR1; 15 min) followed by a 20-sec timeout period (chamber dark, levers retracted), and extension of a second spatially distinct lever that the animals pressed for sucrose reinforcement (FR1; 15 min). Of 84 cells, 55 neurons (65%) displayed one of three types of patterned discharges (increases or decreases in firing rate) immediately before or following the sucrose- or water-reinforced response. The major finding of this report was that the majority of these neurons (36/55 cells; 65%) showed similar types of neuronal firing patterns across the two reinforcer conditions. The remaining cells (19/55; 35%) exhibited patterned activity specific to responding for one reinforcer only (water or sucrose). These findings are discussed with respect to how Acb neurons encode goal-directed behaviors for "natural" reinforcers including food, water, and a palatable sweet solution.

Action Potentials↗

Anatomic distribution of reinforcer selective cell firing in the core and shell of the nucleus accumbens.

We have previously reported that distinct populations of nucleus accumbens (NAc) neurons differentially encode information about goal-directed behaviors for "natural" (food/water) vs. cocaine reinforcement [J Neurosci 20:4255-4266, (2000)]. Here, the anatomic distribution of reinforcer-selective cell firing was examined within the core and shell of the NAc. Rats (n=8) were trained on a multiple schedule for water reinforcement and cocaine (0.33 mg/infusion) self-administration. Next, microelectrode arrays (eight wires/array) were bilaterally positioned in the NAc core and shell, and cell firing was recorded during the multiple schedule. All electrode tip placements were then "marked," and histological reconstruction of each electrode position was completed. Of 93 NAc cells, 44 neurons (47%) exhibited 1 of 4 types of well-documented patterned discharges relative to the water- or cocaine-reinforced response. Of the 44 phasic cells, 39 neurons (89%) displayed differential, nonoverlapping neuronal firing patterns across the two reinforcer conditions (i.e., reinforcer-selective activity). Histological reconstruction of electrode placement revealed that NAc patterned discharges, specific to goal-directed behaviors for water or cocaine, were not limited to one NAc subregion but were evenly distributed and intermixed throughout the core and shell. These findings are discussed with respect to the functional organization of the NAc.

Animals↗

The effects of pipradrol on the acquisitionof responding with conditioned reinforcement: a role for sensory preconditioning.

Previous studies have shown that pipradrol enhances the acquisition of responding with conditioned reinforcement. The present experiments replicated this finding and assessed the possible role of nonspecific stimulus change, feeding in the test environment and prior exposure to the conditioned stimulus. The test procedure consisted of three phases: Operant rates of pressing two levers, one of which produced a 3-s tone, were measured in the pre-exposure phase; the tone was paired with food in the four conditioning sessions; and conditioned reinforcement was demonstrated in the test phase by a relative increase in pressing the tone lever. A group (N = 8) receiving food but no tone during the conditioning phase also increased responding on the tone lever in the test phase and this effect was enhanced in a group (N = 8) receiving pipradrol prior to the test. A group (N = 8) receiving neither tones nor pellets during conditioning and pipradrol prior to test failed to show a change in lever bias, ruling out the possibility that pipradrol produced a nonspecific enhancement of responding for stimulus change. It was hypothesized that the conditioned reinforcement effect seen in the food-alone groups resulted from sensory preconditioning. According to this hypothesis, the tone was conditioned to environmental stimuli during the pre-exposure phase; subsequent presentation of pellets resulted in a learned association between environmental stimuli and food, leading to increased responding for the tone in the test phase. The results of two control experiments supported this view. One group (N = 8) received no tone in the pre-exposure phase, pellets alone in the conditioning phase and then pipradrol prior to test. The second group, but under altered environmental stimulus conditions, and then was given pipradrol prior to test. Neither group showed evidence of conditioned reinforcement. It was concluded that pipradrol enhanced acquisition of responding with conditioned reinforcement even if the conditioned reinforceing stimulus was established with sensory preconditioning procedures.

Acoustic Stimulation↗

Effects of D2 dopamine receptor blockade with raclopride on intracranial self-stimulation and food-reinforced operant behaviour.

To examine the involvement of D2 dopamine receptors in the neural mechanism of reinforcement, raclopride tartrate, a D2 specific dopamine antagonist with a relatively fast central action, was injected into 32 rats. The D2 antagonist reduced bar-pressing responses reinforced with electrical stimulation of the ventral tegmental area (ED50 = 0.079 mumol/kg) and those reinforced with food (ED50 = 0.58 mumol/kg) in 18-30 min after IP injection. The reduction in response rates could not be attributed to an interference with motor functions. An increase in the frequency of brain-stimulation pulses and a change in the schedule of food reinforcement, which respectively increased the baseline rate of responding, did not alter the effectiveness of raclopride. SCH 23,390, a D1-specific dopamine antagonist, was sensitive to similar manipulation of reinforcement. These results seem to suggest that D1 and D2 antagonists may be acting at different locations in the neural mechanism underlying the reinforcement of operant behaviour.

Animals↗

Direct versus indirect response-reinforcer relationships in teaching autistic children.

One possibility suggested by the literature for maximizing the efficiency of behavior modification procedures concerns the relationship between target behaviors and their reinforcers. Therefore, in this experiment three severely autistic children were taught a total of six new target behaviors (in a multiple baseline design) employing two different response-reinforcer relationships: (1) those where the target behaviors were a direct part of the response chain required to procure a reinforcer (e.g., opening the lid of a container to obtain a food reward inside the container); and (2) those where the target behavior was an indirect part of the chain leading to the reinforcer (e.g., the therapist handing the child a food reqard after the child had opened the lid of an empty container). In all cases, the results showed rapid acquisition only when the target behavior was a direct part of the chain leading to the reinforcer. The results are discussed in terms of several possible conceptualizations concerning efficient reinforcement contingencies, and in terms of their implications for teaching autistic children.

Autistic Disorder↗

The effect of reinforcement and verbal rehearsal on selective attention in learning-disabled children.

A central-incidental task of selective attention was administered to 100 learning-disabled boys--48 younger children (8 1/2-10 1/2 years) and 52 older children (10 1/2-12 1/2 years). Subjects at both age levels were assigned to one of four conditions: (a) a standard condition; (b) a rehearsal condition, in which subjects were taught a verbal rehearsal strategy; (c) a reinforcement condition, in which correct responses were rewarded; and (d) a combined rehearsal-reinforcement condition. Older subjects recalled more central task but not more incidental task information than younger subjects. A measure of selective attention efficiency was also greater for older than for younger subjects. Central recall in the rehearsal-reinforcement condition was greater than in any other condition. Central recall was greater in the rehearsal condition than in the standard and reinforcement conditions. Selective attention efficiency was greater for both rehearsal conditions than for both nonrehearsal conditions. Incidental recall was higher for reinforcement subjects than for rehearsal subjects. Results suggest that induced verbal rehearsal improves central recall and selective attention in learning-disabled children. Reinforcement alone does not improve central recall but may when paired with rehearsal.

Attention↗

Effects of increasing the magnitude of an alternative reinforcer on drug choice in a discrete-trials choice procedure.

Rhesus monkeys were trained in a discrete-trials choice procedure and allowed to choose between food delivery (1-16 pellets; 1 g/pellet) and intravenous injections of cocaine (0.03-0.56 mg/kg/injection; N = 4) or procaine (1.0-10 mg/kg/injection; N = 4) during daily 3-h sessions. Injections were available as the alternative to food. When the amount of food available as the alternative to drug was held constant and dose of drug was varied, the frequency of drug choice and total drug intake increased in a dose-related fashion for both cocaine and procaine. For both drugs, when the amount of food available as the alternative to drug was increased and the dose of the drug was held constant, the frequency of drug choice and total drug intake decreased. Thus, increases in the magnitude of an alternative non-drug reinforcer decreased cocaine and procaine self-administration. Further, the results suggest that while increasing the magnitude of the alternative reinforcer decreased the potency of cocaine as a positive reinforcer, the reinforcing efficacy of procaine was decreased. Because drug use by humans typically occurs in a context in which other reinforcers are available, the present results are consistent with the hypothesis that drug self-administration by humans can be decreased by increasing the value of alternative positive reinforcers. In addition, these results suggest that the extent to which drug self-administration is sensitive to this manipulation varies across drugs.

Animals↗

Sequence-specific effects of neurokinin substance P on memory, reinforcement, and brain dopamine activity.

There is ample evidence that the neurokinin substance P (SP) can have neurotrophic as well as memory-promoting effects. This paper outlines a recent series of experiments dealing with the effects of SP and its N- and C-terminal fragments on memory, reinforcement, and brain monoamine metabolism. It was shown that SP, when applied peripherally (IP), promotes memory (inhibitory avoidance learning) and is reinforcing (place preference task) at the same dose of 37 nmol/kg. Most important, however, is the finding that these effects seemed to be encoded by different SP sequences, since the N-terminal SP1-7 (185 nmol/kg) enhanced memory, whereas C-terminal hepta- and hexapeptide sequences of SP proved to be reinforcing in a dose equimolar to SP. These differential behavioral effects were paralleled by selective and site-specific changes in dopamine (DA) activity, as both SP and its C-, but not N-terminus, increased extracellular DA in the nucleus accumbens (NAc), but not in the neostriatum. The neurochemical changes lasted at least 2 h after injection. These results show that the reinforcing action of peripheral administered SP may be mediated by its C-terminal sequence, and that this effect could be related to DA activity in the NAc. Direct application of SP (0.74 pmol) into the region of the nucleus basalis magnocellularis (NBM) was also memory-promoting and reinforcing, and again, these effects were differentially produced by the N-terminus and C-terminus, supporting the proposed structure-activity relationship for SP's effects on memory and reinfrocement. These results may provide a hypothetical link between the memory-modulating and reinforcing effects of SP and the impairment in associative functioning accompanying certain neurodegenerative processes.

Amino Acid Sequence↗

Relative roles of ventral striatal D1 and D2 dopamine receptors in responding with conditioned reinforcement.

Several experiments investigated the involvement of D1 and D2 dopamine receptors in the ventral striatum in the control over behaviour by a conditioned reinforcer using an acquisition of new response procedure. Intra-accumbens infusion of either the D1 receptor antagonist, SCH 23390, or the D2 receptor antagonist, raclopride, completely blocked the potentiative effects of intra-accumbens d-amphetamine on responding with conditioned reinforcement and reduced responding to control levels. SCH 23390 was more potent than raclopride. At higher doses in the absence of d-amphetamine, both antagonists also blocked the preference for responding on the lever producing the conditioned reinforcer. Intra-accumbens infusions of either the D1 receptor agonist, SKF 38393, or the D2/3 receptor agonist, LY 171555 (quinpirole), selectively potentiated responding on the lever producing the conditioned reinforcer. Various combined infusions of the D1 and D2 agonists in specific low doses had additive, but not synergistic, effects on responding with conditioned reinforcement. None of the drugs affected the drinking of water in deprived subjects when infused intra-accumbens. These results suggest that both D1 and D2 receptors in the nucleus accumbens are involved in mediating the effects of dopamine in potentiating the control over behaviour by conditioned reinforcers.

2,3,4,5-Tetrahydro-7,8-dihydroxy-1-phenyl-1H-3-ben↗

Brain neuronal mechanisms of motivation and reinforcement: systemic organization of behavior.

The concept of systemic quantitation of behavior was used to study the interaction between dominant motivation and reinforcement on brain neurons. Feeding and escape were used as experimental models. Results showed that feeding and escape motivations are based on the mechanisms of ascending activating influences of lateral or ventromedial hypothalamic centers, respectively, on cortical neurons. Feeding and escape motivations evoked by electrical stimulation of hypothalamus, or the ones occurring naturally, modify the responses of single neurons of sensorimotor and insular cortex to sensory stimuli, to microiontophoretic application of neurotransmitters and neuropeptides, and especially to reinforcement. Dominant motivations are reflected in the burst-like activity and in a specific pattern of interpulse intervals of single units in various brain structures. Reinforcement transforms this activity into a regular pattern and also changes the neuronal responses of hypothalamic feeding and escape centers, to electrical stimulation and to microiontophoretic application of oligopeptides. Specific patterns of the unit responses to conditioned stimuli in the course of consecutive reinforcement was determined. After several instances of reinforcement, especially after repetitive reinforcement, the brain neurons influenced by the dominant motivation begin to produce specific protein molecules that are important for organization of an appropriate type of behavior. This process can be blocked by protein synthesis inhibitors.

Animals↗

Training of instrumental responses in dogs socially reinforced by humans.

The motivational bases of the social reinforcement in human-dog relations were examined. In experiment I, performed on seven dogs, it was found that dogs were able to learn and sustain the natural responses of sitting, paw extension, and lying prostrate to conditional stimuli in the form of vocal commands reinforced only by social rewards given by the experimenter, such as petting and vocal encouragement. Overtraining did not produce deterioration of performance but, on the contrary, the continual decrease of latencies. It was evidenced that tactile stimulation plays an important role in social reward. In experiment II, instrumental responses to the auditory conditional stimuli were elaborated in two groups of dogs. The first group (nine dogs) was reinforced by food, and the second group (eight dogs) was reinforced exclusively by petting. A similar course of learning and level of performance during overtraining sessions in both groups indicated that petting serves as a good reinforcement, with rewarding value comparable to that of food reinforcement. It is suggested that a strong rewarding effect of pleasurable sensory stimuli occurs in the formation of the bond between dog and human and in the learning of different tasks.

Animals↗

Multiple 5-HT receptors are involved in the effects of acute MDMA treatment: studies on locomotor activity and responding for conditioned reinforcement.

RATIONALE: Responding for conditioned reinforcement is increased by the dopamine releasing agent amphetamine, but reduced by drugs that enhance serotonin (5-HT) function. The amphetamine derivative 3,4-methylenedioxymethamphetamine (MDMA, Ecstasy) releases both monoamines. OBJECTIVES: The primary purpose of this study was to examine the effects of MDMA on responding for conditioned reinforcement as well as on locomotor activity. The roles of several 5-HT receptor sub-types in mediating these behavioural effects of MDMA were also examined. METHODS: Locomotion was measured in photocell activity monitors. For conditioned reinforcement experiments thirsty rats learned to associate a conditioned stimulus (CS) with water in operant chambers. Subsequently, two response levers were available; responding on one lever delivered the CS, while responding on the second lever had no consequences. Drug effects on this operant response were measured. RESULTS: MDMA dose-dependently increased locomotion but reduced responding for conditioned reinforcement. This latter effect differs from that induced by amphetamine, which potentiates conditioned reinforcement responding. The stimulant effect of MDMA was attenuated by GR127935 and ketanserin, indicating facilitatory roles of 5-HT(1B) and 5-HT(2A) receptors in mediating this effect. The 5-HT(2C) antagonist SB242084 enhanced the stimulant effect of MDMA. Only SB242084 attenuated the suppressant effect of MDMA on responding for conditioned reinforcement. CONCLUSIONS: The results show that 5-HT(2A) and 5-HT(1B/1D) receptors play a facilitatory role in mediating the stimulant effect of MDMA, whereas 5-HT(2C) receptors are inhibitory. Activation of 5-HT(2C) receptors also contributes to the deficit in operant responding. Multiple 5-HT receptor sub-types appear to contribute to the behavioural effects of MDMA.

3,4-Methylenedioxyamphetamine↗

Discrete-trials heroin self-administration produces sensitization to the reinforcing effects of cocaine in rats.

RATIONALE: The prevalence of cocaine use in opioid-dependent individuals is reportedly high, and the associated negative health and social consequences are severe and well documented. Sensitization of the reinforcing effects of cocaine has been demonstrated following noncontingent opioid exposure in animals; however, no preclinical studies have investigated the impact of opioid self-administration on cocaine's reinforcing effects. OBJECTIVE: Experiments were designed to investigate whether access to heroin self-administration altered the subsequent reinforcing effects of cocaine. METHODS: Baseline responding for cocaine under a progressive ratio schedule was first established. Heroin was then self-administered under a 24-h discrete-trials procedure (DT5; access to heroin five times per hour). Subsequently, cocaine-maintained responding was reassessed. RESULTS: Here we demonstrate that 10 days of DT5 heroin self-administration (50 microg/kg per infusion) resulted in an increase in cocaine's reinforcing effects at several doses across the cocaine dose-effect curve (0.38-3.0 mg/kg per infusion). These increases were relatively long lasting, exceeding the time course of a mild withdrawal syndrome. CONCLUSIONS: The DT5x10-day history of heroin self-administration resulted in an upward shift in the cocaine dose-effect curve, suggesting that DT5 heroin self-administration produced an increase in potency and sensitization of the maximal effectiveness with which cocaine functions as a reinforcer. The present experiments contribute to a growing amount of preclinical evidence suggesting an impact of opioid exposure on the reinforcing effects of cocaine, which may partially explain the high incidence of cocaine use in opioid-dependent individuals.

Animals↗