Search PubMed⌕ Search

SEARCH · Search PubMed

Results for “REINFORCEMENT”

Search indexed PubMed citations on genomics, clinical trials, systematic reviews and public health. Explore titles, authors and supplied subject terms, then open the PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35Linked to original sources

Fixed-interval schedule of cocaine reinforcement: effect of dose and infusion duration.

Rhesus monkeys were trained on a fixed-interval 9-min limited-hold 3-min schedule of intravenous cocaine reinforcement. A 15-min timeout followed each reinforcement or limited-hold expiration. An identical schedule of food reinforcement was interspersed in the session to assess rate-modifying effects of the drug infusions not specific to drug reinforcement. In one experiment, response rate for cocaine reinforcement was shown to be a positive function of reinforcement magnitude for a dose range from 0 to 800 ug/kg/inj. At these doses, there was little effect on food reinforced responding except at the highest dose, where responding decreased. Results of the second experiment indicated that increasing the duration of the cocaine infusion produced a change in response rate similar to decreasing unit dose. The response rate change for a given increase in infustion duration was less at a unit dose of 400 ug/kg than at 200 ug/kg.

Animals↗

Self-control in adult humans: variation in positive reinforcer amount and delay.

In five experiments, choice responding of female human adults was examined, as a function of variations in reinforcer amount and reinforcer delay. Experiment 1 used a discrete-trials procedure, and Experiments 2, 3, 4, and 5 used a concurrent variable-interval variable-interval schedule. Reinforcer amount and reinforcer delay were varied both separately and together. In contrast to results previously reported with pigeons, the subjects in the present experiments usually chose the larger reinforcers even when those reinforcers were delayed. Together, the results from all the experiments suggest that the subjects followed a maximization strategy in choosing reinforcers. Such behavior makes it easy to observe self-control and difficult to observe impulsiveness in traditional laboratory experiments that use adult human subjects.

Adolescent↗

The effects of reinforcement frequency and response requirements on the maintenance of behavior.

Six rats responded under fixed-interval and tandem fixed-interval fixed-ratio schedules of food reinforcement. Basic fixed-interval schedules alternated over experimental conditions with tandem fixed-interval fixed-ratio schedules with the same fixed-interval value. Fixed-interval length was varied within subjects over pairs of experimental conditions; the ratio requirement of the tandem schedules was varied across subjects. For both subjects with a ratio requirement of 10, overall response rates and running response rates typically were higher under the tandem schedules than under the corresponding basic fixed-interval schedules. For all subjects with ratio requirements of 30 or 60, overall response rates and running response rates were higher under the tandem schedules than under the corresponding basic fixed-interval schedules only with relatively short fixed intervals. At longer fixed intervals, higher overall response rates and running rates were maintained by the basic fixed-interval schedules than by the tandem schedules. These findings support Zeiler and Buchman's (1979) reinforcement-theory account of response strength as an increasing monotonic function of both the response requirement and reinforcement frequency. Small response requirements added in tandem to fixed-interval schedules have little effect on reinforcement frequency and so their net effect is to enhance responding. Larger response requirements reduce reinforcement frequency more substantially; therefore their net effect depends on the length of the fixed interval, which limits overall reinforcement frequency. At the longest fixed intervals studied in the present experiment, reinforcement frequency under the tandem schedules was sufficiently low that responding weakened or ceased altogether.

Animals↗

Choice and conditioned reinforcement.

A potential weakness of one formulation of delay-reduction theory is its failure to include a term for rate of conditioned reinforcement, that is, the rate at which the terminal-link stimuli occur in concurrent-chains schedules. The present studies assessed whether or not rate of conditioned reinforcement has an independent effect upon choice. Pigeons responded on either modified concurrent-chains schedules or on comparable concurrent-tandem schedules. The initial link was shortened on only one of two concurrent-chains schedules and on only one of two corresponding concurrent-tandem schedules. This manipulation increased rate of conditioned reinforcement sharply in the chain but not in the tandem schedule. According to a formulation of delay-reduction theory, when the outcomes chosen (the terminal links) are equal, as in Experiment 1, choice should depend only on rate of primary reinforcement; thus, choice should be equivalent for the tandem and chain schedules despite a large difference in rate of conditioned reinforcement. When the outcomes chosen are unequal, however, as in Experiment 2, choice should depend upon both rate of primary reinforcement and relative signaled delay reduction; thus, larger preferences should occur in the chain than in the tandem schedules. These predictions were confirmed, suggesting that increasing the rate of conditioned reinforcement on concurrent-chains schedules may have no independent effect on choice.

Animals↗

Choice as a function of local versus molar reinforcement contingencies.

Rats were trained on a discrete-trial probability learning task. In Experiment 1, the molar reinforcement probabilities for the two response alternatives were equal, and the local contingencies of reinforcement differentially reinforced a win-stay, lose-shift response pattern. The win-stay portion was learned substantially more easily and appeared from the outset of training, suggesting that its occurrence did not depend upon discrimination of the local contingencies but rather only upon simple strengthening effects of individual reinforcements. Control by both types of local contingencies decreased with increases in the intertrial interval, although some control remained with intertrial intervals as long as 30 s. In Experiment 2, the local contingencies always favored win-shift and lose-shift response patterns but were asymmetrical for the two responses, causing the molar reinforcement rates for the two responses to differ. Some learning of the alternation pattern occurred with short intertrial intervals, although win-stay behavior occurred for some subjects. The local reinforcement contingencies were discriminated poorly with longer intertrial intervals. In the absence of control by the local contingencies, choice proportion was determined by the molar contingencies, as indicated by high exponent values for the generalized matching law with long intertrial intervals, and lower values with short intertrial intervals. The results show that when molar contingencies of reinforcement and local contingencies are in opposition, both may have independent roles. Control by molar contingencies cannot generally be explained by local contingencies.

Animals↗

Sexual reinforcement in the female rat.

Sexual reinforcement in the female rat was studied in a preparation that allowed continuous operant responding for access to a male rat leading to intromission. Experiment 1 used a high operant level nose-poke response to test the possible reinforcing effects of some components of access to a male. A simple tone stimulus used as a conditioned reinforcer and two odor stimuli, target male bedding and emulsified preputial gland, were tested. None of these contingent events altered responding above or below operant level. Access to the male, which was always accompanied by intromission, immediately increased response rate when it was made contingent upon the nose-poke response. Performance on fixed-ratio schedules was erratic, and response rate was low in comparison to typical food-reinforced responding. An interresponse-time analysis indicated, however, that some effect of the ratio contingency may have been present. In Experiment 2, several modifications of the procedure were tested with the objective of creating a more tractable preparation for behavior analysis. Response type and the hormone delivery method were changed, and 2 target males were used instead of 1. The latter tripled the average number of reinforcers earned in a single session. Differences between sexual and other reinforcers are discussed in terms of procedural, quantitative, and motivational aspects of the sexual reinforcement procedure.

Animals↗

Varying wheel-running reinforcer duration within a session: effect on the revolution-postreinforcement pause relation.

Previous investigations of wheel-running reinforcement that manipulated reinforcer duration across conditions showed a strong relation between wheel-running rate and average postreinforcement pause (PRP) duration. To determine if the basis of this relation across conditions was a local effect of fatigue or satiation, the correlation between revolutions run and the duration of the immediately following PRP was investigated under conditions in which reinforcer duration was either constant or variable within a session. Seven male Wistar rats pressed a lever on a fixed-interval 60-s reinforcement schedule with the opportunity to run for 60 s as the reinforcing consequence. In the constant-duration condition, the duration of the reinforcer was always 60 s. In the variable-duration condition, the duration of the reinforcer varied between 2 and 240 s with a mean of 60 s. Mean correlations between revolutions run and the next PRP duration for constant, variable, and constant conditions were -.07, .20, and -.07, respectively. Although the positive correlation in the variable-duration condition is consistent with an effect of momentary fatigue or satiation, little of the variance in PRP duration appears to be attributable to these factors.

Animals↗

The effect of signaled reinforcement on rats' fixed-interval responding.

Four experiments examined the effect on rats' response rate of presenting a brief (500 ms) stimulus simultaneously with the delivery of food on fixed-interval (FI) schedules. In Experiment 1, reinforcement signals that were spatially diffuse (both tones and lights) elevated rates of responding, but responding was attenuated by localized visual stimuli. The remaining experiments examined the signal-induced potentiation of responding. In Experiment 2, a tone reinforcement signal potentiated response rates on an FI schedule, but attenuated response rates on a variable-interval (VI) schedule. This difference was obtained even though the overall rate of responding was equated on the two schedules before the introduction of the signal. Signal-induced potentiation of responding occurred over a range of FI values employed in Experiment 3. In Experiment 4, presenting a reinforcement signal when high local rates of response had occurred immediately before reinforcement resulted in potentiated rates of responding on an FI schedule. The opposite effect on response rate occurred when the reinforcement signal followed only low local rates of response. These results indicate that a variety of factors influence the effects of a reinforcement signal. They imply, however, that the local rate of response at the time of reinforcement is a key factor in establishing the nature of the signaling effect.

Animals↗

The effect of reinforcer delays on the form of the forgetting function.

Pigeons were trained in a matching-to-sample procedure with retention intervals of 0, 2, 4, 6, and 8 s mixed within each session. In different conditions, reinforcement was delayed by 0, 1, 2, 4, 6, or 8 s from correct choice responses. Discriminability decreased with increasing retention-interval duration and with increasing reinforcer delay. Exponential forgetting functions were fitted to discriminability measures plotted as a function of retention interval. Initial discriminability (intercept of the fitted functions) decreased with increasing reinforcer delay. Rate of forgetting (slope of the fitted functions) increased with reinforcer delay, suggesting an interaction between the effects of reinforcer delay and retention interval. The data were well described by multiplying an exponential function describing the effects of retention interval by a hyperbolic function describing the effect of reinforcer delay. This description included an interaction term that allowed for a greater effect of reinforcer delay at longer retention intervals.

Animals↗

On the effects of signaling reinforcer probability and magnitude in delayed matching to sample.

Two experiments examined whether postsample signals of reinforcer probability or magnitude affected the accuracy of delayed matching to sample in pigeons. On each trial, red or green choice responses that matched red or green stimuli seen shortly before a variable retention interval were reinforced with wheat access. In Experiment 1, the reinforcer probability was either 0.2 or 1.0 for both red and green responses. Reinforcer probability was signaled by line or cross symbols that appeared after the sample had been presented. In Experiment 2, all correct responses were reinforced, and the signaled reinforcer durations were 1.0 s and 4.5 s. Matching was more accurate when larger or more probable reinforcers were signaled, independently of retention interval duration. Because signals were presented postsample, the effects were not the result of differential attention to the sample.

Animals↗

Resistance to change of responding maintained by unsignaled delays to reinforcement: a response-bout analysis.

Previous experiments have shown that unsignaled delayed reinforcement decreases response rates and resistance to change. However, the effects of different delays to reinforcement on underlying response structure have not been investigated in conjunction with tests of resistance to change. In the present experiment, pigeons responded on a three-component multiple variable-interval schedule for food presented immediately, following brief (0.5 s), or following long (3 s) unsignaled delays of reinforcement. Baseline response rates were lowest in the component with the longest delay; they were about equal with immediate and briefly delayed reinforcers. Resistance to disruption by presession feeding, response-independent food during the intercomponent interval, and extinction was slightly but consistently lower as delays increased. Because log survivor functions of interresponse times (IRTs) deviated from simple modes of bout initiations and within-bout responding, an IRT-cutoff method was used to examine underlying response structure. These analyses suggested that baseline rates of initiating bouts of responding decreased as scheduled delays increased, and within-bout response rates tended to be lower in the component with immediate reinforcers. The number of responses per bout was not reliably affected by reinforcer delay, but tended to be highest with brief delays when total response rates were higher in that component. Consistent with previous findings, resistance to change of overall response rate was highly correlated with resistance to change of bout-initiation rates but not with within-bout responding. These results suggest that unsignaled delays to reinforcement affect resistance to change through changes in the probability of initiating a response bout rather than through changes in the underlying response structure.

Animals↗

An analysis of reinforcement history effects.

Four pigeons were exposed to two tandem variable-interval differential-reinforcement-of-low-rate schedules under different stimulus conditions. The values of the tandem schedules were adjusted so that reinforcement rates in one stimulus condition were higher than those in the other, even though response rates in the two conditions were nearly identical. Following this, a fixed-interval schedule of either shorter or longer values than, or equal to the baseline schedule, was introduced in the two stimulus conditions respectively. Response rates during those fixed-interval schedules typically were higher in the presence of the stimuli previously correlated with the lower reinforcement rates than were those in the presence of the stimuli previously correlated with the higher reinforcement rates. Such effects of the reinforcement history were most prominent when the value of the fixed-interval schedule was shorter. The results are consistent with both incentive contrast and response strength conceptualizations of related effects. They also suggest methods for disentangling the effects of reinforcement rate on subsequent responding, from the response rate with which it is confounded in many conventional schedules of reinforcement.

Animals↗

Reinforcement value and substitutability of sucrose and wheel running: implications for activity anorexia.

Choice between sucrose and wheel-running reinforcement was assessed in two experiments. In the first experiment, ten male Wistar rats were exposed to concurrent VI 30 s VI 30 s schedules of wheel-running and sucrose reinforcement. Sucrose concentration varied across concentrations of 2.5, 7.5, and 12.5%. As concentration increased, more behavior was allocated to sucrose and more reinforcements were obtained from that alternative. Allocation of behavior to wheel running decreased, but obtained wheel-running reinforcement did not change. Overall, the results suggested that food-deprived rats were sensitive to qualitative changes in food supply (sucrose concentration) while continuing to defend a level of physical activity (wheel running). In the second study, 15 female Long Evans rats were exposed to concurrent variable ratio schedules of sucrose and wheel-running, wheel-running and wheel-running, and sucrose and sucrose reinforcement. For each pair of reinforcers, substitutability was assessed by the effect of income-compensated price changes on consumption of the two reinforcers. Results showed that, as expected, sucrose substituted for sucrose and wheel running substituted for wheel running. Wheel running, however, did not substitute for sucrose; but sucrose partially substituted for wheel running. We address the implications of the interrelationships of sucrose and wheel running for an understanding of activity anorexia.

Animals↗

Differential reinforcement of reaction times in developmental retardates.

The effects of differential reinforcement on reaction times to two intensities of reaction signal were investigated in 36 developmental retardates. One group was reinforced for reaction times to the higher intensity signal; a second group was reinforced for reaction times to the lower intensity signal; a third group received no reinforcement. Reaction time decreased as signal intensity increased and decreased over sessions as a function of reinforcement. Likewise, reinforcement either exaggerated or reversed differences in reaction times to each signal depending on the particular reinforcement contingency. Results were discussed in terms of attentional and motivational explanations of effects of signal intensity on reaction times of retardates.

Acoustic Stimulation↗

Social reinforcement in block design performance by brain-damaged, emotionally disturbed, and non-disturbed retardates.

48 retarded adults, equally divided by sex in three diagnostic categories (brain-damaged, nondamaged disturbed, and nondamaged-nondisturbed) were assigned to posttest reinforcement or control conditions on the basis of CA, IQ, and pretest performance on the Block Design. Reinforced subjects were praised for each individual correct block placement on the posttrest; control subjects repeated the test without reinforcement. Both brain-damaged and non-damaged-nondisturbed subjects showed accuracy gains under reinforcement, while nondamaged-disturbed subjects decreased in accuracy. Failure to replicate previous differential reinforcement effects with brain-damaged and nondamaged-nondisturbed subjects, and the discrepant reinforcement effect on nondamaged-disturbed subjects, did not support the use of reinforcement of performance on the Block Design test as an aid in detecting organic damage.

Adult↗

Within-session rates of responding when reinforcer magnitude is changed within the session.

In the present experiment, the authors investigated the idea that within-session changes in operant response rates occur because subjects sensitize and then habituate to the reinforcer. If that is true, then altering an aspect of the reinforcer within the session should alter the observed within-session responding. The authors tested that idea by having rats press a lever for 2 food-pellet reinforcers delivered by a variable-interval 120-s schedule during 60-min baseline sessions. In treatment conditions, the magnitude of the reinforcer was halved (1 pellet) or doubled (4 pellets) 10, 20, 30, 40, or 50 min into the session. That magnitude of reinforcement then remained in effect for the rest of the session. Altering reinforcer magnitude altered the rates of responding within the session in a fashion consistent with the habituation explanation, that is, response rates increased, relative to baseline, when the magnitude of reinforcement was increased. They decreased when the magnitude was decreased. Those results were seemingly inconsistent with the competing idea that within-session decreases in responding rates are produced by satiation.

Animals↗

Reinforcement frequency, but not gender, determines sensitivity to discriminative stimulus effects of morphine.

We demonstrated previously that several parameters of a morphine discrimination were significantly different in female versus male rats, using a fixed ratio (FR)-10 schedule of food reinforcement; however, this schedule produced a significant bias in reinforcement frequency between saline and morphine sessions in males but not in females. To determine whether this schedule-drug-sex interaction caused the sex difference in discriminability of morphine, female and male rats were trained to discriminate 3.0 mg/kg morphine from saline using a variable interval (VI) 15-s/VI 15-s (Phase I), a VI 7.5-s/VI 15-s (Phase II), and a VI 15-s/VI 15-s (Phase III) schedule of food reinforcement on morphine/saline levers, respectively. After a minimum of 40 training sessions in each phase, mean reinforcement rates in morphine sessions were highest, and the ED50 values for morphine discrimination were lowest, in Phase II. Thus, as predicted, the morphine dose-effect curves shifted to the left from Phase I to Phase II, and back to the right from Phase II to III, presumably due to the bias in reinforcement rate between saline and morphine sessions that was induced by manipulating the VI schedule on the morphine lever. However, there were no sex differences in the morphine versus saline reinforcement rate or in discrimination ED50 in any phase, suggesting that the sex difference observed in our initial study was probably due to the bias in reinforcement frequency (towards the saline condition) that occurred only in males under the FR-10 schedule. This study demonstrates the importance of considering group differences in schedule-drug interactions when comparing discriminative stimulus properties of drugs between groups.

Analysis of Variance↗

In vitro analog of operant conditioning in aplysia. I. Contingent reinforcement modifies the functional dynamics of an identified neuron.

Previously, an analog of operant conditioning in Aplysia was developed using the rhythmic motor activity in the isolated buccal ganglia. This analog expressed a key feature of operant conditioning, namely a selective enhancement in the occurrence of a designated motor pattern by contingent reinforcement. Different motor patterns generated by the buccal central pattern generator were induced by monotonic stimulation of a peripheral nerve (i.e., n.2,3). Phasic stimulation of the esophageal nerve (E n.) was used as an analog of reinforcement. The present study investigated the neuronal mechanisms associated with the genesis of different motor patterns and their modifications by contingent reinforcement. The genesis of different motor patterns was related to changes in the functional states of the pre-motor neuron B51. During rhythmic activity, B51 dynamically switched between inactive and active states. Bursting activity in B51 was associated with, and predicted, characteristic features of a specific motor pattern (i.e., pattern I). Contingent reinforcement of pattern I modified the dynamical properties of B51 by decreasing its resting conductance and threshold for eliciting plateau potentials and thus increased the occurrences of pattern I-related activity in B51. These modifications were not observed in preparations that received either noncontingent reinforcement (i.e., yoke control) or no reinforcement (i.e., control). These results suggest that a contingent reinforcement paradigm can regulate the dynamics of neuronal activity that is centrally programmed by the intrinsic cellular properties of neurons.

Animals↗