Search PubMed⌕ Search

SEARCH · Search PubMed

Results for “REINFORCEMENT”

Search indexed PubMed citations on genomics, clinical trials, systematic reviews and public health. Explore titles, authors and supplied subject terms, then open the PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50Linked to original sources

A test of the negative discriminative stimulus as a reinforcer of observing.

Five pigeons were used to test the hypothesis that the source of reinforcement for observing behavior is the information that it provides concerning the schedule of primary reinforcement. On a variable-interval schedule, pecking the left-hand key produced a 30-sec display of such information. During this 30-sec period, when pecking the right-hand key was reinforced on a random-interval schedule, both keys were green; when no reinforcement was scheduled (extinction) both keys were red. Later, this baseline procedure, in which both red and green were available, was replaced for blocks of sessions by procedures in which either (a) the red was eliminated and only the green could be produced; or (b) the green was eliminated and only the red could be produced. The results were that green maintained rates of pecking on the left key that were as high or higher than when both colors were available and that red maintained no responding. It was concluded that the reinforcing value of a stimulus depends on the positive or negative direction of its correlation with primary reinforcement, rather than upon the amount of information that it conveys.

Journal Article↗

Interaction of frequency and magnitude of reinforcement on concurrent performances.

Frequency and magnitude of reinforcement were varied in concurrent variable-interval variable-interval schedules of reinforcement. The relative response rate to the two stimuli did not support the notion that choice approximately matches relative total access to food (the product of frequency and magnitude of reinforcement in one schedule divided by the sum of products of frequency and magnitude in both schedules). Relative response rates matched relative reinforcement value when that measure was adjusted to give more emphasis to reinforcement frequency than to reinforcement duration.

Journal Article↗

Continuous, fixed-ratio, and fixed-interval reinforcement in honey bees.

Bees learned to enter a Plexiglas tube and to suck small portions of sugar solution; every entry or every fifth entry was reinforced. During an extinction phase, the bees on the fixed-ratio schedule emitted twice as many responses as did those given continuous reinforcement. Bees on a fixed-interval schedule of reinforcement emitted lower response rates than did those given fixed-ratio reinforcement. By extending the conditioning procedure for several days, it was possible to maintain responding with fixed-ratio schedules requiring 30 responses per reinforcement and with fixed-interval values up to 90 sec. Under fixed-interval schedules, response rates did not increase toward the end of the reinforcement intervals.

Journal Article↗

Signalled reinforcement in multiple and concurrent schedules.

Five pigeons were exposed to multiple and concurrent variable-interval, variable-interval reinforcement schedules in which reinforcement availability in one component was never signalled. During certain phases of the experiment, reinforcement availability in the other component was signalled. Behavioral contrast was observed in seven of eight instances when reinforcement availability in the multiple schedules was signalled. Under the concurrent schedules in which reinforcement availability was signalled, the subjects did not always allocate more time to (prefer) the component containing non-signalled reinforcement, as would be predicted by an account of behavioral contrast holding that contrast results from the introduction of a less-preferred condition in one component of a multiple schedule.

Journal Article↗

A test of the effectiveness of the differential-reinforcement-of-low-rate schedule.

Pigeons and rats were used in a yoked-control design that equated the reinforcement distributions of differential-reinforcement-of-low-rate and variable-interval schedules. Both a between-subjects design and a within-subjects design found response rate higher for the variable-interval schedule than for the differential-reinforcement-of-low-rate schedule, thus demonstrating the effectiveness of the differential-reinforcement-of-low-rate contingency. The interresponse-time distributions were unimodal for all subjects under the variable-interval schedule and bimodal for pigeons under the differential-reinforcement-of-low-rate schedule. The interresponse-time distributions for rats under the differential-reinforcement-of-low-rate schedule were also bimodal in three of four cases but the height of the modes at the shorter interresponse times were small in both absolute value and in relation to the height of the modes at the shorter interresponse times of the pigeons' distributions.

Journal Article↗

Concurrent performances: stimulus-control gradients during schedules of signalled and unsignalled concurrent reinforcement.

On one key, pigeons' pecks were reinforced according to a variable-interval schedule in the presence of vertical lines, and were not reinforced in the presence of oblique lines. On a second key, pecks were reinforced according to a variable-interval schedule in the presence of blue, according to a signalled variable-interval schedule in the presence of red, and were not reinforced in the presence of white. Subsequently, during extinction, stimulus-control gradients were obtained by presenting eight different line orientations on the first key concurrent with each of the three colors on the second key. On the first key, line-orientation gradients tended to be lower, narrower, and less shifted in peak or area when the second-key stimulus was blue or red, the stimuli respectively correlated with unsignalled and signalled reinforcement, than when it was white, the stimulus correlated with extinction. Thus, the effect on first-key line-orientation gradients depended on second-key stimuli correlated with concurrent reinforcement, whether or not these stimuli were also correlated with concurrent responding. As a function of first-key line orientation, an inverted gradient was obtained on the second key during blue; during both red and white, rates of pecking on the second key were near zero.

Journal Article↗

The reinforcement value of schedule-induced drinking.

The effect of food reinforcement schedules on the reinforcement value of drinking water was evaluated. Food-deprived rats were exposed to concurrent, identical variable-time schedules of food presentation, the food thus being delivered independently of the rats' behavior. When the relative amount of time spent in a schedule component stabilized, an opportunity to drink water was introduced into one schedule component. The value of the variable-time schedules was varied from 60 to 90 to 270 sec. The relative amount of time spent in the schedule component associated with drinking water was a decreasing function of food frequency for two animals and remained constant for the third. Drinking rates were direct functions of food frequency, and the amount of water drunk per pellet was an inverse function of food frequency. The reinforcement value of drinking water, according to the Matching Law, was a direct function of the frequency of food presentation. It was concluded that food reinforcement schedules indirectly influence rates of drinking by altering the reinforcement value of drinking water and that certain properties of schedule-induced drinking can be accounted for in terms of the reinforcement value of drinking water, the rate of drinking, and the frequency of food presentation.

Journal Article↗

Behavioral contrast in the pigeon: a study of the duration of key pecking maintained on multiple schedules of reinforcement.

Pecks on an operant key were reinforced on either multiple variable-interval variable-interval or multiple variable-interval extinction schedules of reinforcement. The stimuli that signalled the multiple-schedule components were located on a second key (signal key), and a changeover delay prevented reinforcement of signal key-peck-operant key-peck sequences. No behavioral contrast was observed on the operant key, and appreciable responding to the signal key occurred during the variable-interval component of the multiple variable-interval extinction procedure. Peck durations on the signal key were markedly shorter than peck durations on the operant key. Moreover, most responses on the signal key occurred just after the multiple-schedule components changed. These data support an account of behavioral contrast in terms of the summation of pecks that are separately controlled by stimulus-reinforcer and response-reinforcer dependencies, and suggest that the stimulus-reinforcer dependency is responsible primarily for local contrast. In addition, the data suggest that pecks that are controlled by these two dependencies may belong to topographically different classes.

Journal Article↗

Aftereffects of reinforcement on variable-ratio schedules.

On each of variable-ratio 10, 40, and 80 schedules of reinforcement, when rats' lever-pressing rates were stable, the concentration of a liquid reinforcer was varied within sessions. The duration of the postreinforcement pause was an increasing function of the reinforcer concentration, this effect being more marked the higher the schedule parameter. The running rate, calculated by excluding the postreinforcement pause, was unaffected by concentration. The duration of the postreinforcement pause increased with the schedule parameter, but the proportion of the interreinforcement interval taken up by the pause decreased. Consequently, the overall response rate was an increasing function of the schedule parameter; i.e., it was inversely related to reinforcement frequency, contrary to the law of effect. The running rate, however, decreased with the reinforcement frequency, in accord with the law of effect. When 50% of reinforcements were randomly omitted, the postomission pause was shorter than the postreinforcement pause, but the running rate of responses was not affected.

Journal Article↗

Force and rate relations in responding during variable-interval reinforcement.

Four rats responded on one-minute variable-interval schedules with several variations in peak-force of response required for food reinforcement. Measures of peak force and rate were taken for the responses, which were the downward exertions of force against a static force-transducing operandum. The analysis distinguished responses, a generic class of measured behavior, from criterion responses, an operationally specified subclass required for reinforcement. Absolute rate of response showed no systematic change, but the rate of responses meeting a newly required criterion of peak-force invariably increased through changes in the absolute rate of response, the relative-frequency distributions of peak force, or some combination of both. The relative frequency of responses meeting an elevated force criterion during variable-interval reinforcement exceeded that maintained with the same criterion with continuous reinforcement. The requirement of more effortful responding for reinforcement does not necessarily reduce response rate. Conformity of the behavior to the requirement for reinforcement is the salient effect.

Journal Article↗

Effect of variable-interval punishment on the behavior of humans in variable-interval schedules of monetary reinforcement.

One male and three female human subjects pressed a button for monetary reinforcement under a range of variable-interval schedules specifying different frequencies of reinforcement. On alternate days, responding was also punished (by subtraction of money) according to a variable-interval 170-second schedule. In the absence of punishment, the rate of responding was an increasing negatively accelerated function of reinforcement frequency, as predicted by Herrnstein's equation. The effect of the punishment schedule was to suppress responding under lower frequencies of reinforcement; responding under higher reinforcement frequencies was much less affected. This was reflected in an increase in the value of K(H) (the constant expressing the reinforcement frequency corresponding to the half-maximal response rate), whereas there was no significant change in the value of R(max) (the constant expressing the maximum response rate). Previous results had shown that variable-ratio punishment resulted in a change in the values of both constants (Bradshaw, Szabadi, and Bevan, 1977). The results of the present study were consistent with the concept that the suppressive effects of punishment on responding depend on the nature of the punishment schedule.

Journal Article↗

Contrast and induction in multiple schedules of discrete-trial concurrent reinforcement.

Three pigeons were exposed to two-key discrete-trial concurrent schedules of reinforcement. Red and white key colors alternated irregularly and the assignment of reinforcers depended on key color. The red-key schedules were held constant, with the scheduled relative frequency of reinforcement for left-key pecks set at 0.75, while the white-key schedules varied. When the location of white-key reinforcement was changed from one side to the other, while its overall frequency was constant, red-key choices shifted in the same direction as white-key choices, an induction effect. When the overall frequency of white-key reinforcement was changed while its location remained constant, red key choices shifted in a direction opposite to white-key choices, a contrast effect. Both induction and contrast effects were clearer when the overall frequency of red-key reinforcement was reduced. These data demonstrate that the allocation of responding may exhibit schedule interaction effects similar to those commonly reported for response rate.

Journal Article↗

Interresponse-time shaping by variable-interval-like interresponse-time reinforcement contingencies.

The interresponse-time reinforcement contingencies and distributions of interreinforcement intervals characteristic of certain variable-interval schedules were mimicked by reinforcing each key peck with a probability equal to the duration of the interresponse time it terminated, divided by the scheduled mean interreinforcement interval. The interresponse-time reinforcement contingency was then eliminated by basing the probability of reinforcement on the fifth interresponse time preceding the key peck. Even though distributions of interreinforcement intervals were unaffected by this manipulation, response rates consistently increased. A second experiment replicated this effect and showed it to combine additively with that of mean reinforcement rate. These results provide strong support for the contention that current analyses of variable-interval response rates that ignore the inherent interresponse-time reinforcement contingency may be seriously in error.

Journal Article↗

The following schedule of reinforcement as a fundamental determinant of steady state contrast in multiple schedules.

Two experiments investigated whether steady-state interactions in multiple schedules depend exclusively on the following schedule of reinforcement. Experiment 1 used a four-component multiple schedule in which two components were associated with the same constant schedule of reinforcement, and where rate of reinforcement was varied in the component that followed one of these. Contrast effects were reliable only in the component that preceded the point of reinforcement variation, although some contrast did occur otherwise. In those instances where contrast other than the following-schedule effect did occur, it was accounted for by the effect of the preceding schedule, an effect for which there were consistent individual differences among subjects, and which varied with component duration. Experiment 2 used a three-component schedule, in which reinforcement rate was varied in the middle component. The results were consistent with Experiment 1, as the following-schedule effect was the only consistent effect that occurred, although an effect of the preceding schedule did occur for some subjects under some conditions, and was especially evident early in training. The conclusion from both experiments is that there is no general effect of relative rate of reinforcement apart from the sum of the effects of the preceding and following schedules, and that the following-schedule effect is the fundamental cause of steady-state interactions.

Journal Article↗

Reinforcement by an imprinting stimulus versus water on simple schedules in ducklings.

Ducklings (5 to 28 days old) were trained to peck a pole on fixed-ratio, fixed-interval, and multiple schedules using brief presentation of an imprinting stimulus as the response-contingent event. Other ducklings of the same age were trained similarly except that reinforcement consisted of access to water. With water reinforcement the typical fixed-ratio ("break-run"), fixed-interval ("scallop"), and multiple schedule response patterns were readily established and consistently maintained. With the imprinting stimulus these schedule effects were inconsistent in some subjects and virtually nonexistent in others, despite extended training. Schedule control with the imprinting stimulus was not improved by the use of a reinforcement signaling procedure which enhances responding reinforced by electrical brain stimulation on intermittent schedules. However, the overall rates of responding and the extinction functions generated after reinforcement with water versus the imprinting stimulus were comparable. These findings imply that control by temporal and discriminative stimuli may be relatively weak when a young organism's behavior is reinforced by presentation of an imprinting stimulus.

Journal Article↗

Failure to produce response variability with reinforcement.

Two experiments attempted to train pigeons to produce variable response sequences. In the first, naive pigeons were exposed to a procedure requiring four pecks on each of two keys in any order, with a reinforcer delivered only if a given sequence was different from the preceding one. In the second experiment, the same pigeons were exposed to this procedure after having been trained successfully to alternate between two specific response sequences. In neither case did any pigeon produce more than a few different sequences or obtain more than 50% of the possible reinforcers. Stereotyped sequences developed even though stereotypy was not reinforced. It is suggested that reinforcers have both hedonic and informative properties and that the hedonic properties are responsible for sterotyped repetition of reinforced responses, even when stereotypy is negatively related to reinforcer delivery.

Journal Article↗

Briefly delayed reinforcement: An interresponse time analysis.

Key-peck responding of pigeons was compared under VI or DRL schedules arranging immediate reinforcement and briefly (.5 sec) delayed reinforcement. Delays were either signaled by a blackout in the chamber, unsignaled, or unsignaled with an additional requirement that responding not occur during the .5 sec interval immediately preceding reinforcement (response delay). Relative to the immediate reinforcement condition, response rates increased during the unsignaled delay, decreased during the signaled delay, and were inconsistent during the response delay condition. An analysis of interresponse times (IRTs) under the different conditions revealed a substantial increase in the frequency of short (0 to .5 sec) IRTs during the unsignaled condition and generally during the response delay conditions compared to that during the immediate reinforcement baseline. Signaled delays decreased the frequency of short (0 to .5 sec) IRTs relative to the immediate reinforcement condition. The results suggest that brief unsignaled delays and, in many instances, response delays increase the frequency of short IRTs by eliminating constraints on responding.

Journal Article↗

On the effects of food deprivation and component reinforcer rates on multiple-schedule performance.

Six pigeons were used to investigate the effects of varying body weight and component reinforcer rates in two-component multiple variable-interval variable-interval schedules. In Parts 1 and 3 of the experiment, unequal component reinforcer rates were arranged, and body weights were respectively increased and decreased. At 80% ad lib weight, response-rate ratios were closer to unity than reinforcer-rate ratios, but at 100% or more of ad lib weight, response-rate ratios generally equaled reinforcer-rate ratios. In Part 2, component reinforcer-rate ratios were varied over five conditions with the subjects maintained at 100% or more of their ad lib weights, and response-rate ratios matched reinforcer-rate ratios. The data thus support the empirical finding that response allocation in multiple schedules is a function of deprivation. Although this qualitative result is predicted by three models of multiple-schedule performance, only a model that assumes no direct component interaction adequately describes the data.

Journal Article↗