Biomedical subjects
Publications and source records attributed to J E Staddon.
Rats pressing a lever for food reinforcement showed large positive-contrast effects when provided with the opportunity for a competing wheel-running response. Positive and negative behavioral contrast may reflect reallocation of competing interim and terminal responses between schedule components following changes in the reinforcement conditions in one component.
In 1970, Herrnstein proposed a simple equation to describe the relation between response and reinforcement rates on interval schedules. Its empirical basis is firm, but its theoretical foundation is still uncertain. Two approaches to the derivation of Herrnstein's equation are discussed. It can be derived as the equilibrium solution to a process model equivalent to familiar linear-operator learning models. Modifications of this approach yield competing power-function formulations. The equation can also be derived from the assumption that response strength is proportional to reinforcement rate, given that there is a ceiling on response rate. The proportional relation can, in turn, be derived from a threshold assumption equivalent to Shimp's "momentary maximizing". This derivation implies that the two parameters of Herrnstein's equation should be correlated, and may explain its special utility in application to internal schedules.
Pigeons were trained to peck on a fixed-interval schedule of food reinforcement and then exposed to three schedules in which there was either no, or an indirect, relation between pecking and food delivery: (a) a conjunctive schedule in which food was delivered at fixed intervals, providing at least one peck was emitted in the interval; (b) a recycling version of the conjunctive schedule that essentially eliminated occasional peck-food contiguities (recycling conjunctive); (c) delivery of food at fixed intervals independently of the birds' behavior (fixed time). The rates and patterns of pecking sustained by these procedures depended on interfood interval and relative proximity of pecks to food.
The effects of presenting a different ("eccentric") stimulus for one interval during either or both components of a cyclic multiple fixed-interval fixed-interval schedule, with 12 short and four long intervals per cycle, were studied in three experiments. Eccentric stimuli in the short-interval component reliably produced a persistent, substantial elevation in key-peck rate. The effect appears to depend on schedule context and an initial "disinhibiting" effect of the eccentric stimulus.
Explore the source record for details and available documents.
Pigeons were exposed to periodic food-reinforcement schedules in which intervals ended with equal probability in either reinforcement or brief blackout. The effects on the pattern of key pecking of sequential probability of reinforcement, interval duration, and time to reinforcement opportunity were investigated in three experiments. The major results were: (1) at short absolute interval durations, time to reinforcement opportunity determined both postreinforcement and postblackout pause (time to first key peck within an interval); (2) at long intervals, postblackout pause was consistently shorter than postreinforcement pause, even if both events signalled the same time to the next reinforcement opportunity (omission effect); (3) when reinforcement and blackout signalled different times to the next reinforcement opportunity, within the same experiment, there was some evidence for interactions analogous to behavioral contrast.
In Experiment I, pigeons were given equal reinforcement (variable-interval 1-min) for responding during randomized presentations of eight line-orientation stimuli. Then, only responding in the vertical orientation was reinforced. Stable generalization gradients soon formed and persistent behavioral and local (transient) contrast effects appeared. Local contrast effects were not a function of relative reinforcement frequency or of any other variable known to produce contrast. Instead, they were related to average response rates associated with each stimulus. Experiment II showed that local contrast effects represent increases and decreases in response rates relative to baseline responding, and that these effects are relative; a given stimulus might enhance responding during a subsequent presentation of one stimulus, but depress responding when followed by another. These data indicate that discrimination learning is not adequately described as the acquisition of excitatory properties by some stimuli and inhibitory properties by others. A more adequate account implies that stimuli exert both excitatory and inhibitory effects related to their value.
Either a partial blackout, or the blackout plus a "feeder flash", occurred in lieu of reinforcement on two procedures that produced opposite patterns of responding after reinforcement. Response rate was elevated after reinforcement omission on the procedure that produced a "pause-and-respond" pattern following reinforcement, but depressed after reinforcement omission on the procedure that produced a "respond-and-pause" pattern. The effect of blackout plus feeder flash was generally intermediate between the effects of blackout and the effects of reinforcement. These results are consistent with an interpretation of reinforcement omission effects in terms of the discriminative temporal control exerted by reinforcement and stimuli similar to it.
Pigeons were exposed to four cycles per session of a schedule in which the duration of successive interreinforcement intervals differed by t-sec. A cycle was composed of seven increasing and seven decreasing intervals, from 2t to 8t sec in length. In Exp. 1, postreinforcement pause tracked interval duration on five cyclic schedules, with values of t ranging from 2 to 40 sec. Tracking was better at shorter t values, and when discriminative stimuli signalled increasing and decreasing parts of the cycle. Pooled data for the whole experiment showed postreinforcement pause to bear a power function relationship to interval length, with a smaller exponent than the comparable function for fixed-interval schedules. Tests in a second experiment showed that pigeons trained on an arithmetic progression could also track schedules in which successive intervals followed either a logarithmic or a geometric progression, although tracking was more stable in the logarithmic case.
Five different reinforcement durations occurred randomly within each session on fixed interval 60-sec. Postreinforcement pause was directly related (and "running" rate inversely related) to the duration of reinforcement initiating each fixed interval.
Pigeons emitted interresponse times that were reinforced if they fell between an upper and a lower bound (t<IRT<t+t/10). Brief stimuli followed each response; under some experimental conditions the color of these stimuli was correlated with whether the preceding interresponse time was longer or shorter than that specified by the schedule. Preliminary experiments indicated that these "feedback" stimuli acquired no discriminative properties even after prolonged training. A modified procedure, in which t varied cyclically throughout each experimental session, allowed the stimuli to acquire such properties: stimulus control was demonstrated under the training conditions, for two of the pigeons, and under transfer conditions for all three birds. A series of probe conditions, followed by a replication of the simple procedure using a multiple schedule, indicated that the controlling property of the stimuli was not the relation between stimuli, interresponse time, and value of t, but a variable determined by the interaction between the animals' responding and the cyclic procedure. This variable was probably the relative frequency of the less-frequent feedback stimulus.
Pigeons were exposed to four cycles per session of a multiple schedule in which each cycle involved twelve 60-sec fixed intervals followed by four 180-sec intervals [(12 FI 60-sec)(4 FI 180-sec) schedule]. Post-reinforcement pauses were shorter during the first few short intervals of each cycle than during later short intervals, and increased over the four long intervals of each cycle (positive and negative transient contrast). A (12 FI 15-sec)(4 FI 45-sec) schedule showed similar results. These two schedules differed in some other respects indicating effects of absolute FI duration on stimulus control. Differences in contrast properties between both these procedures and multiple variable-interval schedules were related to the pause-producing property of reinforcement on FI (temporal inhibition). Behavior under two other multiple fixed-interval schedules-(2 FI 360-sec)(1 FI 720-sec) and (3 FI 360-sec)(1 FI 720-sec)-differed in certain respects from both the (12 FI x-sec)(4 FI 3x-sec) schedules. These differences may be related to differences in the number of successive fixed intervals within a component (run length).
EXPERIMENTS WITH PIGEONS AND RATS SHOWED THAT: (1) When a brief blackout was presented in lieu of reinforcement at the end of 25% of intervals on a fixed-interval 2-min schedule, response rate was reliably and persistently higher during the following 2-min intervals (omission effect). This effect was largely due to a decrease in time to first response after reinforcement omission. (2) When blackout duration was varied, within sessions, over the range 2 to 32 sec, time to first response was inversely related to the duration of the preceding blackout, for pigeons, and for rats during the first few sessions after the transition from FI 2-min to FI 2-min with reinforcement omission. Post-blackout pause was independent of blackout duration for rats at asymptote. These results were interpreted in terms of differential depressive effects of reinforcement and blackout on subsequent responding.
Pigeons were exposed to reinforcement both for short (2 < IRT < 3 sec) and long (10 < IRT < 11 sec) interresponse times. They developed bimodal interresponse-time distributions, which were decomposable into two independent component distributions under the control of the short and long contingencies respectively. The birds' allocation of responses between these two distributions was determined by a simple power-law relationship between reinforcement ratios, and response ratios derived from the component distributions. Comparison between this situation and concurrent choice situations raises the possibility that the power-law relation between ratios may be a more general law of choice than the matching of relative frequencies (probabilities).
Explore the source record for details and available documents.
Pigeons were exposed to a cyclic schedule in which each cycle was composed of twelve 1-min fixed intervals followed by four 3-min fixed intervals; four such cycles comprised an experimental session. The pigeons responded at a much higher average rate during the 3-min intervals than during the 1-min intervals. Other effects were a depression of responding during the first short interval of each cycle and a shortening of postreinforcement pause during the second short interval. The main effect is attributable to a relatively fixed pattern of responding after reinforcement; this pattern consisted in a pause of approximately constant duration followed by responding at an approximately constant rate until the next reinforcement, resulting in much higher average response rates during the longer interreinforcement intervals. The other effects seem attributable to relatively slight differences between the pattern of responding characteristic of later long intervals and the pattern during later short intervals of each cycle. A major implication is that the pigeon is largely insensitive to the sequential properties of many interval-reinforcement schedules. A description of interval-schedule "frustration" phenomena in terms of the inhibitory effects of reinforcement is discussed in relation to these results.
Explore the source record for details and available documents.