Search PubMed⌕ Search

Biomedical subjects

J A Nevin

Publications and source records attributed to J A Nevin.

At least 37 records · Page 2Linked to original sources

Reinforcement contingencies and signal detection.

Pigeons were trained to discriminate temporal stimuli in a discrete-trial signal-detection procedure. Pecks to one side key were reinforced intermittently after exposure to one duration, and pecks to the other side key were reinforced intermittently after exposure to a different duration. In Experiment I, the allocation of reinforcers was varied systematically for correct responses and for errors, using a procedure that controlled the obtained numbers of reinforcers. When reinforcers were allocated symmetrically, the level of discrimination decreased as the proportion of reinforcers for errors increased. When reinforcers were allocated asymmetrically, the decrease in discrimination was less systematic. Bias toward one or the other side key roughly matched the ratio of reinforcers obtained by pecks at those keys, independent of the level of discrimination. In Experiment II, the overall rate of reinforcement for correct responses was varied both within and between experimental conditions. The level of discrimination was positively related to the overall rate of reinforcement. The discrimination data of both experiments were interpreted in relation to the contingencies of reinforcement and nonreinforcement, characterized by the average difference in reinforcement probability for correct responses and errors.

Animals↗

Editor's comment.

Explore the source record for details and available documents.

Journal Article↗

Introduction.

Explore the source record for details and available documents.

Journal Article↗

Editorial.

Explore the source record for details and available documents.

Journal Article↗

Editorial.

Explore the source record for details and available documents.

Journal Article↗

Feedback functions for variable-interval reinforcement.

On a given variable-interval schedule, the average obtained rate of reinforcement depends on the average rate of responding. An expression for this feedback effect is derived from the assumptions that free-operant responding occurs in bursts with a constant tempo, alternating with periods of engagement in other activities; that the durations of bursts and other activities are exponentially distributed; and that the rates of initiating and terminating bursts are inversely related. The expression provides a satisfactory account of the data of three experiments.

Journal Article↗

Conditioned reinforcement and choice.

In a series of three experiments, rats were exposed to successive schedule components arranged on two levers, in which lever pressing produced a light, and nose-key pressing produced water in 50% of the light periods. When one auditory signal was presented only during those light periods correlated with water on one lever, and a different signal was presented only during those light periods correlated with nonreinforcement on the other lever, the former lever was preferred in choice trials, and higher rates of responding were maintained on the former lever in nonchoice (forced) trials. Thus, the rats preferred a schedule component that included a conditioned reinforcer over one that did not, with the schedules of primary reinforcement and the information value of the signals equated. Preferences were maintained when one or the other of the auditory signals was deleted, but were not established in naive subjects when training began with either the positive or negative signal only. Discriminative control of nose-key pressing by the auditory signals was highly variable across subjects and was not correlated with choice.

Journal Article↗

Contrast and induction in multiple schedules of discrete-trial concurrent reinforcement.

Three pigeons were exposed to two-key discrete-trial concurrent schedules of reinforcement. Red and white key colors alternated irregularly and the assignment of reinforcers depended on key color. The red-key schedules were held constant, with the scheduled relative frequency of reinforcement for left-key pecks set at 0.75, while the white-key schedules varied. When the location of white-key reinforcement was changed from one side to the other, while its overall frequency was constant, red-key choices shifted in the same direction as white-key choices, an induction effect. When the overall frequency of white-key reinforcement was changed while its location remained constant, red key choices shifted in a direction opposite to white-key choices, a contrast effect. Both induction and contrast effects were clearer when the overall frequency of red-key reinforcement was reduced. These data demonstrate that the allocation of responding may exhibit schedule interaction effects similar to those commonly reported for response rate.

Journal Article↗

Choice, time allocation, and response rate during stimulus generalization.

Six pigeons were trained to discriminate between two noise intensities using a procedure that assessed choice, time allocation, and response rate simultaneously and independently. Responses on the left or right key (R1 or R2) were respectively correct in the presence of two different intensities, S1 and S2. After a correct response, reinforcement became available for pecks on the center key. Reinforcement density for R1|S1 relative to R2|S2 was varied across experimental conditions. Generalization tests followed extensive training at each condition. As a function of stimulus intensity, proportions of initial choices of R2, of time spent in R2-initiated components, and of center-key responses emitted in R2-initiated components all yielded sigmoidal gradients of similar slope, which shifted slightly in location when relative reinforcement density changed. Changeovers were maximal where initial choice proportions approximated 0.5. Gradients relating the absolute number of center-key responses to stimulus intensity were also roughly sigmoidal, but were more sensitive to changes in reinforcement density. Gradients of momentary response rate also depended on reinforcement density. During training, large but transitory shifts in choice responding occurred when reinforcement density changed, while differences in momentary response rate developed slowly, suggesting separate control of choice and response rate by the contingencies of reinforcement.

Journal Article↗

Olfactory discrimination, reversal learning, and stimulus control in rats.

Rats were trained to discriminate lights, tones, or odors and then given a series of discrimination reversals. Only rats trained with odors showed positive transfer on the first reversal and acquisition of a reversal set. Other experiments demonstrated that rats preferentially attend to odors when presented in compound with lights or tones; that odors exert more discriminative control than tones in tests using compound stimuli of competing sign; and that after pretraining on the positive stimulus, acquisition of an odor but not a light discrimination occurs with virtually no errors. These results demonstrate the importance of stimulus modality in the establishment of stimulus control and the need for more careful analysis of stimulus factors in cross-species comparisons of learning ability.

Animals↗

Transfer of hue matching in pigeons.

Pigeons were trained on a modified three-key matching-to-sample procedure, in which only one comparison key (rather than two) was lighted after an observing response to the center-key standard. Pecks on keys of matching comparison hues were reinforced. When non-matching hues appeared as the initially lighted comparisons, the nonmatching hue terminated and the matching hue appeared on the other side key only if the pigeon did not peck the nonmatching comparison for 4.8 sec. Pecks to the nonmatching hue reset the 4.8-sec delay interval. Three hues were used during acquisition. During transfer tests, two novel hues were substituted individually or together for one or two of the training hues. Latencies to the novel side-key hue were shortest when a novel matching hue appeared as the standard on the center key, and were essentially identical to baseline matching latencies. In contrast, when a novel hue appeared as either a standard or comparison in a nonmatching combination, latencies increased with increasing separation between the noevel hue and the nonmatching hue. These transfer data demonstrate the concept of hue matching.

Animals↗

Differential reinforcement and signal detection.

Reinforcement was introduced for responses normally treated as errors in signal-detection procedures. The first experiment used a standard two-response discrete-trial procedure with no reinforcement for errors. Results showed that rats altered their response biases but maintained constant sensitivity to visual signals when reinforcement probabilities varied, and that their sensitivity depended on the physical difference between signals, in accordance with the predictions of signal-detection theory. Experiment II, with rats, and Experiment III, with pigeons, demonstrated that sensitivity decreased in this procedure when reinforcement was scheduled for errors with the signals held constant, despite independence of overall number of reinforcers and sensitivity. Experiment IV, with rats, replicated the decrease in sensitivity in a continuous procedure employing only one response. The decrements in sensitivity were similar across Experiments II, III, and IV, and accorded well with earlier research. Thus, contrary to a fundamental assumption of signal-detection theory, estimates of sensitivity are not always invariant with respect to the outcomes of responding, but depend on relative reinforcement of correct responses.

Animals↗

On the form of the relation between response rates in a multiple schedule.

Three pigeons received training on multiple variable-interval schedules with brief alternating components, concurrently with a fixed-interval schedule of food reinforcement on a second key. Fixed-interval performance exhibited typical increases in rate within the interval, and was independent of multiple-schedule responding. Responding on the multiple-schedule key decreased as a function of proximity to reinforcement on the fixed-interval key. The overall relative rate of responding in one component of the multiple schedule roughly matched the overall relative rate of reinforcement. Within the fixed interval, response rate during one multiple-schedule component was a monotonic, negatively accelerated function of response rate during the other component. To a first approximation, the data were described by a power function, where the exponent depended on the relative rate of reinforcement obtained in the two components. The relative rate of responding in one component of the multiple schedule increased as a function of proximity to fixed-interval reinforcement, and often exceeded the overall obtained relative rate of reinforcement. The form of the function relating response rates is discussed in relation to findings on rate-dependent effects of drugs, chaining, and the relation between response rate and reinforcement rate in single-schedule conditions.

Journal Article↗

Signal detection methods for measurement of utility in animals.

Analytic methods of signal detection theory were employed to assess the utility of reinforcers. Four pigeons were trained to detect the presence or absence of a stimulus by pecking one of two side keys in a trial-by-trial choice paradigm. The relative rate of positive reinforcement for correct choices was varied to offset the biasing effects of electric shock for incorrect right side-key choices. The effects of relative rate of reinforcement on bias were similar at all shock intensities even though the subjects' sensitivity changed during the course of the experiment. The relative rate of reinforcement required to produce equal bias was calculated and plotted against shock intensity to generate utility functions. The relative rate of reinforcement necessary to offset the bias induced by shock was an increasing function of shock intensity.

Journal Article↗

Response strength in multiple schedules.

In several different experiments, pigeons were trained with one schedule or condition of food reinforcement for pecking in the presence of one key color, and a different schedule or condition in the presence of a second key color. After responding in both of these multiple schedule components stabilized, response-independent food was presented during dark-key periods between components, and the rates of pecking in both schedule components decreased. The decrease in responding relative to baseline depended on the frequency, magnitude, delay, or response-rate contingencies of reinforcement prevailing in that component. When reinforcement was terminated, decreases in responding relative to baseline rates were ordered in the same way as with response-independent food. The relations between component response rates were power functions. Internal consistencies in the data, in conjunction with parallel findings in the literature, suggest that the concept of response strength summarizes the effects of diverse procedures, where response strength is identified with relative resistance to change. The exponent of the power function relating response rates may provide the basis for scaling response strength.

Journal Article↗

Rates and patterns of responding with concurrent fixed-interval and variable-interval reinforcement.

Pigeons were exposed to concurrent fixed-interval and variable-interval schedules of food reinforcement on two keys. The times between reinforcement were varied systematically on both keys. The overall relative frequency of responding on the fixed-interval key depended on the relative frequency of reinforcement, but did not match it. Instead, the ratio of responses on the fixed-interval key to responses on the variable-interval key was a power function of the ratio of reinforcements, with an exponent of 0.5. Patterns of responding between reinforcements on the fixed-interval key depended on both relative and absolute values of the reinforcement schedules. Similar overall relative responding was obtained at different absolute schedule values with equal relative reinforcement, despite some differences in patterns of responding.

Journal Article↗

Interval reinforcement of choice behavior in discrete trials.

Pigeons were trained to peck at red or green keys presented simultaneously in discrete trials. In one experiment, reinforcements were arranged by concurrent variable-interval schedules. The proportion of responses to green approximately matched the proportion of reinforcements produced by pecking green. Detailed analysis of responding revealed a systematic decrease in the probability of switching from green to red within sequences of trials after reinforcement. This trend corresponded to sequential changes in the relative frequency of reinforcement, and not to sequential changes in probability of reinforcement. In a second experiment, reinforcements were scheduled probabilistically every seventh trial. Even though there were no contingencies on pecking during the first six post-reinforcement trials, choices of green on the first response after reinforcement matched the proportion of reinforcements for pecking green. These results extend the generality of overall matching under concurrent reinforcement.

Journal Article↗