Search PubMed⌕ Search

Biomedical subjects

Michael Davison

Publications and source records attributed to Michael Davison.

17 recordsLinked to original sources

Molecular order in concurrent response sequences.

We studied the order of emission of concurrently reinforced free-operant two-response sequences such as left-left (LL) and left-right (LR). The end of each sequence was demarcated by stimulus change. The use of demarcated sequences of responses, as opposed to individual responses, provides an expanded set of distinct, temporally ordered behaviour pairings to investigate (e.g., LL followed by LL, LL followed by LR, etc.); it is as well a real-life analogue. A sequential analysis of new and existing rat and pigeon data revealed patterns in both overall and post-reinforcer-only sequence emission order. These patterns were consistent across species and individuals, and they followed higher-order organising principles. We describe sequence non-repetition, last-response repetition, and the proportion and post-reinforcer effects, and relate them to existing molar and molecular behaviour principles. Beyond their immediate implications, our results illustrate the value of sequential analysis as a tool for the investigation of molar-molecular behavioural relations.

Animals↗

Contingency discriminability and peak shift in concurrent schedules.

We investigated the effects of discriminative stimuli on choice in a highly variable environment using a procedure in which multiple two-key concurrent VI VI components changed every 10 reinforcers and were signaled by differential flashes of red and yellow keylights. Across conditions, five pigeons were exposed to a number of different combinations of the following component reinforcer ratios: 27:1, 9:1, 3:1, 1:1, 1:3, 1:9, 1:27. Overall, there was clear control by the component signals in that preference, early in components and particularly before any reinforcers had been delivered, was ordinally related to the signaled reinforcer ratios. In conditions in which only two components arranged unequal reinforcer ratios (e.g., 27:1 and 1:27) with the remaining components arranging 1:1 reinforcer ratios, preference before the first reinforcer in a component showed peak shift in that the most extreme preference did not occur in the unequal reinforcer-ratio components, but in 1:1 components further towards the ends of the stimulus dimension. The contingency-discriminability model (Davison & Nevin, 1999) was fitted to the data and provided an excellent description of the interactions between stimulus and reinforcer effects in a highly variable environment.

Animals↗

Do conditional reinforcers count?

Six pigeons were trained on a procedure in which seven components arranged different food-delivery ratios on concurrent variable-interval schedules each session. The components were unsignaled, lasted for 10 food deliveries, and occurred in random order with a 60-s blackout between components. The schedules were arranged using a switching-key procedure in which two responses on a center key changed the schedules and associated stimuli on two side keys. In Experiment 1, over five conditions, an increasing proportion of food deliveries accompanied by a magazine light was replaced with the presentation of the magazine light only. Local analyses of preference showed preference pulses toward the alternative that had just produced either a food-plus-magazine-light or magazine-light-only presentation, but pulses after food deliveries were always greater than those after magazine lights. Increasing proportions of magazine lights did not change the size of preference pulses after food or magazine-light presentations. Experiment 2 investigated the effects of correlations between food ratios and magazine-light ratios: In Condition 6, magazine-light ratios in components were inversely correlated (-1.0) with food ratios, and in Condition 7, magazine-light ratios were uncorrelated with food ratios. In Conditions 8 and 9, pecks also produced occasional 2.5-s flashes of a green keylight. In Condition 8, food and magazine-light ratios were correlated 1.0 whereas food and green-key ratios were correlated -1.0. In Condition 9, food and green-key ratios were correlated 1.0 whereas food and magazine-light ratios were correlated -1.0. Preference pulses toward alternatives after magazine lights and green keys depended on the correlation between these event ratios and the food ratios: If the ratios were correlated +1.0, positive preference pulses resulted; if the correlation was -1.0, preference pulses were negative. These results suggest that the Law of Effect has more to do with events signaling consequences than with strengthening responses.

Animals↗

Demarcated response sequences and generalised matching.

The generalised matching law was applied for the first time to sequences of responses. Pigeons responded on dependently arranged two-operandum concurrent schedules in which all four possible two-response sequences on these operanda were demarcated and reinforced. Reinforcer rates for the sequences were varied over a wide range, including extinction. Sequences of responses, rather than individual responses, followed the generalised matching law. We compared single-sensitivity and multiple-sensitivity versions of the generalised matching law. The multiple sensitivities were not significantly different from each other, so the single-sensitivity model provided the more efficient fit. As in previous research, responding was biased against the emission of sequences that required changeovers.

Animals↗

Local preference in concurrent schedules: the effects of reinforcer sequences.

We investigated the effects that sequences of reinforcers obtained from the same response key have on local preference in concurrent variable-interval schedules with pigeons as subjects. With an overall reinforcer rate of one every 27 s, on average, reinforcers were scheduled dependently, and the probability that a reinforcer would be arranged on the same alternative as the previous reinforcer was manipulated. Throughout the experiment, the overall reinforcer ratio was 1:1, but across conditions we varied the average lengths of same-key reinforcer sequences by varying this conditional probability from 0 to 1. Thus, in some conditions, reinforcer locations changed frequently, whereas in others there tended to be very long sequences of same-key reinforcers. Although there was a general tendency to stay at the just-reinforced alternative, this tendency was considerably decreased in conditions where same-key reinforcer sequences were short. Some effects of reinforcers are at least partly to be accounted for by their signaling subsequent reinforcer locations.

Animals↗

On science and the discriminative law of effect.

This article considers the process of the dissemination of scientific findings from the point of view of the discriminative law of effect. We assume that the purpose of science is to describe the state of the world in an unbiased and accurate manner. We then consider a number of challenges to the unbiased consensual development of science that arise from differences between science that is done, submitted for publication, and published. These challenges arise from the differential reinforcers for both research and publication delivered by journals and editors for novel results, the undervaluation of systematic replication and findings of invariance, and general lack of reinforcers for failed replications. All these challenges bias science toward searching for, reporting, and valuing novel results and consequently lead to a biased and erroneous view of the world. We suggest that science should be approached more conservatively, and that a reevaluation of the value of replication, and especially failed replication, is in order.

Editorial Policies↗

A theory of attending and reinforcement in conditional discriminations.

A model of conditional discrimination performance (Davison & Nevin, 1999) is combined with the notion that unmeasured attending to the sample and comparison stimuli, in the steady state and during disruption, depends on reinforcement in the same way as predicted for overt free-operant responding by behavioral momentum theory (Nevin & Grace, 2000). The rate of observing behavior, a measurable accompaniment of attending, is well described by an equation for steady-state responding derived from momentum theory, and the resistance to change of observing conforms to predictions of momentum theory, supporting a key assumption of the model. When probabilities of attending are less than 1.0, the model accounts for some aspects of conditional-discrimination performance that posed problems for the Davison-Nevin model: (a) the effects of differential reinforcement on the allocation of responses to the comparison stimuli and on accuracy in several matching-to-sample and signal-detection tasks where the differences between the stimuli or responses were varied across conditions, (b) the effects of overall reinforcer rate on the asymptotic level and resistance to change of both response rate and accuracy of matching to sample in multiple schedules, and (c) the effects of fixed-ratio reinforcement on accuracy. Some tests and extensions of the model are suggested, and the role of unmeasured events in behavior theory is considered.

Attention↗

Magnetoreception and its trigeminal mediation in the homing pigeon.

Two conflicting hypotheses compete to explain how a homing pigeon can return to its loft over great distances. One proposes the use of atmospheric odours and the other the Earth's magnetic field in the 'map' step of the 'map and compass' hypothesis of pigeon homing. Although magnetic effects on pigeon orientation provide indirect evidence for a magnetic 'map', numerous conditioning experiments have failed to demonstrate reproducible responses to magnetic fields by pigeons. This has led to suggestions that homing pigeons and other birds have no useful sensitivity to the Earth's magnetic field. Here we demonstrate that homing pigeons (Columba livia) can discriminate between the presence and absence of a magnetic anomaly in a conditioned choice experiment. This discrimination is impaired by attachment of a magnet to the cere, local anaesthesia of the upper beak area, and bilateral section of the ophthalmic branch of the trigeminal nerve, but not of the olfactory nerve. These results suggest that magnetoreception (probably magnetite-based) occurs in the upper beak area of the pigeon. Traditional methods of rendering pigeons anosmic might therefore cause simultaneous impairment of magnetoreception so that future orientation experiments will require independent evaluation of the pigeon's magnetic and olfactory systems.

Animal Migration↗

Interresponse times and the structure of choice.

This paper presents some analyses of available data on interresponse-time emission on concurrent variable-interval schedules arranged either continuously or as discrete components, and in which either reinforcer rates or magnitudes were varied. Ratios of frequencies of interresponse times in a series of temporal bins varied in their sensitivity to reinforcement: Sensitivity values were least for interresponse times around 0.2-0.4s, were higher in the region 0-0.2s, and were highest at values greater than 0.4s. Relative frequencies of interresponse times were greatest around 0.2-1.6s. As a result, time allocation to alternatives were mainly determined by IRTs between 0.8 and 6.4s, and least by IRTs less than 0.8s. If inter-bout times reflect time allocation to unmeasured responses, then time spent emitting unmeasured behavior may be the main constituent of time allocation on concurrent schedules. An analysis of log survivor plots supported this suggestion, and further suggested that a full understanding of time allocation in choice requires accepting that unmeasured responses do not result from a unitary process, but from many disparate contributing processes. These other behaviors can be revealed through Gaussian log-normal analyses of interresponse-time distributions.

Animals↗

Choice in a variable environment: visit patterns in the dynamics of choice.

Molar and molecular views of behavior imply different approaches to data analysis. The molecular view privileges moment-to-moment analyses, whereas the molar view supports analysis of more and less extended activities. In concurrent performance, the molar view supports study of both extended patterns of choice and more local patterns of visiting the choice alternatives. Analysis of the present data illustrated the usefulness of investigating order at various levels of extendedness. Seven different reinforcer ratios were presented within each session, without cues to identify them, and pigeons pecked at two response keys that delivered food on variable-interval schedules. Choice changed rapidly within components as reinforcers were delivered and, following each reinforcer, shifted toward the alternative that produced it. If several reinforcers were delivered consecutively by one alternative, choice favored that alternative, but shifted more slowly with each new reinforcer. A discontinuation of such a series of reinforcers by the delivery of a reinforcer by the other alternative resulted in a large shift of choice toward that alternative. These effects were illuminated by analysis of visits to the two alternatives. Changes in visit length occurred primarily in the first postreinforcer visit to the repeatedly reinforced alternative. All other visits tended to be brief and equal. Performance showed multiple signs of moving in the direction of a fix-and-sample pattern that characterized steady-state performance in earlier experiments with many sessions of maintaining each schedule pair. The analyses of extended and local patterns illustrate the flexibility of a molar view of behavior.

Animals↗

Concurrent schedules: reinforcer magnitude effects.

Five pigeons were trained on pairs of concurrent variable-interval schedules in a switching-key procedure. The arranged overall rate of reinforcement was constant in all conditions, and the reinforcer-magnitude ratios obtained from the two alternatives were varied over five levels. Each condition remained in effect for 65 sessions and the last 50 sessions of data from each condition were analyzed. At a molar level of analysis, preference was described well by a version of the generalized matching law, consistent with previous reports. More local analyses showed that recently obtained reinforcers had small measurable effects on current preference, with the most recently obtained reinforcer having a substantially larger effect. Larger reinforcers resulted in larger and longer preference pulses, and a small preference was maintained for the larger-magnitude alternative even after long inter-reinforcer intervals. These results are consistent with the notion that the variables controlling choice have both short- and long-term effects. Moreover, they suggest that control by reinforcer magnitude is exerted in a manner similar to control by reinforcer frequency. Lower sensitivities when reinforcer magnitude is varied are likely to be due to equal frequencies of different sized preference pulses, whereas higher sensitivities when reinforcer rates are varied might result from changes in the frequencies of different sized preference pulses.

Animals↗

Strict and random alternation in concurrent variable-interval schedules.

Six pigeons responded on pairs of concurrent variable-interval schedules with, in different parts, four different arrangements of alternation between schedules. Following a single switching-key response, alternation was either strict or random, and the alternative presented after a switch (the postswitch alternative) was either signaled by the location of the switching key or unsignaled. Generalized-matching analyses showed little difference in behavior among the different alternation arrangements, except the usual finding of lower sensitivity of response allocation than time allocation was eliminated by arranging random alternation. Patterns of interchangeover times were similar for all arrangements except signaled random alternation. Differences in behavior preceding the different postswitch alternatives were found in the signaled random alternation procedure. Preference was biased towards the color of the signaled postswitch alternative and showed increased sensitivity when the postswitch alternative was to be the one with the higher reinforcer rate. Interchangeover times were substantially shorter when the postswitch alternative was signaled to be different from the current alternative than when it was signaled to be the same. However, when separate reinforcer ratios were calculated for the different postswitch alternatives, those effects were eliminated or greatly reduced. We suggest that, although behavior is indeed influenced by the postswitch alternative, the mechanism is indirect. That is, the distributions of reinforcers between alternatives obtained before each postswitch alternative differ when those alternatives are signaled, and those distributions are discriminated, but the same relations between choice and relative reinforcement hold irrespective of which postswitch alternative is signaled.

Animals↗

Concurrent-schedule performance in transition: changeover delays and signaled reinforcer ratios.

Six pigeons were trained in experimental sessions that arranged six or seven components with various concurrent-schedule reinforcer ratios associated with each. The order of the components was determined randomly without replacement. Components lasted until the pigeons had received 10 reinforcers, and were separated by 10-s blackout periods. The component reinforcer ratios arranged in most conditions were 27:1, 9:1, 3:1, 1:1, 1:3, 1:9 and 1:27; in others, there were only six components, three of 27:1 and three of 1:27. In some conditions, each reinforcement ratio was signaled by a different red-yellow flash frequency, with the frequency perfectly correlated with the reinforcer ratio. Additionally, a changeover delay was arranged in some conditions, and no changeover delay in others. When component reinforcer ratios were signaled, sensitivity to reinforcement values increased from around 0.40 before the first reinforcer in a component to around 0.80 before the 10th reinforcer. When reinforcer ratios were not signaled, sensitivities typically increased from zero to around 0.40. Sensitivity to reinforcement was around 0.20 lower in no-changeover-delay conditions than in changeover-delay conditions, but increased in the former after exposure to changeover delays. Local analyses showed that preference was extreme towards the reinforced alternative for the first 25 s after reinforcement in changeover-delay conditions regardless of whether components were signaled or not. In no-changeover-delay conditions, preference following reinforcers was either absent, or, following exposure to changeover delays, small. Reinforcers have both local and long-term effects on preference. The former, but not the latter, is strongly affected by the presence of a changeover delay. Stimulus control may be more closely associated with longer-term, more molar, reinforcer effects.

Animals↗

Choice in a variable environment: effects of unequal reinforcer distributions.

Six pigeons were trained in a procedure in which sessions included seven unsignaled components, each offering two pecking keys, and each providing a potentially different reinforcer ratio between the two keys. Across conditions, various combinations of reinforcer ratios and reinforcer-magnitude ratios were used to create unequal reinforcer distributions between the two alternatives when averaged across a session. The results extended previous research using the same basic procedure that had included only reinforcer distributions symmetrical around 1:1. Data analyses suggested that the variables controlling choice operated at a number of levels: First, individual reinforcers had local effects on choice; second, sequences of successive reinforcers obtained at the same alternative (continuations) had cumulative effects; and, third, when these sequences themselves occurred with greater frequency, their effects further cumulated. A reinforcer obtained at the other alternative following a sequence of continuations (a discontinuation) had a large effect and apparently reset choice to levels approximating the sessional reinforcer ratio.

Animals↗

Every reinforcer counts: reinforcer magnitude and local preference.

Six pigeons were trained on concurrent variable-interval schedules. Sessions consisted of seven components, each lasting 10 reinforcers, with the conditions of reinforcement differing between components. The component sequence was randomly selected without replacement. In Experiment 1, the concurrent-schedule reinforcer ratios in components were all equal to 1.0, but across components reinforcer-magnitude ratios varied from 1:7 through 7:1. Three different overall reinforcer rates were arranged across conditions. In Experiment 2, the reinforcer-rate ratios varied across components from 27:1 to 1:27, and the reinforcer-magnitude ratios for each alternative were changed across conditions from 1:7 to 7:1. The results of Experiment 1 replicated the results for changing reinforcer-rate ratios across components reported by Davison and Baum (2000, 2002): Sensitivity to reinforcer-magnitude ratios increased with increasing numbers of reinforcers in components. Sensitivity to magnitude ratio, however, fell short of sensitivity to reinforcer-rate ratio. The degree of carryover from component to component depended on the reinforcer rate. Larger reinforcers produced larger and longer postreinforcer preference pulses than did smaller reinforcers. Similar results were found in Experiment 2, except that sensitivity to reinforcer magnitude was considerably higher and was greater for magnitudes that differed more from one another. Visit durations following reinforcers measured either as number of responses emitted or time spent responding before a changeover were longer following larger than following smaller reinforcers, and were longer following sequences of same reinforcers than following other sequences. The results add to the growing body of research that informs model building at local levels.

Animals↗

Concurrent schedules: short- and long-term effects of reinforcers.

Five pigeons were trained on concurrent variable-interval schedules in a switching-key procedure. The overall rate of reinforcement was constant in all conditions, and the ratios of reinforcers obtainable on the two alternatives were varied over seven levels. Each condition remained in effect for 65 sessions, and the last 50 sessions of data from each condition were analyzed. The most recently obtained reinforcer had the largest effect on current preference, but each of the eight previously obtained reinforcers had a small measurable effect. These effects were larger when the reinforcer ratio was more extreme. A longer term effect of reinforcement was also evident, which changed as a function of the reinforcer ratio arranged. More local analyses showed regularities at a reinforcer-by-reinforcer level and large transient movements in preference toward the just-reinforced alternative immediately following reinforcers, followed by a return to stable levels that were related to the reinforcer ratio in effect. The present data suggest that the variables that control choice have both short- and long-term effects and that the short-term effects increased when the reinforcer ratios arranged were more extreme.

Animals↗

Choice in a variable environment: effects of blackout duration and extinction between components.

Pigeons were trained in a procedure in which sessions included seven four- or 10-reinforcer components, each providing a different reinforcer ratio that ranged from 27:1 to 1:27. The components were arranged in random order, and no signals differentiated the component reinforcer ratios. Each condition lasted 50 sessions, and the data from the last 35 sessions were analyzed. Previous results using 10-s blackouts between components showed some carryover of preference from one component to the next, and this effect was investigated in Experiment 1 by varying blackout duration from 1 s to 120 s. The amount of carryover decreased monotonically as the blackout duration was lengthened. Preference also decreased between reinforcers within components, suggesting that preference change during blackout might follow the same function as preference change between reinforcers. Experiment 2 was designed to measure preference change between components more directly and to relate this to preference change during blackout. In two conditions a 60-s blackout occurred between components, and in two other conditions a 60-s period of unsignaled extinction occurred between components. Preference during the extinction period progressively fell toward indifference, and the level of preference following extinction was much the same as that following blackout. Although these results are consistent with Davison and Baum's (2000) theory of the effects of reinforcers on local preference, other findings suggest that theory is incomplete: After a sequence of reinforcers from one alternative, some residual preference remained after 60 s of extinction or blackout, indicating the possibility of an additional longer term accumulation of reinforcer effects than originally suggested.

Animals↗