Search PubMed⌕ Search

Biomedical subjects

J E R Staddon

Publications and source records attributed to J E R Staddon.

4 recordsLinked to original sources

Interval timing as an emergent learning property.

Interval timing in operant conditioning is the learned covariation of a temporal dependent measure such as wait time with a temporal independent variable such as fixed-interval duration. The dominant theories of interval timing all incorporate an explicit internal clock, or "pacemaker," despite its lack of independent evidence. The authors propose an alternative, pacemaker-free view that demonstrates that temporal discrimination can be explained by using only 2 assumptions: (a) variation and selection of responses through competition between reinforced behavior and all other, elicited, behaviors and (b) modulation of the strength of response competition by the memory for recent reinforcement. The model departs radically from existing timing models: It shows that temporal learning can emerge from a simple dynamic process that lacks a periodic time reference such as a pacemaker.

Conditioning, Operant↗

Operant conditioning.

Operant behavior is behavior "controlled" by its consequences. In practice, operant conditioning is the study of reversible behavior maintained by reinforcement schedules. We review empirical studies and theoretical approaches to two large classes of operant behavior: interval timing and choice. We discuss cognitive versus behavioral approaches to timing, the "gap" experiment and its implications, proportional timing and Weber's law, temporal dynamics and linear waiting, and the problem of simple chain-interval schedules. We review the long history of research on operant choice: the matching law, its extensions and problems, concurrent chain schedules, and self-control. We point out how linear waiting may be involved in timing, choice, and reinforcement schedules generally. There are prospects for a unified approach to all these areas.

Attention↗

Habituation, memory and the brain: the dynamics of interval timing.

Memory decay is rapid at first and slower later-a feature that accounts for Jost's memory law: that old memories gain on newer ones with lapse of time. The rate-sensitive property of habituation-that recovery after spaced stimuli may be slower than after massed-provides a clue to the dynamics of memory decay. Rate-sensitive habituation can be modeled by a cascade of thresholded integrator units that have a counterpart in human brain areas identified by magnetic source imaging (MSI). The memory trace component of the multiple-time-scale model for habituation can provide a 'clock' that has the properties necessary to account for both static and dynamic properties of interval timing: static proportional and Weber-law timing as well as dynamic tracking of progressive, 'impulse' and periodic interval sequences.

Journal Article↗

A tuned-trace theory of interval-timing dynamics.

Animals on interval schedules of reinforcement can rapidly adjust a temporal dependent variable, such as wait time, to changes in the prevailing interreinforcement interval. We describe data on the effects of impulse, step, sine-cyclic, and variable-interval schedules and show that they can be explained by a tuned-trace timing model with a one-back threshold-setting rule. The model can also explain steady-state timing properties such as proportional and Weber law timing and the effects of reinforcement magnitude. The model assumes that food reinforcers and other time markers have a decaying effect (trace) with properties that can be derived from the rate-sensitive property of habituation (the multiple-time-scale model). In timing experiments, response threshold is determined by the trace value at the time of the most recent reinforcement. The model provides a partial account for the learning of multiple intervals, but does not account for scalloping and other postpause features of responding on interval schedules and has some problems with square-wave schedules.

Animals↗