Search PubMed⌕ Search

SEARCH · Search PubMed

Results for “REINFORCEMENT LEARNING”

Search indexed PubMed citations on genomics, clinical trials, systematic reviews and public health. Explore titles, authors and supplied subject terms, then open the PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,513 records · Page 84Linked to original sources
PubMed1962

A facilitative effect of punishment on unpunished behavior.

The key pecking of two pigeons was reinforced on a variable-interval schedule of reinforcement during the presentation of each of two stimuli. In various phases of the experiment, punishment followed every response emitted in the presence of one of the stimuli. In general, when the rate of punished responding changed during the presentation of one stimulus, the rate of unpunished responding during the other stimulus changed in the opposite direction. This sort of change in rate is an example of behavioral contrast. When punishment was introduced, the rate of punished responding decreased and the rate of unpunished responding increased as functions of shock intensity. When the rate of previously punished responding increased after the termination of the shock, the rate of the always unpunished responding decreased. When the procedure correlated with a red key was changed from variable-interval reinforcement and punishment for each response to extinction and no punishment, the rate of reinforced responding during presentations of a green key decreased and then increased while the rate of the previously punished responding during red first increased and then decreased during extinction.

Animals↗
PubMed1962

Effects of operant reinforcement on the GSR.

Each of nine Ss was run for 11 daily sessions. Except for the first (operant level) and last two (extinction) sessions, 500-ohm drops in skin resistance were followed by reinforcement (light). These reinforcement periods lasted 20 min and were preceded by 10-min control periods during which no reinforcement was administered. Although the results showed no evidence for operant conditioning of the GSR, they did indicate that increased emission of GSR's occurred during the reinforcement period. This effect was shown to hold for Ss with low operant levels of GSR's but not for Ss with high operant levels.

Conditioning, Operant↗
PubMed1991

"Turning back the clock" on serial-stimulus sign tracking.

Two experiments examined the effects of a negative (setback) response contingency on key pecking engendered by a changing light-intensity stimulus clock (ramp stimulus) signaling fixed-time 30-s food deliveries. The response contingency specified that responses would immediately decrease the light-intensity value, and, because food was delivered only after the highest intensity value was presented, would delay food delivery by 1 s for each response. The first experiment examined the acquisition and maintenance of responding for a group trained with the contingency in effect and for a group trained on a response-independent schedule with the ramp stimulus prior to introduction of the contingency. The first group acquired low rates of key pecking, and, after considerable exposure to the contingency, those rates were reduced to low levels. The rates of responding for the second group were reduced very rapidly (within four to five trials) after introduction of the setback contingency. For both groups, rates of responding increased for all but 1 bird when the contingency was removed. A second experiment compared the separate effects of each part of the response contingency. One group was exposed only to the stimulus setback (stimulus only), and a second group was exposed only to the delay of the reinforcer (delay only). The stimulus-only group's rates of responding were immediately reduced to moderate levels, but for most of the birds, these rates recovered quickly when the contingency was removed. The delay-only groups's rates decreased after several trials, to very low levels, and recovery of responding took several sessions once the contingency was removed. The results suggest that (a) sign-tracking behavior elicited by an added clock stimulus may be reduced rapidly and persistently when a setback contingency is imposed, and (b) the success of the contingency is due both to response-dependent stimulus change and response-dependent alterations in the frequency of food delivery. The operation of the contingency is compared with the effects of secondary reinforcement and punishment procedures.

Animals↗
PubMed1961

Continuous compensatory tracking by a cebus monkey.

A cebus monkey was trained to hold a continuously moving voltmeter needle on-target for 60 seconds to obtain a food-pellet reinforcement. The task confronting the animal was relatively complex in that the high-frequency error voltage fed to the voltmeter needle was nulled by the animal by means of a joystick physically separated from the stimulus display.

Animals↗
PubMed2004

The influence of NMDA receptors in the dorsomedial striatum on response reversal learning.

In mammals, the dorsomedial striatum is one brain area shown to be critical for the flexible shifting of response patterns. At present, the neurochemical mechanisms that underlie learning during a shift in response patterns are unknown. The present study examined the effects of NMDA competitive antagonist, DL-2-amino-5-phosphonopentanoic acid (AP-5), injected into the dorsomedial striatum on the acquisition and reversal of a response discrimination. Male Long-Evans rats were tested across two consecutive days in a modified cross-maze. Rats received an infusion of either saline or AP-5 (5 or 25 nmol) 5 min prior to each test session. In the acquisition phase rats learned to turn in one direction (right or left) to receive a cereal reinforcement. In the reversal learning phase rats learned to turn in the opposite direction as in the acquisition phase. In both phases, criterion was achieved when a rat made 10 consecutive correct trials. Infusions of AP-5 did not impair acquisition, but impaired reversal learning of a response discrimination in a dose-dependent fashion. The reversal learning deficit induced by AP-5 resulted from reversions back to the originally learned response pattern following the initial shift. These results suggest that activation of NMDA receptors in the dorsomedial striatum are critical for the flexible shifting of response patterns by enhancing the reliable execution of a new response pattern under changing task contingencies.

2-Amino-5-phosphonovalerate↗
PubMed1991

Blocking between occasion setters and contextual stimuli.

Two appetitive conditioning experiments with rats used a blocking procedure to compare the mechanisms through which contexts and positive occasion setters control responding to conditioned stimuli (CSs) in discrimination learning. In Experiment 1, a light (L) initially set the occasion for food reinforcement of a tone CS (T). Then a compound of L and a novel context signaled reinforcement of T. Previous learning about L blocked contextual control of responding to T. Blocking was not due to simple excitation conditioned to L during discrimination training; comparable excitation to L in a control group did not result in blocking. Conversely, in Experiment 2, initial learning about the context blocked the acquisition of occasion setting to L. Excitation conditioned to the context could not account for the blocking. In general, the results suggest that contexts and occasion setters may control responding to CSs through similar mechanisms.

Animals↗
PubMed2003

Drug addiction, relapse, and the amygdala.

Evidence has extensively implicated the amygdala in the associative learning process for appetitive reinforcers. Recent interest has focused on the role of the amygdala in the learned associations that occur during the process of drug addiction and relapse. Using an animal model of relapse after chronic cocaine self-administration, we found that rats reinstate extinguished lever responding for conditioned stimuli (tone + light) previously paired with cocaine or heroin ("conditioned-cued reinstatement"). The basolateral amygdala (BLA) complex plays a critical role in this behavior, because permanent lesions or reversible pharmacologic inactivation of the BLA attenuates conditioned-cued reinstatement without affecting cocaine self-administration or cocaine-primed reinstatement. Conditioned-cued reinstatement appears to be mediated in part by dopamine inputs to the BLA, as intra-BLA infusion of a dopamine D1 receptor antagonist blocks reinstatement, whereas intra-BLA infusion of amphetamine potentiates reinstatement. Furthermore, the BLA is also necessary for acquisition of associative learning with cocaine-paired stimuli. Disruption of neural activity within the BLA by sodium channel blockade or muscarinic receptor blockade just before acquisition of stimulus-cocaine associations blocks the ability of conditioned stimuli to elicit conditioned-cued reinstatement after extinction. Together, these results reveal the importance of the amygdala as part of a corticolimbic circuit mediating both the acquisition and the expression of conditioning that plays a critical role in relapse to drug-seeking behavior.

Amygdala↗
PubMed1994

Improvement of poor operant performance by continual intake of phenobarbital in spontaneously epileptic rats.

Spontaneously epileptic rats (SER) are a double mutant (zi/zi, tm/tm) obtained by mating the tremor rats with another tremulous mutant, zitter rats, and spontaneously exhibit absence-like seizures, tonic convulsions and wild jumping or running episodes. In addition, SER exhibit retardation in learning ability under differential reinforcement at a low rate (DRL)-5 sec schedule of food reinforcement in operant behavior at 14 to 15 weeks of age. We examined the long-term effects of phenobarbital (PB) on total bar presses, reinforcements and inter-response time distribution to assess whether the poorness of learning ability in SER can be ascribed to frequent occurrence of seizures. Food pellets containing 0.1% PB were given ad libitum to male SER from 7 weeks, and operant behavior was examined at 13 to 14 weeks of age. Tonic seizures and wild jumping or running episode were inhibited effectively and poor operant performance was significantly improved by continual intake of PB in SER.

Administration, Oral↗
PubMed1962

Reduction of shock frequency as reinforcement for avoidance behavior.

An avoidance technique was used in which rats had two levers available, with independent shock schedules associated with each. Behavioral patterns in initial conditioning and in the maintenance of the responses with various response-shock intervals led to the suggestion that reduction of shock density be considered an important variable in avoidance behavior.

Animals↗