Search PubMed⌕ Search

SEARCH · Search PubMed

Results for “Probability Learning”

Search indexed PubMed citations on genomics, clinical trials, systematic reviews and public health. Explore titles, authors and supplied subject terms, then open the PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44Linked to original sources

Retributive reactions to suspected offenders: the importance of social categorizations and guilt probability.

In the current research, the author investigates the influence of social categorizations on retributive emotions (e.g., anger) and punishment intentions when people evaluate suspected offenders as independent observers. It is argued that information that guilt is certain or uncertain (i.e., guilt probability) has different consequences for retributive reactions to ingroup and outgroup suspects. In correspondence with predictions, results of four experiments showed that people reacted more negatively to ingroup than outgroup suspects when guilt was certain but that people reacted more negatively to outgroup than ingroup suspects when guilt was uncertain. It is concluded that guilt probability moderates the influence of social categorizations on people's retributive reactions to suspected offenders.

Adolescent↗

General performance on a numeracy scale among highly educated samples.

BACKGROUND: Numeracy, how facile people are with basic probability and mathematical concepts, is associated with how people perceive health risks. Performance on simple numeracy problems has been poor among populations with little as well as more formal education. Here, we examine how highly educated participants performed on a general and an expanded numeracy scale. The latter was designed within the context of health risks. METHOD: A total of 463 men and women aged 40 and older completed a 3-item general and an expanded 7-item numeracy scale. The expanded scale assessed how well people 1) differentiate and perform simple mathematical operations on risk magnitudes using percentages and proportions, 2) convert percentages to proportions, 3) convert proportions to percentages, and 4) convert probabilities to proportions. RESULTS: On average, 18% and 32% of participants correctly answered all of the general and expanded numeracy scale items, respectively. Approximately 16% to 20% incorrectly answered the most straightforward questions pertaining to risk magnitudes (e.g., Which represents the larger risk: 1%, 5%, or 10%?). A factor analysis revealed that the general and expanded risk numeracy items tapped the construct of global numeracy. CONCLUSIONS: These results suggest that even highly educated participants have difficulty with relatively simple numeracy questions, thus replicating in part earlier studies. The implication is that usual strategies for communicating numerical risk may be flawed. Methods and consequences of communicating health risk information tailored to a person's level of numeracy should be explored further.

Adult↗

Behavioural vigilance in schizophrenia. Evidence for hyperattentional processing.

BACKGROUND: Despite 30 years of research, some surprisingly fundamental gaps remain in our understanding of schizophrenic input dysfunctions. METHOD: In a provisional test of a 'hyperattention' hypothesis, schizophrenic patients and control subjects performed a behavioural test that was adapted from a paradigm originally developed for characterising vigilance or sustained attention in animals. On this computerised operant testing procedure, subjects discriminated between signals of various salience and non-signal presentations. Hits and correct rejections resulted in monetary rewards while misses and false alarms entailed monetary costs. RESULTS: Data from in-patients with schizophrenia and age, education and gender-matched controls support hypotheses not only about hyperattentional dysfunctions in schizophrenia with respect to overall signal detectability but also in terms of resistance to the vigilance decrement that normally occurs over trials. CONCLUSIONS: The theoretical importance of impairments of this sort are discussed with respect to the cognitive and perceptual consequences of hypervigilance and 'input dysfunction'.

Adult↗

Simple and multiple P-splines regression with shape constraints.

In many research areas, especially within social and behavioural sciences, the relationship between predictor and criterion variables is often assumed to have a particular shape, such as monotone, single-peaked or U-shaped. Such assumptions can be transformed into (local or global) constraints on the sign of the nth-order derivative of the functional form. To check for such assumptions, we present a non-parametric regression method, P-splines regression, with additional asymmetric discrete penalties enforcing the constraints. We show that the corresponding loss function is convex and present a Newton-Raphson algorithm to optimize. Constrained P-splines are illustrated with an application on monotonicity-constrained regression with both one and two predictor variables, using data from research on the cognitive development of children.

Algorithms↗

Belief in psychic ability and the misattribution hypothesis: a qualitative review.

This paper explores the notion that people who believe in psychic ability possess various psychological attributes that increase the likelihood of them misattributing paranormal causation to experiences that have a normal explanation. The paper discusses the structure and measurement of belief in psychic ability, then reviews the considerable body of work exploring the relationship between belief in psychic ability, and academic performance, intelligence, critical thinking, probability misjudgement and reasoning, measures of fantasy proneness and the propensity to find correspondences in distantly related material. Finally, the paper proposes several possible directions for future research, including: the need to build a multi-causal model of belief; to address the issue of correlation versus causation; to resolve the inconsistent pattern of findings present in many areas; and to develop a more valid, reliable and fine-grained measure of belief in psychic ability.

Aptitude↗

Vasopressin and oxytocin. Their presence in the central nervous system and their functional significance in brain processes related to behaviour and memory.

Vasopressin and oxytocin exert pronounced effects on behaviour by a direct action on the brain. A single injection of vasopressin results in a long-term inhibition of extinction of a conditioned avoidance response suggesting that vasopressin triggers a long-term effect on the maintenance of a learned response, probably by facilitation of memory processes. In addition vasopressin improves passive avoidance behaviour, delays extinction of appetitive discrimination tasks, affects approach behaviour to an imprinting stimulus in ducklings, improves copulation rewarded behaviour of male rats in a T-maze, prevents or reverses amnesia induced by electroconvulsive shock, CO2 inhalation, pentylenetetrazol or puromycin. The majority of these effects of vasopressin in the various and sometimes relatively complex tasks may be explained by stimulatory influences of this neuropeptide on memory processes. Generally oxytocin exerts effects which are opposite to those of vasopressin and it has been suggested that oxytocin may be an amnesic neuropeptide. Various limbic system structures seem to act as the anatomical substrate for the behavioural effects of vasopressin. In particular the amygdala, the dentate gyrus of the hippocampal complex, the ventral hippocampus and the dorsal septum seem to be involved. Evidence has been obtained from experiments with homozygous diabetes insipidus rats and from experiments in which antisera were applied that endogenous vasopressin and oxytocin play a physiological role in brain processes related to memory. It appears that highly active fragments can be generated from vasopressin and experiments in which a fragment of vasopressin ([pGlu4, Cyt6]AVP-(4-8)) as well as an AVP-antagonist were used, reveal that the vasopressin receptors mediating the behavioural effects are situated in the brain and differ in specificity from the peripheral (blood pressure) vasopressin receptors. Generally the clinical data obtained so far with vasopressin treatment are in agreement with the results from animal experiments and they support the notion on the involvement of vasopressin in memory function. The sometimes reported conflicting results on vasopressin effects in certain patients (Korsakoff or Alzheimer) may have to do with the wide-spread pathology in these diseases.

Animals↗

Choice between reliable and unreliable outcomes: mixed percentage-reinforcement in concurrent chains.

Pigeons' choices between alternatives that provided different percentages of reinforcement in mixed schedules were studied using the concurrent-chains procedure. In Experiment 1, the alternatives were terminal-link schedules that were equal in delay and magnitude of reinforcement, but that provided different percentages of reinforcement, with one schedule providing, reinforcement twice as reliably as the other. All pigeons preferred the more reliable schedule, and their level of preference was not systematically affected by variation in the absolute percentage values, or in the magnitude of reinforcement. In Experiment 2, preference for a schedule providing 100% reinforcement over one providing 33% reinforcement increased systematically with increases in the duration of the terminal links. In contrast, preference decreased systematically with increases in the duration of the initial links. Experiment 3 examined choice with equal percentages of reinforcement but unequal delays to reinforcement. Preference for the shorter delay to reinforcement was not systematically affected by variation in the absolute percentage of reinforcement. The overall pattern of results supported predictions based on an extension of the delay-reduction hypothesis to choice procedures involving mixed schedules of percentage reinforcement.

Animals↗

Choice and foraging: the effects of accessibility on acceptability.

Pigeons responded in a successive-encounters choice procedure in which accessibility of the less profitable of two outcomes varied either in terms of probability of encounter or search time to encounter (keeping search time to the more profitable outcome constant). When the less profitable outcome was made more probable its acceptance became more likely. However, when search time to encounter the less profitable outcome was shortened, its acceptance became less likely. Both results are consistent with the delay-reduction hypothesis and with an optimality model developed for application to the successive-encounters choice procedure.

Animals↗

A cost-benefit analysis of demand for food.

Laboratory studies of consumer demand theory require assumptions regarding the definition of price in the absence of a medium of exchange (money). In this study we test the proposition that the fundamental dimension of price is a cost-benefit ratio expressed as the effort expended per unit of food value consumed. Using rats as subjects, we tested the generality of this "unit price" concept by varying four dimensions of price: fixed-ratio schedule, number of food pellets per fixed-ratio completion, probability of reinforcement, and response lever weight or effort. Two levels of the last three factors were combined in a 2 x 2 x 2 design giving eight groups. Each group was studied under a series of six FR schedules. Using the nominal values of all factors to determine unit price, we found that grams of food consumed plotted as a function of unit price followed a single demand curve. Similarly, total work output (responses x effort) conformed to a single function when plotted in terms of unit price. These observations provided a template for interpreting the effects of biological factors, such as brain lesions or drugs, that might alter the cost-benefit ratio.

Animals↗

Theories of probabilistic reinforcement.

In three experiments, pigeons chose between two alternatives that differed in the probability of reinforcement and the delay to reinforcement. A peck at a red key led to a delay of 5 s and then a possible reinforcer. A peck at a green key led to an adjusting delay and then a certain reinforcer. This delay was adjusted over trials so as to estimate an indifference point, or a duration at which the two alternatives were chosen about equally often. In Experiments 1 and 2, the intertrial interval was varied across conditions, and these variations had no systematic effects on choice. In Experiment 3, the stimuli that followed a choice of the red key differed across conditions. In some conditions, a red houselight was presented for 5 s after each choice of the red key. In other conditions, the red houselight was present on reinforced trials but not on nonreinforced trials. Subjects exhibited greater preference for the red key in the latter case. The results were used to evaluate four different theories of probabilistic reinforcement. The results were most consistent with the view that the value or effectiveness of a probabilistic reinforcer is determined by the total time per reinforcer spent in the presence of stimuli associated with the probabilistic alternative. According to this view, probabilistic reinforcers are analogous to reinforcers that are delivered after variable delays.

Animals↗

Subjective probability and delay.

Human subjects indicated their preference between a hypothetical $1,000 reward available with various probabilities or delays and a certain reward of variable amount available immediately. The function relating the amount of the certain-immediate reward subjectively equivalent to the delayed $1,000 reward had the same general shape (hyperbolic) as the function found by Mazur (1987) to describe pigeons' delay discounting. The function relating the certain-immediate amount of money subjectively equivalent to the probabilistic $1,000 reward was also hyperbolic, provided that the stated probability was transformed to odds against winning. In a second experiment, when human subjects chose between a delayed $1,000 reward and a probabilistic $1,000 reward, delay was proportional to the same odds-against transformation of the probability to which it was subjectively equivalent.

Adult↗

Choice with probabilistic reinforcement: effects of delay and conditioned reinforcers.

Two experiments measured pigeons' choices between probabilistic reinforcers and certain but delayed reinforcers. In Experiment 1, a peck on a red key led to a 5-s delay and then a possible reinforcer (with a probability of .2). A peck on a green key led to a certain reinforcer after an adjusting delay. This delay was adjusted over trials so as to estimate an indifference point, or a duration at which the two alternatives were chosen about equally often. In all conditions, red houselights were present during the 5-s delay on reinforced trials with the probabilistic alternative, but the houselight colors on nonreinforced trials differed across conditions. Subjects showed a stronger preference for the probabilistic alternative when the houselights were a different color (white or blue) during the delay on nonreinforced trials than when they were red on both reinforced and nonreinforced trials. These results supported the hypothesis that the value or effectiveness of a probabilistic reinforcer is inversely related to the cumulative time per reinforcer spent in the presence of stimuli associated with the probabilistic alternative. Experiment 2 tested some quantitative versions of this hypothesis by varying the delay for the probabilistic alternative (either 0 s or 2 s) and the probability of reinforcement (from .1 to 1.0). The results were best described by an equation that took into account both the cumulative durations of stimuli associated with the probabilistic reinforcer and the variability in these durations from one reinforcer to the next.

Animals↗

Human choice on concurrent variable-interval variable-ratio schedules.

Each of 5 adult male humans sat in a 4 degrees C room where they could warm themselves by illuminating six heat lamps for 10-second periods according to a concurrent variable-interval variable-ratio schedule. Left-button presses on a response panel switched between the schedules and started a 2-second changeover delay. Right-button presses illuminated the heat lamps if assigned by the associated schedule and if the changeover delay had timed out. Panel lights identified the schedule in effect and each effective right-button press. A discrimination procedure--either a multiple variable-interval variable-ratio schedule or the presentation of each schedule individually on alternate days--preceded exposure to the choice procedure for some subjects. For subjects not exposed to a discrimination procedure prior to exposure to choice, or if such exposure failed to result in higher rates to the ratio than to the interval schedule, relative response rates matched relative reinforcement rates. However, if subjects responded at higher rates to the ratio schedule than to the interval schedule during a prior discrimination procedure, relative rates on a subsequent choice procedure deviated from matching in the direction of reinforcement-rate maximizing. In eight of 11 conditions, choice appeared to be governed by maximizing processes. In all cases, human concurrent ratio-interval performances differed from those of nonhumans in that matching was never obtained with local ratio-interval rate differences.

Adult↗

Molar versus local reinforcement probability as determinants of stimulus value.

During one component of a multiple schedule, pigeons were trained on a discrete-trial concurrent variable-interval variable-interval schedule in which one alternative had a high scheduled rate of reinforcement and the other a low scheduled rate of reinforcement. When the choice proportion between the alternatives matched their respective relative reinforcement frequencies, the obtained probabilities of reinforcement (reinforcer per peck) were approximately equal. In alternate components of the multiple schedule, a single response alternative was presented with an intermediate scheduled rate of reinforcement. During probe trials, each alternative of the concurrent schedule was paired with the constant alternative. The stimulus correlated with the high reinforcement rate was preferred over that with the intermediate rate, whereas the stimulus correlated with the intermediate rate of reinforcement was preferred over that correlated with the low rate of reinforcement. Preference on probe tests was thus determined by the scheduled rate of reinforcement. Other subjects were presented all three alternatives individually, but with a distribution of trial frequency and reinforcement probability similar to that produced by the choice patterns of the original subjects. Here, preferences on probe tests were determined by the obtained probabilities of reinforcement. Comparison of the two sets of results indicates that the availability of a choice alternative, even when not responded to, affects the preference for that alternative. The results imply that models of choice that invoke only obtained probability of reinforcement as the controlling variable (e.g., melioration) are inadequate.

Animals↗

Temporal control on interval schedules: what determines the postreinforcement pause?

On fixed-interval or response-initiated delay schedules of reinforcement, the average pause following food presentation is proportional to the interfood interval. Moreover, when a number of intervals of different durations occur in a programmed cyclic series, postreinforcement pauses track the changes in interval value. What controls the duration of postreinforcement pauses under these conditions? Staddon, Wynne, and Higa (1991), in their linear waiting model, propose control by the preceding interfood interval. Another possibility is that delay to reinforcement, signaled by a key peck and/or stimulus change, determines the subsequent pause. The experiments reported here examined the role of these two possible time markers by studying the performance of pigeons under a chained cyclic fixed-interval procedure. The data support the linear waiting model, but suggest that more than the immediately preceding interfood interval plays a role in temporal control.

Animals↗

Behavioral and pharmacological variables affecting risky choice in rats.

The effects of manipulations of response requirement, intertrial interval (ITI), and psychoactive drugs (ethanol, phencyclidine, and d-amphetamine) on lever choice under concurrent fixed-ratio schedules were investigated in rats. Responding on the "certain'' lever produced three 45-mg pellets, whereas responding on the "risky" lever produced either 15 pellets (p = .33) or no pellets (p .67). Rats earned all food during the session, which ended after 12 forced trials and 93 choice trials or 90 min, whichever occurred first. When the response requirement was increased from 1 to 16 and the ITI was 20 s, percentage of risky choice was inversely related to fixed-ratio value. When only a single response was required but the ITI was manipulated between 20 and 120 s (with maximum session duration held constant), percentage of risky choice was directly related to length of the ITI. The effects of the drugs were investigated first at an ITI of 20 s, when risky choice was low for most rats, and then at an ITI of 80 s, when risky choice was higher for most rats. Ethanol usually decreased risky choice. Phencyclidine did not usually affect risky choice when the ITI was 20 s but decreased it in half the rats when the ITI was 80 s. For d-amphetamine, the effects appeared to he related to baseline probability of risky choice; that is, low probabilities were increased and high probabilities were decreased. Although increase in risky choice as a function of the ITI is at variance with previous ITI data, it is consistent with foraging data showing that risk aversion decreases as food availability decreases. The pharmacological manipulations showed that drug effects on risky choice may be influenced by the baseline probability of risky choice, just as drug effects can be a function of baseline response rate.

Animals↗

Resistance to extinction following variable-interval reinforcement: reinforcer rate and amount.

Rats obtained food-pellet reinforcers by nose poking a lighted key. Experiment 1 examined resistance to extinction following single-schedule training with different variable-interval schedules, ranging from a mean interval of 16 min to 0.25 min. That is, for each schedule, the rats received 20 consecutive daily baseline sessions and then a session of extinction (i.e., no reinforcers). Resistance to extinction (decline in response rate relative to baseline) was negatively related to the rate of reinforcers obtained during baseline, a relation analogous to the partial-reinforcement-extinction effect. A positive relation between these variables emerged, however, when the unit of extinction was taken as the mean interreinforcer interval that had been in effect during training (i.e., as an omitted reinforcer during extinction). In a second experiment, rats received blocks of training sessions, all with the same variable-interval schedule but with a reinforcer of four pellets for some blocks and one pellet for others. Resistance to extinction was greater following training with the larger (four pellets) than with the smaller (one pellet) reinforcer. Taken together, these results support the principle that greater reinforcement during training (e.g., higher rate or larger amount) engenders greater resistance to extinction even when the different conditions of reinforcement are varied between blocks of sessions.

Animals↗