Biomedical subjects

Paul Bertelson

Publications and source records attributed to Paul Bertelson.

9 recordsLinked to original sources

PubMed2006

Visual recalibration and selective adaptation in auditory-visual speech perception: Contrasting build-up courses.

Exposure to incongruent auditory and visual speech produces both visual recalibration and selective adaptation of auditory speech identification. In an earlier study, exposure to an ambiguous auditory utterance (intermediate between /aba/ and /ada/) dubbed onto the video of a face articulating either /aba/ or /ada/, recalibrated the perceived identity of auditory targets in the direction of the visual component, while exposure to congruent non-ambiguous /aba/ or /ada/ pairs created selective adaptation, i.e. a shift of perceived identity in the opposite direction [Bertelson, P., Vroomen, J., & de Gelder, B. (2003). Visual recalibration of auditory speech identification: a McGurk aftereffect. Psychological Science, 14, 592-597]. Here, we examined the build-up course of the after-effects produced by the same two types of bimodal adapters, over a 1-256 range of presentations. The (negative) after-effects of non-ambiguous congruent adapters increased monotonically across that range, while those of ambiguous incongruent adapters followed a curvilinear course, going up and then down with increasing exposure. This pattern is discussed in terms of an asynchronous interaction between recalibration and selective adaptation processes.

Adaptation, Physiological↗

PubMed2006

The aftereffects of ventriloquism: patterns of spatial generalization.

We examined how visual recalibration of apparent sound location obtained at a particular location generalizes to untrained locations. Participants pointed toward the origin of tone bursts scattered along the azimuth, before and after repeated exposure to bursts in one particular location, synchronized with point flashes of light a constant distance to their left/right. Adapter tones were presented straight ahead in Experiment 1, and in the left or right periphery in Experiment 2. With both arrangements, different generalization patterns were obtained on the visual distractor's side of the auditory adapter and onthe opposite side. On the distractor side, recalibration generalized following a descending gradient; practically no generalization was observed on the other side. This dependence of generalization patterns on the direction of the discordance imposed during adaptation has not been reported before, perhaps because the experimental designs in use did not allow its observation.

Adolescent↗

PubMed2004

The aftereffects of ventriloquism: generalization across sound-frequencies.

Exposure to synchronous but spatially discordant auditory and visual inputs produces, beyond immediate cross-modal biases, adaptive recalibrations of the respective localization processes that manifest themselves in aftereffects. Such recalibrations probably play an important role in maintaining the coherence of spatial representations across the various spatial senses. The present study is part of a research program focused on the way recalibrations generalize to stimulus values different from those used for adaptation. Considering the case of sound frequency, we recently found that, in contradiction with an earlier report, auditory aftereffects generalize nearly entirely across two octaves. In this new experiment, participants were adapted to an 18 degrees auditory-visual discordance with either 400 or 6400 Hz tones, and their subsequent sound localization was tested across this whole four-octave frequency range. Substantial aftereffects, decreasing significantly with increasing difference between test and adapter frequency, were obtained at all combinations of adapter and test frequency. Implications of these results concerning the functional site at which visual recalibration of auditory localization might take place are discussed.

Adolescent↗

PubMed2004

Recalibration of temporal order perception by exposure to audio-visual asynchrony.

The perception of simultaneity between auditory and visual information is of crucial importance for maintaining a coordinated representation of a multisensory event. Here we show that the perceptual system is able to adaptively recalibrate itself to audio-visual temporal asynchronies. Participants were exposed to a train of sounds and light flashes with a constant time lag ranging from -200 (sound first) to +200 ms (light first). Following this exposure, a temporal order judgement (TOJ) task was performed in which a sound and light were presented with a stimulus onset asynchrony (SOA) chosen from 11 values between -240 and +240 ms. Participants either judged whether the sound or the light was presented first, or whether the sound and light were presented simultaneously or successively. The point of subjective simultaneity (PSS) was, in both cases, shifted in the direction of the exposure lag, indicative of recalibration.

Acoustic Stimulation↗

PubMed2003

Multisensory integration, perception and ecological validity.

Studies of multimodal integration have relied to a large extent on conflict situations, in which two sensory modalities receive incongruent data concerning one aspect of the source. Exposure to such situations produces immediate crossmodal biases as well as longer lasting aftereffects, revealing recalibrations of data-to-percept matches. In the natural environment, such phenomena might be adaptive, by reducing the perturbing effects of factors like noise or growth-induced changes in receptor organs, and by enriching the percept. However, experimental results generalize to real life only when they reflect automatic perceptual processes, and not response strategies adopted to satisfy the particular demands of laboratory tasks. Here, we focus on this issue and review ways of addressing it that have been developed recently.

Journal Article↗

PubMed2003

The aftereffects of ventriloquism: are they sound-frequency specific?

Exposing different sense modalities (like sight, hearing or touch) to repeated simultaneous but spatially discordant stimulations generally causes recalibration of localization processes in one or both of the involved modalities, which is manifested through aftereffects. These provide opportunities for determining the extent of the changes induced by the exposure. Taking the so-called ventriloquism situation, in which synchronized sounds and light flashes are delivered in different locations, we examine if auditory recalibration produced by exposing tones of one frequency to attraction by discordant light flashes generalizes to different frequencies. Contrary to an earlier report, generalization was obtained across two octaves. This result did not depend on which modality attention was forced on through catch trials during exposure. Implications concerning the functional site of recalibration are briefly discussed.

Adaptation, Physiological↗

PubMed2003

Temporal ventriloquism: crossmodal interaction on the time dimension. 1. Evidence from auditory-visual temporal order judgment.

In the well-known visual bias of auditory location (alias the ventriloquist effect), auditory and visual events presented in separate locations appear closer together, provided the presentations are synchronized. Here, we consider the possibility of the converse phenomenon: crossmodal attraction on the time dimension conditional on spatial proximity. Participants judged the order of occurrence of sound bursts and light flashes, respectively, separated in time by varying stimulus onset asynchronies (SOAs) and delivered either in the same or in different locations. Presentation was organized using randomly mixed psychophysical staircases, by which the SOA was reduced progressively until a point of uncertainty was reached. This point was reached at longer SOAs with the sounds in the same frontal location as the flashes than in different places, showing that apparent temporal separation is effectively longer in the first condition. Together with a similar one obtained recently in a case of tactile-visual discrepancy, this result supports a view in which timing and spatial layout of the inputs play to some extent inter-changeable roles in the pairing operation at the base of crossmodal interaction.

Acoustic Stimulation↗

PubMed2003

Temporal ventriloquism: crossmodal interaction on the time dimension. 2. Evidence from sensorimotor synchronization.

In two experiments, we measured audio-visual crossmodal attraction on the time dimension, using a sensorimotor synchronization task. Synchronization performance made it possible to split up the total crossmodal attraction (demonstrated in earlier studies through inter-modal temporal order judgments) into its modality-specific components, the auditory bias of the visual event's perceived time of occurrence and the visual bias of the auditory event's perceived time of occurrence. Participants were asked to produce tapping movements in synchrony with a sequence of isochronously repeated pacing signals. In Experiment 1, pacing signals were light flashes, each preceded or followed, at one of several stimulus onset asynchronies (SOAs), by an auditory distracter that the participant was instructed to ignore. The timing of the tap was, in spite of that instruction, strongly biased toward the distracter. In Experiment 2, the converse task was used. The pacing signals were auditory and the to be ignored distracters, light flashes. The timing of the taps was biased significantly here also toward the distracter, but to a much lesser extent. Taken together, these results clearly demonstrate that audition plays a bigger role than vision in temporal ventriloquism and is probably generally superior to vision for processing the temporal dimension of events.

Acoustic Stimulation↗

PubMed2003

Visual recalibration of auditory speech identification: a McGurk aftereffect.

The kinds of aftereffects, indicative of cross-modal recalibration, that are observed after exposure to spatially incongruent inputs from different sensory modalities have not been demonstrated so far for identity incongruence. We show that exposure to incongruent audiovisual speech (producing the well-known McGurk effect) can recalibrate auditory speech identification. In Experiment 1, exposure to an ambiguous sound intermediate between /aba/ and /ada/ dubbed onto a video of a face articulating either /aba/ or /ada/ increased the proportion of /aba/ or /ada/ responses, respectively, during subsequent sound identification trials. Experiment 2 demonstrated the same recalibration effect or the opposite one, fewer /aba/ or /ada/ responses, revealing selective speech adaptation, depending on whether the ambiguous sound or a congruent nonambiguous one was used during exposure. In separate forced-choice identification trials, bimodal stimulus pairs producing these contrasting effects were identically categorized, which makes a role of postperceptual factors in the generation of the effects unlikely.

Auditory Perception↗