Search PubMed⌕ Search

Biomedical subjects

Charles Spence

Publications and source records attributed to Charles Spence.

At least 73 records · Page 4Linked to original sources

Cross-modal dynamic capture: congruency effects in the perception of motion across sensory modalities.

This study investigated multisensory interactions in the perception of auditory and visual motion. When auditory and visual apparent motion streams are presented concurrently in opposite directions, participants often fail to discriminate the direction of motion of the auditory stream, whereas perception of the visual stream is unaffected by the direction of auditory motion (Experiment 1). This asymmetry persists even when the perceived quality of apparent motion is equated for the 2 modalities (Experiment 2). Subsequently, it was found that this visual modulation of auditory motion is caused by an illusory reversal in the perceived direction of sounds (Experiment 3). This "dynamic capture" effect occurs over and above ventriloquism among static events (Experiments 4 and 5), and it generalizes to continuous motion displays (Experiment 6). These data are discussed in light of related multisensory phenomena and their support for a "modality appropriateness" interpretation of multisensory integration in motion perception.

Auditory Perception↗

Tactile selective attention and body posture: assessing the multisensory contributions of vision and proprioception.

This study addressed the role of proprioceptive and visual cues to body posture during the deployment of tactile spatial attention. Participants made speeded elevation judgments (up vs. down) to vibrotactile targets presented to the finger or thumb of either hand, while attempting to ignore vibrotactile distractors presented to the opposite hand. The first two experiments established the validity of this paradigm and showed that congruency effects were stronger when the target hand was uncertain (Experiment 1) than when it was certain (Experiment 2). Varying the orientation of the hands revealed that these congruency effects were determined by the position of the target and distractor in external space, and not by the particular skin sites stimulated (Experiment 3). Congruency effects increased as the hands were brought closer together in the dark (Experiment 4), demonstrating the role of proprioceptive input in modulating tactile selective attention. This spatial modulation was also demonstrated when a mirror was used to alter the visually perceived separation between the hands (Experiment 5). These results suggest that tactile, spatially selective attention can operate according to an abstract spatial frame of reference, which is significantly modulated by multisensory contributions from both proprioception and vision.

Adult↗

Spatial constraints on visual-tactile cross-modal distractor congruency effects.

Across three experiments, participants made speeded elevation discrimination responses to vibrotactile targets presented to the thumb (held in a lower position) or the index finger (upper position) of either hand, while simultaneously trying to ignore visual distractors presented independently from either the same or a different elevation. Performance on the vibrotactile elevation discrimination task was slower and less accurate when the visual distractor was incongruent with the elevation of the vibrotactile target (e.g., a lower light during the presentation of an upper vibrotactile target to the index finger) than when they were congruent, showing that people cannot completely ignore vision when selectively attending to vibrotactile information. We investigated the attentional, temporal, and spatial modulation of these cross-modal congruency effects by manipulating the direction of endogenous tactile spatial attention, the stimulus onset asynchrony between target and distractor, and the spatial separation between the vibrotactile target, any visual distractors, and the participant's two hands within and across hemifields. Our results provide new insights into the spatiotemporal modulation of cross-modal congruency effects and highlight the utility of this paradigm for investigating the contributions of visual, tactile, and proprioceptive inputs to the multisensory representation of peripersonal space.

Adult↗

When mirrors lie: "visual capture" of arm position impairs reaching performance.

If we stand at a mirror's edge, we can see one half of our body reflected in the mirror, as if it were the other half of our body, seen "through" the mirror. We used this mirror illusion to examine the effect of conflicts between visually and proprioceptively specified arm positions on subsequent reaching movements made with the unseen right arm. When participants viewed their static left arm in the mirror (i.e., as if it were their right arm), subsequent right-arm reaching movements were affected significantly more when there was conflict between the apparent visual and the proprioceptively specified right-arm positions than when there was no conflict. This result demonstrates that visual capture of arm position can occur when individual body parts are viewed in the mirror and that this capture has a measurable effect on subsequent reaching movements made with an unseen arm. The result has implications for how the brain represents the body across different sensory modalities.

Adult↗

Congruency effects between auditory and tactile motion: extending the phenomenon of cross-modal dynamic capture.

Behavioral studies of multisensory integration in motion perception have focused on the particular case of visual and auditory signals. Here, we addressed a new case: audition and touch. In Experiment 1, we tested the effects of an apparent motion stream presented in an irrelevant modality (audition or touch) on the perception of apparent motion streams in the other modality (touch or audition, respectively). We found significant congruency effects (lower performance when the direction of motion in the irrelevant modality was incongruent with the direction of the target) for the two possible modality combinations. This congruency effect was asymmetrical, with tactile motion distractors having a stronger influence on auditory motion perception than vice versa In Experiment 2, we used auditory motion targets and tactile motion distractors while participants adopted one of two possible postures: arms uncrossed or arms crossed. The effects of tactile motion on auditory motion judgments were replicated in the arms-uncrossed posture, but they dissipated in the arms-crossed posture. The implications of these results are discussed in light of current findings regarding the representation of tactile and auditory space.

Auditory Perception↗

When does visual perceptual grouping affect multisensory integration?

Several studies have shown that the direction in which a visual apparent motion stream moves can influence the perceived direction of an auditory apparent motion stream (an effect known as cross-modal dynamic capture). However, little is known about the role that intramodal perceptual grouping processes play in the multisensory integration of motion information. The present study was designed to investigate the time course of any modulation of the cross-modal dynamic capture effect by the nature of the perceptual grouping taking place within vision. Participants were required to judge the direction of an auditory apparent motion stream while trying to ignore visual apparent motion streams presented in a variety of different configurations. Our results demonstrate that the cross-modal dynamic capture effect was influenced more by visual perceptual grouping when the conditions for intramodal perceptual grouping were set up prior to the presentation of the audiovisual apparent motion stimuli. However, no such modulation occurred when the visual perceptual grouping manipulation was established at the same time as or after the presentation of the audiovisual stimuli. These results highlight the importance of the unimodal perceptual organization of sensory information to the manifestation of multisensory integration.

Adult↗

Cross-modal congruency and visual capture in a visual elevation-discrimination task.

Participants in this experiment were required to discriminate the elevation of visual target stimuli (upper versus lower) presented to either side of fixation, while simultaneously trying to ignore vibrotactile distracters presented independently from the index finger (up) or thumb (lower) of either hand. The participants' hands were occluded from view under an opaque screen while the visual targets were situated directly over the hands above the screen. Participants responded more slowly on this elevation-discrimination task when the vibrotactile distracters were incongruent with the elevation of the visual targets (i.e. a "lower" vibration to the thumb during the presentation of an upper visual target) than when they were congruent (presumably due to the competing responses primed by the target and distracter stimuli on incongruent trials). The vibrotactile distracters had less of an effect on performance when a pair of rubber hands was placed on top of the screen, "holding" the target lights, in a posture consistent with that of the participant. Those participants who agreed most strongly with a statement about feeling the vibrations at the location of the rubber hands in a post-congruency task questionnaire evidenced the greatest reduction in the magnitude of the cross-modal congruency effect.

Adult↗

Audiovisual temporal order judgments.

In two experiments, we examined the extent to which audiovisual temporal order judgments (TOJs) were affected by spatial factors and by the dimension along which TOJs were made. Pairs of auditory and visual stimuli were presented from either the left and/or right of fixation at varying stimulus onset asynchronies (SOAs), and participants made unspeeded TOJs regarding either "Which modality was presented first?" (experiment 1), or "Which side was presented first?" (experiment 2). Modality TOJs were more accurate (i.e. just-noticeable differences, JNDs, were smaller) when the auditory and visual stimuli were presented from different spatial positions rather than from the same position, highlighting an important potential confound inherent in previous research. By contrast, spatial TOJs were unaffected by whether or not the two stimuli were presented in different modalities. A between-experiments comparison revealed more accurate performance (i.e. smaller JNDs) when people reported which modality came first than when they reported which side came first for identical bimodal stimulus pairs. These results demonstrate that multisensory TOJs are critically dependent on both the relative spatial position from which stimuli are presented and on the particular dimension being judged.

Acoustic Stimulation↗

Orienting of attention and Parkinson's disease: tactile inhibition of return and response inhibition.

There is growing evidence for cognitive impairments in Parkinson's disease (PD), including in the orienting of attention and inhibition of return (IOR). IOR refers to the slowing of a response to a target stimulus presented in the same location as a previous stimulus. While some researchers have reported normal levels of visual IOR in PD patients using cue-target tasks, others have reported significant reductions in IOR in this patient group. However, the inhibitory effects observed in cue-target tasks may reflect non-ocular response inhibition associated with withholding a response from the cue stimulus, rather than attentional or oculomotor processes. Many researchers working with normal participants have circumvented this confound by using a target-target task, in which a response is made to all peripheral stimuli. Here, we compared IOR measured in cue-target and target-target tasks, using tactile rather than visual stimuli. Both the PD and the control groups exhibited significant inhibitory effects in the cue-target task, but only the control group exhibited significant IOR in the target-target task. Our results demonstrate a reduction, or elimination, of IOR in PD and this change may have been underestimated in previous studies, in which methodologically flawed cue-target tasks were used. This reduction in IOR may reflect impaired inhibitory processes or hyper-reflexive orienting in parkinsonian patients.

Aged↗

Multisensory integration and the body schema: close to hand and within reach.

There has been a recent and dramatic growth of interest in the psychological and neural mechanisms of multisensory integration between different sensory modalities. Much of this recent research has focused specifically on how multisensory representations of body parts and of the 'peripersonal' space immediately around them, are constructed. Research has also focused on how this may lead to multisensorially determined perceptions of body parts, to action execution, and even to attributions of agency and self-ownership for the body parts in question. Converging evidence from animal and human studies suggests that the primate brain constructs various body-part-centred representations of space, based on the integration of visual, tactile and proprioceptive information. These representations can plastically change following active tool-use that extends reachable space and also modifies the representation of peripersonal space. These new results indicate that a modern cognitive neuroscience approach to the classical concept of the 'body schema' may now be within reach.

Animals↗

Tactile dominance in speeded discrimination of textures.

When assessing the roughness of textures, no single sensory modality universally dominates perception. Instead, the task and stimuli critically determine to what extent a given sense is favoured. We report a visuotactile texture assessment experiment, consisting of the speeded discrimination of roughened textile samples, in the presence of a congruent or an incongruent textile distractor. When discriminating between samples, visual assessment of textile roughness was modulated by incongruous tactile distractors, but not vice versa, even when visual distractors were more discriminable than tactile targets. This asymmetry in interference suggests that 'modality appropriateness' is not purely a function of the discriminative ability of a sensory modality, but that ecological validity may play a role in determining the more 'appropriate' sense for a given task. Results are discussed in relation to the claim that the assessment of textiles is more ecologically suited to touch than to vision.

Adult↗

Multimodal visual-somatosensory integration in saccade generation.

Neurophysiological studies have demonstrated multisensory interaction effects in the neural structures involved in saccade generation when visual, auditory or somatosensory stimuli are presented bimodally. Visual-auditory interaction effects have been demonstrated in numerous behavioural studies of saccades but little is known about interaction effects involving somatosensory stimuli. The present study examined visual-somatosensory interaction effects on saccade generation using a multisensory paradigm, whereby task-irrelevant distractors appeared spatially-coincident with, or remote from the designated saccade target. Somatosensory distractors reduced the latency of saccades when presented before the visual target and the greatest facilitation effect was observed with spatially-coincident stimuli. Visual distractors spatially-coincident with a somatosensory target reduced latency (and increased peak velocity) when presented before and after the target. Visual distractors contralateral to somatosensory targets increased saccade latency and produced high error rates of saccades made to the distractor. The high error rates and latency modulation with visual distractors is consistent with a bias for visual stimuli in the saccadic system. In the visual target condition, saccade latency was modulated by a somatosensory distractor that was entirely task-irrelevant and this effect was always greatest with spatially-coincident distractors. The multisensory distractor effects are discussed in terms of saccades being programmed to the non-target modality, the early triggering of a non-spatial saccade 'when' signal, and multisensory neuronal enhancement effects.

Acoustic Stimulation↗

Multisensory contributions to the perception of motion.

The ability to process motion is crucial for coherent perception and action. While the majority of studies have focused on the unimodal factors that influence motion perception (see, for example, the other chapters in this Special Issue), some researchers have also investigated the extent to which information presented in one sensory modality can affect the perception of motion for stimuli presented in another modality. Although early studies often gave rise to mixed results, the development of increasingly sophisticated psychophysical paradigms are now enabling researchers to determine the spatiotemporal constraints on multisensory interactions in the perception of motion. Recent findings indicate that these interactions stand over-and-above the multisensory interactions documented previously for static stimuli, such as the oft-cited 'ventriloquism' effect. Neuroimaging and neuropsychological studies are also beginning to elucidate the network of neural structures responsible for the processing of motion information in the different sensory modalities, an important first step that will ultimately lead to the determination of the neural substrates underlying these multisensory contributions to motion perception.

Animals↗

What role does multisensory integration play in the visuotactile perception of texture?

Previous research has shown that vision and touch are both effective at many roughness discrimination tasks; however, there is no evidence that using both senses simultaneously improves discrimination performance. We investigated the nature of this failure to integrate multisensory inputs, using three varieties of forced-choice discrimination tasks. In Experiment 1, visual, tactile and bimodal roughness discriminations were made between pairs of fabric stimuli. Bimodal discriminations were typically performed with a sensitivity somewhere between that observed for the unimodal presentations. In Experiment 2, a similar design was used except that during the stimulus presentation, one interval contained a unimodal (vision or touch) stimulus, the other interval a bimodal stimulus presentation. Bias toward the bimodal interval would indicate an increase in the magnitude of perceived roughness for such presentations. No such bias was found. In Experiment 3, participants made single-interval, bimodal discriminations, determining whether a rough stimulus was presented to touch, to vision, to both modalities, or to neither modality. The improved performance seen for the dual-target vs. single-target presentations was best modelled as arising from a trialwise division of attention between vision and touch. Overall, these results suggest that vision and touch act as independent sources of roughness information, where the necessity to divide attention across both modalities reduces the discriminative ability in (or information available from) each of these individual modalities.

Adolescent↗

Multisensory temporal order judgments: the role of hemispheric redundancy.

Participants made unspeeded 'Which modality came first?' temporal order judgments (TOJs) in response to pairs of auditory and visual stimuli presented at varying stimulus onset asynchronies (SOAs), using the method of constant stimuli. The presentation of auditory and visual stimuli from different spatial positions facilitated performance (i.e. just noticeable differences were lowered) only when the stimuli were presented across the body midline (Experiment 4), but not when both stimuli were either placed on the body midline (Experiments 1-3), or else within the same hemifield (Experiment 5). These results demonstrate that hemispheric redundancy may account for the facilitatory effects reported in previous multisensory TOJs research when stimuli were presented from different spatial locations. Our results also show that the accuracy with which people can make multisensory TOJs is unaffected by the predictability of target stimulus locations, suggesting little role for spatial attention in this aspect of multisensory temporal perception.

Acoustic Stimulation↗

Multisensory representation of limb position in human premotor cortex.

Using functional magnetic resonance imaging (fMRI) in humans, we identified regions of cortex involved in the encoding of limb position. Tactile stimulation of the right hand, across the body midline, activated the right parietal cortex when the eyes were closed; activation shifted to a left parietofrontal network when the eyes were open. These data reveal important similarities between human and non-human primates in the network of brain areas involved in the multisensory representation of limb position.

Brain Mapping↗

Speech shadowing while driving: on the difficulty of splitting attention between eye and ear.

We investigated the role of cross-modal links in spatial attention in modulating the efficiency of dual-task performance. The difficulty of combining speech shadowing with a simulated driving task was modulated by the spatial location from which the speech was presented. In both single- and dual-task conditions, participants found it significantly easier to shadow one of two auditory streams when the relevant speech was presented from directly in front of them, rather than from the side. This frontal speech advantage was more pronounced when participants performed the demanding simulated driving task at the same time as shadowing than when they performed the shadowing task alone. These results demonstrate that people process auditory information more efficiently (with a lower overall dual-task decrement) when relevant auditory and visual stimuli are presented from the same, rather than different, spatial locations. These results are related to recent findings showing that there are extensive cross-modal links in spatial attention, and have clear implications for the design of better user interfaces.

Adult↗