Biomedical subjects
Publications and source records attributed to G A Calvert.
Recent studies using modern functional imaging methods have provided insights into the brain areas involved in combining information across the senses, and the manner in which sensory signals are integrated within them. These findings are remarkably consistent with the results from single-unit recording in animals.
Does the lateral temporal cortex require acoustic exposure in order to become specialized for speech processing? Six hearing participants and six congenitally deaf participants, all with spoken English as their first langugage, were scanned using functional magnetic resonance imaging while performing a simple speech-reading task. Focal activation of the left lateral temporal cortex was significantly reduced in the deaf group compared with the hearing group. Activation within this region was present in individual deaf participants, but varied in location from person to person. Early acoustic experience may be required for regions within the left temporal cortex in order to develop into a coherent network with subareas devoted to specific speech analysis functions.
Abnormalities in the integration of auditory and visual language inputs could underlie many core psychotic features. Perceptual confusion may arise because of the normal propensity of visual speech perception to evoke auditory percepts. Recent functional neuroimaging studies of normal subjects have demonstrated activation in auditory-linguistic brain areas in response to silent lip-reading. Three functional magnetic resonance imaging experiments were carried out on seven normal volunteers, and 14 schizophrenia patients, half of whom were actively psychotic. The tasks involved listening to auditory speech, silent lip-reading (visual speech), and perception of meaningless lip movements (visual non-speech). Subjects also undertook a behavioural study of audio-visual word identification designed to evoke perceptual fusions. Patients and controls both showed susceptibility to audio-visual fusions on the behavioural task. The patient group as a whole showed less activation relative to controls in superior and inferior posterior temporal areas while performing the silent lip-reading task. Attending to visual non-speech, the patients activated less posterior (occipito-temporal) and more anterior (frontal, insular and striatal) brain areas than controls. This difference was accounted for largely by the psychotic subgroup. Insular and striatal areas were also activated in both subject groups in the auditory speech perception condition, thus demonstrating the bimodal sensitivity of these regions. The results suggest that schizophrenia patients with psychotic symptoms respond to visually ambiguous stimuli (non-speech) by activation of polysensory structures. This could reflect particular processing strategies and may increase susceptibility to certain paranoid and hallucinatory symptoms.
Electrophysiological studies in nonhuman primates and other mammals have shown that sensory cues from different modalities that appear at the same time and in the same location can increase the firing rate of multisensory cells in the superior colliculus to a level exceeding that predicted by summing the responses to the unimodal inputs. In contrast, spatially disparate multisensory cues can induce a profound response depression. We have previously demonstrated using functional magnetic resonance imaging (fMRI) that similar indices of crossmodal facilitation and inhibition are detectable in human cortex when subjects listen to speech while viewing visually congruent and incongruent lip and mouth movements. Here, we have used fMRI to investigate whether similar BOLD signal changes are observable during the crossmodal integration of nonspeech auditory and visual stimuli, matched or mismatched solely on the basis of their temporal synchrony, and if so, whether these crossmodal effects occur in similar brain areas as those identified during the integration of audio-visual speech. Subjects were exposed to synchronous and asynchronous auditory (white noise bursts) and visual (B/W alternating checkerboard) stimuli and to each modality in isolation. Synchronous and asynchronous bimodal inputs produced superadditive BOLD response enhancement and response depression across a large network of polysensory areas. The most highly significant of these crossmodal gains and decrements were observed in the superior colliculi. Other regions exhibiting these crossmodal interactions included cortex within the superior temporal sulcus, intraparietal sulcus, insula, and several foci in the frontal lobe, including within the superior and ventromedial frontal gyri. These data demonstrate the efficacy of using an analytic approach informed by electrophysiology to identify multisensory integration sites in humans and suggest that the particular network of brain areas implicated in these crossmodal integrative processes are dependent on the nature of the correspondence between the different sensory inputs (e.g. space, time, and/or form).
Modern brain imaging techniques have now made it possible to study the neural sites and mechanisms underlying crossmodal processing in the human brain. This paper reviews positron emission tomography, functional magnetic resonance imaging (fMRI), event-related potential and magnetoencephalographic studies of crossmodal matching, the crossmodal integration of content and spatial information, and crossmodal learning. These investigations are beginning to produce some consistent findings regarding the neuronal networks involved in these distinct crossmodal operations. Increasingly, specific roles are being defined for the superior temporal sulcus, the inferior parietal sulcus, regions of frontal cortex, the insula cortex and claustrum. The precise network of brain areas implicated in any one study, however, seems to be heavily dependent on the experimental paradigms used, the nature of the information being combined and the particular combination of modalities under investigation. The different analytic strategies adopted by different groups may also be a significant factor contributing to the variability in findings. In this paper, we demonstrate the impact of computing intersections, conjunctions and interaction effects on the identification of audiovisual integration sites using existing fMRI data from our own laboratory. This exercise highlights the potential value of using statistical interaction effects to model electrophysiological responses to crossmodal stimuli in order to identify possible sites of multisensory integration in the human brain.
Landau-Kleffner syndrome (LKS) is an acquired aphasia which begins in childhood and is thought to arise from an epileptic disorder within the auditory speech cortex. Although the epilepsy usually subsides at puberty, a severe communication impairment often persists. Here we report on a detailed study of a 26-year old, left-handed male, with onset of LKS at age 5 years, who is aphasic for English but who learned British Sign Language (BSL) at age 13. We have investigated his skills in different language modalities, recorded EEGs during wakefulness, sleep, and under conditions of auditory stimulation, measured brain stem auditory-evoked potentials (BAEP), and performed functional MRI (fMRI) during a range of linguistic tasks. Our investigation demonstrated severe restrictions in comprehension and production of spoken English as well as lip-reading, while reading was comparatively less impaired. BSL was by far the most efficient mode of communication. All EEG recordings were normal, while BAEP showed minor abnormalities. fMRI revealed: 1) powerful and extensive bilateral (R > L) activation of auditory cortices in response to heard speech, much stronger than when listening to music; 2) very little response to silent lip-reading; 3) strong activation in the temporo-parieto-occipital association cortex, exclusively in the right hemisphere (RH), when viewing BSL signs. Analysis of these findings provides novel insights into the disturbance of the auditory speech cortex which underlies LKS and its diagnostic evaluation by fMRI, and underpins a strategy of restoring communication abilities in LKS through a natural sign language of the deaf (with Video)
In a previous study we used functional magnetic resonance imaging (fMRI) to demonstrate activation in auditory cortex during silent speechreading. Since image acquisition during fMRI generates acoustic noise, this pattern of activation could have reflected an interaction between background scanner noise and the visual lip-read stimuli. In this study we employed an event-related fMRI design which allowed us to measure activation during speechreading in the absence of acoustic scanner noise. In the experimental condition, hearing subjects were required to speechread random numbers from a silent speaker. In the control condition subjects watched a static image of the same speaker with mouth closed and were required to subvocally count an intermittent visual cue. A single volume of images was collected to coincide with the estimated peak of the blood oxygen level dependent (BOLD) response to these stimuli across multiple baseline and experimental trials. Silent speechreading led to greater activation in lateral temporal cortex relative to the control condition. This indicates that activation of auditory areas during silent speechreading is not a function of acoustic scanner noise and confirms that silent speechreading engages similar regions of auditory cortex as listening to speech.
BACKGROUND: Integrating information from the different senses markedly enhances the detection and identification of external stimuli. Compared with unimodal inputs, semantically and/or spatially congruent multisensory cues speed discrimination and improve reaction times. Discordant inputs have the opposite effect, reducing performance and slowing responses. These behavioural features of crossmodal processing appear to have parallels in the response properties of multisensory cells in the superior colliculi and cerebral cortex of non-human mammals. Although spatially concordant multisensory inputs can produce a dramatic, often multiplicative, increase in cellular activity, spatially disparate cues tend to induce a profound response depression. RESULTS: Using functional magnetic resonance imaging (fMRI), we investigated whether similar indices of crossmodal integration are detectable in human cerebral cortex, and for the synthesis of complex inputs relating to stimulus identity. Ten human subjects were exposed to varying epochs of semantically congruent and incongruent audio-visual speech and to each modality in isolation. Brain activations to matched and mismatched audio-visual inputs were contrasted with the combined response to both unimodal conditions. This strategy identified an area of heteromodal cortex in the left superior temporal sulcus that exhibited significant supra-additive response enhancement to matched audio-visual inputs and a corresponding sub-additive response to mismatched inputs. CONCLUSIONS: The data provide fMRI evidence of crossmodal binding by convergence in the human heteromodal cortex. They further suggest that response enhancement and depression may be a general property of multisensory integration operating at different levels of the neuroaxis and irrespective of the purpose for which sensory inputs are combined.
We have used functional magnetic resonance imaging (fMRI) to characterize brain activations associated with two distinct language tasks performed by a 28-year-old woman after partial recovery from dysphasia due to a left frontal hemispheric ischemic stroke. MRI showed that her ischemic lesion extended posteriorly from the left inferior frontal to the perisylvian cortex. fMRI scans of both language tasks revealed substantial differences in activation pattern relative to controls. The nature of this difference was task-specific. During performance of a verbal semantic decision task, the patient, in contrast to controls, activated a network of brain areas that excluded the inferior frontal gyrus (in either hemisphere). A second task involving rhyme judgment was designed to place a heavier cognitive load on language production processes and activated the left inferior frontal gyrus (Broca's area) strongly in normal controls. During this task, the most prominent frontal activation in the patient occurred in the right homologue of Broca's area. Subsequent analysis of this data by methods able to deal with responses of changing amplitude revealed additional, less sustained recruitment by the patient of cortex adjacent to the infarct in the region inferior to Broca's area during rhyming. These results suggest that in addition to changes in cognitive strategy, recovery from dysphasia could be mediated by both the preservation of neuronal networks in and around the infarct and the use of homologous regions in the contralateral hemisphere.
Integrating information across the senses can enhance our ability to detect and classify stimuli in the environment. For example, auditory speech perception is substantially improved when the speaker's face is visible. In an fMRI study designed to investigate the neural mechanisms underlying these crossmodal behavioural gains, bimodal (audio-visual) speech was contrasted against both unimodal (auditory and visual) components. Significant response enhancements in auditory (BA 41/42) and visual (V5) cortices were detected during bimodal stimulation. This effect was found to be specific to semantically congruent crossmodal inputs. These data suggest that the perceptual improvements effected by synthesizing matched multisensory inputs are realised by reciprocal amplification of the signal intensity in participating unimodal cortices.
Bishop, Ross, Daniels, and Bright (1996) proposed a novel approach to quantifying hand preference (QHP) using a single behavioural measure. The extent to which individuals used their dominant hand to reach across the midline to pick up cards discriminated subgroups of right-handers, similarly categorised by their scores on the Edinburgh Handedness Inventory. This study aimed to investigate whether (1) the QHP approach was able to differentiate subgroups within the left-handed as well as right-handed populations, (2) left-handers behave like mirror-image right-handers, and (3) if interacting with the environment in extrapersonal space is influenced by the level of fine motor skill demanded by the task. Results support the use of the QHP to discriminate subgroups of both left- and right-handers, particularly when the task demands very fine motor skill or very little. Left-handers behaved as mirror-images of the right-handers except when performing the unskilled motor task in which they showed greater readiness to use the nonpreferred hand. These results suggest that interaction with the environment in extrapersonal space may be a key factor contributing to manual dominance and that the lateralisation of fine motor skill interacts with this attentional bias.
Watching a speaker's lips during face-to-face conversation (lipreading) markedly improves speech perception, particularly in noisy conditions. With functional magnetic resonance imaging it was found that these linguistic visual cues are sufficient to activate auditory cortex in normal hearing individuals in the absence of auditory speech sounds. Two further experiments suggest that these auditory cortical areas are not engaged when an individual is viewing nonlinguistic facial movements but appear to be activated by silent meaningless speechlike movements (pseudospeech). This supports psycholinguistic evidence that seen speech influences the perception of heard speech at a prelexical stage.