Search PubMed⌕ Search

Biomedical subjects

Sophie Molholm

Publications and source records attributed to Sophie Molholm.

16 recordsLinked to original sources
PubMed2006

Multisensory processing and oscillatory activity: analyzing non-linear electrophysiological measures in humans and simians.

Stimulus-related oscillations are known to be closely linked to integrative processing in the brain. One research domain within which there has been tremendous interest in oscillatory mechanisms is in the integration of inputs across the widely separated sensory systems. Under the standard approach of assessing multisensory interactions in electrophysiological datasets, the event-related response to a multisensory stimulus is directly compared with the sum of the responses to its unisensory constituents when presented alone. When using methods like wavelet transformation or fast Fourier transformation to derive induced oscillatory signals, however, such linear operations are not appropriate. Here we introduce a simple bootstrapping procedure wherein the linear summation of single unisensory trials forms a distribution against which multisensory trials may be statistically compared, an approach that circumvents the issue of non-linearity when combining unisensory oscillatory responses. To test this approach we applied it to datasets from intracranial recordings in non-human primates and human scalp-recorded EEG, both derived from a simple audio-visual integration paradigm. Significant multisensory interactions were revealed in oscillatory activity centered at 15 and 20 Hz (the so-called beta band). Simulations of different levels of background noise further validated the results obtained by this method. By demonstrating super- and sub-additive effects, our analyses showed that this approach is a valuable metric for studying multisensory interactions reflected in induced oscillatory responses.

Adult↗
PubMed2006

Seeing voices: High-density electrical mapping and source-analysis of the multisensory mismatch negativity evoked during the McGurk illusion.

Seeing a speaker's facial articulatory gestures powerfully affects speech perception, helping us overcome noisy acoustical environments. One particularly dramatic illustration of visual influences on speech perception is the "McGurk illusion", where dubbing an auditory phoneme onto video of an incongruent articulatory movement can often lead to illusory auditory percepts. This illusion is so strong that even in the absence of any real change in auditory stimulation, it activates the automatic auditory change-detection system, as indexed by the mismatch negativity (MMN) component of the auditory event-related potential (ERP). We investigated the putative left hemispheric dominance of McGurk-MMN using high-density ERPs in an oddball paradigm. Topographic mapping of the initial McGurk-MMN response showed a highly lateralized left hemisphere distribution, beginning at 175 ms. Subsequently, scalp activity was also observed over bilateral fronto-central scalp with a maximal amplitude at approximately 290 ms, suggesting later recruitment of right temporal cortices. Strong left hemisphere dominance was again observed during the last phase of the McGurk-MMN waveform (350-400 ms). Source analysis indicated bilateral sources in the temporal lobe just posterior to primary auditory cortex. While a single source in the right superior temporal gyrus (STG) accounted for the right hemisphere activity, two separate sources were required, one in the left transverse gyrus and the other in STG, to account for left hemisphere activity. These findings support the notion that visually driven multisensory illusory phonetic percepts produce an auditory-MMN cortical response and that left hemisphere temporal cortex plays a crucial role in this process.

Acoustic Stimulation↗
PubMed2006

Audio-visual multisensory integration in superior parietal lobule revealed by human intracranial recordings.

Intracranial recordings from three human subjects provide the first direct electrophysiological evidence for audio-visual multisensory processing in the human superior parietal lobule (SPL). Auditory and visual sensory inputs project to the same highly localized region of the parietal cortex with auditory inputs arriving considerably earlier (30 ms) than visual inputs (75 ms). Multisensory integration processes in this region were assessed by comparing the response to simultaneous audio-visual stimulation with the algebraic sum of responses to the constituent auditory and visual unisensory stimulus conditions. Significant integration effects were seen with almost identical morphology across the three subjects, beginning between 120 and 160 ms. These results are discussed in the context of the role of SPL in supramodal spatial attention and sensory-motor transformations.

Acoustic Stimulation↗
PubMed2006

The anterior cingulate and error avoidance.

The precise role of the anterior cingulate cortex in monitoring, evaluating, and correcting behavior remains unclear despite numerous theories and much empirical data implicating it in cognitive control. The present event-related functional magnetic resonance imaging study was able to separate monitoring from error-specific functions by allowing subjects to reject a trial so as to avoid errors. Cingulate and left dorsolateral prefrontal activity was greatest on rejection trials but comparable for correct and error trials, whereas an error-specific response was observed in bilateral insula. A dissociation was also observed between the cingulate and the nucleus accumbens with the latter more active for error than reject trials. These results reveal that the functional role of the cingulate is not particular to errors but instead is related to an evaluative function concerned with on-line behavioral adjustment in the service of avoiding losses.

Adult↗
PubMed2006

Preattentively grouped tones do not elicit MMN with respect to each other.

To promote preattenive grouping of two sets of tones, one set of tones with a combination of frequency and ear of delivery was intermixed with another set of tones with a different combination of frequency and ear of delivery. The ERPs elicited by tones delivered to one ear that were preceded by three or four tones delivered in a row to the other ear were associated with an enhanced N1, due to the changes in frequency and ear of delivery with respect to the immediately preceding tones. However, no mismatch negativity (MMN) was obtained, even though these tones differed from the previious tones on the two dimensions of frequency and ear of delivery. The data were interpreted to signify that preattentively grouped sets of tones do not elicit MMN with respect to one another. This implies that once acoustic input has been preattentively grouped, the MMN system is dedicated to detecting changes that occur within but not between preattentively grouped stimuli.

Acoustic Stimulation↗
PubMed2005

Oscillatory beta activity predicts response speed during a multisensory audiovisual reaction time task: a high-density electrical mapping study.

Bisensory redundant targets are processed faster than the respective unisensory target stimuli alone as evidenced by substantially faster reaction times (RTs). This multisensory RT facilitation has been interpreted as an expression of integrative processing between the different sensory modalities. However, the neuronal mechanisms underlying the RT facilitation effect are not well understood. Oscillatory responses in the beta frequency range (13-30 Hz) have been related to sensory-motor processing. Here, we investigated whether modulation of beta responses might also underlie the faster RTs seen for multisensory stimuli. Using high-density electrical mapping, we explored the association between early (50-170 ms) multisensory processing in the evoked beta response and RTs recorded during a simple RT task. Subjects were instructed to indicate the appearance of any stimulus in a stream of auditory-alone (A), visual-alone (V), and multisensory (AV) stimuli by a button press. Beta responses were analyzed using Morlet wavelet transformations. Multisensory interactions were found over frontal, occipital, central, and sensory-motor regions. Critically, beta activity correlated with mean RTs over all stimulus types. Significant negative correlations were found for frontal, occipital, and sensory-motor scalp regions. We conclude that the association between oscillatory beta activity and integrative multisensory processing is directly linked to multisensory RT facilitation effects.

Acoustic Stimulation↗
PubMed2005

Spatiotemporal dynamics of human object recognition processing: an integrated high-density electrical mapping and functional imaging study of "closure" processes.

Humans are capable of recognizing objects, often despite highly adverse viewing conditions (e.g., occlusion). The term "perceptual closure" has been used to refer to the neural processes responsible for "filling-in" missing information in the visual image under such conditions. Closure phenomena have been linked to a group of object recognition areas, the so-called lateral-occipital complex (LOC). Here, we investigated the spatiotemporal dynamics of perceptual closure processes by coregistering data from high-density electrical recordings (ERPs) and functional magnetic resonance imaging (fMRI) while subjects participated in a perceptual closure task. Subjects were presented with highly fragmented images and control scrambled images. Fragmented images were calibrated to be 'just' recognizable as objects (that is, perceptual closure was necessary), whereas the scrambled images were unrecognizable. Comparison of responses to these two stimulus classes revealed the neural processes underlying perceptual closure. fMRI revealed an object recognition system that mediates these closure processes, the core of which consists of the LOC regions. ERP recordings resulted in the well-characterized N(CL) component (for negativity associated with closure), a robust relative negativity over bilateral occipito-temporal scalp that occurs in the 230-400 ms timeframe. Our investigations further revealed an extended network of dorsal and frontal regions, also involved in perceptual closure processes. Inverse source analysis showed that the major generators of N(CL) localized to the identical regions within LOC revealed by the fMRI recordings and detailed the temporal dynamics across these LOC regions including interactions between LOC and these other nodes of the object recognition circuit.

Adult↗
PubMed2005

Neural mechanisms involved in error processing: a comparison of errors made with and without awareness.

The ability to detect an error in one's own performance and then to improve ongoing performance based on this error processing is critical for effective behaviour. In our event-related fMRI experiment, we show that explicit awareness of a response inhibition commission error and subsequent post-error behaviour were associated with bilateral prefrontal and parietal brain activation. Activity in the anterior cingulate region, typically associated with error detection, was equivalent for both errors subjects were aware of and those they were not aware of making. While anterior cingulate activation has repeatedly been associated with error-related processing, these results suggest that, in isolation, it is not sufficient for conscious awareness of errors or post-error adaptation of response strategies. Instead, it appears, irrespective of awareness, to detect information about stimuli/responses that requires interpretation in other brain regions for strategic implementation of post-error adjustments of behaviour.

Adult↗
PubMed2004

Grabbing your ear: rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment.

Multisensory interactions are observed in species from single-cell organisms to humans. Important early work was primarily carried out in the cat superior colliculus and a set of critical parameters for their occurrence were defined. Primary among these were temporal synchrony and spatial alignment of bisensory inputs. Here, we assessed whether spatial alignment was also a critical parameter for the temporally earliest multisensory interactions that are observed in lower-level sensory cortices of the human. While multisensory interactions in humans have been shown behaviorally for spatially disparate stimuli (e.g. the ventriloquist effect), it is not clear if such effects are due to early sensory level integration or later perceptual level processing. In the present study, we used psychophysical and electrophysiological indices to show that auditory-somatosensory interactions in humans occur via the same early sensory mechanism both when stimuli are in and out of spatial register. Subjects more rapidly detected multisensory than unisensory events. At just 50 ms post-stimulus, neural responses to the multisensory 'whole' were greater than the summed responses from the constituent unisensory 'parts'. For all spatial configurations, this effect followed from a modulation of the strength of brain responses, rather than the activation of regions specifically responsive to multisensory pairs. Using the local auto-regressive average source estimation, we localized the initial auditory-somatosensory interactions to auditory association areas contralateral to the side of somatosensory stimulation. Thus, multisensory interactions can occur across wide peripersonal spatial separations remarkably early in sensory processing and in cortical regions traditionally considered unisensory.

Adult↗
PubMed2004

The neural circuitry of pre-attentive auditory change-detection: an fMRI study of pitch and duration mismatch negativity generators.

Electrophysiological studies have revealed a pre-attentive change-detection system in the auditory modality. This system emits a signal termed the mismatch negativity (MMN) when any detectable change in a regular pattern of auditory stimulation occurs. The precise intracranial sources underlying MMN generation, and in particular whether these vary as a function of the acoustic feature that changes, is a matter of some debate. Using functional magnetic resonance imaging, we show that anatomically distinct networks of auditory cortices are activated as a function of the deviating acoustic feature--in this case, tone frequency and tone duration--strongly supporting the hypothesis that MMN generators in auditory cortex are feature dependent. We also detail regions of the frontal and parietal cortices activated by change-detection processes. These regions also show feature dependence and we hypothesize that they reflect recruitment of attention-switching mechanisms.

Adult↗
PubMed2004

Multisensory visual-auditory object recognition in humans: a high-density electrical mapping study.

Multisensory object-recognition processes were investigated by examining the combined influence of visual and auditory inputs upon object identification--in this case, pictures and vocalizations of animals. Behaviorally, subjects were significantly faster and more accurate at identifying targets when the picture and vocalization were matched (i.e. from the same animal), than when the target was represented in only one sensory modality. This behavioral enhancement was accompanied by a modulation of the evoked potential in the latency range and general topographic region of the visual evoked N1 component, which is associated with early feature processing in the ventral visual stream. High-density topographic mapping and dipole modeling of this multisensory effect were consistent with generators in lateral occipito-temporal cortices, suggesting that auditory inputs were modulating processing in regions of the lateral occipital cortices. Both the timing and scalp topography of this modulation suggests that there are multisensory effects during what is considered to be a relatively early stage of visual object-recognition processes, and that this modulation occurs in regions of the visual system that have traditionally been held to be unisensory processing areas. Multisensory inputs also modulated the visual 'selection-negativity', an attention dependent component of the evoked potential this is usually evoked when subjects selectively attend to a particular feature of a visual stimulus.

Adult↗
PubMed2004

Feature versus gestalt representation of stimuli in the mismatch negativity system of 7- to 9-year-old children.

We examined preattentive auditory change detection in 7- to 9-year-old children. The question of interest was whether the preattentive comparison of stimuli indexed by the scalp-recorded mismatch negativity (MMN) was performed on representations of individual stimulus features or on gestalt representations of their combined attributes. The design of the study, based on a work by D. Deacon, J. Nousak, M. Pilotti, W. Ritter, and C. Yang (Psychophysiology, 1998), was such that both feature and gestalt representations could have been available to the comparator mechanism generating the MMN. The data indicated that for the majority of the children-those that exhibited an inverse relationship between the amplitude of the MMN and the probability of the deviant-the MMN was based on feature-specific information. This study also provides a method to obtain MMNs to deviants in three different features in the time usually required to obtain an MMN to a single acoustic feature.

Acoustic Stimulation↗
PubMed2002

Novel metaphors appear anomalous at least momentarily: evidence from N400.

This study addresses a central question in perception of novel figurative language: whether it is interpreted intelligently and figuratively immediately, or only after a literal interpretation fails. Eighty sentence frames that could plausibly end with a literal, truly anomalous, or figurative word were created. After validation for meaningfulness and figurativeness, the 240 sentences were presented to 11 subjects for event related potential (ERP) recording. ERP's first 200 ms is believed to reflect the structuring of the input; the prominence of a dip at around 400 ms (N400) is said to relate inversely to how expected a word is. Results showed no difference between anomalous and metaphoric ERPs in the early window, metaphoric and literal ERPs converging 300-500 ms after the ending, and significant N400s only for anomalous endings. A follow-up study showed that the metaphoric endings were less frequent (in standardized word norms) than were the anomalous and literal endings and that there were significant differences in cloze probabilities (determined from 24 new subjects) among the three ending types: literal > metaphoric > anomalous. It is possible that the low frequency of the metaphoric element and lower cloze probability of the anomalous one contributed to the processes reflected in the early window, while the incongruity and near-zero cloze probability of the anomalous endings produced an N400 effect in them alone. The structure or parse derived for metaphor during the early window appears to yield a preliminary interpretation suggesting anomaly, while semantic analysis reflected in the later window renders a plausible figurative interpretation.

Adult↗
PubMed2002

Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study.

Integration of information from multiple senses is fundamental to perception and cognition, but when and where this is accomplished in the brain is not well understood. This study examined the timing and topography of cortical auditory-visual interactions using high-density event-related potentials (ERPs) during a simple reaction-time (RT) task. Visual and auditory stimuli were presented alone and simultaneously. ERPs elicited by the auditory and visual stimuli when presented alone were summed ('sum' ERP) and compared to the ERP elicited when they were presented simultaneously ('simultaneous' ERP). Divergence between the 'simultaneous' and 'sum' ERP indicated auditory-visual (AV) neural response interactions. There was a surprisingly early right parieto-occipital AV interaction, consistent with the finding of an earlier study [J. Cogn. Neurosci. 11 (1999) 473]. The timing of onset of this effect (46 ms) was essentially simultaneous with the onset of visual cortical processing, as indexed by the onset of the visual C1 component, which is thought to represent the earliest cortical visual evoked potential. The coincident timing of the early AV interaction and C1 strongly suggests that AV interactions can affect early visual sensory processing. Additional AV interactions were found within the time course of sensory processing (up to 200 ms post stimulus onset). In total, this system of AV effects over the scalp was suggestive of both activity unique to multisensory processing, and the modulation of 'unisensory' activity. RTs to the stimuli when presented simultaneously were significantly faster than when they were presented alone. This RT facilitation could not be accounted for by probability summation, as evidenced by violation of the 'race' model, providing compelling evidence that auditory-visual neural interactions give rise to this RT effect.

Acoustic Stimulation↗
PubMed2002

Memory reactivation or reinstatement and the mismatch negativity.

Previous studies have suggested that the memory underlying the mismatch negativity (MMN) can be deactivated by a period of silence and later reactivated. An alternative is that the memory becomes inapplicable due to a period of silence and subsequently reinstated. Both interpretations rest on the absence of a MMN for a deviant in Position 1 of a train (showing deactivation or inapplicability of the memory) and the presence of a MMN in Position 2 of the train (evidencing reactivation or reinstatement of the memory). In these studies, the standards were fixed across all trains of a given condition. Hence, it is not clear if the MMN elicited in Position 2 requires presentation of multiple trains with identical standards or only a single train. Experiment 1 showed that a single train is sufficient. With data from recent studies, Experiment 2 showed that MMNs in Position 2 of trains are due to reinstatement rather than reactivation of the memory.

Acoustic Stimulation↗