Search PubMed⌕ Search
Home/Archive/PubMed

PubMed · 14511840

Audio-visual integration in temporal perception.

Yuji Wada·Norimichi Kitagawa·Kaoru Noguchi
View original source ↗Export metadata ↓

Abstract

In situations of audio-visual interaction, research has generally found that audition prevails over vision in temporal perception, while vision is dominant over audition for spatial perception. Modality appropriateness to a given task generally determines the direction of this inter-modality effect. However, we found a reverse effect in some situations where a change in the frequency of visual stimuli was associated with a perceived change in the frequency of auditory stimuli. In our experiment, 12 participants were asked to judge the change in the frequency of visual and auditory stimuli using a visual flicker and auditory flutter stimuli. In some conditions either the auditory or the visual information was ambiguous. In addition to confirming the expected finding that a change in the frequency of the auditory stimuli induced a perceived change in the frequency of the visual stimuli, we found a new phenomenon. When ambiguous auditory temporal cues were presented, the change in the frequency of the visual stimuli was associated with a perceived change in the frequency of the auditory stimuli. This suggests that cross-modal asymmetry effects are influenced by the reliability of visual and auditory information as well as modality appropriateness.

Explore related subjects

Acoustic StimulationAdultAnalysis of VarianceAuditory PerceptionFemaleHumansMalePhotic StimulationTime PerceptionVisual PerceptionJournal ArticleResearch Support, Non-U.S. Gov't

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Yuji Wada, Norimichi Kitagawa, Kaoru Noguchi. 2003. Audio-visual integration in temporal perception.. https://doi.org/10.1016/s0167-8760(03)00128-4

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related citations

PubMed2004

Functional imaging during covert auditory attention in multiple sclerosis.

Recent literature suggests that the brain in multiple sclerosis (MS) undergoes reorganization that subserves the performance of visual and motor tasks. We identified sites of cerebral activity in 16 MS patients while performing a covert attention (CA) task, presented in the auditory modality. Positron emission tomography (PET) revealed activation of rostral/dorsal anterior cingulate cortex (ACC) in normal subjects studied previously. Activity in this region was not significant in MS patients, but there was a large region of activity in superior temporal cortex. Decreased activation of frontal attentional networks and greater activity in sensory/perceptual cortical areas (auditory association cortex) suggests a reduction of transmission along white matter tracts connecting these regions. This study demonstrates cingulate hypoactivity and cerebral reorganization during auditory attention in MS.

Acoustic Stimulation↗
PubMed2004

Mismatch negativity in schizophrenia: a family study.

BACKGROUND: Mismatch negativity (MMN) is a measure of cortical activity that occurs in response to a change in auditory stimuli. We investigated whether MMN is a potential marker of genetic vulnerability to schizophrenia by comparing MMN in a group of patients with schizophrenia, their unaffected relatives, and controls. METHOD: There are 25 schizophrenic patients, 37 of their unaffected first-degree relatives, and 20 unrelated controls that performed the MMN task. Linear regression with robust standard errors, and accounting for correlations within families, was employed to test for differences in MMN amplitude between the groups. RESULTS: Patients had significantly smaller MMN amplitudes compared to both their unaffected relatives and controls at FZ (P<0.01) and at F3 (P=0.01), whereas relatives and controls did not differ at FZ or at F3. No differences were found between any of the groups at F4. Furthermore, we found no strong evidence that the MMN amplitude is a familial trait. CONCLUSIONS: Our results confirm that the MMN amplitude is reduced in schizophrenia. However, the MMN does not show a significant familial influence and is normal among the unaffected relatives. We conclude that while the MMN is abnormal in patients with schizophrenia, it is a weak or unreliable marker of vulnerability when applied to subclinical populations, and therefore is unlikely to be an endophenotype for the disorder.

Acoustic Stimulation↗
PubMed2004

Characterization of deficits in pitch perception underlying 'tone deafness'.

Congenital amusia is a disorder characterized by life-long, selective deficits in the perception of music. This study examined pitch-perception abilities in a group of 10 adults with this disorder. Tests were administered that assessed fine-grained pitch perception by determining thresholds both for the detection of continuous and segmented pitch changes, and for the recognition of pitch direction. Tests were also administered that assessed the perception of more complex pitch patterns, using pitch-sequence comparison tasks. In addition, the perceptual organization of pitch was also examined, using stream segregation tasks that assess the assignment of sounds differing in pitch to one or two distinct perceptual sources. In comparison with 10 control subjects, it was found that the participants with congenital amusia exhibited deficits both at the level of detecting fine-grained differences in pitch, and at the level of perceiving patterns in pitch. In contrast, no abnormalities were identified in the perceptual organization of pitch. The pitch deficits identified are able to account for the music perception difficulties in this disorder, and implicate deficient cortical processing.

Acoustic Stimulation↗