Search PubMed⌕ Search

Biomedical subjects

Shinsuke Shimojo

Publications and source records attributed to Shinsuke Shimojo.

36 records · Page 2Linked to original sources

Sound-aided recovery from and persistence against visual filling-in.

Disappearance phenomena, in which salient visual stimuli do not register consciously, have been known to occur. Recovery from such phenomena typically occurs through change in some visual attribute, such as increase in luminance contrast or stimulus duration. Thus far, there have been no reports of cross-modal modulation of disappearance phenomena. In particular, what effect a cross-modal attentional cue has on sensory suppression is unknown. Here, we show that an adapted, flickered visual target that is synchronous with a brief sound appears more vivid than a similarly adapted, otherwise identical, visual target that is offset in time by more than 200 ms from the auditory cue. We argue that the brief auditory stimuli momentarily boost the concurrent signal of the adapted visual stimulus at a site downstream of the visual adaptation, thus causing the transient recovery from the visual adaptation. Repetitive visual cues cause significantly less recovery from visual adaptation than repetitive auditory cues, implying that there are functions a cross-modal cue can perform that a cue of the same modality cannot. Moreover repetitive auditory cues selectively prevent synchronous visual targets from undergoing visual adaptation. Ours is the first report of cross-modal modulation of a disappearance phenomenon.

Acoustic Stimulation↗

An integrative model of binocular vision: a stereo model utilizing interocularly unpaired points produces both depth and binocular rivalry.

Half-occluded points (visible only in one eye) are perceived at a certain depth behind the occluding surface without binocular rivalry, even though no disparity is defined at such points. Here we propose a stereo model that reconstructs 3D structures not only from disparity information of interocularly paired points but also from unpaired points. Starting with an array of depth detection cells, we introduce cells that detect unpaired points visible only in the left eye or the right eye (left and right unpaired point detection cells). They interact cooperatively with each other based on optogeometrical constraints (such as uniqueness, cohesiveness, occlusion) to recover the depth and the border of 3D objects. Since it is contradictory for monocularly visible regions to be visible in both eyes, we introduce mutual inhibition between left and right unpaired point detection cells. When input images satisfy occlusion geometry, the model outputs the depth of unpaired points properly. An interesting finding is that when we input two unmatched images, the model shows an unstable output that alternates between interpretations of monocularly visible regions for the left and the right eyes, thereby reproducing binocular rivalry. The results suggest that binocular rivalry arises from the erroneous output of a stereo mechanism that estimates the depth of half-occluded unpaired points. In this sense, our model integrates stereopsis and binocular rivalry, which are usually treated separately, into a single framework of binocular vision. There are two general theories for what the "rivals" are during binocular rivalry: the two eyes, or representations of two stimulus patterns. We propose a new hypothesis that bridges these two conflicting hypotheses: interocular inhibition between representations of monocularly visible regions causes binocular rivalry. Unlike the traditional eye theory, the level of the interocular inhibition introduced here is after binocular convergence at the stage solving the correspondence problem, and thus open to pattern-specific mechanisms.

Depth Perception↗

Perceptual-binding and persistent surface segregation.

Visual input is segregated in the brain into subsystems that process different attributes such as motion and color. At the same time, visual information is perceptually segregated into objects and surfaces. Here we demonstrate that perceptual segregation of visual entities based on a transparency cue precedes and affects perceptual binding of attributes. Adding an irrelevant transparency cue paradoxically improved the pairing of color and motion for rapidly alternating surfaces. Subsequent experiments show: (1) Attributes are registered over the temporal window defined by the perceptual persistence of segregation, resulting in asynchrony in binding, and (2) attention is necessary for correct registration of attributes in the presence of ambiguity.

Attention↗

Extrinsic cues suppress the encoding of intrinsic cues.

Remembering where objects are in space is fundamental to adaptive behavior. Little is known about how intact humans combine information from intrinsic (egocentric) and extrinsic (exocentric, allocentric, or landmark-based) coordinate systems to locate objects. Using a simple location estimation paradigm, this study finds that we mostly remember position in extrinsic coordinates. Intrinsic-coordinate-based mapping of space is less precise in the presence of landmarks or extrinsic cues than in their absence. Thus, not only do extrinsic frames of reference dominate internal representations of space, they suppress intrinsic-based representations as well. We speculate that this dominance-suppression hierarchy undercuts intersystem conflicts and underlies a single, undissociated spatial map in intact humans.

Brain Mapping↗

Gaze bias both reflects and influences preference.

Emotions operate along the dimension of approach and aversion, and it is reasonable to assume that orienting behavior is intrinsically linked to emotionally involved processes such as preference decisions. Here we describe a gaze 'cascade effect' that was present when human observers were shown pairs of human faces and instructed to decide which face was more attractive. Their gaze was initially distributed evenly between the two stimuli, but then gradually shifted toward the face that they eventually chose. Gaze bias was significantly weaker in a face shape discrimination task. In a second series of experiments, manipulation of gaze duration, but not exposure duration alone, biased observers' preference decisions. We thus conclude that gaze is actively involved in preference formation. The gaze cascade effect was also present when participants compared abstract, unfamiliar shapes for attractiveness, suggesting that orienting and preference for objects in general are intrinsically linked in a positive feedback loop leading to the conscious choice.

Choice Behavior↗

Signal strength determines the nature of the relationship between perception and working memory.

Neurophysiological and behavioral studies have shown that perception and memory share neural substrates and functional properties. But are perception and the active working memory of a stimulus one and the same? To address this question in the spatial domain, we compared the percept and the working memory of the position of a target stimulus embedded within a surround of moving dots. Motion in a particular direction after the target's offset biased the memory of target location in the same direction. However, motion simultaneous with a high-contrast, perceptually strong target biased the percept of target location in the opposite direction. Thus, perception and working memory can be modified by motion in qualitatively different ways. Manipulations to strengthen the memory trace had no effect on the direction of the memory bias, indicating that memory signal strength can never equal that of the percept of a strong stimulus. However, the percept of a weak stimulus was biased in the direction of motion. Thus, although perception and working memory are not inherently different, they can differ behaviorally depending on the strength of the perceptual signal. Understanding how a changing surround biases neural representations in general, and postsensory processes in particular, can help one understand past reports of spatial mislocalization.

Computer Simulation↗

Gaze modulation of visual aftereffects.

Physiological studies of non-human primates have suggested that the direction of gaze can modulate the gain of neuronal responses to visual stimuli in many cortical areas including V1. The neural gaze modulation is suggested to subserve the conversion from gaze-independent (eye-centered) to dependent (e.g., head-centered) representations. However, it has not been established whether the gaze modulation has significant influences on human visual perception. Here we show that gaze direction modestly but significantly modulates the magnitudes of the motion aftereffect, the tilt aftereffect and the size aftereffect. These aftereffects were stronger when the adaptation and test patterns were presented in the same gaze direction, than when they were presented in different gaze directions, even though the patterns always stimulated the same retinal location. The gaze modulation effect was not statistically significant for the post-adaptation elevation of contrast detection thresholds. The gaze modulation of visual aftereffects provides a useful psychophysical tool to analyze human cortical processes for coordinate transformations of visual space.

Figural Aftereffect↗

Sustained deviation of gaze direction can affect "inverted vection" induced by the foreground motion.

A slowly moving foreground with an orthogonally moving background can induce self-motion perception in the same direction as the foreground motion (inverted vection; [Vision Research 40 (2000) 2915]). In the present study, we investigate the effect of sustained gaze deviation on inverted vection. We hypothesized that gaze deviation affects eye-movement information registered in the perceptual system, which might be a primary factor for causing inverted vection. The experiment revealed that strength of inverted vection decreases with observer's gaze deviation in the same direction as the foreground motion, while it increases with the deviation in the opposite direction to the foreground. These results support our hypothesis and suggest that inverted vection is affected by eye-movement information.

Adult↗

Perceived shifts of flashed stimuli by visible and invisible object motion.

Perceived positions of flashed stimuli can be altered by motion signals in the visual field-position capture (Whitney and Cavanagh, 2000 Nature Neuroscience 3 954-959). We examined whether position capture of flashed stimuli depends on the spatial relationship between moving and flashed stimuli, and whether the phenomenal permanence of a moving object behind an occluding surface (tunnel effect; Michotte 1950 Acta Psychologica 7 293-322) can produce position capture. Observers saw two objects (circles) moving vertically in opposite directions, one in each visual hemifield. Two horizontal bars were simultaneously flashed at horizontally collinear positions with the fixation point at various timings. When the movement of the object was fully visible, the flashed bar appeared shifted in the motion direction of the circle. But this position-capture effect occurred only when the bar was presented ahead of or on the moving circle. Even when the motion trajectory was covered by an opaque surface and the bar was flashed after complete occlusion of the circle, the position-capture effect was still observed, though the positional asymmetry was less clear. These results show that movements of both visible and 'hidden' objects can modulate the perception of positions of flashed stimuli and suggest that a high-level representation of 'objects in motion' plays an important role in the position-capture effect.

Attention↗

Neuromagnetic responses to chromatic flicker: implications for photosensitivity.

Excessive cortical excitation due to visual stimulation often leads to photosensitive epilepsy. Here we demonstrate that even in normal subjects, prolonged stimulation with low-luminance chromatic (equiluminant) flicker evokes neuromagnetic activity in the primary visual cortex, which develops slowly (up to 1000 ms) and depends on the color combination of flicker. This result suggests that chromatic sensitivity is a critical factor of cortical excitation, which can be amplified over time by a flickering stimulus. We further show that transient activity occurs in the parieto-occipital sulcus as early as 100-400 ms after flicker onset, which is negatively correlated with the later occipital activity. The early parieto-occipital activity may reflect a defensive mechanism that suppresses cortical hyperactivity due to chromatic flicker.

Adult↗

Sound-induced illusory flash perception: role of gamma band responses.

In the recently discovered sound-induced illusory flash phenomenon, a single flash accompanied with two auditory beeps is perceived as two flashes in a majority of trials. Here we asked what the neural substrates distinguishing illusion and no-illusion (i.e. perception of single flash) percepts are under identical stimulus configuration. Wavelet based method was used to analyze gamma band (> 30 Hz) responses in the event-related potential (ERP) signals recorded over visual cortical regions. We found: (i) significantly higher oscillatory and induced gamma band responses in illusion than in no-illusion trials, and (ii) significant supra-additive audio-visual interactions only in illusion trials. These results provide a clear neurophysiological correlate to the perception of illusion. Furthermore, the results suggest that auditory stimuli modulate cortical processing of visual stimuli, and the flash illusion (qualitative alteration of visual percept) only takes place when this modulation exceeds some critical threshold for the registration of conscious awareness.

Acoustic Stimulation↗

Dynamic shape integration in extrastriate cortex.

BACKGROUND: In anorthoscopic viewing conditions, observers can perceive a moving object through a narrow slit even when only portions of its contour are visible at any time. We used fMRI to examine the contribution of early and later visual cortical areas to dynamic shape integration. Observers' success at integrating the shape of the slit-viewed object was manipulated by varying the degree to which the stimulus was dynamically distorted. Line drawings of common objects were either moderately distorted, strongly distorted, or shown undistorted. Phenomenologically, increasing the stimulus distortion made both object shape and motion more difficult to perceive. RESULTS: We found that bilateral cortical activity in portions of the ventral occipital cortex, corresponding to known object areas within the lateral occipital complex (LOC), was inversely correlated with the degree of stimulus distortion. We found that activity in left MT+, the human cortical area specialized for motion, showed a similar pattern as the ventral occipital region. The LOC also showed greater activity to a fully visible moving object than to the undistorted slit-viewed object. Area MT+, however, showed more equivalent activity to both the slit-viewed and fully visible moving objects. CONCLUSIONS: In early retinotopic cortex, the distorted and undistorted stimuli elicited the same amount of activity. Higher visual areas, however, were correlated with the percept of the coherent object, and this correlation suggests that the shape integration is mediated by later visual cortical areas. Motion information from the dorsal stream may project to the LOC to produce the shape percept.

Adult↗

How the lack of visuomotor feedback affects even the early stages of goal-directed pointing movements.

Pointing movements made with a hidden cursor from the center of gaze to a stationary, visible target overshot the actual target location. The systematic error decreased when the final cursor location from the previous trial was shown, which likely led to the creation of an internal sensorimotor model of movement. However, the putative model had a short memory, and could not substitute for on-line visuomotor feedback on subsequent trials. Contrary to common belief, the effect of a lack of visuomotor feedback was seen even in the early acceleration stage of the movement trajectory. Unchecked in the absence of visual monitoring, the acceleration stage of the movement lasted longer, as was evidenced by the significantly larger value of the peak cursor speed. Moreover, the speed peaked much later in the course of the movement. Speed declined more rapidly thereafter. Consequently, the delayed deceleration stage lasted far less than the acceleration stage. In the absence of visual feedback, the shift rightward in time of the peak speed position (PSP) in relation to total movement duration and other changes in the trajectory imply that visual feedback must play a significant role in determining when acceleration ceases (d V/d t=0), and argue against the traditional notion that visuomotor feedback is unavailable until the later stages of movement. Moreover, our data suggest that non-visual modalities, e.g., proprioception, may be too slow to make up for the absence of vision.

Feedback↗

Shifts in perceived position of flashed stimuli by illusory object motion.

Moving stimuli cause the position of flashed stimuli to appear shifted in the direction of motion (position capture). To examine whether position capture depends on low-level motion interactions or perception of integrated object motion, we employed a slit-view display. Two line-drawn diamonds translated horizontally in opposite directions, one above and one below the fixation cross, either behind an occluding surface with a narrow slit or without occluding surface. When the diamonds were in vertical alignment, two vertical bars were flashed, one in the center of each diamond. In the slit-view condition, the diamonds were visible through a 4-, 2-, or 1-pixel vertical slit; the width of the flashed bars always matched the width of the slit. Even though the horizontal component of physical motion was greatly reduced or absent in the slit-view conditions, observers perceived diamonds moving behind the occluding surface. Furthermore, the position of the flashed bar was captured by the moving diamonds such that each bar appeared shifted in the direction of perceived motion. We conclude that the position capture reported here has a component based on high-level motion processing that is responsible for dynamically integrating object motion and shape.

Analysis of Variance↗

Visual illusion induced by sound.

We present the first cross-modal modification of visual perception which involves a phenomenological change in the quality-as opposed to a small, gradual, or quantitative change-of the percept of a non-ambiguous visual stimulus. We report a visual illusion which is induced by sound: when a single flash of light is accompanied by multiple auditory beeps, the single flash is perceived as multiple flashes. We present two experiments as well as several observations which establish that this alteration of the visual percept is due to cross-modal perceptual interactions as opposed to cognitive, attentional, or other origins. The results of the second experiment also reveal that the temporal window of these audio-visual interactions is approximately 100 ms.

Acoustic Stimulation↗

Visual feature binding in early infancy.

How does the developing brain of the human infant solve the feature-binding problem when visual stimuli consisting of multiple colored objects are presented? A habituation--dishabituation procedure revealed that 1-month-old infants have the ability to discriminate changes in the conjunction of a familiar shape and color in two objects. However, this good earlier performance was followed by poorer performance at 2 months of age. The performance improved again at 3 months of age. Detailed analysis of the oculomotor behaviors revealed that the age of 2 months was a period of drastic transition when the tendency to stay with the fixated objects disappeared and repetitive saccades between the two objects emerged. Our findings suggest that the ability to perceive conjunctions of features is available to infants very early, that the perceptual/neural basis at 1 and at 3 months of age may be fundamentally different, and that feature integration by vigorous eye movements or selective attention may be the key functional difference between the age groups.

Analysis of Variance↗

Rapid long lasting learning in a collinear edge-detection task.

We have developed a detection task in which subjects identify a pair of collinear edges in a field of polygons. Five of our six subjects showed significant, rapid learning at this task. Four showed evidence of retention a day and a week later. In several transfer tests, we found that disruption of the distractors produced a significant drop-off in performance. These results are consistent with a model in which collinear targets initially produce a salience signal too weak to be reliably detected over the noise of the distractors. As the experiment proceeds, the visual system learns to dampen the distractor signals, allowing for more reliable detection.

Adult↗

Perceptual organization of moving stimuli modulates the flash-lag effect.

When a visual stimulus is flashed at a given location the moment a second moving stimulus arrives at the same location, observers report the flashed stimulus as spatially lagging behind the moving stimulus (the flash-lag effect). The authors investigated whether the global configuration (perceptual organization) of the moving stimulus influences the magnitude of the flash-lag effect. The results indicate that a flash presented near the leading portion of a moving stimulus lags significantly more than a flash presented near the trailing portion. This result also holds for objects consisting of several elements that group to form a unitary percept of an object in motion. The present study demonstrates a novel interaction between the global configuration of moving objects and the representation of their spatial position and may provide a new and useful tool for the study of perceptual organization.

Fixation, Ocular↗