Search PubMed⌕ Search

Biomedical subjects

E H Adelson

Publications and source records attributed to E H Adelson.

18 recordsLinked to original sources

Synchrony does not promote grouping in temporally structured displays.

It has been proposed that the human visual system can use temporal synchrony to bind image regions into unified objects, as proposed in some neural models. Here we present experimental results from a new dynamic stimulus suggesting that previous evidence for this hypothesis can be explained with the well-established mechanisms of early visual processing, thus obviating the need to posit new synchrony-sensitive grouping mechanisms (see also ref. 5 for a critique of the binding by neural synchrony hypothesis).

Cortical Synchronization↗

Beyond junctions: nonlocal form constraints on motion interpretation.

Because of the aperture problem, local motion measurements must be combined across space. However, not all motions should be combined. Some arise from distinct objects and should be segregated, and some are due to occlusion and should be discounted because they are spurious. Humans have little difficulty ignoring spurious motions at occlusions and correctly integrating object motion, and are evidently making use of form information to do so. There is a large body of theoretical and empirical evidence supporting the importance of form processes involving junctions in the way motion is integrated. To assess the role of more complex form analysis, we manipulated nonlocal form cues that could be varied independently of local junctions. Using variants on diamond and plaid stimuli used in previous studies, we found that manipulations distant from the junctions themselves could cause large changes in motion interpretation. Nonlocal information often overrides the integration decisions that would be expected from local cues. The mechanisms implicated appear to involve surface segmentation, amodal completion, and depth ordering.

Cues↗

Adventures with gelatinous ellipses--constraints on models of human motion analysis.

An ellipse rotating rigidly about its center may appear to rotate rigidly or to deform nonrigidly so that it appears gelatinous. We use this ambiguous stimulus to study how motion information is propagated across space. We find that features that are quite far from the contour of the ellipse may have a strong influence on the percept of the ellipse, provided they move in a way consistent with the motion of the ellipse. We show that the percept cannot be accounted for by computational models that pool constraints over a local area only, or by models that propagate information along contours, or by models that indiscriminately propagate information across space. However, the percept can be accounted for by a class of models that assume smoothness in a layered representation.

Algorithms↗

Separating reflections from images by use of independent component analysis.

The image of an object can vary dramatically, depending on lighting, specularities, reflections, and shadows. It is often advantageous to separate these incidental variations from the intrinsic aspects of an image. We describe a method for photographing objects behind glass and digitally removing the reflections from the surface of the glass, leaving the image of the objects behind the glass intact. We describe the details of this method, which employs simple optical techniques and independent component analysis and show its efficacy with several examples.

Image Processing, Computer-Assisted↗

Transparent motion perception as detection of unbalanced motion signals. I. Psychophysics.

Our visual system can solve the difficult problem of representing multiple motions in the same part of the visual space, the motion transparency problem. We investigated the conditions under which transparent motion perception occurs through psychophysical observations, using a series of visual displays composed of two simple patterns moving in opposite directions. We found that whenever a display has finely balanced opposing motion signals in all local regions, it is perceptually nontransparent. The displays that appeared transparent always contain locally unbalanced motion signals, with some local regions having net motion signals in one direction and some other regions in the opposite direction. These interdigitating net motion signals in both directions appear to be integrated separately to form two overlapping transparent surfaces. Displays that were spatially balanced could be made perceptually transparent if the two components moving in opposite directions were at different stereo depth planes or had different spatial frequency contents. Our results can be explained by proposing a disparity- and spatial frequency-specific suppression stage in the motion pathway, at which motion signals of different directions, but of the same disparity and spatial frequency contents, locally inhibit each other. Such a mechanism would suppress noise input to the motion system, which generally activates several direction channels simultaneously, and would still not eliminate activity evoked by transparent surfaces that are at different depths or have different textures.

Cues↗

Transparent motion perception as detection of unbalanced motion signals. III. Modeling.

In the preceding two companion articles we studied the conditions under which transparent motion perception occurs through psychophysical experiments, and investigated the underlining neural mechanisms through physiological recordings. The main finding of our perceptual experiments was that whenever a display has finely balanced motion signals in all local areas, it is perceptually nontransparent, and that transparent displays always contain motion signals in different directions that are either spatially unbalanced, or unbalanced in their disparity or spatial frequency contents. In the physiological experiments, we found two stages in the processing of transparent stimuli. The first stage is located primarily in area V1. At this stage motion measurements are made and V1 cells respond well to both the balanced, nontransparent stimuli and the unbalanced, perceptually transparent stimuli. The second stage is located primarily in area MT. MT cells show strong suppression between opposite directions of motion. The suppression for the unbalanced, transparent stimuli is significantly less than that for the balanced, nontransparent stimuli. Therefore, the activity in the second, MT stage correlates better with the perception of motion transparency than the first, V1 stage, which does not distinguish reliably between transparent and nontransparent motion. The above experiments suggest a two-stage model of motion perception with a motion measurement stage in V1 and an opponent-direction suppression stage in area MT. In this article we explicitly test this model through analysis and computer simulations, and compare the response of the model to the perceptual and physiological results using the same balanced and unbalanced stimuli we used in the experiments. In the first stage of the computational model, motion energies in different spatial frequency and disparity ranges are extracted from each local region. Similar to V1, this stage does not distinguish between the balanced and unbalanced stimuli. In the subsequent stage motion energies of opposite directions but with same spatial frequency and disparity contents suppress each other using subtractive or divisive inhibition. This stage responds significantly better to the transparent stimuli than to the nontransparent ones, in agreement with MT activity.

Animals↗

Perceptual organization and the judgment of brightness.

The perceived brightness of a gray patch depends on the surrounding context. For example, a medium-gray patch appears darker when placed on a bright background and brighter when placed on a dark background. Models to explain these effects are usually based on simple low-level mechanisms. A new set of brightness illusions cannot be explained by such models. In these illusions, the brightness percept is strongly influenced by the perceptual organization of the stimuli. Simple modifications of the stimuli that should have little effect on low-level mechanisms greatly alter the strength of the illusion. These effects may be ascribed to more complex mechanisms occurring later in the visual system.

Contrast Sensitivity↗

Directionally selective complex cells and the computation of motion energy in cat visual cortex.

We applied a set of 1- and 2-bar tests to directionally selective (DS) complex cells in the cat's striate cortex, and compared the responses with those predicted by two computational models. Single-bar responses and 2-bar interactions produce distinctive patterns that are highly diagnostic. The observed responses are quite similar to those predicted by a basic (non-opponent) motion-energy model [Adelson & Bergen (1985) Journal of the Optical Society of America A, 2, 284-299]. However, they are not consistent with an opponent combination of energy models, nor are they consistent with any stage of the classic Reichardt model. In particular, the Reichardt model (as well as opponent combinations of energy models) predicts a separable space-time symmetry in the 2-bar interaction that is not observed in our measurements, while the non-opponent energy model predicts an inseparable, oriented interaction very similar to the measured cortical responses. Comparisons between model and measurements suggest possible mechanisms of spatial receptive-field organization and of nonlinear transformations.

Action Potentials↗

Vision with equiluminant colour contrast: 2. A large-scale technique and observations.

A simple technique is described for producing large-scale, tritanopic displays. The technique reproduces the various phenomena of vision with equiluminous-colour contrast that have previously been reported with red/green stimuli. It is, however, much less demanding technically, robust against artifacts, and can be used on large-scale scenes. One advantage of the technique is that a piece of blue filter can be used individually by each observer to compare quickly tritanopic and luminance conditions.

Attention↗

The perceptual buildup of three-dimensional structure from motion.

We present a set of psychophysical experiments that measure the accuracy of perceived three-dimensional (3-D) structure derived from relative motion in the changing two-dimensional image. The experiments are motivated in part by a computational model proposed by Ullman (1984), called the incremental rigidity scheme, in which an accurate 3-D structure is built up incrementally, by considering images of moving objects over an extended time period. Our main conclusions are: First, the human visual system can derive an accurate model of the relative depths of moving points, even in the presence of noise in their image positions; second, the accuracy of the 3-D model improves with time, eventually reaching a plateau; and third, the 3-D structure currently perceived appears to depend on previous 3-D models. Through computer simulations, we relate the results of our psychophysical experiments with the predictions of Ullman's model.

Adult↗

Early vision and texture perception.

Texture perception has frequently been studied using textures constructed by repeated placement of micropatterns or texture elements. Theories have been developed to explain the discriminability of such textures in terms of specific features within the micropatterns themselves. For example, Beck observed that a region filled with vertical Ts is readily distinguished from one filled with tilted Ts but not from one filled with vertical Ls. He attributed this to the different distribution of oriented line segments present in the former case but not in the latter. However, Bergen and Julesz found that a region of randomly oriented Xs segregated from one filled with randomly oriented Ls, in spite of the identical distribution of oriented line segments in the two cases. They suggested that this discrimination might be based on the density of such features as terminators, corners, and intersections within the patterns. We note here that simpler, lower-level mechanisms tuned for size may be sufficient to explain this discrimination. We tested this by varying the relative sizes of the Xs and the Ls; when they produce equal responses in size-tuned mechanisms they are hard to discriminate, and when they produce different size-tuned responses they are easy to discriminate.

Form Perception↗

Spatiotemporal energy models for the perception of motion.

A motion sequence may be represented as a single pattern in x-y-t space; a velocity of motion corresponds to a three-dimensional orientation in this space. Motion sinformation can be extracted by a system that responds to the oriented spatiotemporal energy. We discuss a class of models for human motion mechanisms in which the first stage consists of linear filters that are oriented in space-time and tuned in spatial frequency. The outputs of quadrature pairs of such filters are squared and summed to give a measure of motion energy. These responses are then fed into an opponent stage. Energy models can be built from elements that are consistent with known physiology and psychophysics, and they permit a qualitative understanding of a variety of motion phenomena.

Humans↗

The delayed rod afterimage.

A flashed background, presented to a dark-adapted eye, can saturate the rod system, making an incremental test patch invisible. But as the afterimage decays, the test can be distinguished. Increment thresholds measured within the decaying afterimage exhibit Weber's law over a wide range. The Penn and Hagins model of rod kinetics correctly predicts Weber's law, but makes incorrect predictions of the latency for the detection to occur. A new model, involving two exponential decays, is able to accommodate the latency data, as well as Weber's law. The model also makes good predictions of the results when the stimulus duration is increased from 100 msec to 1 sec.

Afterimage↗

The psychophysics of iconic storage.

Some simple models of iconic storage, based on the persisting responses of photoreceptors, were tested in two experiments. Substantial changes in such physical parameters as adapting luminance, stimulus luminance, and stimulus contrast produced little or no change in the duration of partial-report performance. This is at odds with most receptoral models. It seems unlikely that any model based on receptoral persistence can accommodate the results, thus forcing one to locate the icon beyond the receptors and probably beyond the retina as a whole.

Figural Aftereffect↗

Iconic storage: the role of rods.

The hypothesis that rods mediate iconic storage was tested by presenting letters of one color against a field of another. The colors were chosen to be discriminable only by the cones, only by the rods, or both. Under dark adaptation, the rods had little if any effect on partial-report advantage; however, they were important in determining the phenomenal persistence of the stimulus. Under light adaptation, the rods played no apparent role in either type of persistence.

Afterimage↗