Search PubMed⌕ Search

Biomedical subjects

S Grossberg

Publications and source records attributed to S Grossberg.

At least 37 records · Page 2Linked to original sources

The link between brain learning, attention, and consciousness.

The processes whereby our brains continue to learn about a changing world in a stable fashion throughout life are proposed to lead to conscious experiences. These processes include the learning of top-down expectations, the matching of these expectations against bottom-up data, the focusing of attention upon the expected clusters of information, and the development of resonant states between bottom-up and top-down processes as they reach an attentive consensus between what is expected and what is there in the outside world. It is suggested that all conscious states in the brain are resonant states and that these resonant states trigger learning of sensory and cognitive representations. The models which summarize these concepts are therefore called Adaptive Resonance Theory, or ART, models. Psychophysical and neurobiological data in support of ART are presented from early vision, visual object recognition, auditory streaming, variable-rate speech perception, somatosensory perception, and cognitive-emotional interactions, among others. It is noted that ART mechanisms seem to be operative at all levels of the visual system, and it is proposed how these mechanisms are realized by known laminar circuits of visual cortex. It is predicted that the same circuit realization of ART mechanisms will be found in the laminar circuits of all sensory and cognitive neocortex. Concepts and data are summarized concerning how some visual percepts may be visibly, or modally, perceived, whereas amodal percepts may be consciously recognized even though they are perceptually invisible. It is also suggested that sensory and cognitive processing in the What processing stream of the brain obey top-down matching and learning laws that are often complementary to those used for spatial and motor processing in the brain's Where processing stream. This enables our sensory and cognitive representations to maintain their stability as we learn more about the world, while allowing spatial and motor representations to forget learned maps and gains that are no longer appropriate as our bodies develop and grow from infanthood to adulthood. Procedural memories are proposed to be unconscious because the inhibitory matching process that supports these spatial and motor processes cannot lead to resonance.

Attention↗

A self-organizing neural system for learning to recognize textured scenes.

A self-organizing ARTEX model is developed to categorize and classify textured image regions. ARTEX specializes the FACADE model of how the visual cortex sees, and the ART model of how temporal and prefrontal cortices interact with the hippocampal system to learn visual recognition categories and their names. FACADE processing generates a vector of boundary and surface properties, notably texture and brightness properties, by utilizing multi-scale filtering, competition, and diffusive filling-in. Its context-sensitive local measures of textured scenes can be used to recognize scenic properties that gradually change across space, as well as abrupt texture boundaries. ART incrementally learns recognition categories that classify FACADE output vectors, class names of these categories, and their probabilities. Top-down expectations within ART encode learned prototypes that pay attention to expected visual features. When novel visual information creates a poor match with the best existing category prototype, a memory search selects a new category with which classify the novel data. ARTEX is compared with psychophysical data, and is bench marked on classification of natural textures and synthetic aperture radar images. It outperforms state-of-the-art systems that use rule-based, backpropagation, and K-nearest neighbor classifiers.

Discrimination, Psychological↗

Spatial facilitation by color and luminance edges: boundary, surface, and attentional factors.

The thresholds of human observers detecting line targets improve significantly when the targets are presented in a spatial context of collinear inducing stimuli. This phenomenon is referred to as spatial facilitation, and may reflect the output of long-range interactions between cortical feature detectors. Spatial facilitation has thus far been observed with luminance-defined, achromatic stimuli on achromatic backgrounds. This study compares spatial facilitation with line targets and collinear, edge-like inducers defined by luminance contrast to spatial facilitation with targets and inducers defined by color contrast. The results of a first experiment show that achromatic inducers facilitate the detection of achromatic targets on gray and colored backgrounds, but tend to suppress the detection of chromatic targets. Chromatic inducers facilitate the detection of chromatic targets on gray and colored backgrounds, but tend to suppress the detection of achromatic targets. Chromatic spatial facilitation appears to be strongest when inducers and background are isoluminant. The results of a second experiment show that spatial facilitation with chromatic targets and inducers requires a longer exposure duration of the inducers than spatial facilitation with achromatic targets and inducers, which is already fully effective at an inducer exposure of 30 ms only. The findings point towards two separate mechanisms for spatial facilitation with collinear form stimuli: one that operates in the domain of luminance, and one that operates in the domain of color contrast. These results are consistent with neural models of boundary and surface formation which suggest that achromatic and chromatic visual cues are represented on different cortical surface representations that are capable of selectively attracting attention. Multiple copies of these achromatic and chromatic surface representations exist corresponding to different ranges of perceived depth from an observer, and each can attract attention to itself. Color and contrast differences between inducing and test stimuli, and transient responses to inducing stimuli, can cause attention to shift across these surface representations in ways that sometimes enhance and sometimes interfere with target detection.

Color Perception↗

A neural model of saccadic eye movement control explains task-specific adaptation.

Multiple brain learning sites are needed to calibrate the accuracy of saccadic eye movements. This is true because saccades can be made reactively to visual cues, attentively to visual or auditory cues, or planned in response to memory cues using visual, parietal, and prefrontal cortex, as well as superior colliculus, cerebellum, and reticular formation. The organization of these sites can be probed by displacing a visual target during a saccade. The resulting adaptation typically shows incomplete and asymmetric transfer between different tasks. A neural model of saccadic system learning is developed to explain these data, as well as data about saccadic coordinate changes.

Adaptation, Physiological↗

Neural dynamics of binocular brightness perception.

How does the visual cortex combine information from both eyes to generate perceptual representations of object surfaces? Important clues about this process may be derived from data about the perceived brightness of surface regions under binocular viewing conditions, including data about binocular brightness summation in response to Ganzfelds, the U-shaped data of Fechner's paradox that violates binocular brightness summation, and the effects of different combinations of monocular and binocular contours and surface luminance differences on threshold sensitivity to monocular flashes of light. How to reconcile these apparently contradictory data properties has been a severe challenge to previous models, and none has explained them all. The present article quantitatively simulates them all by further developing the FACADE vision model. Key model processes discount the illuminant and compute image contrasts in each monocular channel using shunting on-center off-surround networks; binocularly fuse these discounted monocular signals using shunting on-center off-surround networks with nonlinear excitatory and inhibitory signals; and use these binocularly fused activities to trigger filling-in of a binocular surface representation that represents perceived surface brightness. Previous models that have suggested explanations of subsets of these data are discussed.

Contrast Sensitivity↗

A neural model of motion processing and visual navigation by cortical area MST.

Cells in the dorsal medial superior temporal cortex (MSTd) process optic flow generated by self-motion during visually guided navigation. A neural model shows how interactions between well-known neural mechanisms (log polar cortical magnification, Gaussian motion-sensitive receptive fields, spatial pooling of motion-sensitive signals and subtractive extraretinal eye movement signals) lead to emergent properties that quantitatively simulate neurophysiological data about MSTd cell properties and psychophysical data about human navigation. Model cells match MSTd neuron responses to optic flow stimuli placed in different parts of the visual field, including position invariance, tuning curves, preferred spiral directions, direction reversals, average response curves and preferred locations for stimulus motion centers. The model shows how the preferred motion direction of the most active MSTd cells can explain human judgments of self-motion direction (heading), without using complex heading templates. The model explains when extraretinal eye movement signals are needed for accurate heading perception, and when retinal input is sufficient, and how heading judgments depend on scene layouts and rotation rates.

Algorithms↗

How does the cerebral cortex work? Learning, attention, and grouping by the laminar circuits of visual cortex.

The organization of neocortex into layers is one of its most salient anatomical features. These layers include circuits that form functional columns in cortical maps. A major unsolved problem concerns how bottom-up, top-down, and horizontal interactions are organized within cortical layers to generate adaptive behaviors. This article models how these interactions help visual cortex to realize: (i) the binding process whereby cortex groups distributed data into coherent object representations; (ii) the attentional process whereby cortex selectively processes important events; and (iii) the developmental and learning processes whereby cortex shapes its circuits to match environmental constraints. New computational ideas about feedback systems suggest how neocortex develops and learns in a stable way, and why top-down attention requires converging bottom-up inputs to fully activate cortical cells, whereas perceptual groupings do not.

Attention↗

Neural model of first-order and second-order motion perception and magnocellular dynamics.

A neural model of motion perception simulates psychophysical data concerning first-order and second-order motion stimuli, including the reversal of perceived motion direction with distance from the stimulus (gamma display), and data about directional judgments as a function of relative spatial phase or spatial and temporal frequency. Many other second-order motion percepts that have ascribed to a second non-Fourier processing stream can also be explained in the model by interactions between ON and OFF cells within a single, neurobiologically interpreted magnocellular processing stream. Yet other percepts may be traced to interactions between form and motion processing streams, rather than to processing within multiple motion processing streams. The model hereby explains why monkeys with lesions of the parvocellular layers, but not of the magnocellular layers, of the lateral geniculate nucleus (LGN) are capable of detecting the correct direction of second-order motion, why most cells in area MT are sensitive to both first-order and second-order motion, and why after 2-amino-4-phosphonobutyrate injection selectively blocks retinal ON bipolar cells, cortical cells are sensitive only to the motion of a moving bright bar's trailing edge. Magnocellular LGN cells show relatively transient responses, whereas parvocellular LGN cells show relatively sustained responses. Correspondingly, the model bases its directional estimates on the outputs of model ON and OFF transient cells that are organized in opponent circuits wherein antagonistic rebounds occur in response to stimulus offset. Center-surround interactions convert these ON and OFF outputs into responses of lightening and darkening cells that are sensitive both to direct inputs and to rebound responses in their receptive field centers and surrounds. The total pattern of activity increments and decrements is used by subsequent processing stages (spatially short-range filters, competitive interactions, spatially long-range filters, and directional grouping cells) to determine the perceived direction of motion.

Animals↗

Neural dynamics of perceptual order and context effects for variable-rate speech syllables.

How does the brain extract invariant properties of variable-rate speech? A neural model, called PHONET, is developed to explain aspects of this process and, along the way, data about perceptual context effects. For example, in consonant-vowel (CV) syllables, such as /ba/ and /wa/, an increase in the duration of the vowel can cause a switch in the percept of the preceding consonant from /w/ to /b/ (J.L. Miller & Liberman, 1979). The frequency extent of the initial formant transitions of fixed duration also influences the percept (Schwab, Sawusch, & Nusbaum, 1981). PHONET quantitatively simulates over 98% of the variance in these data, using a single set of parameters. The model also qualitatively explains many data about other perceptual context effects. In the model, C and V inputs are filtered by parallel auditory streams that respond preferentially to the transient and sustained properties of the acoustic signal before being stored in parallel working memories. A lateral inhibitory network of onset- and rate-sensitive cells in the transient channel extracts measures of frequency transition rate and extent. Greater activation of the transient stream can increase the processing rate in the sustained stream via a cross-stream automatic gain control interaction. The stored activities across these gain-controlled working memories provide a basis for rate-invariant perception, since the transient-to-sustained gain control tends to preserve the relative activities across the transient and sustained working memories as speech rate changes. Comparisons with alternative models tested suggest that the fit cannot be attributed to the simplicity of the data. Brain analogues of model cell types are described.

Attention↗

A self-organizing neural network architecture for navigation using optic flow.

This article describes a self-organizing neural network architecture that transforms optic flow and eye position information into representations of heading, scene depth, and moving object locations. These representations are used to navigate reactively in simulations involving obstacle avoidance and pursuit of a moving target. The network's weights are trained during an action-perception cycle in which self-generated eye and body movements produce optic flow information, thus allowing the network to tune itself without requiring explicit knowledge of sensor geometry. The confounding effect of eye movement during translation is suppressed by learning the relationship between eye movement outflow commands and the optic flow signals that they induce. The remaining optic flow field is due to only observer translation and independent motion of objects in the scene. A self-organizing feature map categorizes normalized translational flow patterns, thereby creating a map of cells that code heading directions. Heading information is then recombined with translational flow patterns in two different ways to form maps of scene depth and moving object locations. Most of the learning processes take place concurrently and evolve through unsupervised learning. Mapping the learned heading representations onto heading labels or motor commands requires additional structure. Simulations of the network verify its performance using both noise-free and noisy optic flow information.

Computer Simulation↗

Cortical computation of stereo disparity.

Our ability to see the world in depth is a major accomplishment of the brain. Previous models of how positionally disparate cues to the two eyes are binocularly matched limit possible matches by invoking uniqueness and continuity constraints. These approaches cannot explain data wherein uniqueness fails and changes in contrast alter depth percepts, or where surface discontinuities cause surfaces to be seen in depth, although they are registered by only one eye (da Vinci stereopsis). A new stereopsis model explains these depth percepts by proposing how cortical complex cells binocularly filter their inputs and how monocular and binocular complex cells compete to determine the winning depth signals.

Contrast Sensitivity↗

Texture segregation, surface representation and figure-ground separation.

A widespread view is that most texture segregation can be accounted for by differences in the spatial frequency content of texture regions. Evidence from both psychophysical and physiological studies indicate, however, that beyond these early filtering stages, there are stages of 3-D boundary segmentation and surface representation that are used to segregate textures. Chromatic segregation of element-arrangement patterns--as studied by Beck and colleagues--cannot be completely explained by the filtering mechanisms previously employed to account for achromatic segregation. An element arrangement pattern is composed of two types of elements that are arranged differently in different image regions (e.g. vertically on top and diagonally on the bottom). FACADE theory mechanisms that have previously been used to explain data about 3-D vision and figure-ground separation are here used to simulate chromatic texture segregation data, including data with equiluminant elements on dark or light homogeneous backgrounds, or backgrounds composed of vertical and horizontal dark or light stripes, or horizontal notched stripes. These data include the fact that segregation of patterns composed of red and blue squares decreases with increasing luminance of the interspaces. Asymmetric segregation properties under 3-D viewing conditions with the equiluminant elements close or far are also simulated. Two key model properties are a spatial impenetrability property that inhibits boundary grouping across regions with non-collinear texture elements and a boundary-surface consistency property that uses feedback between boundary and surface representations to eliminate spurious boundary groupings and separate figures from their backgrounds.

Color Perception↗

Neural dynamics of motion processing and speed discrimination.

A neural network model of visual motion perception and speed discrimination is presented. The model shows how a distributed population code of speed tuning, that realizes a size-speed correlation, can be derived from the simplest mechanisms whereby activations of multiple spatially short-range filters of different size are transformed into speed-turned cell responses. These mechanisms use transient cell responses to moving stimuli, output thresholds that covary with filter size, and competition. These mechanisms are proposed to occur in the V1-->MT cortical processing stream. The model reproduces empirically derived speed discrimination curves and simulates data showing how visual speed perception and discrimination can be affected by stimulus contrast, duration, dot density and spatial frequency. Model motion mechanisms are analogous to mechanisms that have been used to model 3-D form and figure-ground perception. The model forms the front end of a larger motion processing system that has been used to simulate how global motion capture occurs, and how spatial attention is drawn to moving forms. It provides a computational foundation for an emerging neural theory of 3-D form and motion perception.

Form Perception↗

A neural network model for the development of simple and complex cell receptive fields within cortical maps of orientation and ocular dominance.

Prenatal development of the primary visual cortex leads to simple cells with spatially distinct and oriented ON and OFF subregions. These simple cells are organized into spatial maps of orientation and ocular dominance that exhibit singularities, fractures, and linear zones. On a finer spatial scale, simple cells occur that are sensitive to similar orientations but opposite contrast polarities, and exhibit both even-symmetric and odd-symmetric receptive fields. Pooling of outputs from oppositely polarized simple cells leads to complex cells that respond to both contrast polarities. A neural network model is described which simulates how simple and complex cells self-organize starting from unsegregated and unoriented geniculocortical inputs during prenatal development. Neighboring simple cells that are sensitive to opposite contrast polarities develop from a combination of spatially short-range inhibition and high-gain recurrent habituative excitation between cells that obey membrane equations. Habituation, or depression, of synapses controls reset of cell activations both through enhanced ON responses and OFF antagonistic rebounds. Orientation and ocular dominance maps form when high-gain medium-range recurrent excitation and long-range inhibition interact with the short-range mechanisms. The resulting structure clarifies how simple and complex cells contribute to perceptual processes such as texture segregation and perceptual grouping.

Journal Article↗

Self-organization of binocular disparity tuning by reciprocal corticogeniculate interactions.

This article develops a neural model of how sharp disparity tuning can arise through experience-dependent development of cortical complex cells. This learning process clarifies how complex cells can binocularly match left and right eye image features with the same contrast polarity, yet also pool signals with opposite contrast polarities. Antagonistic rebounds between LGN ON and OFF cells and cortical simple cells sensitive to opposite contrast polarities enable anticorrelated simple cells to learn to activate a shared set of complex cells. Feedback from binocularly tuned cortical cells to monocular LGN cells is proposed to carry out a matching process that dynamically stabilizes the learning process. This feedback represents a type of matching process that is elaborated at higher visual processing areas into a volitionally controllable type of attention. We show stable learning when both of these properties hold. Learning adjusts the initially coarsely tuned disparity preference to match the disparities present in the environment, and the tuning width decreases to yield high disparity selectivity, which enables the model to quickly detect image disparities. Learning is impaired in the absence of either antagonistic rebounds or corticogeniculate feedback. The model also helps to explain psychophysical and neurobiological data about adult 3-D vision.

Algorithms↗

A cortico-spinal model of reaching and proprioception under multiple task constraints.

A model of cortico-spinal trajectory generation for voluntary reaching movements is developed to functionally interpret a broad range of behavioral, physiological, and anatomical data. The model simulates how arm movements achieve their remarkable efficiency and accuracy in response to widely varying positional, speed, and force constraints. A key issue in arm movement control is how the brain copes with such a wide range of movement contexts. The model suggests how the brain may set automatic and volitional gating mechanisms to vary the balance of static and dynamic feedback information to guide the movement command and to compensate for external forces. For example, with increasing movement speed, the system shifts from a feedback position controller to a feedforward trajectory generator with superimposed dynamics compensation. Simulations of the model illustrate how it reproduces the effects of elastic loads on fast movements, endpoint errors in Coriolis fields, and several effects of muscle tendon vibration, including tonic and antagonist vibration reflexes, position and movement illusions, effects of obstructing the tonic vibration reflex, and reaching undershoots caused by antagonist vibration.

Computer Simulation↗