Search PubMed⌕ Search

Biomedical subjects

P R Roelfsema

Publications and source records attributed to P R Roelfsema.

At least 19 recordsLinked to original sources

The effect of items in working memory on the deployment of attention and the eyes during visual search.

Paying attention to an object facilitates its storage in working memory. The authors investigate whether the opposite is also true: whether items in working memory influence the deployment of attention. Participants performed a search for a prespecified target while they held another item in working memory. In some trials this memory item was present in the search display as a distractor. Such a distractor has no effect on search time if the search target is in the display. In that case, the item in working memory is unlikely to be selected as a target for an eye movement, and if the eyes do land on it, fixation duration is short. In the absence of the target, however, there is a small but significant effect of the memory item on search time. The authors conclude that the target for visual search has a special status in working memory that allows it to guide attention. Guidance of attention by other items in working memory is much weaker and can be observed only if the search target is not present in the display.

Adolescent↗

A gradual spread of attention during mental curve tracing.

The visual system has to segregate objects that are relevant to behavior from other objects and the background, if they are embedded in a visual scene. This segregation process can be time consuming, especially if the relevant object is spatially extended and overlaps with other image components, but the cause of the delays is presently not well understood. In the present study, we used a curve-tracing task to investigate processing delays during the grouping of contour segments into elongated curves. Our results indicate that contour segments that need to be grouped together are labeled with visual attention. Attention gradually spreads from contour segments that were labeled previously to other contours that are colinear and connected to them. The contour-grouping task is completed as soon as attention is directed to the entire curve. We conclude that processing delays during contour grouping are caused by a time-consuming spread of visual attention.

Adult↗

The representation of erroneously perceived stimuli in the primary visual cortex.

In order to attain a correct interpretation of an ambiguous visual stimulus, the brain may have to elaborate on the sensory evidence. Are the neurons that carry the sensory evidence also involved in generating an interpretation? To address this question, we studied the activity of neurons in the primary visual cortex of macaque monkeys involved in a task in which they have to trace a curve mentally, without moving their eyes. On a percentage of trials, the monkeys made errors and traced the wrong curve. Here, we show that these errors are predicted by activity in area V1. Thus, neurons in the primary visual cortex do not only represent sensory events, but also the way in which they are interpreted by the monkey.

Action Potentials↗

The spatial profile of visual attention in mental curve tracing.

In a curve-tracing task, subjects have to judge whether items are located on a single, continuous curve. Spatially separate segments of such a curve are related to each other through grouping criteria, like collinearity and connectedness. These grouping cues need to be exploited during curve tracing, but it is still an open issue how grouping of contour segments is achieved by the visual system. Many contemporary theories of visual perception assume that grouping operations are carried out pre-attentively, with unlimited capacity. The present study examines this assumption by investigating the involvement of attention in curve tracing. The results show that attention is directed to contour segments that need to be grouped together. The distribution of attention is guided by grouping criteria, such as connectedness. Apparently, attention is required to group spatially separate contour segments into a coherent representation of a curve.

Adolescent↗

The implementation of visual routines.

Many visual tasks can be decomposed into a sequence of simpler subtasks. Ullman suggested that such subtasks are carried out by elemental operations that are implemented by specialized processes in the visual brain [Ullman, S. (1984). Visual routines. Cognition (18), 97-159]. According to this hypothesis, there are a limited number of elemental operations that, since they can be applied sequentially, may nevertheless give rise to a large number of visual routines. Examples of such elemental operations are visual search, texture segregation and contour grouping. Here we attempt to delineate how such elemental operations are implemented in the visual brain. When an image appears, feedforward processing rapidly leads to an activity pattern that is distributed across many visual areas. Thereafter, elemental operations come into play, and these are implemented by the modulation of firing rates. Firing rate modulations effectuate grouping of neural responses into coherent object representations. Moreover, they permit transfer of information from one operator to the next, which allows flexibility in the sequencing of operations. We discuss how the elemental operations provide a tool to relate cortical physiology to psychophysics, and suggest a reclassification of pre-attentive and attentive processes.

Animals↗

The role of primary visual cortex (V1) in visual awareness.

In the search for the neural correlate of visual awareness, much controversy exists about the role of primary visual cortex. Here, the neurophysiological data from V1 recordings in awake monkeys are examined in light of two general classes of models of visual awareness. In the first model type, visual awareness is seen as being mediated either by a particular set of areas or pathways, or alternatively by a specific set of neurons. In these models, the role of V1 seems rather limited, as the mere activity of V1 cells seems insufficient to mediate awareness. In the second model type, awareness is hypothesized to be mediated by a global mechanism, i.e. a specific kind of activity not linked to a particular area or cell type. Two separate versions of global models are discussed, synchronous oscillations and spike rate modulations. It is shown that V1 synchrony does not reflect perception but rather the horizontal connections between neurons, indicating that V1 synchrony cannot be a direct neural correlate of conscious percepts. However, the rate of spike discharges of V1 neurons is strongly modulated by perceptual context, and these modulations correlate very well with aspects of perceptual organization, visual awareness, and attention. If these modulations serve as a neural correlate of visual awareness, then V1 contributes to that neural correlate. Whether V1 plays a role in the neural correlate of visual awareness thus strongly depends on the way visual awareness is hypothesized to be implemented in the brain.

Animals↗

The distinct modes of vision offered by feedforward and recurrent processing.

An analysis of response latencies shows that when an image is presented to the visual system, neuronal activity is rapidly routed to a large number of visual areas. However, the activity of cortical neurons is not determined by this feedforward sweep alone. Horizontal connections within areas, and higher areas providing feedback, result in dynamic changes in tuning. The differences between feedforward and recurrent processing could prove pivotal in understanding the distinctions between attentive and pre-attentive vision as well as between conscious and unconscious vision. The feedforward sweep rapidly groups feature constellations that are hardwired in the visual brain, yet is probably incapable of yielding visual awareness; in many cases, recurrent processing is necessary before the features of an object are attentively grouped and the stimulus can enter consciousness.

Animals↗

The effects of pair-wise and higher order correlations on the firing rate of a post-synaptic neuron.

Coincident firing of neurons projecting to a common target cell is likely to raise the probability of firing of this postsynaptic cell. Therefore, synchronized firing constitutes a significant event for postsynaptic neurons and is likely to play a role in neuronal information processing. Physiological data on synchronized firing in cortical networks are based primarily on paired recordings and cross-correlation analysis. However, pair-wise correlations among all inputs onto a postsynaptic neuron do not uniquely determine the distribution of simultaneous postsynaptic events. We develop a framework in order to calculate the amount of synchronous firing that, based on maximum entropy, should exist in a homogeneous neural network in which the neurons have known pair-wise correlations and higher-order structure is absent. According to the distribution of maximal entropy, synchronous events in which a large proportion of the neurons participates should exist even in the case of weak pair-wise correlations. Network simulations also exhibit these highly synchronous events in the case of weak pair-wise correlations. If such a group of neurons provides input to a common postsynaptic target, these network bursts may enhance the impact of this input, especially in the case of a high postsynaptic threshold. The proportion of neurons participating in synchronous bursts can be approximated by our method under restricted conditions. When these conditions are not fulfilled, the spike trains have less than maximal entropy, which is indicative of the presence of higher-order structure. In this situation, the degree of synchronicity cannot be derived from the pair-wise correlations.

Animals↗

Temporal constraints on the grouping of contour segments into spatially extended objects.

The speed of contour integration was investigated in a task that can be solved by grouping contour segments into elongated curves. Subjects had to detect a continuous curve, which could be intersected by one or two other curves. At locations where these curves came in close proximity, the assignment of contour segments to the different curves could be based on collinearity. Reaction times exhibited a strong dependence on (1) the presence of intersections among curves; and (2) the context provided by the stimulus set from which individual stimuli were selected. Reaction times were shortest when grouping of contour segments depended on information at a single location in the visual field. In this condition, responses to stimuli containing an intersection were faster than responses to stimuli that did not. When responses were determined by information at spatially separate locations, responses were delayed, and every intersection increased the reaction time considerably. This result contrasts with earlier investigations which have suggested that contour integration on the basis of collinearity is performed pre-attentively but is in accordance with studies on curve tracing. We propose that the assignment of contour segments to equally coherent curves, a process which may be called figure-figure segregation, is a function of object-based attention. Moreover, the protracted reaction times for some of the stimuli indicate that spread of attention within an object costs time. This implies that object recognition is not always as fast as is sometimes assumed.

Attention↗

Object-based attention in the primary visual cortex of the macaque monkey.

Typical natural visual scenes contain many objects, which need to be segregated from each other and from the background. Present theories subdivide the processes responsible for this segregation into a pre-attentive and attentive system. The pre-attentive system segregates image regions that 'pop out' rapidly and in parallel across the visual field. In the primary visual cortex, responses to pre-attentively selected image regions are enhanced. When objects do not segregate automatically from the rest of the image, the time-consuming attentive system is recruited. Here we investigate whether attentive selection is also associated with a modulation of firing rates in area V1 of the brain in monkeys trained to perform a curve-tracing task. Neuronal responses to the various segments of a target curve were simultaneously enhanced relative to responses evoked by a distractor curve, even if the two curves crossed each other. This indicates that object-based attention is associated with a response enhancement at the earliest level of the visual cortical processing hierarchy.

Animals↗

Synchronization of oscillatory responses in visual cortex correlates with perception in interocular rivalry.

In subjects suffering from early onset strabismus, signals conveyed by the two eyes are not perceived simultaneously but in alternation. We exploited this phenomenon of interocular suppression to investigate the neuronal correlate of binocular rivalry in primary visual cortex of awake strabismic cats. Monocularly presented stimuli that were readily perceived by the animal evoked synchronized discharges with an oscillatory patterning in the gamma-frequency range. Upon dichoptic stimulation, neurons responding to the stimulus that continued to be perceived increased the synchronicity and the regularity of their oscillatory patterning while the reverse was true for neurons responding to the stimulus that was no longer perceived. These differential changes were not associated with modifications of discharge rate, suggesting that at early stages of visual processing the degree of synchronicity rather than the amplitude of responses determines which signals are perceived and control behavioral responses.

Animals↗

Visuomotor integration is associated with zero time-lag synchronization among cortical areas.

Information processing in the cerebral cortex invariably involves the activation of millions of neurons that are widely distributed over its various areas. These distributed activity patterns need to be integrated into coherent representational states. A candidate mechanism for the integration and coordination of neuronal activity between different brain regions is synchronization on a fine temporal scale. In the visual cortex, synchronization occurs selectively between the responses of neurons that represent related features and that need to be integrated for the generation of coherent percepts; neurons in other areas of the cerebral cortex also synchronize their discharges. However, little is known about the patterns and the behavioural correlates of synchrony among widely separated cortical regions. Here we report that synchronization occurs between areas of the visual and parietal cortex, and between areas of the parietal and motor cortex, in the awake cat. When cats responded to a sudden change of a visual pattern, neuronal activity in cortical areas exhibited synchrony without time lags; this synchrony was particularly strong between areas subserving related functions. During reward and inter-trial episodes, zero-time-lag synchrony was lost and replaced by interactions exhibiting large and unsystematic time lags.

Action Potentials↗

Role of the temporal domain for response selection and perceptual binding.

Most cognitive functions are based on highly parallel and distributed information processing by the brain. A paradigmatic example is provided by the vertebrate visual system where numerous cortical areas have been described which analyse different types of visual information. At present, it is unclear how information can be integrated and how coherent representational states can be established in such distributed systems. We suggest that this so-called 'binding problem' may be solved in the temporal domain. The hypothesis is that synchronization of neuronal discharges can serve for the integration of distributed neurons into cell assemblies and that this process may underlie the selection of perceptually and behaviourally relevant information. We review experimental results, mainly obtained in the visual system, which support this temporal binding hypothesis.

Animals↗

Role of reticular activation in the modulation of intracortical synchronization.

During aroused states of the brain, electroencephalographic activity is characterized by fast, irregular fluctuations of low amplitude, which are thought to reflect desynchronization of neuronal activity. This phenomenon seems at odds with the proposal that synchronization of cortical responses may play an important role in the processing of sensory signals. Here, activation of the mesencephalic reticular formation (MRF), an effective way to "desynchronize the electroencephalogram," was shown to facilitate oscillatory activity in the gamma frequency range and to enhance the stimulus-specific synchronization of neuronal spike responses in the visual cortex of cats.

Action Potentials↗

How precise is neuronal synchronization?

Recent work suggests that synchronization of neuronal activity could serve to define functionally relevant relationships between spatially distributed cortical neurons. At present, it is not known to what extent this hypothesis is compatible with the widely supported notion of coarse coding, which assumes that features of a stimulus are represented by the graded responses of a population of optimally and suboptimally activated cells. To resolve this issue we investigated the temporal relationship between responses of optimally and suboptimally stimulated neurons in area 17 of cat visual cortex. We find that optimally and suboptimally activated cells can synchronize their responses with a precision of a few milliseconds. However, there are consistent and systematic deviations of the phase relations from zero phase lag. Systematic variation of the orientation of visual stimuli shows that optimally driven neurons tend to lead over suboptimally activated cells. The observed phase lag depends linearly on the stimulus orientation and is, in addition, proportional to the difference between the preferred orientations of the recorded cells. Similar effects occur when testing the influence of the movement direction and the spatial frequency of visual stimuli. These results suggest that binding by synchrony can be used to define assemblies of neurons representing a coarse-coded stimulus. Furthermore, they allow a quantitative test of neuronal network models designed to reproduce physiological results on stimulus-specific synchronization.

Anesthesia↗

Reduced synchronization in the visual cortex of cats with strabismic amblyopia.

Synchronous firing of spatially separate neurons was studied with multi-electrode recordings in area 17 of the visual cortex of strabismic cats which had developed behaviourally verified amblyopia of the deviated eye. Responses of neurons were evoked with moving light bars or gratings of different spatial frequency. Neurons driven by the normal eye displayed stronger synchronization of their responses than neurons dominated by the amblyopic eye. These interocular differences were highly significant and particularly pronounced for grating stimuli of high spatial frequency. No interocular differences were noted with respect to the amplitudes of responses to the light bars and gratings. These results suggest reduced synchronization of population responses as a neurophysiological correlate of strabismic amblyopia and underline the importance of correlated firing of spatially separate cortical neurons for normal processing of visual information.

Amblyopia↗

Detecting connectedness.

Natural visual images are typically composed of multiple objects, which need to be segregated from each other and from the background. The visual system has evolved to capture a great variety of cues that allow a meaningful segmentation of the visual input. One of these cues is connectedness. Connected image regions are likely to belong to a single visual object, whereas disconnected image regions typically belong to different objects. The visual system should therefore be rather proficient in recovering connected image regions. In the present article we will review evidence in favour of an important role of connectedness detection for figure-ground segmentation, and speculate on the physiological mechanisms that allow the visual system to perform this non-trivial task. We argue that biologically plausible feedforward networks are maladapted for the detection of connectedness. It is proposed that neurons that respond to connected image regions are linked by a network of recurrent connections that we call the interaction skeleton. Neurons spread a tag through the interaction skeleton, which labels cells that respond to the same perceptual object. Tag-spreading costs time and is therefore inconsistent with extremely rapid object recognition. We will discuss the pros and cons of two such tags: synchrony and rate modulation.

Algorithms↗