Search PubMed⌕ Search

SEARCH · Search PubMed

Results for “representation learning”

Search indexed PubMed citations on genomics, clinical trials, systematic reviews and public health. Explore titles, authors and supplied subject terms, then open the PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 829 records · Page 46Linked to original sources

A competitive neural model of small number detection.

The ability to represent numbers is a key attribute for both humans and animals. Recent developments in the understanding of numerical processing has led to the proposal that humans utilise two independent representations of number, one for real numbers and another for integers. We describe a computational model of small number detection to explore the relationship between these core systems of number. We use a combination of unsupervised and supervised neural networks to simulate the interaction between the real and integer representations. For real values we use a self-organised spatial representation of number. For integer values we use a supervised network motivated by linguistic processing. During training and testing, the networks exhibit behavioural characteristics such as the number size and numerical distance effects. Each representation is combined using the mixture-of-experts architecture that allows us to model the subitization limit (the maximum number of visual stimuli that can be accurately quantified almost immediately) as the competitive allocation of representations for number detection, where the crossover point between deploying the real and integer representations of number is obtained through a process of learning. Our results suggest that the existence of two core systems of number is at least computationally plausible and further suggests that the subitization limit emerges through the interaction of spatial and linguistic numerical processing. This provides computational evidence for one way in which small and large numbers are related in humans.

Animals↗

Learning top-down gain control of feature selectivity in a recurrent network model of a visual cortical area.

We propose that the effects of attentional top-down modulations observed in the visual cortex reflect the simple strategy of strengthening currently relevant pathways in a task-dependent manner. To exemplify this idea, we set up a network model of a visual area and simulate the learning of a context-dependent 'go/no-go'-task. The model learns top-down gain-modulations of sensory representations based on reinforcements received from the environment. We also discuss how this idea relates to alternative interpretations like optimal coding hypotheses.

Adaptation, Physiological↗

Bottom-up and top-down dynamics in visual cortex.

A key emergent property of the primary visual cortex (V1) is the orientation selectivity of its neurons. Recent experiments demonstrate remarkable bottom-up and top-down plasticity in orientation networks of the adult cortex. The basis for such dynamics is the mechanism by which orientation tuning is created and maintained, by integration of thalamocortical and intracortical inputs. Intracellular measurements of excitatory and inhibitory synaptic conductances reveal that excitation and inhibition balance each other at all locations in the cortex. This balance is particularly critical at pinwheel centers of the orientation map, where neurons receive intracortical input from a wide diversity of local orientations. The orientation tuning of neurons in adult V1 changes systematically after short-term exposure to one stimulus orientation. Such reversible physiological shifts in tuning parallel the orientation tilt aftereffect observed psychophysically. Neurons at or near pinwheel centers show pronounced changes in orientation preference after adaptation with an oriented stimulus, while neurons in iso-orientation domains show minimal changes. Neurons in V1 of alert, behaving monkeys also exhibit short-term orientation plasticity after very brief adaptation with an oriented stimulus, on the time scale of visual fixation. Adaptation with stimuli that are orthogonal to a neuron's preferred orientation does not alter the preferred orientation but sharpens orientation tuning. Thus, successive fixation on dissimilar image patches, as happens during natural vision, combined with mechanisms of rapid cortical plasticity, actually improves orientation discrimination. Finally, natural vision involves judgements about where to look next, based on an internal model of the visual world. Experiments in behaving monkeys in which information about future stimulus locations can be acquired in one set of trials but not in another demonstrate that V1 neurons signal the acquisition of internal representations. Such Bayesian updating of responses based on statistical learning is fundamental for higher level vision, for deriving inferences about the structure of the visual world, and for the regulation of eye movements.

Adaptation, Psychological↗

Attempting to model dissociations of memory.

Kinder and Shanks report simulations aimed at describing a single-system model of the dissociation between declarative and non-declarative memory. This model attempts to capture both Artificial Grammar Learning (AGL) and recognition memory with a single underlying representation. However, the model fails to reflect an essential feature of recognition memory - that it occurs after a single exposure - and the simulations may instead describe a potentially interesting property of over-training non-declarative memory.

Journal Article↗

Color naming and categorization in inherited color vision deficiencies.

Dichromatic subjects can name colors accurately, even though they cannot discriminate among red-green hues (Jameson & Hurvich, 1978). This result is attributed to a normative language system that dichromatic observers developed by learning subtle visual cues to compensate for their impoverished color system. The present study used multidimensional scaling techniques to compare color categorization spaces of color-vision deficient (CVD) subjects to those of normal trichromat (NT) subjects, and consensus analysis estimated the normative effect of language on categorization. Subjects sorted 140 Munsell color samples in three different ways: a free sorting task (unlimited number of categories), a constrained sorting task (number of categories limited to eight), and a constrained naming task (limited to eight basic color terms). CVD color categories were comparable to those of NT subjects. For both CVD and NT subjects, a common color categorization space derived from the three tasks was well described by a three-dimensional model, with the first two dimensions corresponding to reddish-greenish and yellowish-bluish axes. However, the third axis, which was associated with an achromatic dimension in NTs, was not identified in the CVD model. Individual differences multidimensional scaling failed to reveal group differences in the sorting tasks. In contrast, the personal color naming spaces of CVD subjects exhibited a relative compression of the yellowish-bluish dimension that is inconsistent with the typical deutan-type color spaces derived from more direct measures of perceptual color judgments. As expected, the highest consensus among CVDs (77%) and NTs (82%) occurred in the naming task. The categorization behaviors studied in this experiment seemed to rely more on learning factors, and may reveal little about CVD perceptual representation of colors.

Adult↗

Orientation-dependent priming effects in the perception of biological motion.

In a serial 2-choice reaction time task, subjects discriminated between a biological motion walker and a similar distractor. The point-light walker appeared in 1 of 2 possible in-depth orientations: The figure was walking either to the right or to the left in the sagittal plane. Reliable priming effects were established in consecutive trials but only when priming and primed walkers had the same in-depth orientation. This orientation-dependent priming effect was not tempered when priming and primed figures had different directions of articulatory motion (Experiments 1 to 6), different starting positions in the step cycle (Experiment 2), and different point-light localizations (Experiment 3) or when the figures were translating (Experiments 4 to 6). The data converge with neurophysiological findings that suggest that object recognition is accomplished by accessing high-level, orientation-dependent representations.

Adult↗

Human-centric intelligent systems for exploration and knowledge discovery.

This speculative article discusses research and development relating to computational intelligence (CI) technologies comprising powerful machine-based search and exploration techniques that can generate, extract, process and present high-quality information from complex, poorly understood biotechnology domains. The integration and capture of user experiential knowledge within such CI systems in order to support and stimulate knowledge discovery and increase scientific and technological understanding is of particular interest. The manner in which appropriate user interaction can overcome problems relating to poor problem representation within systems utilising evolutionary computation (EC), machine-learning and software agent technologies is investigated. The objective is the development of user-centric intelligent systems that support an improving knowledge-base founded upon gradual problem re-definition and reformulation. Such an approach can overcome initial lack of understanding and associated uncertainty.

Artificial Intelligence↗

Responding to joint attention and language development: a comparison of target locations.

This study examined the importance of target location (within vs. outside the visual field) on the relation between responding to joint attention and subsequent language development in 47 normally developing infants. The results supported a developmental progression in the infants' ability to locate targets from within to outside the visual field. In addition, individual differences in 15-month-old infants' ability to correctly locate targets outside the visual field was a unique predictor of expressive language at 24 months. Infants' ability to locate targets outside the visual field may demonstrate increasing capacities for attention regulation, representational thinking, and social cognition that may facilitate language learning. The implications of this study are discussed with regard to the usefulness of measures of responding to joint attention for identifying early language and developmental delays.

Attention↗

Local and global minima in visual completion: effects of symmetry and orientation.

The visual information that specifies three-dimensional objects is often incomplete because objects occlude parts of themselves and other objects. Yet people rarely have difficulty perceiving complete, three-dimensional forms. Somehow the visual system seems to 'complete' partially specified objects. The perceptual processes underlying this seemingly effortless and immediate completion are poorly understood. Sekuler and Palmer designed in 1992 the primed-matching paradigm for the objective study of completion effects and their microgenesis. Results from the paradigm suggest that global processes may play a role early in perceptual completion, and that local processes dominate only under limited conditions of figural regularity and orientation. These results are not consistent with purely local or purely global theories of completion. The findings have implications for object perception and representation.

Attention↗

Line drawings of faces reduce configural processing.

The highly specialised skill of face recognition found in humans is thought to be dependent on the processing of a combination of edge-based and surface-based information, and of single-feature as well as of configural information. An investigation was carried out into how the saliency of facial information differs between faces presented as line drawings and the same faces presented as photographs. In experiment 1, the participants showed a decreased sensitivity in their detection of changed configural properties if the faces were presented as line drawings. In experiment 2 an investigation was carried out into whether distinctiveness due to configural properties loses its impact on recognition when faces are transformed to line drawings. For each of twenty unfamiliar male faces, a more 'distinctive' version was created by moving the eye region down. The increase of distinctiveness was confirmed in a rating phase. In a later recognition test, with the same stimuli presented either as line drawings or as photographs, the more distinctive stimuli produced higher recognition rates when presented as photographs but the advantage disappeared when the same faces were presented as line drawings. The changes in sensitivity to configural properties thus contribute to the poor recognition of faces presented as line representations.

Adult↗

Recognition of line-drawing representations by a chimpanzee (Pan troglodytes).

The ability of a chimpanzee to recognize individuals portrayed in line drawings was evaluated. A 12-year-old female chimpanzee with extensive prior experience in the use of visual symbols matched the line drawings of chimpanzees, humans, and an orangutan with a specific letter of the alphabet. When a line drawing of a familiar individual was presented on the computer screen, the chimpanzee responded by punching a key with the letter of the alphabet that corresponded to the individual's name. Results indicate that the chimpanzee is able to categorize individuals from novel line-drawing representations.

Animals↗

Predicting enhancer-promoter interactions using a stacking-based ensemble strategy.

MOTIVATION: Enhancer-promoter interactions (EPIs) are essential for gene regulation and disease progression. Recent studies have shown that distal enhancers can regulate target genes through interactions with nearby promoters, providing important insights into transcriptional regulation mechanisms. Although high-throughput experimental techniques have enabled large-scale identification of EPIs, these methods are often costly and time-consuming. In addition, existing computational approaches still face challenges in effectively integrating heterogeneous feature representations from different cell lines. RESULTS: We propose a stacked ensemble framework for EPI prediction that integrates feature representations from diverse cell line datasets using multiple machine learning algorithms. The extracted complementary patterns are further combined by an XGBoost classifier to improve robustness against overfitting. Experiments on six independent datasets show that the proposed method achieves superior accuracy and generalization compared with existing EPI prediction models, with an average AUROC of 0.909 while maintaining computational efficiency. AVAILABILITY: The source code and its archived release are available at GitHub and Zenodo. The Zenodo archive provides a versioned snapshot of the repository: https://zenodo.org/records/19952998.

Promoter Regions, Genetic↗

Affective blindsight: intact fear conditioning to a visual cue in a cortically blind patient.

Blindsight refers to remarkable residual visual abilities of patients with damage to the primary visual cortex (V1). Recent studies revealed that such residual abilities do not apply only to relatively simple object discriminations, but that these patients can also differentially categorize and respond to emotionally salient stimuli. The current study reports on a case of intact fear conditioning to a visual cue in a male patient with complete bilateral cortical blindness. The patient was admitted to the stroke unit of the neurological department because of complete loss of vision. Both CT and structural MRI scans confirmed lesions in both territories of the posterior cerebral artery. No visual evoked potentials could be detected confirming complete cortical blindness. During fear conditioning, a visual cue predicted the occurrence of an aversive electric shock. Acoustic startle probes were presented during and between the conditioned stimuli. Relative to the control condition, startle reflexes were substantially potentiated when elicited in the presence of the conditioned stimuli. No such potentiation was observed prior to conditioning. These data suggest that fear learning to visual cues does not require a cortical representation of the conditioned stimulus in the primary sensory cortex and that subcortical pathways are sufficient to activate the fear module in humans.

Aged↗

Decorrelation control by the cerebellum achieves oculomotor plant compensation in simulated vestibulo-ocular reflex.

We introduce decorrelation control as a candidate algorithm for the cerebellar microcircuit and demonstrate its utility for oculomotor plant compensation in a linear model of the vestibulo-ocular reflex (VOR). Using an adaptive-filter representation of cerebellar cortex and an anti-Hebbian learning rule, the algorithm learnt to compensate for the oculomotor plant by minimizing correlations between a predictor variable (eye-movement command) and a target variable (retinal slip), without requiring a motor-error signal. Because it also provides an estimate of the unpredicted component of the target variable, decorrelation control can simplify both motor coordination and sensory acquisition. It thus unifies motor and sensory cerebellar functions.

Algorithms↗

A joint physics-based statistical deformable model for multimodal brain image analysis.

A probabilistic deformable model for the representation of multiple brain structures is described. The statistically learned deformable model represents the relative location of different anatomical surfaces in brain magnetic resonance images (MRIs) and accommodates their significant variability across different individuals. The surfaces of each anatomical structure are parameterized by the amplitudes of the vibration modes of a deformable spherical mesh. For a given MRI in the training set, a vector containing the largest vibration modes describing the different deformable surfaces is created. This random vector is statistically constrained by retaining the most significant variation modes of its Karhunen-Loève expansion on the training population. By these means, the conjunction of surfaces are deformed according to the anatomical variability observed in the training set. Two applications of the joint probabilistic deformable model are presented: isolation of the brain from MRI using the probabilistic constraints embedded in the model and deformable model-based registration of three-dimensional multimodal (magnetic resonance/single photon emission computed tomography) brain images without removing nonbrain structures. The multi-object deformable model may be considered as a first step toward the development of a general purpose probabilistic anatomical atlas of the brain.

Anatomy, Cross-Sectional↗

Research in clinical reasoning: past history and current trends.

BACKGROUND: Research in clinical reasoning has been conducted for over 30 years. Throughout this time there have been a number of identifiable trends in methodology and theory. PURPOSE: This paper identifies three broad research traditions, ordered chronologically, are: (a) attempts to understand reasoning as a general skill--the "clinical reasoning" process; (b) research based on probes of memory--reasoning related to the amount of knowledge and memory; and (c) research related to different kinds of mental representations--semantic qualifiers, scripts, schemas and exemplars. RESULTS AND CONCLUSIONS: Several broad themes emerge from this review. First, there is little evidence that reasoning can be characterised in terms of general process variables. Secondly, it is evident that expertise is associated, not with a single basic representation but with multiple coordinated representations in memory, from causal mechanisms to prior examples. Different representations may be utilised in different circumstances, but little is known about the characteristics of a particular situation that led to a change in strategy. IMPLICATIONS: It becomes evident that expertise lies in the availability of multiple representations of knowledge. Perhaps the most critical aspect of learning is not the acquisition of a particular strategy or skill, nor is it the availability of a particular kind of knowledge. Rather, the critical element may be deliberate practice with multiple examples which, on the hand, facilitates the availability of concepts and conceptual knowledge (i.e. transfer) and, on the other hand, adds to a storehouse of already solved problems.

Clinical Competence↗

A perspective and critique of adaptive neurofuzzy systems used for modelling and control applications.

This paper outlines some of the theoretical and practical developments being made in neurofuzzy systems. As the name suggests, neurofuzzy networks were developed by fusing the ideas that originated in the fields of neural and fuzzy systems. A neurofuzzy network attempts to combine the transparent, linguistic, symbolic representation associated with fuzzy logic with the architecture and learning rules commonly used in neural networks. These hybrid structures have both a qualitative and a quantitative interpretation and can overcome some of the difficulties associated with solely neural algorithms which can usually be regarded as black box mappings, and with fuzzy systems where few modelling and learning theories existed. Both B-spline and Gaussian Radial Basis Function networks can be regarded as neurofuzzy systems and soft inductive learning algorithms can be used to extract unknown, qualitative information about the relationships contained in the training data. In a similar manner, qualitative rules or information about the network's structure can be used to initialise the system. These areas, coupled with the extensive work being carried out on theoretically analysing their modelling, convergence and stability properties means that this research topic is highly applicable in "intelligent" modelling and control problems. Apart from outlining this work, the paper also discusses a wide variety of open research questions and suggests areas where new efforts may be fruitfully applied.

Algorithms↗

Thinking.

Reasoning processes allow the human cognitive system to go beyond the information readily available in the environment. This review focuses on the processes of human thinking, including deductive reasoning, induction, mental simulation, and analogy. We survey recent trends across several areas, including categorization, mental models, cognitive development, and decision making. Our chief organizing principle is the contrast between traditional approaches that focus on abstract logical reasoning and a number of current approaches that posit domain-specific, knowledge-intensive cognition. We suggest that some instances of domain-specific cognition result from domain-general processes operating on domain-specific representations. Another theme is the link between reasoning and learning. We suggest that learning typically occurs as a byproduct of reasoning, rather than as an end in itself.

Cognition↗