Search PubMed⌕ Search

SEARCH · Search PubMed

Results for “multimodal integration”

Search indexed PubMed citations on genomics, clinical trials, systematic reviews and public health. Explore titles, authors and supplied subject terms, then open the PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17Linked to original sources
PubMed2006

Imaging prostate cancer with 11C-choline PET/CT.

UNLABELLED: The ability of 11C-choline and multimodality fusion imaging with integrated PET and contrast-enhanced CT (PET/CT) was investigated to delineate prostate carcinoma (PCa) within the prostate and to differentiate cancer tissue from normal prostate, benign prostate hyperplasia, and focal chronic prostatitis. METHODS: All patients with PCa gave written informed consent. Twenty-six patients with clinical stage T1, T2, or T3 and biopsy-proven PCa underwent 11C-choline PET/CT after intravenous injection of 1,112 +/- 131 MBq 11C-choline, radical retropubic prostatovesiculectomy, and standardized prostate tissue sampling. Maximal standardized uptake values (SUVs) of 11C-choline within 36 segments of the prostate were determined. PET/CT results were correlated with histopathologic results, prostate-specific antigen (PSA), Gleason score, and pT stage. RESULTS: The SUV of 11C-choline in PCa tissue was 3.5 +/- 1.3 (mean +/- SD) and significantly higher than that in prostate tissue with benign histopathologic lesions (2.0 +/- 0.6; P < 0.001 benign histopathology vs. cancer). Visual and quantitative analyses of segmental 11C-choline uptake of each patient unambiguously located PCa in 26 of 26 patients and 25 of 26 patients, respectively. A threshold SUV of 2.65 yielded an area under the receiver-operating-characteristic (ROC) curve of 0.89 +/- 0.01 for correctly locating PCa. The maximal 11C-choline SUV did not correlate significantly with PSA or Gleason score but did correlate with T stage (P = 0.01; Spearman r = 0.49). CONCLUSION: 11C-Choline PET/CT can accurately detect and locate major areas with PCa and differentiate segments with PCa from those with benign hyperplasia, chronic prostatitis, or normal prostate tissue. The maximal tumoral 11C-choline uptake is related to pT stage.

Aged↗
PubMed1979

The effect of delayed feedback on infant learning reexamined.

The study reexamines the effect of delayed reinforcement upon contingency behavior in 6- to 8-month-old infants and attempts to account for the temporal discrepancy between span of integration and contingency memory. A modified delayed-reinforcement scheduling procedure enabled a previous methodological criticism to be discounted. The findings confirmed that whereas infants revealed reliable acquisition under immediate reinforcement, a 3-sec delay (whether reset or nonreset) precluded response acquisition, as did 6-sec and 10-sec delay of reinforcement. The findings are interpreted in terms of an informational-load hypothesis which relates short-term memory to the integration and/or segregation of multimodal input.

Conditioning, Operant↗
PubMed1996

Application of laser Doppler flowmetry in neurosurgery.

Experience with LDF has indicated that intraoperative estimation of cerebral blood flow can be very useful and that long-term recordings of cortical perfusion pressure are possible. The disadvantage of LDF is that measurements are extremely local and that the units of measurements are arbitrary. Moreover, the reliability of the technique depends to a large extent on probe position and on the avoidance of movement artifact. The disadvantages are, however, compensated by an excellent dynamic resolution with ultra-short time responses to sudden fluctuations in cerebral perfusion pressure. The high temporal resolution of LDF provides the opportunity to detect hemodynamic events and to monitor the microcirculatory effects of treatment that alters cerebral perfusion pressure in patients with raised intracranial pressure. At no point in the near future is LDF going to supercede continuous recording of intracranial pressure and mean arterial blood pressure and, hence, cerebral perfusion pressure. Rather, we envision LDF becoming an integral part of a multimodal patient monitoring system whereby time trends of monitored variables are combined with calculated variables to provide continuous assessment of cerebral hemodynamic and compensatory reserves.

Humans↗
PubMed1998

[Development and importance of surgical oncology in Germany].

Karl Heinrich Bauer (1890-1978) must be considered the Nestor of surgical oncology in Germany (mutation hypothesis 1928, monograph "Das Krebsproblem" 1949, German Cancer Research Institution (DKFZ) in Heidelberg 1964). The biological understanding of tumor disease has influenced the standardization of surgical procedures and has integrated these into a multimodal oncological concept, including neoadjuvant and adjuvant radio- and chemotherapy. Guidelines and consensus recommendations for the diagnosis and treatment of solid tumors have been established. Laparoscopic oncological surgery is under discussion and should be restricted to prospective trials.

General Surgery↗
PubMed2004

Rovibrational energy levels of hydrogen peroxide, studied by MULTIMODE with a reaction path Hamiltonian.

Recently, Carter and Handy [J. Chem. Phys. 113 (2000) 987] have introduced the theory of the reaction path Hamiltonian (RPH) [J. Chem. Phys. 72 (1980) 99] into the variational scheme MULTIMODE, for the calculation of the J=0 vibrational levels of polyatomic molecules, which have a single large-amplitude motion. In this theory the reaction path coordinate s becomes the fourth dimension of the moment-of-inertia tensor, and must be treated separately from the remaining 3N-7 normal coordinates in the MULTIMODE program. In the modified program, complete integration is performed over s, and the M-mode MULTIMODE coupling approximation for the evaluation of the matrix elements applies only to the 3N-7 normal coordinates. In this paper the new algorithm is extended to the calculation of rotational-vibration energy levels (i.e. J>0) with the RPH, following from our analogous implementation for rigid molecules [Theoret. Chem. Acc. 100 (1998) 191]. The full theory is given, and all extra terms have been included to give the exact kinetic energy operator. In order to validate the new code, we report studies on hydrogen peroxide (H2O2), where the reaction path is equivalent to torsional motion. H2O2 has previously been studied variationally using a valence coordinate Hamiltonian; complete agreement for calculated rovibrational levels is obtained between the previous results and those from the new code, using the identical potential surface. MULTIMODE is now able to calculate rovibrational levels for polyatomic molecules which have one large-amplitude motion.

Algorithms↗
PubMedDate not supplied

Design methods and architectural issues of integrated medical image data base systems.

The past 20 years have seen tremendous changes in medical imaging techniques. New modalities and protocols are expanding the available digital image data at a rapid rate. Yet a framework for gathering, managing, and using multimodal image information is an integrated database environment is missing. The purpose of this paper is to present the experience of implementing an integrated medical image database system at UCSF. We discuss the general system architecture, software design methods, and specific database tools and illustrate them with application examples. Two immediate issues conforming the building of medical image database systems are: lack of supporting infrastructure and inability to index images by contest. To circumvent these problems, the evolutionary medical image database system being implemented at UCSF is based on a three-tiered client-server architecture: client medical workstations, database application servers, and a hospital-integrated picture archiving and communication system (HIP-PACS). The approach used to integrate content-based retrieval and knowledge base techniques within the existing HI-PACS to make the whole database system useful in medicine.

Adult↗
PubMed2026

mmContext: an open framework for multimodal contrastive learning of omics and text data.

SUMMARY: Multimodal approaches are increasingly leveraged for integrating omics data with textual biological knowledge. Yet there is still no accessible, standardized framework that enables systematic comparison of omics representations with different text encoders within a unified workflow. We present mmContext, a lightweight and extensible multimodal embedding framework built on top of the open-source Sentence Transformers library. The software allows researchers to train or apply models that jointly embed omics and text data using any numeric representation stored in an AnnData.obsm layer and any text encoder available in Hugging Face. mmContext supports integration of diverse biological text sources and provides pipelines for training, evaluation, and data preparation. We train and evaluate models for a RNA-Seq and text integration task, and demonstrate their utility through zero-shot classification of cell types and diseases across four independent datasets. By releasing all models, datasets, and tutorials openly, mmContext enables reproducible and accessible multimodal learning for omics-text integration. AVAILABILITY AND IMPLEMENTATION: Pretrained checkpoints and full source code for our custom MMContextEncoder are available on Hugging Face huggingface.co/jo-mengr. The Python package github.com/mengerj/mmcontext provides the model implementation and training and evaluation scripts for custom training. The releases for the publication can be accessed via zenodo: adata_hf_datasets: doi.org/10.5281/zenodo.19185217 and mmContext: doi.org/10.5281/zenodo.19185493.

Computational Biology↗
PubMed2006

The neurocognitive bases of human multimodal food perception: consciousness.

This review explores how we become aware of the (integrated) flavor of food. In recent years, progress has been made understanding the neural correlates of consciousness. Experimental and computational data have been largely based on the visual system. Contemporary neurobiological frameworks of consciousness are reviewed, concluding that neural reverberation among forward- and back-projecting neural ensembles across brain areas is a common theme. In an attempt to extrapolate these concepts to the oral-sensory and olfactory systems involved with multimodal flavor perception, the integration of the sensory information of which into a flavor gestalt has been reviewed elsewhere (Verhagen, J.V., Engelen, L., 2006. The neurocognitive bases of human multimodal food perception: Sensory integration. Neurosci. Biobehav. Rev. 30(5): 613_650), I reconceptualize the flavor-sensory system by integrating it into a larger neural system termed the Homeostatic Interoceptive System (HIS). This system consists of an oral (taste, oral touch, etc.) and non-oral part (non oral-thermosensation, pain, etc.) which are anatomically and functionally highly similar. Consistent with this new concept and with a large volume of experimental data, I propose that awareness of intraoral food is related to the concomitant reverberant self-sustained activation of a coalition of neuronal subsets in agranular insula and orbitofrontal cortex (affect, hedonics) and agranular insula and perirhinal cortex (food identity), as well as the amygdala (affect and identity) in humans. I further discuss the functional anatomy in relation essential nodes. These formulations are by necessity to some extent speculative.

Brain↗
PubMed1999

Behavioral interventions in the diagnosis, treatment and rehabilitation of children with cancer.

Behavioral interventions used to reduce distress and increase cooperation in children undergoing cancer treatment incorporate: contingency management, cognitive/attentional distraction, hypnosis, systematic desensitization, modeling and behavioral rehearsal. In most cases clinical interventions integrate these procedures into a multimodal intervention package. Although in most behavioral interventions the 'therapist' is a nurse, social worker or child psychologist; parents often take an active role in behavioral intervention. Early return to school can 'normalize' the child's life in the midst of coping with cancer and can promote optimal rehabilitation. More research is needed on the integration of behavioral methods with other therapeutic methods (e.g., pharmacologic). Indeed, research in this area of pediatric oncology must be continuously updated as advances in other areas may affect clinical decisions regarding preferred psychosocial intervention methods.

Adaptation, Psychological↗
PubMed2003

Integration of polymer waveguides for optical detection in microfabricated chemical analysis systems.

Multimode polymer waveguides and fiber-to-waveguide couplers have been integrated with microfluidic channels by use of a single-mask-step procedure, which ensured self-alignment between the optics and the fluidics and allowed a fabrication and packaging time of only one day. Three fabrication procedures for obtaining hermetically sealed channels were investigated, and the spectrally resolved propagation loss (400-900 nm) of the integrated waveguides was determined for all three procedures. Two chemical absorbance cells with optical path lengths of 100 and 1000 microm were furthermore fabricated and characterized in terms of coupling loss, sensitivity, and limit of detection for measurements of the dye bromothymol blue.

Bromthymol Blue↗
PubMed2026

CRISPR-Enabled functional genomics in hPSCs-derived neural models for autism spectrum disorder.

Autism Spectrum Disorder (ASD) is a genetically heterogeneous neurodevelopmental condition in which hundreds of individually rare risk variants converge on a small number of shared biological pathways, including synaptic scaffolding, chromatin remodeling, excitation-inhibition balance, and cellular energy metabolism. Translating this genetic heterogeneity into mechanistic insight requires experimental systems capable of interrogating individual gene functions in human-relevant neural contexts at scale. CRISPR-enabled functional genomics in human pluripotent stem cell (hPSC)-derived neural models, spanning neural progenitors, cortical and inhibitory neurons, astrocytes, microglia, and brain organoids, provides precisely this capability. By integrating pooled perturbation screens with multimodal readouts including single-cell and spatial transcriptomics, chromatin accessibility profiling, proximity labeling proteomics, multi-electrode array electrophysiology, and metabolic flux analysis, these platforms enable systematic, causal mapping of ASD gene function at system resolution. Early applications have already revealed convergent mechanisms: BAF complex disruption expands the ventral progenitor pool and biases its fate toward oligodendrocyte and interneuron lineages; ADNP loss impairs microglial synaptic pruning through altered endocytic trafficking; and mTOR pathway dysregulation in PTEN- and TSC2-perturbed models links genetic risk directly to metabolic and mitochondrial dysfunction. Computational frameworks including MIMOSCA and SCEPTRE enable causal network reconstruction and pseudotime inference from these datasets, moving the field from gene lists toward pathway-level models of ASD pathobiology. Translational applications leverage isogenic iPSC panels and variant-level base and prime editing to stratify ASD variants by functional impact, informing gene therapy design for haploinsufficient targets such as CHD8 and SCN2A via AAV or antisense oligonucleotide delivery. Remaining challenges, including model developmental immaturity, batch variability, and the difficulty of modeling polygenic risk, are addressed by a roadmap integrating spatial perturbomics, AI-driven causal inference, and population-scale standardized biobanks. This review synthesizes the current state of CRISPR-based functional genomics in human stem cell neural models as a coherent experimental framework for converting ASD genetic associations into mechanistic understanding and therapeutic opportunity.

Humans↗
PubMed2025

Foundation model based multimodal transformer framework for survival analysis in HER2 stratified breast cancer.

Objective. To improve survival prediction for HER2-positive breast cancer by integrating histopathological, molecular, and clinical data using a multimodal transformer framework.Approach. We propose a multimodal transformer framework for breast cancer survival prediction using HER2 stratified (SurvMBC), a foundation model-enhanced architecture that fuses three data modalities: whole-slide images, clinical narratives, and molecular features. Tumor microenvironment features are extracted using a pathology language and image pre-training (PLIP), clinical narratives are processed with BioBERT, and miRNA expression plus DNA methylation data are embedded using Gen2Vec. These representations are integrated through a cross-modal transformer with attention mechanisms for survival prediction.Main results. The model was evaluated on 1,095 HER2-positive breast cancer patients from The Cancer Genome Atlas. SurvMBC achieved a concordance index (C-index) of 0.857 (95% CI: 0.834, 0.880), a low integrated Brier score, and a strong inverse negative binomial log-likelihood. Risk stratification based on model outputs significantly separated high- and low-risk groups (log-rankp< 0.01) and showed strong associations with tumor stage, grade, and hormone receptor status (allp< 0.05).Significance. SurvMBC demonstrates the effectiveness of multimodal fusion in addressing tumor heterogeneity and improving prognostic accuracy. The attention-based integration enables context-aware learning of survival-relevant features across modalities, supporting individualized risk stratification and risk-adaptive treatment planning for HER2 stratified breast cancer patients.

Breast Neoplasms↗
PubMed1999

Multimodal approach in invasive fetal therapy.

BACKGROUND: Integrated fetal therapy is a new approach to prenatal management consisting of a combination of invasive procedures which complement each other to provide as much information as possible on the fetal compartments. METHODS: We carried out a study on 50 fetuses of singleton pregnancies undergoing invasive procedures -- at least three per fetus -- for diagnostic and therapeutical purposes. A total of two hundred and fifty invasive procedures were adopted. The study population was divided into two groups, those studied between 1988 and 1992 and those studied between 1993 and 1995. RESULTS: The diagnostic and therapeutic utility of complementary invasive procedures in fetuses with nonimmune fetal hydrops and urinary tract malformations was assessed. In fetuses with nonimmune fetal hydrops integrated invasive procedures markedly affected the fetal-neonatal survival rate, whereas in those with urinary tract malformations scheduled for postnatal surgery these procedures made it possible to limit intrauterine renal damage. CONCLUSIONS: Complementary invasive procedures in NIFH fetuses particularly influence the fetal-neonatal survival rate. Since urinary tract malformations must be treated by postnatal surgery, complementary invasive procedures serve to limit intrauterine renal damage in the meantime and to reduce cesarean section rate.

Female↗
PubMed2004

The development of a VR system for the cognitive & behavioral assessment of schizophrenia.

Patients with schizophrenia have many trouble in their life due to their thinking disorders such as delusion or hallucination. It is because they have a deficit in the ability which to systematize and integrate information. Therefore, they cannot integrate or systematize properly the integrated stimuli occurring frequently in a real situation. In this study, we suggest a virtual reality system for the assessment of their ability to integrate, memorize and react to integrated stimuli. The virtual reality system we developed provided multimodal stimuli, such as visual and auditory stimuli or visuo-spatial integration, and the patients was assessed and compared their thought flexibility and working memory abilities based on multi-modal manner by making the patient experience and react to multimodal stimuli. From this study, we could conclude that the VR could provide a patient with various stimuli in an immersive environment and allow the assessment of cognitive ability, and the identification of the relationships between cognitive functions.

Case-Control Studies↗
PubMed1997

Comparative study of sound localization and its anatomical correlates in mammals.

One of the fundamental features of hearing is the ability to localize the sources of sounds, particularly brief sounds, which may warn of nearby animals. Yet not all mammals localize sound equally well with threshold acuity ranging from about 1 degree for elephants and humans to more than 25 degrees for gerbils and horses and a near absence of localization in some subterranean species. During the past decade evidence has accumulated that this variation cannot be accounted for simply by the availability of the physical cues for locus. Nor does it appear to be a function of an animal's lifestyle. Rather sound-localization acuity in mammals appears to be a function of the precision required of the visual orienting response to sound. Thus the neural integration of hearing and vision in cortex, as well as in multimodal subcortical structures, is a reflection of their behavioral integration and evolutionary coupling.

Animals↗
PubMed2005

Gastrointestinal stromal tumor: 5 years later.

There is now considerable interest in gastrointestinal stromal tumor (GIST) because it can be treated effectively with a targeted molecular agent. The majority of GISTs contain an activating mutation in the KIT protooncogene or, occasionally, in the platelet-derived growth factor-alpha (PDGFRA) gene. Five years ago, imatinib mesylate, a specific molecular inhibitor of the protein products of these 2 genes, was applied to metastatic GIST. Approximately 80% of patients with metastatic GIST benefit from imatinib, although acquired resistance to the agent may develop. For patients with primary GIST, surgery remains the treatment of choice, and whether outcome is improved by adjuvant imatinib is currently under broad investigation. A combination of imatinib therapy and surgery also may be effective in a subset of patients with metastatic or unresectable primary GIST. In this review, the authors summarize the new multimodality approach to GIST. The integration of surgery and molecular therapy in GIST will serve as a prototype for the management of other solid tumors for which targeted agents become available.

Antineoplastic Agents↗
PubMed2003

Parasol cells of the hemiellipsoid body in the crayfish Procambarus clarkii: dendritic branching patterns and functional implications.

Multimodal, higher-order sensory integration in decapod crustaceans occurs in local interneurons (parasol cells) within a structure in the lateral protocerebrum, the hemiellipsoid body, which is located dorsal to the terminal medulla. The hemiellipsoid body is targeted by projection neuron inputs by means of the olfactory globular tract from bilateral deutocerebral neuropils, the accessory lobes, which receive secondary visual, mechanosensory, and olfactory inputs. Parasol cell dendrites arborize extensively within the two neuropils of the hemiellipsoid body and possibly have some neurites within another neuropil at its base. The two neuropils of the hemiellipsoid body, neuropils I and II, are known to receive asymmetrical inputs from the contralateral and ipsilateral accessory lobes, and our current study addresses the question of the distribution of parasol cells within these two neuropils. Three anatomic methods were used to analyze this distribution: intracellular filling of cells with neurobiotin and visualization of the cells by using either a fluorescent or a peroxidase avidin conjugate, or placement of a fluorescent lipophilic tracer within a lobe of the hemiellipsoid body. All of these methods demonstrated that single parasol cells exclusively arborize within one of the two lobes of the hemiellipsoid body, but not in both lobes. Electrophysiological recordings from pairs of parasol cells with dendrites in the same or different lobes confirm a functional separation between neuropils I and II. Comparisons are made between insect and crustacean systems, emphasizing the inputs to the hemiellipsoid body and the mushroom body and similarities between extrinsic cells in insects and parasol cells in decapod crustaceans.

Animals↗
PubMed2005

Large-scale maintenance of dual projections by callosal and frontal cortical projection neurons in adult mice.

Integration of sensory-motor information in premotor cortex of rodents occurs largely through callosal and frontal cortical association projections directed in a hierarchically organized manner. Although most anatomical studies in rodents have been performed in rats, mammalian genetic models have focused on mice, because of their successful manipulation on the genetic and cell biological levels. It is therefore important to establish the normal patterns of anatomical connectivity in mice, which potentially differ from those in rats. The goal of this study is to investigate the anatomical development of callosal and frontal premotor projection neurons (CPN and FPN, respectively) in mouse sensory-motor and premotor cortex and to investigate quantitatively the potential laminar differences between these neurons with simultaneous callosal and frontal projections during development. The retrograde tracers Fluoro-Gold and DiI were injected into sensory-motor and premotor cortices, respectively, C57Bl/6 mice at different developmental times (P2, P8, P21, adult). We found that, in contrast to the case in primate and cat, there is widespread overlap in populations of long-distance projection neurons in mice; many projection neurons have simultaneous projections to both contralateral somatosensory cortex and ipsilateral frontal cortex, and a considerable number of these dual projections persist into adulthood. In addition, there are significant laminar differences in the percentage of neurons with simultaneous callosal and frontal projections, and an isolated population of layer V FPN has bilateral projections to both premotor cortical hemispheres. Taken together, our results indicate that a large proportion of individual projection neurons maintains simultaneous callosal and frontal projections in adult mice, suggesting that these dual projections might serve the critical function of integrating motor coordination information with multimodal association areas.

Animals↗