SEARCH · Search PubMed

Results for “multimodal data fusion”

Search indexed PubMed citations on genomics, clinical trials, systematic reviews and public health. Explore titles, authors and supplied subject terms, then open the PubMed record.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

89 records · Page 5Linked to original sources

PubMed2002

Multimodality management of a giant cell tumor arising in the proximal sacrum: case report.

STUDY DESIGN: Descriptive. OBJECTIVE: To outline a novel multimodality approach for a difficult surgical resection of a giant cell tumor in the cephalad portion of the sacrum. SUMMARY OF BACKGROUND DATA: Giant cell tumors of the sacrum are rare primary bone tumors. Recent reports have demonstrated diminished giant cell tumor recurrence with cryosurgery by using a "direct pour" technique with liquid nitrogen. Although successful in decreasing tumor recurrence, this technique is accompanied by a 4%-8% rate of skin necrosis and high rates of pathologic fracture. The authors describe resection and a novel, controlled method of argon-based cryotherapy (followed by a unique pelvic reconstruction) for a large, difficult giant cell tumor of the sacrum. METHODS: A 29-year-old woman presented with complaints of right foot drop and decreased sensation of the right buttock, posterior thigh, posterior calf, and lateral aspect of the right foot. Radiographic evaluation revealed a mass in the right sacrum; histologic examination of CT-guided biopsy revealed a giant cell tumor. A combined anterior abdominal and posterior sacral approach was performed, the tumor was resected, and the margin of the cavity was treated with controlled argon-based cryotherapy. The combination of thermocouples, electromyographic monitoring, and rapid freeze-thaw cycles allowed a controlled ablation of the tumor margin while ensuring that surrounding structures, such as the rectal wall, sacral nerves, and gluteal muscles, were not damaged. Posterior spinal fusion L4 to sacrum, posterior spinal instrumentation L4 to pelvis, and allograft reconstruction of the right sacrum were performed. RESULTS: The patient recovered well without skin necrosis or pathologic fracture. Urinary and fecal continence were preserved. At the 20-month follow-up the patient has no evidence of local tumor recurrence and is fully ambulatory without a brace or narcotic medication. CONCLUSION: A novel multimodality approach, consisting of resection, controlled cryosurgery, and a unique lumbopelvic reconstruction, was safe and successful in managing a challenging proximal sacral giant cell tumor. Twenty months after surgery the patient has excellent bowel and bladder control, no tumor recurrence, and functional ambulation without a brace or pain.

Adult↗

PubMed2026

GBFN: A gated bimodal fusion network leveraging foundation model embeddings for cancer drug sensitivity prediction.

Despite recent progress in deep learning for cancer drug sensitivity prediction, many existing models still rely on task-specific representation learning or relatively simple multimodal fusion, which may limit their ability to capture complex drug-cell interactions. To address this issue, we developed GBFN, a gated bimodal fusion network for continuous IC50 prediction that integrates pretrained drug and cell-line representations. Specifically, drug embeddings were obtained from SMI-TED, whereas cell-line embeddings were derived from transcriptomic profiles using BulkFormer. These two modalities were then combined through a dimension-wise gated fusion module and used to predict IC50 values in matched drug-cell line pairs. On the CCLE-based benchmark, GBFN outperformed representative neural baselines, including GraphDRP, TGSA, and TransEDRP, and achieved the best overall performance, with an R² of 0.8714 and an RMSE of 0.8938. Moreover, ablation analysis showed that the model using drug features and cell-line expression data with gated fusion performed better than the corresponding model using direct concatenation, indicating that the improvement was associated with the fusion strategy rather than with the input modalities alone. In addition, cell-line expression data were more informative than mutation data in the present setting, and adding mutation data to the model using drug features and expression data did not further improve performance. Across major cancer types, GBFN maintained generally high cell-line-level predictive performance, and perturbation-based attribution identified biologically relevant transcriptomic programs in selected drug-cell line settings. Together, these findings support GBFN as a compact and effective framework for continuous drug response prediction.

Humans↗

PubMed1992

Integrated presentation of multimodal brain images.

This article discusses the fusion of brain images from multiple modalities as well as the presentation of the integrated image information. The paper has three parts. First, individual brain imaging modalities are compared as regards clinical appreciation, invasiveness, dimensionality, spatial resolution, temporal resolution, and cost. Next, methods to combine multiple images are briefly surveyed and collated by characteristics as accuracy, patient-friendliness, reproducibility, labour-extensiveness, feasibility of retrospective matching, and general applicability. Finally, techniques to display multimodal image information are outlined and examples of the various options for integrated presentation are shown.

Brain↗

PubMed1999

Frequency encoding for simultaneous display of multimodality images.

UNLABELLED: An original method for simultaneous display of functional and anatomic images, based on frequency encoding (FE), merges color PET with T1-weighted MR brain images, and grayscale PET with multispectral color MR images. A comparison with two other methods reported in the literature for image fusion (averaging and intensity modulation techniques) was performed. METHODS: For FE, the Fourier transform of the merged image was obtained summing the low frequencies of the PET image and the high frequencies of the MR image. For image averaging, the merged image was obtained as a weighted average of the intensities of the two images to be merged. For intensity modulation, the red, green and blue components of the color image were multiplied on a pixel-by-pixel basis by the grayscale image. A comparison of the performances of the three techniques was made by three independent observers assessing the conspicuity of specific MRI and PET information in the merged images. For evaluation purposes, images from seven patients and a computer-simulated MRI/PET phantom were used. Data were compared with a chi-square test applied to ranks. RESULTS: For the depiction of MRI and PET information when merging color PET and T1-weighted MR images, FE was rated superior to intensity modulation and averaging techniques in a significant number of comparisons. For merging grayscale PET with multispectral color MR images, FE and intensity modulation were rated superior to image averaging in terms of both MRI and PET information. CONCLUSION: The data suggest that improved simultaneous evaluation of MRI and PET information can be achieved with a method based on FE.

Brain↗

PubMed2026

BriGHT: transcriptome-regularized multimodal neuroimaging for brain disorder prediction.

MOTIVATION: Hypergraph-based models for brain disorder prediction mainly adopt imaging-derived hypergraphs as propagation backbones. However, the entanglement of topology construction and feature propagation leaves regional representations weakly constrained by underlying biological organization, making them vulnerable to subject-specific variation and noise, particularly in heterogeneous multimodal settings. RESULTS: We present BriGHT, a Brain transcriptome-reGularized Hypergraph framework for mulTimodal disorder prediction. BriGHT employs a transcriptome-derived structural reference as a soft anchoring prior to regularize neuroimaging ROI embeddings, stabilizing representation geometry while preserving disease-relevant subject-specific variation. BriGHT further incorporates a reliability-aware fusion module to estimate subject-specific modality reliability from prediction confidence, cross-modal consistency, and decision certainty, enabling adaptive integration under heterogeneous modality quality. Experiments on three neuroimaging cohorts (ADNI, ADHD-200, REST-meta-MDD) and four modalities (VBM, fMRI, FDG, AV45) demonstrate that BriGHT consistently outperforms competing graph/hypergraph learning methods across six brain disorder prediction tasks. Perturbation analyses show that BriGHT benefits from the spatial correspondence between transcriptomic modules and imaging ROIs, rather than from arbitrary hypergraph regularization alone. Ablation and meta-analytic interpretability analyses support the contribution of transcriptomic anchoring and adaptive fusion to robust and biologically meaningful brain disorder prediction. AVAILABILITY: The software is publicly available at: https://github.com/Yaolab-fantastic/BriGHT. SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online.

Journal Article↗

PubMed2003

Impact of technology on the utilisation of positron emission tomography in lymphoma: current and future perspectives.

Positron emission tomography (PET) has now gained a place in the management of patients with cancer, including those with Hodgkin's disease and non-Hodgkin's lymphoma. Restaging studies and those addressing the monitoring of response to treatment are especially in focus. Most of the knowledge gained has been achieved with dedicated BGO-based PET technology, but there are a number of developments that will impact on the use of this metabolic imaging technique in the investigation of patients with lymphoma. The challenges ahead are determined by the need for high-quality whole-body imaging associated with increased patient throughput and the need to investigate the role of new labelled ligands. The latter are likely to yield new insights into tumour cell characterisation, tumour behaviour and tumour outcome assessment. The study of new radiolabelled ligands will impose further demands for rapid dynamic data acquisition and accurate tracer quantification. Current and future developments in PET technology range from the use of new detector materials to different detector geometries and data acquisition modes. The search for alternatives to BGO scintillation materials for PET has led to the development of PET instruments utilising new crystals such as LSO and GSO. The use of these new detectors and the increased sensitivity achieved with 3D data acquisitions represent the most significant current developments in the field. With the increasing demands imposed on the clinical utilisation of PET, issues such as study cost and patient throughput will emerge as significant future factors. As a consequence, low-cost units are being offered by the manufacturers through the utilisation of gamma camera-based SPET systems for PET coincidence imaging. Unfortunately, clinical studies in lymphoma and other cancers have already demonstrated the limitations of this technology, with 20% of lesions <15 mm in size escaping detection. On the other hand, the recent development of combined PET/CT devices attempts to address the lack of anatomical information inherent with PET images, taking advantage of further improvement in patient throughput and hence cost-effectiveness. Preliminary studies using this multimodality imaging approach have already demonstrated the potential of the technique. Although the potential exists, certain technical issues with PET/CT require refinement of the methodology. Such issues include organ movement (such as respiratory motion), which strongly influences the image fusion of a rapidly acquired CT scan with the slower acquisition of a PET dataset, and the derivation of CT-based attenuation coefficients in the presence of contrast agents or metallic implants. The application of the technology for radiotherapy planning also poses a number of associated challenges. Finally, the development of dedicated PET systems based on planar detector arrangements with new detector components has the potential to improve clinical throughput by over 100%, but clinical trials using such systems have still to be carried out in order to establish the associated whole-body image quality.

Fluorodeoxyglucose F18↗

PubMed2026

A multi-modal survival prediction framework with group-based batch training and structural consistency alignment.

OBJECTIVE: Integrating whole-slide images (WSIs) with transcriptomic profiles is pivotal for enhancing cancer survival prediction. However, the intrinsic gigapixel resolution and variable sequence lengths of WSIs create a fundamental trade-off between training efficiency and the preservation of data heterogeneity in existing frameworks. Furthermore, substantial statistical and structural discrepancies between histological and genomic modalities often impede effective cross-modal alignment and fusion, thereby limiting prognostic accuracy. METHODS: We propose PRISM, an efficient multi-modal learning framework for integrating WSIs with transcriptomic profiles. To reconcile training efficiency with full data heterogeneity, PRISM first stochastically partitions variable-length WSI sequences into a main subset and a complementary residual subset, both of which are packed into fixed-length groups for batch training. The main subset is processed in the main branch, utilizing isolation masking to maintain intra-group sequence independence. Simultaneously, the residual subset is consolidated into "hyperslides" within a residual branch that leverages tailored supervision, effectively capturing inter-slide correlations. Furthermore, PRISM integrates an Informative Token Aggregation (ITA) module to reduce redundancy in WSIs and employs Cross-batch Structural Consistency Alignment (CBSCA) mechanism to enhance inter-modal structural connectivity. Finally, efficient cross-modal feature interaction is achieved through a Low-rank Bilinear Gated Fusion (LBGF) module. Code is available at https://github.com/Alisa2080/PRISM. RESULTS: Compared with existing methods, PRISM achieves the best overall C-index across five TCGA cohorts. On the larger TCGA-BRCA dataset, PRISM requires only 6 hours of training time, substantially reducing computational cost relative to strong multimodal baselines. Furthermore, comprehensive evaluations demonstrate that PRISM achieves the best overall IBS ranking and favorable time-dependent AUC performance at 1, 3, and 5 years, thereby delivering a more favorable trade-off between prognostic performance and computational efficiency. CONCLUSION: PRISM provides a favorable balance between predictive performance, calibration quality, and computational efficiency, highlighting its potential for practical deployment in multimodal survival modeling for computational pathology.

Humans↗

PubMed1996

Fiber-optic fluorometric sensing of polymerase chain reaction-amplified DNA using an immobilized DNA capture protein.

A fiber-optic assay for amplified DNA products has been developed. Modifications of the DNA capture strategy described previously by Kemp et al. [Proc. Natl. Acad. Sci. USA 86, 2423-2427 (1989)] were made that allowed selective binding of DNA labeled during the amplification process to the sensing surface of fused silica fibers. The gene for a chimeric protein composed of the IgG-binding beta 2 subdomain of streptococcal protein G fused with the DNA binding domain of yeast GCN4 was constructed, and this PG/GCN4 protein was overexpressed in Escherichia coli. The purified protein was noncovalently bound to IgG-modified fibers utilizing strong and specific interactions between the protein G beta 2 domain and goat IgG that had been covalently immobilized on the fiber surface. Nanomolar concentrations of amplified DNA labeled with the fluorophore tetramethylrhodamine and the AP-1 consensus nucleotide sequence recognized by GCN4 (5'-ATGACTCAT) were rapidly and selectively bound within the evanescent zone of multimode laser-illuminated fibers. Signal from unincorporated fluorescent PCR primer was negligible. Individual fibers could be used for multiple sequential assays, since the fluorescent double-stranded DNA was rapidly and completely stripped from their surfaces with high salt solutions, leaving the IgG-PG/GCN4 DNA binding complex intact to accept another PCR sample.

Amino Acid Sequence↗

PubMed2006

The role of single-photon emission computed tomography/computed tomography in benign and malignant bone disease.

Radiological (plain radiographs, computed tomography [CT], magnetic resonance imaging [MRI]) and nuclear medicine methods (bone scan, leukocyte scan) both provide unique information about the status of the skeleton. Both have typical strengths and weaknesses, which often lead to the sequential use of different procedures in daily routine. This use causes the unnecessary loss of time and sometimes money, if redundant information is obtained without establishing a final diagnosis. Recently, new devices for hybrid imaging (single-photon emission computed tomography/computed tomography [SPECT/CT], positron emission tomography/computed tomography [PET/CT]) were introduced, which allow for direct fusion of morphological (CT) and functional (SPECT, PET) data sets. With regard to skeletal abnormalities, this approach appears to be extremely useful because it combines the advantages of both techniques (high-resolution imaging of bone morphology and high sensitivity imaging of bone metabolism). By the accurate correlation of both, a new quality of bone imaging has now become accessible. Although researchers undertaking the initial studies exclusively used low-dose CT equipment, a new generation of SPECT/CT devices has emerged recently. By integrating high-resolution spiral CT, quality of bone imaging may improve once more. Ongoing prospective studies will have to show whether completely new diagnostic algorithms will come up for classification of bone disease as a consequence of this development. Besides, the role of ultrasonography and MRI for bone and soft-tissue imaging also will have to be re-evaluated. Looking at the final aim of all imaging techniques--to achieve correct diagnosis in a fast, noninvasive, comprehensive, and inexpensive way--we are now on the edge of a new era of multimodality imaging that will probably change the paths and structure of medicine in many ways. Presently, hybrid imaging using SPECT/CT has been proven to increase sensitivity and specificity of bone scintigraphy. This was mainly achieved by identifying benign bone conditions with increased bone turnover. Therefore, SPECT/CT should be applied whenever equivocal findings of planar bone imaging occur. It also helps to improve accuracy of leukocyte scanning to detect/exclude osteomyelitis and to define sites of inflammation. We therefore regard SPECT/CT as a valuable tool to optimize bone imaging, which might become even more important if new radiopharmaceuticals become available to image specific cell functions.

Bone Neoplasms↗

PubMed1990

Patch-clamp measurements reveal multimodal distribution of granule sizes in rat mast cells.

Using patch-clamp techniques, we have followed the attributes of the secretory granules of peritoneal mast cells obtained from rats of different ages. The granule attributes were determined by following the step increases in the cell surface membrane area caused by the exocytosis of the granules in GTP gamma S stimulated mast cells. Our data show that the amount of granule membrane available for exocytosis depends exponentially on the weight (age) of the donor rat, reaching a maximum at approximately 300 g. The data are consistent with an exponential growth in the number of granules contained by mast cells of maturing animals. Histograms of the sizes of the step increases in surface area caused by exocytosis of the granules showed at least four equally spaced peaks of similar variance where the position of the first peak and the spacing between peaks averaged 1.3 +/- 0.4 micron2. In all cells recorded, no more than seven peaks could be found, the higher order peaks having a lower probability of occurrence. The distribution of granule sizes did not change measurably between young and adult animals. This study suggests that at least two separate steps may determine the size of a secretory granule: granule to granule fusion that may account for the subunit composition of granule sizes and traffic of microvesicles through the maturing granules that may account for the variance observed in the granule sizes. This study also demonstrates a novel way to study granulo-genesis in living cells.

Aging↗

PubMed2005

Image fusion analysis of (99m)Tc-HYNIC-Tyr(3)-octreotide SPECT and diagnostic CT using an immobilisation device with external markers in patients with endocrine tumours.

PURPOSE: The aim of this study was to assess the value of multimodality imaging using a novel repositioning device with external markers for fusion of single-photon emission computed tomography (SPECT) and computed tomography (CT) images. The additional benefit derived from this methodological approach was analysed in comparison with SPECT and diagnostic CT alone in terms of detection rate, reliability and anatomical assignment of abnormal findings with SPECT. METHODS: Fifty-three patients (30 males, 23 females) with known or suspected endocrine tumours were studied. Clinical indications for somatostatin receptor (SSTR) scintigraphy (SPECT/CT image fusion) included staging of newly diagnosed tumours (n=14) and detection of unknown primary tumour in the presence of clinical and/or biochemical suspicion of neuroendocrine malignancy (n=20). Follow-up studies after therapy were performed in 19 patients. A mean activity of 400 MBq of (99m)Tc-EDDA/HYNIC-Tyr(3)-octreotide was given intravenously. SPECT using a dual-detector scintillation camera and diagnostic multi-detector CT were sequentially performed. To ensure reproducible positioning, patients were fixed in an individualised vacuum mattress with modality-specific external markers for co-registration. SPECT and CT data were initially interpreted separately and the fused images were interpreted jointly in consensus by nuclear medicine and diagnostic radiology physicians. RESULTS: SPECT was true-positive (TP) in 18 patients, true-negative (TN) in 16, false-negative (FN) in ten and false-positive (FP) in nine; CT was TP in 18 patients, TN in 21, FP in ten and FN in four. With image fusion (SPECT and CT), the scan result was TP in 27 patients (50.9%), TN in 25 patients (47.2%) and FN in one patient, this FN result being caused by multiple small liver metastases; sensitivity was 95% and specificity, 100%. The difference between SPECT and SPECT/CT was statistically as significant as the difference between CT and SPECT/CT image fusion (P<0.001). Twenty-seven abnormal SPECT findings in 17 patients could not be initially assigned to organs, but were clearly delineated after image fusion. In 21 patients (40%), clinically relevant information was obtained by image fusion as compared with SPECT alone. CONCLUSION: Co-registration of SPECT and diagnostic CT using a cost-effective immobilisation device provides excellent accuracy for tumour detection of endocrine malignancies and is superior to SPECT and CT alone. Image fusion reduces false positive results and can detect additional lesions. Anatomical information provided by CT enables precise localisation of abnormalities observed in SPECT.

Adult↗

PubMed2003

Management of the cervical esophagus and hypofarinx perforations complicating anterior cervical spine surgery.

STUDY DESIGN: Five cases of esophageal or pharyngeal perforation diagnosed during or after anterior cervical spine surgery are presented. OBJECTIVE: To outline a protocol for the early diagnosis and treatment of iatrogenic pharyngoesophageal perforations. SUMMARY OF BACKGROUND DATA: Pharyngoesophageal perforations after anterior cervical spine surgery are uncommon or rarely reported complications. They may have serious functional consequences, including death, if they are not diagnosed promptly and treated effectively. These potentially fatal conditions require a surgical and medical therapy. METHODS: Clinical course, diagnostic tools and guidelines for the management of five patients presenting esophagopharingeal perforations are illustrated. RESULTS: These five cases resulted in definitive healing of the laceration without functional consequences. CONCLUSION: We believe that awareness of these complications and their causes, prompt recognition of the symptoms and immediate and multimodality therapies are essential tools to achieve successful results.

Bone Screws↗

PubMed2005

Additional value of hybrid PET/CT fusion imaging vs. conventional CT scan alone in the staging and management of patients with malignant pleural mesothelioma.

BACKGROUND: Despite being a relatively rare disease, the incidence of malignant pleural mesothelioma (MPM) is expected to increase over the next two decades due to the long time interval elapsing between exposure to causative factors, mainly asbestos, and disease onset. Early disease stages have been reported to benefit from radical surgery. In more advanced disease stages, a multimodality treatment, including various combinations of chemotherapy, external radiotherapy and surgery, may provide some favourable results though the prognosis remains poor. In this regard, an accurate pre-treatment staging plays an important role in offering patients a more appropriate therapeutic planning. In some preliminary studies, (18)F-FDG PET has proven to be able to provide useful information for staging purpose, especially for the detection of metastatic spread to lymph nodes and distant sites. MATERIAL AND METHODS: In the present study, we investigated 15 consecutive patients with histologically proven MPM by means of conventional 2-mm thickness whole-body CT scan with and without contrast medium in comparison with wholebody (18)F-FDG PET/CT fusion imaging. RESULTS: (18)F-FDG PET/CT did not provide additional information about the primary tumour (T) compared to CT scan, but identified a higher number of metastatic mediastinal lymph nodes (N) in 6 patients (40% of cases) and unknown metastatic disease to distant sites (M) in 3 patients (20% of cases). On the basis of PET/CT findings, treatment planning was changed in 5 patients (33.3% of cases). CONCLUSIONS: Our data show that (18)F-FDG PET/CT fusion imaging can play a relevant role in the staging and treatment planning of MPM patients.

Adult↗

PubMed1987

Defective cytoplasmic granule formation. I. Abnormalities affecting tissue mast cells and pancreatic acinar cells of beige mice.

Beige mice (C57BL/6-bgJ/bgJ) express the Chediak-Higashi syndrome, a genetically determined constellation of morphologic and functional abnormalities affecting cells that synthesize cytoplasmic granules; a similar disorder also occurs in humans and several other mammalian species. We used a computer-assisted morphometric approach to identify and quantitate the effect of the beige mutation on the structure of mast cell or pancreatic acinar cell cytoplasmic granules. Beige and control mouse mast cell or pancreatic acinar cell granules exhibited periodic, multimodal distributions of equivalent volumes in which the modes fell at volumes that were integral multiples of the volume of the "unit granule," whose volume (the "unit volume" or v1) was defined by the first mode in the granule equivalent volume distribution. But the modal frequency of the C57BL/6-bgJ/bgJ mast cell granule equivalent volume distribution fell at v1, a pattern consistent with a haphazard pattern of "unit granule" fusion, whereas the corresponding modal frequency for the control mast cell granules fell at v3, a pattern consistent with a "unit addition" model of granule fusion. In addition, the unit volume of beige mouse mast cell granules was 18 times that of control mouse mast cell granules. By contrast, the unit volume of beige mouse pancreatic acinar cell granules was only slightly (23%) greater than that of control cells. C57BL/6-bgJ/bgJ and control cells did not differ significantly in total cell or nuclear volume, or in the aggregate volume of their cytoplasmic granules. However, C57BL/6-bgJ/bgJ mast cells or pancreatic acinar cells contained significantly fewer granules than did their normal counterparts. These findings are consistent with the hypothesis that the beige mutation affects the formation of unit granules and also alters the pattern of aggregation and fusion of unit granules. The data also identify quantitative differences in the expression of the beige mutation in mast cells and pancreatic acinar cells.

Animals↗

PubMed2001

Evaluation of voxel-based registration of 3-D power Doppler ultrasound and 3-D magnetic resonance angiographic images of carotid arteries.

Spatial registration and fusion of ultrasound (US) images with other modalities may aid clinical interpretation. We implemented and evaluated on patient data an automated retrospective registration of magnetic resonance angiography (MRA) carotid bifurcation images with 3-D power Doppler ultrasound (PD US) and indirectly with 3-D B-mode US. Volumes were initially thresholded to reduce the uncorrelated noise signals. The registration algorithm subsequently maximized the mutual information measure between the PD US and 3-D MRA via iterative simplex search to find best "rigid body" transformation. We rated the performance of the algorithm visually on (n = 5) clinical MRA and 3-D PD US datasets. We also evaluated quantitatively the effect of thresholding, initial misalignment of the paired volumes and the reproducibility registration. We investigated the effect of image artefacts by simulation experiments. Preregistration misalignments of up to 5 mm in the transaxial plane, up to 10 mm along the axis of the carotids and up to 40 degrees resulted in 107 of 110 successful registrations, with translational and rotational errors of 0.32 mm +/- 0.3 mm and 1.6 +/- 2.1 degrees. The algorithm was not affected by missing arterial segments of up to 8 mm in length. The average registration time was 4 min. We conclude that the algorithm could be applied to 3-D US PD and MRA data for automated multimodality registration of carotid vessels without the use of fiducials.

Algorithms↗

PubMed2001

Image-guided endoscopic spine surgery: Part I. A feasibility study.

STUDY DESIGN: A feasibility study was performed to determine the efficacy of computer assistance in endoscopic spine surgery. OBJECTIVES: To assess a new method for computer assistance based on image guidance during thoracoscopic or any endoscopic spine procedure. To evaluate the reproducibility, the sensitivity and the reliability of the technique first in vitro and second in clinical use. SUMMARY OF BACKGROUND DATA: The computer-based, image-guided surgery is now a routine tool used in open spine surgery. Exposure of the anatomy of the vertebra is needed for registration. This methodology is inapplicable in endoscopic approach. Fluoroscopic-based navigation combines the technology of image-guided surgery and C-arm fluoroscopy. The navigation is based on the fluoroscopic images acquired before surgery. This technology is applicable to endoscopic surgery but the navigation is based on fluoroscopic image. The computed tomography images are not exploited. There are no published data on a technique that allows image-guided surgery based on computed tomography and magnetic resonance imaging. METHOD: A laboratory study was performed on a thoracic human spine. One vertebra was marked on the right lateral side of the body with five titanium marks. A percutaneous reference frame was specifically designed to be placed in the pedicle of the same marked vertebrae. The reference frame acted as a 3D localizer and a registration tool. The spine model was scanned including the reference frame. A standard Stealth station treatment guidance platform (Medtronic, Sofamor Danek, Memphis, TN) was used for simulation. The registration was obtained using the reference frame. Twenty navigation procedure trials were done and the error was recorded based on the distance between the anatomical point and the corresponding virtual one. RESULTS: Registration was always possible using the stealth station and a standard spine navigational software (spine 3, Medtronic Sofamor Danek, Memphis, TN). The mean error after registration given by the computer was 0.96 mm. The mean error recorded during the navigation simulation was 1.6 mm. CONCLUSIONS: This technique allows the possibility of computed tomography and magnetic resonance imaging-based, image-guided endoscopic surgery. It is probable that in the near future, as image fusion technology improves, the fluoronavigation based on fluoroscopic images would enable to navigate on multimodal images. Otherwise the technique described in this article is the only reproducible one that allows computed-tomography-based computer assistance during endoscopic procedures.

Endoscopy↗

PubMed2004

Probing plasma membrane microdomains in cowpea protoplasts using lipidated GFP-fusion proteins and multimode FRET microscopy.

Summary Multimode fluorescence resonance energy transfer (FRET) microscopy was applied to study the plasma membrane organization using different lipidated green fluorescent protein (GFP)-fusion proteins co-expressed in cowpea protoplasts. Cyan fluorescent protein (CFP) was fused to the hyper variable region of a small maize GTPase (ROP7) and yellow fluorescent protein (YFP) was fused to the N-myristoylation motif of the calcium-dependent protein kinase 1 (LeCPK1) of tomato. Upon co-expressing in cowpea protoplasts a perfect co-localization at the plasma membrane of the constructs was observed. Acceptor-photobleaching FRET microscopy indicated a FRET efficiency of 58% in protoplasts co-expressing CFP-Zm7hvr and myrLeCPK1-YFP, whereas no FRET was apparent in protoplasts co-expressing CFP-Zm7hvr and YFP. Fluorescence spectral imaging microscopy (FSPIM) revealed, upon excitation at 435 nm, strong YFP emission in the fluorescence spectra of the protoplasts expressing CFP-Zm7hvr and myrLeCPK1-YFP. Also, fluorescence lifetime imaging microscopy (FLIM) analysis indicated FRET because the CFP fluorescence lifetime of CFP-Zm7hvr was reduced in the presence of myrLeCPK1-YFP. A FRET fluorescence recovery after photobleaching (FRAP) analysis on a partially acceptor-bleached protoplast co-expressing CFP-Zm7hvr and myrLeCPK1-YFP revealed slow requenching of the CFP fluorescence in the acceptor-bleached area upon diffusion of unbleached acceptors into this area. The slow exchange of myrLeCPK1-YFP in the complex with CFP-Zm7hvr reflects a relatively high stability of the complex. Together, the FRET data suggest the existence of plasma membrane lipid microdomains in cowpea protoplasts.

Base Sequence↗