Biomedical subjects

D J Hawkes

Publications and source records attributed to D J Hawkes.

At least 19 recordsLinked to original sources

PubMed2001

Medical image registration.

Radiological images are increasingly being used in healthcare and medical research. There is, consequently, widespread interest in accurately relating information in the different images for diagnosis, treatment and basic science. This article reviews registration techniques used to solve this problem, and describes the wide variety of applications to which these techniques are applied. Applications of image registration include combining images of the same subject from different modalities, aligning temporal sequences of images to compensate for motion of the subject between scans, image guidance during interventions and aligning images from multiple subjects in cohort studies. Current registration algorithms can, in many cases, automatically register images that are related by a rigid body transformation (i.e. where tissue deformation can be ignored). There has also been substantial progress in non-rigid registration algorithms that can compensate for tissue deformation, or align images from different subjects. Nevertheless many registration problems remain unsolved, and this is likely to continue to be an active field of research in the future.

Algorithms↗

PubMed2001

Pre-processed image reconstruction applied to breast and brain MR imaging.

Magnetic resonance imaging (MRI) has emerged as a powerful tool in medical diagnosis and research. Although high spatial resolution images are essential in medical diagnosis and image analysis, high temporal resolution is equally important in applications of dynamic contrast-enhanced MRI or functional brain MRI. In particular, in breast MRI the ability to differentiate between benign and malignant lesions depends, in part, on the temporal resolution of the dynamic image acquisition. New applications of MRI such as multi-feature analysis of image time series data and full 3D functional MRI or event-related functional MRI require high spatial and high temporal resolution for accurate image analysis on a voxel-by-voxel basis. Currently available partial Fourier reconstruction techniques. which effectively improve the time resolution, suffer from a reduced signal to noise ratio in the reconstructed image, a decrease in spatial resolution or reconstruction artefacts, making numerical image analysis difficult. In this work we present an image reconstruction algorithm based on image recovery theory which effectively doubles the temporal resolution and results in an image quality sufficient for further numerical analysis. The developed algorithm requires a full Fourier space acquisition of a pre-contrast or baseline image prior to the reconstruction procedure of the time series partial Fourier data.

Algorithms↗

PubMed2001

Validation of a two- to three-dimensional registration algorithm for aligning preoperative CT images and intraoperative fluoroscopy images.

We present a validation of an intensity based two- to three-dimensional image registration algorithm. The algorithm can register a CT volume to a single-plane fluoroscopy image. Four routinely acquired clinical data sets from patients who underwent endovascular treatment for an abdominal aortic aneurysm were used. Each data set was comprised of two intraoperative fluoroscopy images and a preoperative CT image. Regions of interest (ROI) were drawn around each vertebra in the CT and fluoroscopy images. Each CT image ROI was individually registered to the corresponding ROI in the fluoroscopy images. A cross validation approach was used to obtain a measure of registration consistency. Spinal movement between the preoperative and intraoperative scene was accounted for by using two fluoroscopy images. The consistency and robustness of the algorithm when using two similarity measures, pattern intensity and gradient difference, was investigated. Both similarity measures produced similar results. The consistency values were rotational errors below 0.74 degree and in-plane translational errors below 0.90 mm. These errors approximately relate to a two-dimensional projection error of 1.3 mm. The failure rate was less than 8.3% for three of the four data sets. However, for one of the data sets a much larger failure rate (28.5%) occurred.

Algorithms↗

PubMed2000

Voxel similarity measures for 3-D serial MR brain image registration.

We have evaluated eight different similarity measures used for rigid body registration of serial magnetic resonance (MR) brain scans. To assess their accuracy we used 33 clinical three-dimensional (3-D) serial MR images, with deformable extradural tissue excluded by manual segmentation and simulated 3-D MR images with added intensity distortion. For each measure we determined the consistency of registration transformations for both sets of segmented and unsegmented data. We have shown that of the eight measures tested, the ones based on joint entropy produced the best consistency. In particular, these measures seemed to be least sensitive to the presence of extradural tissue. For these data the difference in accuracy of these joint entropy measures, with or without brain segmentation, was within the threshold of visually detectable change in the difference images.

Adult↗

PubMed2000

Design and evaluation of a system for microscope-assisted guided interventions (MAGI).

The problem of providing surgical navigation using image overlays on the operative scene can be split into four main tasks--calibration of the optical system; registration of preoperative images to the patient; system and patient tracking, and display using a suitable visualization scheme. To achieve a convincing result in the magnified microscope view a very high alignment accuracy is required. We have simulated an entire image overlay system to establish the most significant sources of error and improved each of the stages involved. The microscope calibration process has been automated. We have introduced bone-implanted markers for registration and incorporated a locking acrylic dental stent (LADS) for patient tracking. The LADS can also provide a less-invasive registration device with mean target error of 0.7 mm in volunteer experiments. These improvements have significantly increased the alignment accuracy of our overlays. Phantom accuracy is 0.3-0.5 mm and clinical overlay errors were 0.5-1.0 mm on the bone fiducials and 0.5-4 mm on target structures. We have improved the graphical representation of the stereo overlays. The resulting system provides three-dimensional surgical navigation for microscope-assisted guided interventions (MAGI).

Computer Simulation↗

PubMed2000

Sources of error in comparing functional magnetic resonance imaging and invasive electrophysiological recordings.

OBJECT: Several authors have recently reported studies in which they aim to validate functional magnetic resonance (fMR) imaging against the accepted gold standard of invasive electrophysiological monitoring. The authors have conducted a similar study, and in this paper they identify and quantify two characteristics of these data that can make such a comparison problematic. METHODS: Eight patients in whom surgery for epilepsy was performed and five healthy volunteers underwent fMR imaging to localize the part of the sensorimotor cortex responsible for hand movement. In the patient group subdural electrode mats were subsequently implanted to identify eloquent regions of the brain and the epileptogenic zone. The fMR imaging data were processed to correct for motion during the study and then registered with a postimplantation computerized tomography (CT) scan on which the electrodes were visible. The motion during imaging in the two groups studied, and the deformation of the brain between the preoperative images and postoperative scans were measured. The patients who underwent epilepsy surgery moved significantly more during fMR imaging experiments than healthy volunteers performing the same motor task. This motion had a particularly increased out-of-plane component and was significantly more correlated with the stimulus than in the volunteers. This motion was especially increased when the patients were performing a task on the side affected by the lesion. The additional motion is hard to correct and substantially degrades the quality of the resulting fMR images, making it a much less reliable technique for use in these patients than in others. Also, the authors found that after electrode implantation, the brain surface can shift more than 10 mm relative to the skull compared with its preoperative location, substantially degrading the accuracy of the comparison of electrophysiological measurements made in the deformed brain and fMR studies obtained preoperatively. CONCLUSIONS: These two findings indicate that studies of this sort are currently of limited use for validating fMR imaging and should be interpreted with care. Additional image analysis research is necessary to solve the problems caused by patients' motion and brain deformation.

Cerebral Cortex↗

PubMed1999

Nonrigid registration using free-form deformations: application to breast MR images.

In this paper we present a new approach for the nonrigid registration of contrast-enhanced breast MRI. A hierarchical transformation model of the motion of the breast has been developed. The global motion of the breast is modeled by an affine transformation while the local breast motion is described by a free-form deformation (FFD) based on B-splines. Normalized mutual information is used as a voxel-based similarity measure which is insensitive to intensity changes as a result of the contrast enhancement. Registration is achieved by minimizing a cost function, which represents a combination of the cost associated with the smoothness of the transformation and the cost associated with the image similarity. The algorithm has been applied to the fully automated registration of three-dimensional (3-D) breast MRI in volunteers and patients. In particular, we have compared the results of the proposed nonrigid registration algorithm to those obtained using rigid and affine registration techniques. The results clearly indicate that the nonrigid registration algorithm is much better able to recover the motion and deformation of the breast than rigid or affine registration algorithms.

Breast↗

PubMed1999

A system for microscope-assisted guided interventions.

We present a system for surgical navigation using stereo overlays in the operating microscope aligned to the operative scene. This augmented reality system provides 3D information about nearby structures and offers a significant advancement over pointer-based guidance, which provides only the location of one point and requires the surgeon to look away from the operative scene. With a previous version of this system, we demonstrated feasibility, but it became clear that to achieve convincing guidance through the magnified microscope view, a very high alignment accuracy was required. We have made progress with several aspects of the system, including automated calibration, error simulation, bone-implanted fiducials and a dental attachment for tracking. We have performed experiments to establish the visual display parameters required to perceive overlaid structures beneath the operative surface. Easy perception of real and virtual structures with the correct transparency has been demonstrated in a laboratory and through the microscope. The result is a system with a predicted accuracy of 0.9 mm and phantom errors of 0.5 mm. In clinical practice errors are 0.5-1.5 mm, rising to 2-4 mm when brain deformation occurs.

Bone Cysts↗

PubMed1999

Stereo augmented reality in the surgical microscope.

We present an augmented reality system that allows surgeons to view features from preoperative radiological images accurately overlaid in stereo in the optical path of a surgical microscope. The purpose of the system is to show the surgeon structures beneath the viewed surface in the correct 3-D position. The technical challenges are registration, tracking, calibration and visualisation. For patient registration, or alignment to preoperative images, we use bone-implanted markers and a dental splint is used for patient tracking. Both microscope and patient are tracked by an optical localiser. Calibration uses an accurately manufactured object with high contrast circular markers which are identified automatically. All ten camera parameters are modelled as a bivariate polynomial function of zoom and focus. The overall system has a theoretical overlay accuracy of better than 1 mm. Implementations of the system have been tested on seven patients. Recent measurements in the operating room conformed to our accuracy predictions. For visualisation the system has been implemented on a graphics workstation to enable high frame rates with a variety of rendering schemes. Several issues of 3-D depth perception remain unsolved, but early results suggest that perception of structures in the correct 3-D position beneath the viewed surface is possible.

Depth Perception↗

PubMed1998

A three-component deformation model for image-guided surgery.

In image-guided surgery it is necessary to align preoperative image data with the patient. The rigid-body approximation is usually applied, but is often not valid due to tissue deformation. Non-rigid deformation algorithms have been applied to related, but not identical problems, such as atlas matching and surgery simulation. In image-guided surgery we have the additional information that the deformation is constrained by the physical properties of the different tissues. The most important properties that must be incorporated are the rigidity of bone, the unconstrained nature of fluid regions and the relatively smooth deformation of soft tissue. Hence, we have developed a simplified model of tissue deformation based on a three-component system. Rigid regions are constrained by the rigid-body transformation and fluid regions are unconstrained. A number of energy models for deformable tissues have been compared. The model can be deformed using intraoperative data, in this case landmarks, using a technique similar to active contours. A novel strategy to avoid folding in the transformation is described. Our method was applied to MRI and CT data from a neurosurgery patient with epilepsy. Although the current implementation is only two dimensional, the initial results are promising. As the algorithm must ultimately run in or near 'real-time' an improved implementation of the energy minimization is underway. This paper presents the problem of tissue deformation, which has received little attention in the literature and outlines the framework we have developed for tackling this difficult subject.

Algorithms↗

PubMed1998

Algorithms for radiological image registration and their clinical application.

This paper reviews recent work in radiological image registration and provides a classification of image registration by type of transformation and by methods employed to compute the transformation. The former includes transformation of 2D images to 2D images of the same individual, transformation of 3D images to 3D images of the same individual, transformation of images to an atlas or model, transformation of images acquired from a number of individuals, transformations for image guided interventions including 2D to 3D registration and finally tissue deformation in image guided interventions. Recent work on computing transformations for registration using corresponding landmark based registration, surface based registration and voxel similarity measures, including entropy based measures, are reviewed and compared. Recently fully automated algorithms based on voxel similarity measures and, in particular, mutual information have been shown to be accurate and robust at registering images of the head when the rigid body assumption is valid. Two approaches to modelling soft tissue deformation for applications in image guided interventions are described. Validation of complex processing tasks such as image registration is vital if these algorithms are to be used in clinical practice. Three alternative validation strategies are presented. These methods are finding application outside the original domain of radiological imaging.

Algorithms↗

PubMed1998

A comparison of similarity measures for use in 2-D-3-D medical image registration.

A comparison of six similarity measures for use in intensity-based two-dimensional-three-dimensional (2-D-3-D) image registration is presented. The accuracy of the similarity measures are compared to a "gold-standard" registration which has been accurately calculated using fiducial markers. The similarity measures are used to register a computed tomography (CT) scan of a spine phantom to a fluoroscopy image of the phantom. The registration is carried out within a region-of-interest in the fluoroscopy image which is user defined to contain a single vertebra. Many of the problems involved in this type of registration are caused by features which were not modeled by a phantom image alone. More realistic "gold-standard" data sets were simulated using the phantom image with clinical image features overlaid. Results show that the introduction of soft-tissue structures and interventional instruments into the phantom image can have a large effect on the performance of some similarity measures previously applied to 2-D-3-D image registration. Two measures were able to register accurately and robustly even when soft-tissue structures and interventional instruments were present as differences between the images. These measures were pattern intensity and gradient difference. Their registration accuracy, for all the rigid-body parameters except for the source to film translation, was within a root-mean-square (rms) error of 0.54 mm or degrees to the "gold-standard" values. No failures occurred while registering using these measures.

Algorithms↗

PubMed1998

Investigation of intraoperative brain deformation using a 1.5-T interventional MR system: preliminary results.

All image-guided neurosurgical systems that we are aware of assume that the head and its contents behave as a rigid body. It is important to measure intraoperative brain deformation (brain shift) to provide some indication of the application accuracy of image-guided surgical systems, and also to provide data to develop and validate nonrigid registration algorithms to correct for such deformation. We are collecting data from patients undergoing neurosurgery in a high-field (1.5 T) interventional magnetic resonance (MR) scanner. High-contrast and high-resolution gradient-echo MR image volumes are collected immediately prior to surgery, during surgery, and at the end of surgery, with the patient intubated and lying on the operating table in the operative position. In this paper we report initial results from six patients: one freehand biopsy, one stereotactic functional procedure, and four resections. We investigate intraoperative brain deformation by examining threshold boundary overlays and difference images and by measuring ventricular volume. We also present preliminary results obtained using a nonrigid registration algorithm to quantify deformation. We found that some cases had much greater deformation than others, and also that, regardless of the procedure, there was very little deformation of the midline, the tentorium, the hemisphere contralateral to the procedure, and ipsilateral structures except those that are within 1 cm of the lesion or are gravitationally above the surgical site.

Adult↗

PubMed1998

The EASI project--improving the effectiveness and quality of image-guided surgery.

In recent years, advances in computer technology and a significant increase in the accuracy of medical imaging have made it possible to develop systems that can assist the clinician in diagnosis, planning, and treatment. This paper deals with an area that is generally referred to as computer-assisted surgery, image-directed surgery, or image-guided surgery. We report the research, development, and clinical validation performed since January 1996 in the European Applications in Surgical Interventions (EASI) project, which is funded by the European Commission in their "4th Framework Telematics Applications for Health" program. The goal of this project is the improvement of the effectiveness and quality of image-guided neurosurgery of the brain and image-guided vascular surgery of abdominal aortic aneurysms, while at the same time reducing patient risks and overall cost. We have developed advanced prototype systems for preoperative surgical planning and intraoperative surgical navigation, and we have extensively clinically validated these systems. The prototype systems and the clinical validation results are described in this paper.

Quality of Health Care↗

PubMed1997

Feasibility study of magnetic resonance imaging-guided intranasal flexible microendoscopy.

Interventional magnetic resonance imaging (MRI) offers potential advantages over conventional interventional modalities such as X-ray fluoroscopy, ultrasonography, and computed tomography (CT). In particular, it does not use ionizing radiation, can provide high-quality images, and allows acquisition of oblique sections. We have carried out a feasibility study on the use of interventional MRI to track a flexible microendoscope in the paranasal sinuses. In this cadaver study, high-speed MRI was used to track a passive marker attached to the end of the endoscope. Automatic image registration algorithms were used to transfer the coordinates of the endoscope tip into the preoperative MRI and CT images, enabling us to display the position of the endoscope in reformatted orthogonal views or in a rendered view of the preoperative images. The endoscope video images were digitized and could be displayed alongside an approximately aligned, rendered preoperative image. Intraoperative display was provided in the scanner room by means of an liquid crystal display (LCD) projector. We estimate the accuracy of the endoscope tracking to be approximately 2 mm.

Algorithms↗

PubMed1997

Evaluation of the limits of visual detection of image misregistration in a brain fluorine-18 fluorodeoxyglucose PET-MRI study.

In routine clinical work, registration accuracy is assessed by visual inspection. However, the accuracy of visual assessment of registration has not been evaluated. This study establishes the limits of visual detection of misregistration in a registered brain fluorine-18 fluorodeoxyglucose positron emission tomography to magnetic resonance image volume. The "best" registered image volume was obtained by automatic registration using mutual information optimization. Translational movements by 1 mm, 2 mm, 3 mm and 4 mm, and rotational movements by 1 degrees , 2 degrees , 3 degrees and 4 degrees in the positive and negative directions in the x- (lateral), y- (anterior-posterior) and z- (axial) axes were introduced to this standard. These 48 images plus six "best" registered images were presented in random sequence to five observers for visual categorization of registration accuracy. No observer detected a definite misregistration in the "best" registered image. Evaluation for inter-observer variation using observer pairings showed a high percentage of agreement in assigned categories for both translational and rotational misregistrations. Assessment of the limits of detection of misregistration showed that a 2-mm translational misregistration was detectable by all observers in the x- and y-axes and 3-mm translational misregistration in the z-axis. With rotational misregistrations, rotation around the z-axis was detectable by all at 2 degrees rotation whereas rotation around the y-axis was detected at 3-4 degrees . Rotation around the x-axis was not symmetric with a positive rotation being identified at 2 degrees whereas negative rotation was detected by all only at 4 degrees. Therefore, visual analysis appears to be a sensitive and practical means to assess image misregistration accuracy. The awareness of the limits of visual detection of misregistration will lead to increase care when evaluating registration quality in both research and clinical settings.

Brain↗

PubMed1997

Voxel-based 2-D/3-D registration of fluoroscopy images and CT scans for image-guided surgery.

Registration of intraoperative fluoroscopy images with preoperative three-dimensional (3-D) CT images can be used for several purposes in image-guided surgery. On the one hand, it can be used to display the position of surgical instruments, which are being tracked by a localizer, in the preoperative CT scan. On the other hand, the registration result can be used to project preoperative planning information or important anatomical structures visible in the CT image onto the fluoroscopy image. For this registration task, a novel voxel-based method in combination with a new similarity measure (pattern intensity) has been developed. The basic concept of the method is explained at the example of two-dimensional (2-D)/3-D registration of a vertebra in an X-ray fluoroscopy image with a 3-D CT image. The registration method is described, and the results for a spine phantom are presented and discussed. Registration has been carried out repeatedly with different starting estimates to study the capture range. Information about registration accuracy has been obtained by comparing the registration results with a highly accurate "ground-truth" registration, which has been derived from fiducial markers attached to the phantom prior to imaging. In addition, registration results for different vertebrae have been compared. The results show that the rotation parameters and the shifts parallel to the projection plane can accurately be determined from a single projection. Because of the projection geometry, the accuracy of the height above the projection plane is significantly lower.

Fluoroscopy↗

PubMed1997

Automated three-dimensional registration of magnetic resonance and positron emission tomography brain images by multiresolution optimization of voxel similarity measures.

Approaches using measures of voxel intensity similarity are showing promise in fully automating magnetic resonance (MR) and positron emission tomography (PET) image registration in the head, without requiring extraction and identification of corresponding structures. In this paper a method of multiresolution optimization of these measures is described and five alternative measures are compared: cross correlation, minimization of corresponding PET intensity variation, moments of the distribution of values in the intensity feature space, entropy of the intensity feature space and mutual information. Their ability to recover registration is examined for ten clinically acquired image pairs with respect to the size of initial misregistration, the precision of the final result, and the accuracy assessed by visual inspection. The mutual information measure proved the most robust to initial starting estimate, successfully registering 98.8% of 900 trial misregistrations. Success is defined as providing a visually acceptable solution to a trained observer. A high resolution search (1/16 mm step size) of 30 trial misregistrations showed that optimization using the mutual information measure provided solutions with 0.13 mm, 0.11 mm and 0.17 mm standard deviations in the three Cartesian axes of the translation vector and 0.2 degree, 0.3 degree and 0.2 degree standard deviations for rotations about the three axes. The algorithm takes between 4 and 8 minutes to run on a typical workstation, including visual inspection of the result.

Algorithms↗