Search PubMed⌕ Search

SEARCH · Search PubMed

Results for “Software Validation”

Search indexed PubMed citations on genomics, clinical trials, systematic reviews and public health. Explore titles, authors and supplied subject terms, then open the PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41Linked to original sources

The development of target-eye-view maps for selection of coplanar or noncoplanar beams in conformal radiotherapy treatment planning.

Three-dimensional conformal radiotherapy allows the use of tightly conformed, multiple coplanar or noncoplanar beams. However, visualizing the spatial relationships between the target volume and adjacent critical structures is not always obvious or intuitive. Tools such as beam's eye view (BEV) have aided in this process and been very useful. In this study, a target-eye-view (TEV) map is developed as a functional extension of BEVs. The TEV map for a critical structure is created by checking the BEVs for all gantries and table rotations. For each possible BEV, the amount of overlap between the planning target volume (PTV) and the organ at risk (OAR) is determined. This information is presented in a Mercator spherical map, where the color tone indicates the amount of overlap between the PTV and the OAR. A composite TEV map is then created by summing the TEV grading scores for all OARs. The composite map shows beam orientations with the most overlap being light and the least overlap being dark, thus simplifying the selection of appropriate beam angles. The accuracy of the TEV maps has been confirmed separately with corresponding BEVs generated by a three-dimensional treatment planning system.

Algorithms↗

Comparison of dose calculated by an intensity modulated radiotherapy treatment planning system and an independent monitor unit verification program.

A comparison of isocenter dose calculated by a commercial intensity modulated radiation therapy treatment planning system and independent monitor unit verification calculation (MUVC) software was made. The percent disparity between the treatment plan and MUVC doses were calculated for 507 treatments (head and neck, prostate, abdomen, female pelvis, rectum and anus, and miscellaneous) from 303 patients. The MUVC calculated dose was, on average, 1.4% higher than the treatment planning dose, with a 1.2% standard deviation. The distribution of the disparities appeared to be Gaussian in shape with some variation by treatment site. Based on our analysis, disparities outside the range of +/-3% about the mean value should be checked and resolved prior to treatment delivery.

Abdomen↗

Commissioning and implementation of a stereotactic conformal radiotherapy technique using a general-purpose planning system.

The purpose of this paper is to report on commissioning and clinical implementation of a customized system for pediatric stereotactic conformal radiotherapy (SCRT). The system is based on the Pinnacle treatment-planning system and its interfaces with other equipment: (1) Beam models were optimized for our compact blocking system and a new LINAC. (2) Three CT-to-density conversion tables were evaluated, one using tabulated data for a commercial phantom, the second including additional points from the manufacturer's data for the inserts in an in-house phantom, and the third using measured densities for the in-house phantom materials combined with tabulated data for the commercial phantom. (3) Blocks were transferred to a computerized block cutter using in-house software that extracted the block shape from the export file and custom-fitted the additional necessary shapes. (4) In the absence of a DICOM RT Image link, a method based on screen data capture was used to export digitally reconstructed radiographs (DRRs) to two portal imaging systems for treatment verification. Lens shielding by multileaf collimation in the anterior-posterior isocenter verification field was investigated. (1) Computed dose distributions using the beam models agreed with measurements well within published acceptability criteria. A difference of up to 1.0 mm was measured between the beam's eye views of aperture blocks and computed 50% isodose contours for a 2 x 2 x 2 mm dose calculation grid. (2) The third table, which included measured densities, improved the accuracy of the calculated isocenter dose by up to 0.5% in typical patient SCRT treatments and up to 1.0% in a phantom with 5-cm diameter inhomogeneity inserts. (3) The block export and customization process was shown to introduce no additional uncertainty. A 1-mm block production uncertainty was measured using film dosimetry on six blocks. (4) The DRR transfer method did not introduce uncertainty into the process. Verification field shielding reduced lens dose by 12 to 15 times. In conclusion, this customized system for planning and verification of pediatric SCRT provides a high level of precision as well as reasonable practical efficiency.

Computer Simulation↗

The accuracy of dynamic wedge dose computation in the ADAC Pinnacle RTP system.

The nonphysical wedge is a modality that uses computer-controlled jaw motion to generate wedge-shaped dose distributions. There are Varian enhanced dynamic wedges (EDWs) and Siemens virtual wedges (VWs). We recently commissioned dynamic wedges on both Varian and Siemens LINACs. The beam data, acquired with a Wellhofer chamber array and a Sun Nuclear profiler, are used for modeling in the ADAC Pinnacle system. As recommended by ADAC, only a limited number of beam data is measured and used for beam modeling. Therefore, the dose distributions of dynamic wedges generated by Pinnacle must be examined. Following the commissioning of the dynamic wedges, we used Pinnacle to generate a number of dose distributions with different energies, wedge angles, field sizes, and depths. The computed data from Pinnacle are then compared with the measured data. The deviations of the output factor in all square and rectangular fields are mostly within 2.0% for both EDW and VW. For asymmetric fields, the deviations are within 3%. However, exceptions of differences more than 3% have been found in a larger field and large wedge combinations. The precision of the beam profiles generated by Pinnacle is also evaluated. As a result of this investigation, we present a scope of quality assurance tests that are necessary to ensure acceptable consistency between the delivered dose and the associated treatment plan when dynamic wedges are applied.

Equipment Failure Analysis↗

A dose-volume-based tool for evaluating and ranking IMRT treatment plans.

External beam radiotherapy is commonly used for patients with cancer. While tumor shrinkage and palliation are frequently achieved, local control and cure remain elusive for many cancers. With regard to local control, the fundamental problem is that radiotherapy-induced normal tissue injury limits the dose that can be delivered to the tumor. While intensity-modulated radiation therapy (IMRT) allows for the delivery of higher tumor doses and the sparing of proximal critical structures, multiple competing plans can be generated based on dosimetric and/or biological constraints that need to be considered/compared. In this work, an IMRT treatment plan evaluation and ranking tool, based on dosimetric criteria, is presented. The treatment plan with the highest uncomplicated target conformity index (TCI+) is ranked at the top. The TCI+ is a dose-volume-based index that considers both a target conformity index (TCI) and a normal tissue-sparing index (NTSI). TCI+ is designed to assist in the process of judging the merit of a clinical treatment plan. To demonstrate the utility of this tool, several competing lung and prostate IMRT treatment plans are compared. Results show that the plan with the highest TCI+ values accomplished the competing goals of tumor coverage and critical structures sparing best, among rival treatment plans for both treatment sites. The study demonstrates, first, that dose-volume-based indices, which summarize complex dose distributions through a single index, can be used to automatically select the optimal plan among competing plans, and second, that this dose-volume-based index may be appropriate for ranking IMRT dose distributions.

Algorithms↗

Limited accuracy of dose calculation for large fields at deep depths using the BrainSCAN v5.21 treatment planning system.

The Varian 120 multileaf collimator (MLC) has a leaf thickness of 5 mm projected at the isocenter plane and can deliver a radiation beam of large field size (up to 30 cm) to be used in intensity-modulated radiotherapy (IMRT). Often the dose must be delivered to depths greater than 20 cm. Therefore, during the commissioning of the BrainSCAN v5.21 or any radiation treatment-planning (RTP) systems, extensive testing of dose and monitor unit calculations must encompass the field sizes (1 cm to 30 cm) and the prescription depths (1 cm to 20 cm). Accordingly, the central-axis percent depth doses (PDDs) and off-axis percentage profiles must be measured at several depths for various field sizes. The data for this study were acquired with a 6-MV X-ray beam from a Varian 2100EX LINAC with a water phantom at a source-to-surface distance (SSD) of 100 cm. These measurements were also used to generate a photon beam module, based on a photon pencil beam dose-calculation algorithm with a fast-Fourier transform method. To commission the photon beam module used in our BrainSCAN RTP system, we performed a quantitative comparison of measured and calculated central-axis depth doses and off-axis profiles. Utilizing the principles of dose difference and distance-to-agreement introduced by Van Dyk et al. [Commissioning and quality assurance of treatment planning computers. Int J Radiat Oncol Biol Phys. 1993; 26:261-273], agreements between calculated and measured doses are <2% and <2 mm for the regions of low- and high-dose gradients, respectively. However, large errors (up to approximately 5% and approximately 7% for 20-cm and 30-cm fields, respectively, at the depth 20 cm) were observed for monitor unit calculations. For a given field size, the disagreement increased with the depth. Similarly, for a given depth the disagreement also increase with the field size. These large systematic errors were caused by using the tissue maximum ratio (TMR) in BrainSCAN v5.21 without considering increased field size as depth increased. These errors have been reported to BrainLAB.

Algorithms↗

A comparison of two commercial treatment-planning systems to IMRT.

This study compared the clinical functionality of BrainSCAN (BrainLAB) and Helios (Eclipse, Varian) for intensity-modulated radiation therapy (IMRT) treatment planning with the aim of identifying practical and technical issues. The study considered implementation and commissioning, dose optimization, and plan assessment. Both systems were commissioned for the same 6 MV photon beam equipped with a high-resolution multileaf collimator (Varian Millennium 120 leaf). The software was applied to three test plans having identical imaging and contour data. Analysis considered 3D axial dose distributions, dose-volume histograms, and monitor unit calculations. Each system requires somewhat different input data to characterize the beam prior to use, so the same data cannot be used for commissioning. In addition, whereas measured beam data was entered directly into Helios with minimal data processing, the BrainSCAN system required configured beam data to be sent to BrainLAB before clinical use. One key difference with respect to system commissioning was that BrainSCAN required high resolution data, which necessitated the use of detectors with small active volumes. This difference was found to impact on the ability of the systems to accurately calculate dose for highly modulated fields, with BrainSCAN being more successful than Helios. In terms of functionality, the BrainSCAN system uses a dynamically penalized likelihood inverse planning algorithm and calculates four plans at once with various relative weighting of the planning target and organ-at-risk volumes. Helios uses a gradient algorithm that allows the user to make changes to some of the input parameters during optimization. An analysis of the dosimetry output shows that, although the systems are different in many respects, they are each capable of producing substantially equivalent dose plans in terms of target coverage and normal tissue sparing.

Algorithms↗

Density scaling artifacts in dosimetry calculations.

Quality assurance dosimetry often requires the comparison of measured doses with those calculated by a treatment-planning system for phantoms of density other than 1.000 g/cm3. The presence of an artifact in the Pinnacle3 treatment-planning system can lead to systematic errors in such cases. These errors are also present, although reduced in magnitude, in heterogeneous media.

Artifacts↗

Performance evaluation and quality assurance of Varian enhanced dynamic wedges.

Dynamic wedges have been used in clinical practice for many years. Obvious superiority of dynamic over physical wedges is accompanied by the increased overhead involved in verifying the accuracy and reliability of their use. Contrary to very limited QA required to ensure proper functioning of the physical wedges, dynamic wedges, like any other dynamic treatment, require a robust QA program. This work expands upon previous suggestions and describes a comprehensive QA program for Varian enhanced dynamic wedges (EDWs) and presents the results of an 18-month evaluation of these wedges. The QA program includes daily, monthly, and yearly tests and individual treatment QA at the onset of use of the EDWs. The results of the 18-month evaluation show reproducibility in the wedge factors of better than 1% and in dose profiles of better than 2% on a monthly basis. Daily output measurements are generally within 2% of expected values.

Equipment Failure Analysis↗

Performance evaluation of an automated image registration algorithm using an integrated kilovoltage imaging and guidance system.

Image-guided radiation therapy delivery may be used to assess the position of the tumor and anatomical structures within the body as opposed to relying on external marks. The purpose of this manuscript is to evaluate the performance of the image registration software for automatically detecting and repositioning a 3D offset of a phantom using a kilovoltage onboard imaging system. Verification tests were performed on both a geometric rigid phantom and an anthropomorphic head phantom containing a humanoid skeleton to assess the precision and accuracy of the automated positioning system. From the translation only studies, the average deviation between the detected and known offset was less than 0.75 mm for each of the three principal directions, and the shifts did not show any directional sensitivity. The results are given as the measurement with standard deviation in parentheses. The combined translations and rotations had the greatest average deviation in the lateral, longitudinal, and vertical directions. For all dimensions, the magnitude of the deviation does not appear to be correlated with the magnitude of the actual translation introduced. The On-Board Imager (OBI) system has been successfully integrated into a feasible online radiotherapy treatment guidance procedure. Evaluation of each patient's resulting automatch should be performed by therapists before each treatment session for adequate clinical oversight.

Algorithms↗

Automatic detection of diabetic retinopathy using an artificial neural network: a screening tool.

AIMS: To determine if neural networks can detect diabetic features in fundus images and compare the network against an ophthalmologist screening a set of fundus images. METHODS: 147 diabetic and 32 normal images were captured from a fundus camera, stored on computer, and analysed using a back propagation neural network. The network was trained to recognise features in the retinal image. The effects of digital filtering techniques and different network variables were assessed. 200 diabetic and 101 normal images were then randomised and used to evaluate the network's performance for the detection of diabetic retinopathy against an ophthalmologist. RESULTS: Detection rates for the recognition of vessels, exudates, and haemorrhages were 91.7%, 93.1%, and 73.8% respectively. When compared with the results of the ophthalmologist, the network achieved a sensitivity of 88.4% and a specificity of 83.5% for the detection of diabetic retinopathy. CONCLUSIONS: Detection of vessels, exudates, and haemorrhages was possible, with success rates dependent upon preprocessing and the number of images used in training. When compared with the ophthalmologist, the network achieved good accuracy for the detection of diabetic retinopathy. The system could be used as an aid to the screening of diabetic patients for retinopathy.

Diabetic Retinopathy↗

Educational software evaluation process.

The Active Digital Library at the Vanderbilt University Medical Center has created and implemented an educational software evaluation process to facilitate the timely recommendation for product acquisition. Using this process, breadth and depth of subject coverage, clarity of presentation, quality of construction, and ease of use are being assessed by content and technical experts. The process uses a team approach, employing a bi-level evaluation instrument based on existing software evaluation forms and system bug reports.

Computer-Assisted Instruction↗

Evaluation of reporting based on descriptional knowledge.

OBJECTIVE: In an attempt to enhance the completeness and clarity of clinical narratives, the authors developed a general formalism for the entry of structured data. The objective of this study was to gain insight into the expressive power of the formalism through its use for reporting in endoscopy. DESIGN: Each of ten endoscopists reported twice about eight endoscopy videotapes. They produced free-text reports first, and then structured reports using this formalism. Statements in the resulting reports were compared. RESULTS: In total, 6.8% of the endoscopists' statements could not be expressed in structured options. Most of these statements were not due to limitations of the formalism itself. Topics mentioned in the free-text reports were described more frequently in the structured reports and, in addition, the structured reports included a greater variety of topics. Overall, increases of 83% for topics not related to abnormal findings (366 in free-text reports and 671 in structured reports) and 45% for features of abnormal findings (406 in free-text reports and 586 in structured reports) were observed. Although there was an overall information gain, features of abnormal findings were, on average, described by only half of the endoscopists. CONCLUSION: The expressive power of this formalism is promising, but general, multipurpose usage of the acquired data requires that topics be described by a larger percentage of physicians. Since this formalism led to more complete and more uniform data, additional research is justified to study how spontaneous reporting can be augmented further. The few subjects that occurred less often in structured reports suggest a possible negligence effect of structured reporting.

Databases, Factual↗

Quality assurance in anatomic pathology: automated SNOMED coding.

This case study details the set-up and implementation of the PathNet autocoder (Cerner Corporation) in a busy anatomic pathology laboratory. After initial start-up, procedures were developed to improve the system's performance. Four classes of software coding errors were identified, and an index was developed to measure the number of cases between errors (CBE). Through modifications in the program, the CBE increased sharply by the end of the six-month study period. During the last three months of the study, the efficiency of case retrieval was tested by comparing manual and electronic methods on the same reference cases. This demonstrated significant time saving and removed the variability of manual coding. The technique employed in this study may assist other institutions seeking to implement such a coding system within their respective environments.

Clinical Laboratory Information Systems↗

Use of commercial record linkage software and vital statistics to identify patient deaths.

We evaluate the ability of a microcomputer program (Automatch) to link patient records in our hospital's database (N = 253,836) with mortality files from California (N = 1,312,779) and the U.S. Social Security Administration (N = 13,341,581). We linked 96.5% of 3,448 in-hospital deaths, 99.3% for patients with social security numbers. None of 14,073 patients known to be alive (because they were subsequently admitted) was linked with California deaths, and only 6 (0.1%) of 6,444 were falsely identified as dead in the United States file. For patients with unknown vital status but items in the database likely to be associated with high 3-year mortality rates, we identified death records of 88% of 494 patients with cancer metastatic to the liver, 84% of 164 patients with pancreatic cancer, and 91% of 126 patients with CD4 counts of less than 50. Hospital data can be accurately linked with state and national vital statistics using commercial record linkage software.

Algorithms↗

A Web terminology server using UMLS for the description of medical procedures.

The Model for Assistance in the Orientation of a User within Coding Systems (MAOUSSC) project has been designed to provide a representation for medical and surgical procedures that allows several applications to be developed from several viewpoints. It is based on a conceptual model, a controlled set of terms, and Web server development. The design includes the UMLS knowledge sources associated with additional knowledge about medico-surgical procedures. The model was implemented using a relational database. The authors developed a complete interface for the Web presentation, with the intermediary layer being written in PERL. The server has been used for the representation of medico-surgical procedures that occur in the discharge summaries of the national survey of hospital activities that is performed by the French Health Statistics Agency in order to produce inpatient profiles. The authors describe the current status of the MAOUSSC server and discuss their interest in using such a server to assist in the coordination of terminology tasks and in the sharing of controlled terminologies.

Computer Communication Networks↗

Recommendations for responsible monitoring and regulation of clinical software systems. American Medical Informatics Association, Computer-based Patient Record Institute, Medical Library Association, Association of Academic Health Science Libraries, American Health Information Management Association, American Nurses Association.

In mid-1996, the FDA called for discussions on regulation of clinical software programs as medical devices. In response, a consortium of organizations dedicated to improving health care through information technology has developed recommendations for the responsible regulation and monitoring of clinical software systems by users, vendors, and regulatory agencies. Organizations assisting in development of recommendations, or endorsing the consortium position include the American Medical Informatics Association, the Computer-based Patient Record Institute, the Medical Library Association, the Association of Academic Health Sciences Libraries, the American Health Information Management Association, the American Nurses Association, the Center for Healthcare Information Management, and the American College of Physicians. The consortium proposes four categories of clinical system risks and four classes of measured monitoring and regulatory actions that can be applied strategically based on the level of risk in a given setting. The consortium recommends local oversight of clinical software systems, and adoption by healthcare information system developers of a code of good business practices. Budgetary and other constraints limit the type and number of systems that the FDA can regulate effectively. FDA regulation should exempt most clinical software systems and focus on those systems posing highest clinical risk, with limited opportunities for competent human intervention.

Clinical Medicine↗