Search PubMed⌕ Search
Home/Archive/PubMed

PubMed · 2233375

Reference standards for software evaluation.

J Michaelis·S Wellek·J L Willems
View original source ↗Export metadata ↓

Abstract

The field of automated ECG analysis was one of the earliest topics in Medical Informatics and may be regarded as a model both for computer-assisted medical diagnosis and for evaluating medical diagnostic programs. The CSE project has set reference standards of two kinds: In a broad sense, a standard how to perform a comprehensive evaluation study, in a narrow sense, standards as specific references for evaluating computer ECG programs. The evaluation methodology used within the CSE project is described as a basis for presentation of results which are published elsewhere in this issue.

Explore related subjects

Diagnosis, Computer-AssistedElectrocardiographyEvaluation Studies as TopicROC CurveReference StandardsSoftwareCommentJournal ArticleResearch Support, Non-U.S. Gov't

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

J Michaelis, S Wellek, J L Willems. 1990. Reference standards for software evaluation.. https://pubmed.ncbi.nlm.nih.gov/2233375/

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related citations

PubMed1992

Improvement of automated electrocardiographic diagnosis by combination of computer interpretations of the electrocardiogram and vectorcardiogram.

In the international project "Common Standards for Quantitative Electrocardiography" (CSE), diagnostic results of different computer programs for the interpretation of the electrocardiogram (ECG) and of the vectorcardiogram (VCG) were combined, and it was shown that the "combined program" performs better than each program separately. Because the program MEANS (Modular ECG Analysis System) comprises 2 different classification programs--one for the ECG, the other for the VCG--this allowed investigation of whether the combined interpretations would yield a better diagnostic result than either one separately. This approach requires that a VCG always be recorded in addition to the ECG. To circumvent this complication, the VCG was reconstructed from the simultaneously recorded ECG leads. This reconstructed VCG was then interpreted by the VCG classification program, whereupon the diagnostic interpretations of the ECG and the reconstructed VCG were combined. For the validation, the CSE database of documented ECGs and VCGs (n = 1,220) was used. The combination of the ECG and VCG interpretations yielded a better diagnostic result than each interpretation program separately (total accuracy 74.2% (ECG + VCG) vs 69.8% (ECG) and 70.2% (VCG), p less than 0.001 in both cases). The results for the reconstructed VCG (total accuracy 70.5%) are comparable to those for the ECG and the VCG (p greater than 0.10 in both cases). The performance of the combined interpretations of ECG and reconstructed VCG (total accuracy 73.6%) is approximately the same as that of the combined ECG and VCG (p greater than 0.10). Thus, the performance of an ECG computer program can be improved by incorporating both ECG and VCG classificatory knowledge, using only the ECG itself.

Diagnosis, Computer-Assisted↗
PubMed1992

[Potential usefulness of computer-aided diagnosis (CAD) in a mass survey for lung cancer using photo-fluorographic films].

We investigated the potential usefulness of computer-aided diagnosis (CAD) in a mass survey for lung cancer. When the sensitivity of the computer output was adjusted nearly equal to that of the mass survey in our database which contained 198 photofluorographic films, some shadows detected by the computer output were different from those detected by human observers. Therefore, the best estimated sensitivity of an observer using the computer output was equal to or greater than the sensitivity of double reading. It is expected that CAD may have a role in a mass survey for lung cancer using photofluorographic films.

Diagnosis, Computer-Assisted↗