Search PubMed⌕ Search

Biomedical subjects

J A Swets

Publications and source records attributed to J A Swets.

At least 19 recordsLinked to original sources
PubMed1992

The science of choosing the right decision threshold in high-stakes diagnostics.

Many diagnostic tasks require that a threshold be set to convert evidence that is a matter of degree into a positive or negative decision. Although techniques of decision analysis used in psychology help one select the particular threshold that is appropriate to a given situation and purpose, just the concept of adjusting the threshold to the situation is not appreciated in many important practical arenas. Testing for the human immunodeficiency virus (HIV) and for dangerous flaws in aircraft structures are used here as illustrations. This article briefly reviews the relevant techniques and develops those two examples with data. It suggests that use of the decision techniques could substantially benefit individuals and society and asks how that use might be facilitated.

Aircraft↗
PubMed1992

Reading and decision aids for improved accuracy and standardization of mammographic diagnosis.

Image-reading and decision aids were designed to improve the accuracy of mammogram interpretation. The reading aid was a list of diagnostic radiographic features and scales for quantification of each feature. The decision aid, a computer program, converted the reader's scaled values, weighted for predictive power, into an advisory estimate of the probability of malignancy. The features were identified and their importance was assigned in four steps: (a) interviews of five expert readers to establish an initial set of features, (b) perceptual tests to refine the feature set, (c) a consensus meeting to refine this set and establish nomenclature and scales, and (d) the expert's scaling of each feature in a set of 150 mammograms. Those scaled judgments were analyzed to provide the final list of features and their relative importance and to program the computer decision aid. To test the enhancement effect, six other radiologists interpreted a different set of mammograms without, and later with, the two aids. Receiver operating characteristic analysis showed a gain of approximately 0.05 in sensitivity or specificity when the other value remained at 0.85. In a subset of the more difficult cases, the enhancement effect was approximately 0.15 in either sensitivity or specificity.

Humans↗
PubMed1988

Measuring the accuracy of diagnostic systems.

Diagnostic systems of several kinds are used to distinguish between two classes of events, essentially "signals" and "noise". For them, analysis in terms of the "relative operating characteristic" of signal detection theory provides a precise and valid measure of diagnostic accuracy. It is the only measure available that is uninfluenced by decision biases and prior probabilities, and it places the performances of diverse systems on a common, easily interpreted scale. Representative values of this measure are reported here for systems in medical imaging, materials testing, weather forecasting, information retrieval, polygraph lie detection, and aptitude testing. Though the measure itself is sound, the values obtained from tests of diagnostic systems often require qualification because the test data on which they are based are of unsure quality. A common set of problems in testing is faced in all fields. How well these problems are handled, or can be handled in a given field, determines the degree of confidence that can be placed in a measured value of accuracy. Some fields fare much better than others.

Diagnosis↗
PubMed1988

Enhanced interpretation of diagnostic images.

In radiology, as in various other fields, observers study images to detect and diagnose underlying conditions. They make assessments of several image features and merge them into an overall decision. Demonstration is given here, in the context of mammography, that objective aids to this interpretative process can substantially improve accuracy, even for sophisticated and motivated radiologists. The aids are a checklist that solicits explicit, quantitative, systematic assessments of the important features of an image and a computer program that merges those assessments with optimal weights. The computer issues estimates of the likelihoods that specified conditions are present (in this study, the likelihood that a localized abnormality is malignant), and the radiologist benefits from taking those estimates as guidance.

Female↗
PubMed1984

Patient-oriented performance measures of diagnostic tests. 2. Assignment potential and assignment strength.

Assignment Potential (AP) is a performance measure of a diagnostic test, characterizing the chance that, as a consequence of performing the test, the probability of disease will exceed a decision threshold, thereby permitting a management action to be taken. Another performance measure, Assignment Strength (AS) characterizes the average extent to which a decision threshold will be exceeded when the post-test probability of disease does exceed the threshold. Both AP and AS are functions of prior probability of disease and decision threshold, and can be represented as two-dimensional contour maps indicating their behavior throughout the entire probability and threshold space. AP and AS can be determined for both discrete-valued tests and tests with continuous spectra of results. The contour map displays facilitate determination of the values of these measures at any prior probability and threshold, as well as visual sensitivity analysis for ranges of prior probability and/or threshold. AP and AS may be useful to the clinician in prospective evaluation of a diagnostic test in situations where formal decision analysis is not feasible.

Diagnosis↗
PubMed1979

Assessment of diagnostic technologies.

A general protocol for rigorous evaluation of diagnostic systems in medicine was applied successfully in a comparative study of two radiologic techniques. Accuracies of computed tomography and radionuclide scanning in detecting, localizing, and diagnosing brain lesions were assessed with a sample of patients in whom tumor had been suspected. The principal means of analysis was the "relative operating characteristic," which is unique in providing a measure of accuracy that is largely independent of decision biases. Computed tomography was found to be substantially more accurate than radionuclide scanning.

Brain↗
PubMed1970

Attention.

Explore the source record for details and available documents.

Attention↗
PubMedDate not supplied

Combining evidence from multiple imaging modalities: a feature-analysis method.

This study was designed to develop methods to improve radiologists' ability to detect and diagnose breast cancer. We evaluated the ability of a feature-analysis method to help radiologists merge judgements constructively from two rather disparate breast imaging tests. To accomplish these goals, we developed a list of perceptual features and quantitated the importance of each in the diagnosis of patients having both diaphanography (Test 1) and mammography (Test 2). Then, two decision aids were developed: One was a checklist of the critical diagnostic visual features from both tests that also assisted readers in rating these features numerically. The second was a computer-based classifier that assisted readers in merging the assessments of the two tests into one overall diagnostic probability. The value of these aids was assessed by comparing radiologists' accuracy in reading a set of proven cases in their standard fashion with their accuracy when reading in an enhanced mode, utilizing the checklist and computer classifier. When Test 1 was read adjunctively with Test 2, use of the decision aids led to a significant improvement in accuracy (p = .013) over the unenhanced, combined readings. For Test 1 alone, the aids led to a significant improvement over its low level of unenhanced reading (p = .046). For Test 2 alone, the enhancements provided little gain in accuracy over an already high level of performance on the full case set (p = .081), although significant gains were realized on the most difficult ones. We conclude that methods to aid standardization and merging of feature-based judgements can improve radiologists performance on complex diagnostic tasks.

Breast Neoplasms↗
PubMedDate not supplied

ROC analysis applied to the evaluation of medical imaging techniques.

Analysis in terms of the relative operating characteristic (ROC) has recently been applied to several studies of medical decision-making, primarily to decisions based on imaging techniques. This paper presents a brief description of the ROC, and shows how it provides a measure of diagnostic accuracy that is free of judgmental bias. The results of medical studies are reviewed, and the main questions of theory and method that have arisen in the medical context are identified. Certain of these questions are basic to any psychophysical test, in which case an attempt has been made to present the best available answers. Other questions are of special medical importance and relevant reports are reviewed along with a description of current efforts to provide answers.

Decision Making↗