Search PubMedSearch

Biomedical subjects

S J Frawley

Publications and source records attributed to S J Frawley.

12 recordsLinked to original sources

Using semantic constraints to help verify the completeness of a computer-based clinical guideline for childhood immunization.

The paper describes Commander, a prototype computer program designed to help verify the completeness of a computer-based clinical practice guideline built using if then rules. It also describes the application of Commander to a guideline for childhood immunization. Commander is designed to help identify incomplete rule sets, where there are clinically meaningful conditions to which the guideline does not respond. To allow this, the user defines semantic constraints, in the form of if-then statements, which indicate combinations of conditions which are not meaningful. In an iterative process, Commander takes the guideline rules, together with an increasingly refined set of constraints and helps focus in on any combinations of conditions to which the guideline does not respond. When applied to the clinical guideline for childhood immunization, Commander was able to dramatically reduce the number of potential combinations of conditions for consideration and also identified several areas of incompleteness in the rules.

Child

Exploring three approaches for handling incomplete patient histories in a computer-based guideline for childhood immunization.

A significant problem faced by immunization registries is that the dates of a patient's previous vaccinations may not be known. These incomplete histories can pose a problem when attempting to use a computer-based guideline to produce patient-specific immunization recommendations automatically. This paper describes an overall approach, together with 3 specific strategies, developed to help deal with this problem. The paper then describes our experience applying the approach to a database containing over 400,000 immunization histories. The paper also discusses a number of the issues raised in adapting a computer-based guideline to accommodate incomplete patient data of this sort.

Child

Tools for immunization guideline knowledge maintenance. II. Automated Web-based generation of user-customized test cases.

IMM/Test is a prototype software tool built to generate test cases that can be used to help test and verify the internal logic of an immunization forecasting program. A forecasting program takes as input a child's immunization history and produces recommendations as to which vaccinations are due and which should be scheduled next. IMM/Test was developed to test a specific immunization forecasting program, IMM/Serve. In addition, IMM/Test has been incorporated into a broader Web-based tool, IMM/Web, which allows the user (e.g., a member of an immunization registry staff) to customize the parameters used for immunization forecasting (e.g., the minimum ages for each dose and the minimum wait intervals between doses) to reflect local practice. IMM/Web then generates a customized set of test cases that may be used to test the user's immunization forecasting program. The user may also request that the test cases be automatically passed to IMM/Serve to analyze using the newly defined parameters. The paper describes the internal design of IMM/Test and IMM/Web and discusses certain lessons learned in the implementation of the two programs.

Adolescent

Issues in accommodating national changes and local variation in a computer-based guideline for childhood immunization and in related knowledge maintenance tools.

As clinical practice guidelines are increasingly implemented in computer-based form, a major challenge will be to maintain their domain knowledge as new national recommendations are developed and as local customization is required. This maintenance may also need to be performed for any computer-based tools developed to help in the guideline knowledge maintenance process itself. This paper uses the domain of childhood immunization to explore certain issues involved. It describes 1) two recent changes to the national recommendations dealing with the DTP and Polio vaccine series, and 2) several customizations requested by the immunization registries of the State of Oregon and the US Indian Health Service. It then describes how these guideline practice variations are currently handled in three computer-based tools, IMM/Serve, IMM/Def, and IMM/Test. Finally, it discusses how the use of these tools can provide one approach to characterizing the complexity of guideline variations.

Artificial Intelligence

Combining tabular, rule-based, and procedural knowledge in computer-based guidelines for childhood immunization.

IMM/Serve is a computer program which implements the clinical guidelines for childhood immunization. IMM/Serve accepts as input a child's immunization history. It then indicates which vaccinations are due and which vaccinations should be scheduled next. The clinical guidelines for immunization are quite complex and are modified quite frequently. As a result, it is important that IMM/Serve's knowledge be represented in a format that facilitates the maintenance of that knowledge as the field evolves over time. To achieve this goal, IMM/Serve uses four representations for different parts of its knowledge base: (1) Immunization forecasting parameters that specify the minimum ages and wait-intervals for each dose are stored in tabular form. (2) The clinical logic that determines which set of forecasting parameters applies for a particular patient in each vaccine series is represented using if-then rules. (3) The temporal logic that combines dates, ages, and intervals to calculate recommended dates, is expressed procedurally. (4) The screening logic that checks each previous dose for validity is performed using a decision table that combines minimum ages and wait intervals with a small amount of clinical logic. A knowledge maintenance tool, IMM/Def, has been developed to help maintain the rule-based logic. The paper describes the design of IMM/Serve and the rationale and role of the different forms of knowledge used.

Age Factors

Visualizing the logic of a clinical guideline: a case study in childhood immunization.

IMM/Graph is a visual model designed to help knowledge-base developers understand and refine the guideline logic for childhood immunization. The IMM/Graph model is domain-specific and was developed to help build a knowledge-based system that makes patient-specific immunization recommendations. A "visual vocabulary" models issues specific to the immunization domain, such as (1) the age a child is first eligible for each vaccination dose, (2) recommended, "past due" and maximum ages, (3) minimum waiting periods between doses, (4) the vaccine brand or preparation to be given, and (5) the various factors affecting the time course of vaccination. Several lessons learned in the course of developing IMM/Graph include the following: (1) The intended use of the model may influence the choice of visual presentation; (2) There is a potentially interesting interplay between the use of visual and textual information in creating the visual model; (3) Visualization may help a development team better understand a complex clinical guideline and may also help highlight areas of incompleteness.

Child, Preschool

A prototype Web site for immunization knowledge maintenance.

IMM/Web is a prototype Web site designed to assist in the maintenance of the knowledge required to perform computer-based forecasting for childhood immunization. IMM/Web operates in conjunction with IMM/Serve, a immunization forecasting program that takes a child's immunization history and produces recommendations as to which vaccinations are due, and which should be scheduled next. IMM/Serve's domain knowledge is expressed in both tabular and rule-based form. Using IMM/Web, the various tabular forecasting parameters can be modified via the Web. Test cases can then be generated automatically which can be used to help verify the new version of logic. Finally, the test cases can be automatically passed for IMM/Serve to analyze using the newly defined parameters. The IMM/Web project is exploring how the process of updating, customizing, and testing new versions of a computer-based clinical guideline might be performed and guided in an organized fashion via the World-Wide Web.

Child

IMM/Serve: a rule-based program for childhood immunization.

A rule-based program, IMM/Serve, is being developed to help guide childhood immunization for initial use, within Oregon. The program is designed primarily for automated use with an online immunization registry, but can also be used interactively by a single user. The paper describes IMM/Serve and discusses 1) the sources of complexity in immunization logic, 2) the potential advantages of a rule-based approach for representing that logic, and 3) the potential advantage of such a program evolving to become the standard of care. Related projects include 1) a computer-based tool to help verify the completeness of the logic, 2) a tool that allows a central part of the logic to be generated automatically, and 3) an approach that allows visualization of the logic graphically.

Child

Building a Database of Data Sets for Health Services Research.

The Database of Data Sets (DB/DS) for Health Services Research will be an online searchable directory of data sets which are available, often with restrictions and confidentiality safeguards, for use by health care researchers. The DB/DS project is aimed at a wide audience, and intends to include a very broad range of health care data sets, ranging from state hospital discharge data bases, to national registries and health survey data sets, to institutional clinical databases. The intended users are the same community of researchers, policy-makers, administrators and practitioners who are served by the National Library of Medicine's current bibliographic databases. This paper describes a pilot phase of the DB/DS project in which the issues involved in creating such a database were explored with an initial set of 20 representative data sets.

Databases, Factual

Lessons learned from a pilot implementation of the UMLS information sources map.

OBJECTIVE: To explore the software design issues involved in implementing an operational information sources map (ISM) knowledge base (KB) and system of navigational tools that can help medical users access network-based information sources relevant to a biomedical question. DESIGN: A pilot biomedical ISM KB and associated client-server software (ISM/Explorer) have been developed to help students, clinicians, researchers, and staff access network-based information sources, as part of the National Library of Medicine's (NLM) multi-institutional Unified Medical Language System (UMLS) project. The system allows the user to specify and constrain a search for a biomedical question of interest. The system then returns a list of sources matching the search. At this point the user may request 1) further information about a source, 2) that the list of sources be regrouped by different criteria to allow the user to get a better overall appreciation of the set of retrieved sources as a whole, or 3) automatic connection to a source. RESULTS: The pilot system operates in client-server mode and currently contains coded information for 121 sources. It is in routine use from approximately 40 workstations at the Yale School of Medicine. The lessons that have been learned are that: 1) it is important to make access to different versions of a source as seamless as possible, 2) achieving seamless, cross-platform access to heterogeneous sources is difficult, 3) significant differences exist between coding the subject content of an electronic information resource versus that of an article or a book, 4) customizing the ISM to multiple institutions entails significant complexities, and 5) there are many design trade-offs between specifying searches and viewing sets of retrieved sources that must be taken into consideration. CONCLUSION: An ISM KB and navigational tools have been constructed. In the process, much has been learned about the complexities of development and evaluation in this new environment, which are different from those for Gopher, wide area information servers (WAIS), World-Wide-Web (WWW), and MOSAIC resources.

Abstracting and Indexing

Trade-offs in producing patient-specific recommendations from a computer-based clinical guideline: a case study.

This case study explored 1) how much online clinical data is required to obtain patient-specific recommendations from a computer-based clinical practice guideline, 2) whether the availability of increasing amounts of online clinical data might allow a higher specificity of those recommendations, and 3) whether that increased specificity is necessarily desirable. The "quick reference guide" version of the guideline for acute postoperative pain management in adults, developed by the Agency for Health Care Policy and Research, was analyzed. Patient-specific data items that might be used to tailor the computer's output for a particular case were grouped into rough categories depending on how likely they were to be available online and how readily they might be determined from online clinical data. The patient-specific recommendations were analyzed to determine to what degree the amount of text produced depended on the online availability of different categories of data. An examination of example recommendations, however, illustrated that high specificity may not always be desirable. The study provides a concrete illustration of how the richness of online clinical data can affect patient-specific recommendations, and describes a number of related design trade-offs in converting a clinical guideline into an interactive, computer-based form.

Adult

Evaluating IAIMS at Yale: information access.

OBJECTIVE: To evaluate use of information resources during the first year of IAIMS implementation at the Yale-New Haven Medical Center. The evaluation asked: (1) Which information resources are being used? (2) Who uses information resources? (3) Where are information resources used? (4) Are multiple sources of information being integrated? DESIGN: Measures included monthly usage data for resources delivered network-wide, in the Medical Library, and in the Hospital; online surveys of library workstation users; an annual survey of a random, stratified sample of Medical Center faculty, postdoctoral trainees, students, nurses, residents, and managerial and professional staff; and user comments. RESULTS: Eighty-three percent of the Medical Center community use networked information resources, and use of resources is increasing. Both status (faculty, student, nurse, etc.) and mission (teaching, research, patient care) affect use of individual resources. Eighty-eight percent of people use computers in more than one location, and increases in usage of traditional library resources such as MEDLINE are due to increased access from outside the Library. Both survey and usage data suggest that people are using multiple resources during the same information seeking session. CONCLUSIONS: Almost all of the Medical Center community is using networked information resources in more settings. It is necessary to support increased demand for information access from remote locations and to specific populations, such as nurses. People are integrating information from multiple sources, but true integration within information systems is just beginning. Other institutions are advised to incorporate pragmatic evaluation into their IAIMS activities and to share evaluation results with decision-makers.

Academic Medical Centers