Continuous improvement evaluation: a framework for multisite evaluation studies.

F Alemi; M R Haack; S Nemes

doi:10.1111/j.1945-1474.2001.tb00345.x

Home/Archive/PubMed

PubMed · 11378974

Continuous improvement evaluation: a framework for multisite evaluation studies.

F Alemi·M R Haack·S Nemes

View original source ↗Export metadata ↓

Abstract

This article proposes the use of the continuous improvement evaluation (CIE), a framework for multisite demonstration or evaluation studies. This framework is designed for studying intervention programs that change during the evaluation. The development of family drug courts is provided as an example. CIE relies on outcome data collected over time and benchmarked across similar cases in comparison sites; thus, this study was designed to collect data on effectiveness of intervention programs at multiple sites and over time. A weight is calculated for similarity of any two cases based on features they share. In statistical process control charts, these weights are used to compare outcomes at the site against the average of similar cases in comparison groups. Once data are benchmarked, program staff meet to discuss process changes that have led to improvements in outcomes. To ensure that intervention programs have access to evaluation reports on demand, information technology is used to collect, clean, and pool data. Computers generate study reports, and evaluators review reports after release to clients. Statistical tools can be used to evaluate changing programs. Traditional evaluators may be concerned about some threats to validity associated with CIE. The article concludes with a discussion of typical threats to validity and how these threats are addressed in the CIE framework.

Explore related subjects

Data Collection Evaluation Studies as Topic Health Services Research Humans Multicenter Studies as Topic Reproducibility of Results Total Quality Management United States Journal Article Research Support, Non-U.S. Gov't

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

F Alemi, M R Haack, S Nemes. Continuous improvement evaluation: a framework for multisite evaluation studies.. https://doi.org/10.1111/j.1945-1474.2001.tb00345.x

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related citations

PubMed2002

The comparative assessment and improvement of quality of surgical care in the Department of Veterans Affairs.

Prompted by the need to assess comparatively the quality of surgical care in 133 Veterans Affairs (VA) hospitals, the Department of Veterans Affairs conducted the National VA Surgical Risk Study between October 1, 1991, and December 31, 1993, in 44 VA medical centers. The study developed and validated models for risk adjustment of 30-day morbidity and 30-day mortality after major surgery in 8 noncardiac surgical specialties. Similar models were developed for cardiac surgery by the VA's Continuous Improvement in Cardiac Surgery Program. Based on the results of the National VA Surgical Risk Study and the Continuous Improvement in Cardiac Surgery Program, the VA established in 1994 a VA National Surgical Quality Improvement Program (NSQIP), in which all the medical centers performing major surgery participated. An NSQIP nurse at each center oversees the prospective collection of data and their electronic transmission for analysis at 1 of 2 data coordinating centers. Feedback to the providers and managers is aimed at achieving continuous quality improvement. It consists of (1) comparative, site-specific, and outcome-based annual reports; (2) periodic assessment of performance; (3) self-assessment tools; (4) structured site visits; and (5) dissemination of best practices. The NSQIP also provides an infrastructure to enable the VA investigators to query the database and produce scientific presentations and publications. Since the inception of the NSQIP data collection process, the 30-day postoperative mortality after major surgery in the VA has decreased by 27%, and the 30-day morbidity by 45%. The future of the NSQIP lies in expanding it to the private sector and in enhancing its capabilities by incorporating additional measures of outcome, structure, process, and cost.

Data Collection↗

PubMed2002

Historical and geological evidence for seismic origin of newly recognized landslides in southeastern Sicily, and its significance in terms of hazard.

Old, large, and dormant landslides were unexpectedly found in southeastern Sicily, a territory of known seismicity but commonly considered as landslide-free or almost so. Purposely undertaken investigations revealed that: (1) these landslides are scarcely compatible with the local geoclimatic environment; (2) they usually show low-angle basal shear surfaces, despite the fact that the properties of the forming material are generally good; (3) they fulfill the known relationships between earthquake magnitude and epicenter-landslide distance; (4) sources coeval with high-energy historical earthquakes occurred in 1169, 1542 and 1693 testify to the occurrence of earthquake-triggered landsliding; and (5) documentary material (presented here for the first time) correlates with certainty a specific landslide to the 1693 earthquake. This geological and historical evidence, accompanied by the absence of contrasting elements, leads us to conclude that these landslides are earthquake-triggered. Because of their typological and geometrical characteristics, nearly all landslides can be reactivated, which has serious implications in terms of hazard, particularly with respect to lines of communication. Obviously, every action aimed at preventing or mitigating risks must start from the awareness of the causative processes, a condition substantially unsatisfied at the moment in SE Sicily. The paper concludes by emphasizing the opportunity not to trust excessively beliefs that, although shared, have never been really checked.

Data Collection↗

PubMed2002

Technical efficiency of nursing units in a tertiary care hospital in Taiwan.

The variation in productivity and cost efficiency has been observed among 57 nursing units in a large tertiary care hospital. The inefficient units can achieve the same level of efficiency as the efficient units by altering their inputs (either nursing hours or patient costs). The optimization can be achieved through proper reallocations of nursing resources such as nursing hours or costs. However, the resource reallocation to achieve high efficiency should not be at the expense of quality of care. Future efficiency studies should incorporate the nursing sensitive measures of quality in the analysis.

Data Collection↗