Search PubMed⌕ Search

SEARCH · Search PubMed

Results for “Benchmark”

Search indexed PubMed citations on genomics, clinical trials, systematic reviews and public health. Explore titles, authors and supplied subject terms, then open the PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,675 records · Page 93Linked to original sources

A survey assessment of the level of preparedness for domestic terrorism and mass casualty incidents among Eastern Association for the Surgery of Trauma members.

OBJECTIVE: The goal of this survey was to establish a benchmark for trauma surgeons' level of operational understanding of the command structure for a pre-hospital incident, a mass casualty incident (MCI), and weapons of mass destruction (WMD). The survey was distributed before the World Trade Center destruction on September 11, 2001. METHODS: The survey was developed by the authors and reviewed by a statistician for clarity and performance. The survey was sent to the membership of the 2000 Eastern Association for the Surgery of Trauma spring mailing, with two subsequent mailings and a final sampling at the Eastern Association for the Surgery of Trauma 2001 meeting. Of 723 surveys mailed, 243 were returned and statistically analyzed (significance indicated by p < 0.05). RESULTS: No statistical difference existed between level of designation of a trauma center (state or American College of Surgeons) and a facility's level of pre-paredness for MCIs or WMD. Physicians in communities with chemical plants, railways, and waterway traffic were statistically more likely to work at facilities with internal disaster plans addressing chemical and biological threats. Across all variables, physicians with military training were significantly better prepared for response to catastrophic events. With the exception of cyanide (50%), less than 30% of the membership was prepared to manage exposure to a nerve agent, less than 50% was prepared to manage illness from intentional biological exposure, and only 73% understood and were prepared to manage blast injury. Mobile medical response teams were present in 46% of the respondents' facilities, but only 30% of those teams deployed a trauma surgeon. Approximately 70% of the membership had been involved in an MCI, although only 60% understood the command structure for a prehospital incident. Only 33% of the membership had training regarding hazardous materials. Of interest, 76% and 65%, respectively, felt that education about MCIs and WMD should be included in residency training. CONCLUSION: A facility's level of pre-paredness for MCIs or WMD was not related to level of designation as a trauma center, but may be positively influenced by local physicians with prior military background. Benchmark information from this survey will provide the architecture for the development and implementation of further training in these areas for trauma surgeons.

Attitude of Health Personnel↗

ProbCons: Probabilistic consistency-based multiple sequence alignment.

To study gene evolution across a wide range of organisms, biologists need accurate tools for multiple sequence alignment of protein families. Obtaining accurate alignments, however, is a difficult computational problem because of not only the high computational cost but also the lack of proper objective functions for measuring alignment quality. In this paper, we introduce probabilistic consistency, a novel scoring function for multiple sequence comparisons. We present ProbCons, a practical tool for progressive protein multiple sequence alignment based on probabilistic consistency, and evaluate its performance on several standard alignment benchmark data sets. On the BAliBASE, SABmark, and PREFAB benchmark alignment databases, ProbCons achieves statistically significant improvement over other leading methods while maintaining practical speed. ProbCons is publicly available as a Web resource.

Algorithms↗

Outcomes steering practice: when the ends determine the means.

A discussion of outcomes and outcomes measurement will be presented through an examination of achievements of a collaborative project awarded a federal best practice grant in 1995. The project, which established a new service for women of nonEnglish-speaking background, was part of a national venture which sought to benchmark best practice in the primary health care field. The process of benchmarking demanded that the approach to outcomes and outcomes measurement adopted by the project participants be articulated. The approach adopted acknowledges that outcomes are affected by the processes involved in care, which in turn are dependent upon the organisational environment in which care is offered and experienced. Both these contributing factors to outcomes can be hard to measure and, therefore, could be at risk of being omitted from the outcome equation in these economically stringent times. This paper aims to contribute to debate on the topic by recommending an approach to outcomes measurement which is comprehensive, values quality and embraces the short, medium and longer term.

Benchmarking↗

Optimising workflow in andrology: a new electronic patient record and database.

AIM: To improve workflow and usability by introduction of a new electronic patient record (EPR) and database. METHODS: Establishment of an EPR based on open source technology (MySQL database and PHP scripting language) in a tertiary care andrology center at a university clinic. Workflow analysis, a benchmark comparing the two systems and a survey for usability and ergonomics were carried out. RESULTS: Workflow optimizations (electronic ordering of laboratory analysis, elimination of transcription steps and automated referral letters) and the decrease in time required for data entry per patient to 71%+/-27%, P<0.05, lead to a workload reduction. The benchmark showed a significant performance increase (highest with starting the respective system: 1.3+/-0.2 s vs. 11.1+/-0.2 s, mean+/-SD). In the survey, users rated the new system at least two ranks higher over its predecessor (P<0.01) in all sub-areas. CONCLUSION: With further improvements, today's EPR can evolve to substitute paper records, saving time (and possibly costs), supporting user satisfaction and expanding the basis for scientific evaluation when more data is electronically available. Newly introduced systems should be versatile, adaptable for users, and workflow-oriented to yield the highest benefit. If ready-made software is purchased, customization should be implemented during rollout.

Andrology↗

Effect of different diagnostic thresholds on dental caries calibration.

OBJECTIVES: (a) To analyze the intra- and inter-examiner reproducibility (reliability) of a calibration trial, at different diagnostic thresholds of dental caries; (b) to verify the accuracy (benchmark validity) though sensitivity (S), specificity (SP), positive (PPV) and negative predictive (NPV) values. PARTICIPANTS: A group of dental examiners (n=11), who had previous experience in epidemiological surveys and six to seven-year-old children. Children were selected according to the dmft and dental caries activity. METHODS: Theoretical and clinical training and calibration exercises were arranged for a total of 28 hours. WHO criteria including the active initial lesions (IL) were used. MAIN OUTCOME MEASURES: WHO and WHO+IL diagnostic thresholds according to tooth and dental surface. RESULTS: Excellent mean results of intra and inter-examiner Kappa values were found for both diagnostic thresholds, according to tooth and surface, during the calibration phase. The most relevant errors were related to IL diagnosis and to the first permanent molars. When assessed against a benchmark examiner, moderate to high validity values were observed (0.71-1.00), with some loss mainly for sensitivity and positive predictive value, when including IL. CONCLUSION: It was possible and feasible to use the proposed methodology of this study in epidemiological surveys, even with the inclusion of IL. However, further examiner calibration studies are still needed in order to improve and establish a methodology of calibration with this new diagnostic threshold.

Benchmarking↗

Continuous quality improvement for the clinical decision unit.

Clinical decision units (CDUs) are a relatively new and growing area of medicine in which patients undergo rapid evaluation and treatment. Continuous quality improvement (CQI) is important for the establishment and functioning of CDUs. CQI in CDUs has many advantages: better CDU functioning, fulfillment of Joint Commission on Accreditation of Healthcare Organizations mandates, greater efficiency/productivity, increased job satisfaction, better performance improvement, data availability, and benchmarking. Key elements include a database with volume indicators, operational policies, clinical practice protocols (diagnosis specific/condition specific), monitors, benchmarks, and clinical pathways. Examples of these important parameters are given. The CQI process should be individualized for each CDU and hospital.

Benchmarking↗

A culture of patient safety in nursing homes.

BACKGROUND: Few accounts of patient safety initiatives in nursing homes exist. OBJECTIVE: To (1) determine safety culture scores for nursing homes and (2) compare these results with existing data from hospitals. METHODS: Data were collected from a nationally representative sample of nursing homes (n = 2840 completed surveys and a response rate of 71%). From these nursing homes, administrators completed The Hospital Survey On Patient Safety Culture (HSOPSC) instrument. RESULTS: 11 of the 12 HSOPSC subscale scores from the nursing home sample were considerably lower than the benchmark hospital scores. In addition, almost all item scores from nursing homes were considerably lower than the benchmark hospital scores. These results indicate that a less well-developed safety culture exists in nursing homes. CONCLUSIONS: The results clearly show that the patient safety culture scores of nursing homes are considerably lower than those of hospitals. Residents of nursing homes may be at risk of harm as a result of patient safety errors.

Adult↗

An expedited code stroke protocol is feasible and safe.

BACKGROUND AND PURPOSE: Stroke recovery critically depends on timely reperfusion. In July 2003, we set a benchmark onset-to-treatment time of < or =2 hours and instituted an expedited code stroke protocol to accomplish this. We aim to show that the protocol is feasible and safe. METHODS: The expedited protocol includes: Benchmark onset-to-treatment within 2 hours; in-person triage of all code stroke patients; unmixed tissue plasminogen activator at the bedside during evaluation; no delays pending coagulation tests, chest x-ray, or stool guiac unless specifically indicated; and no delays pending formal CT interpretation or written consent. RESULTS: Between July 2003 and June 2005, we evaluated 781 patients and treated 103 of 781 (13.2%) with intravenous recombinant tissue plasminogen activator within 3 hours. Of these, we treated 49 of 103 (47.6%) within 2 hours of symptom onset, and 54 of 103 (52.4%) between 2 and 3 hours. The overall risk of symptomatic intracerebral hemorrhage was 4 of 103 (3.9%; 95% CI, 1.1%, 9.6%), and not significantly different from 6.4% (P=0.42). The hemorrhage risks in those treated within 2 hours of symptom onset and those treated between 2 and 3 hours were not significantly different from each other or from 6.4%. CONCLUSIONS: The expedited code stroke protocol is feasible and appears safe. Further study is warranted to confirm its safety and determine whether it results in better clinical outcomes.

Adult↗

A new scale for assessing perceptions of chance: a validation study.

BACKGROUND: Clinicians and researchers often wish to know how patients perceive the likelihoods of health risks. Little work has been done to develop and validate scales and formats to measure perceptions of event probabilities, particularly low probabilities (i.e., <1%). OBJECTIVE: To compare a new visual analog scale with three benchmarks in terms of validity and reliability. DESIGN: Survey with retest after approximately two weeks. Respondents estimated the probabilities of six events with the new scale, which featured a "magnifying glass" to represent probabilities between 0 and 1% on a logarithmic scale. Participants estimated the same probabilities on three benchmarks: two linear visual analog scales (one labeled with words, one with numbers) and a "1 in x" scale. SUBJECTS: 100 veterans and family members and 107 university faculty and students. MEASURES: For each scale, the authors assessed: 1) validity-the correlation between participants' direct rankings (i.e., numbering them from 1 to 6) and scale-derived rankings of the relative probabilities of six events; 2) test-retest reliability-the correlation of responses from test to retest two weeks later; 3) usability (missing/ incorrect responses, participant evaluation). RESULTS: Both the magnifier and the two linear scales outperformed the "1 in x" scale on all criteria. The magnifier scale performed about as well as the two linear visual analog scales for validity (correlation between direct and scale-derived rankings = 0.72), reliability (test-retest correlation = 0.55), and usability (2% missing or incorrect responses, 65% rated it easy to use). 62% felt the magnifier scale was a "very good or good" indicator of their feelings about chance. The magnifier scale facilitated expression of low-probability judgments. For example, the estimated chance of parenting sextuplets was orders of magnitude lower on the magnifier scale (median perceived chance 10(-5)) than on its linear counterpart (10(-2)). Participants' assessments of high-probability events (e.g., chance of catching a cold in the next year) were not affected by the presence of the magnifier. CONCLUSIONS: The "1 in x" scale performs poorly and is very difficult for people to use. The magnifier scale and the linear number scale are similar in validity, reliability, and usability. However, only the magnifier scale makes it possible to elicit perceptions in the low-probability range (<1%).

Adult↗

National survey of cancer educators: salary and budget.

The National Cancer Institute's Cancer Patient Education Network (CPEN) is composed of cancer education leaders from National Cancer Institute (NCI)-designated comprehensive and clinical cancer centers throughout the United States. Despite this commonality, the role and responsibilities of CPEN members vary across institutions. In an effort to further understand the commonalities and variances among the membership, the authors undertook a research project addressing salary and budget issues across NCI-designated cancer centers. The purpose of this study was to benchmark salaries and budgets of cancer educators at NCI-designated cancer centers; provide information to support a competitive salary range based on benchmarking with peers responsible for cancer patient education; and glean information on CPEN membership, roles, education levels, and job functions. This article highlights lessons learned and offers suggestions for using this information in a broader capacity for other cancer patient educators and patient educators in general.

Benchmarking↗

Assessment of potential risk levels associated with U.S. Environmental Protection Agency reference values.

The U.S. Environmental Protection Agency (U.S. EPA) generally uses reference doses (RfDs) or reference concentrations (RfCs) to assess risks from exposure to toxic substances for noncancer health end points. RfDs and RfCs are supposed to represent lifetime inhalation or ingestion exposure with minimal appreciable risk, but they do not include information about the estimated risk from exposures equal to the RfD/RfC. We used results from benchmark dose modeling approaches recently adopted for use in developing RfDs/RfCs to estimate the risk levels associated with exposures at the RfD/RfC. We searched the U.S. EPA Integrated Risk Information System (IRIS) database and identified 11 chemicals with oral RfDs and 12 chemicals with inhalation RfCs that used benchmark dose modeling. For assessments with sufficient model information, we found that 16 of 21 (76%) of the dose-response models were linear or supralinear. We estimated the risk from exposures at the established RfDs and RfCs for these chemicals using a linear dose-response curve to characterize risk below the observed data. Risk estimates ranged from 1 in 10,000 to 5 in 1,000 for exposures at the RfDs, and from 1 in 10,000 to 3 in 1,000 for exposures at the RfCs. Risk estimates for exposures at the RfD/RfC values derived from sublinear dose-response curves ranged from 3 in 1,000,000,000 to 8 in 10,000. Twenty-four percent of reference values corresponded to estimated risk levels greater than 1 in 1,000; 10 of 14 assessments had points of departure greater than the no-observed-adverse-effect levels. For policy development regarding management of cancer risks, the U.S. EPA often uses 1 in 1,000,000 as a de minimis risk level. Although noncancer outcomes may in some instances be reversible and considered less severe than cancer, our findings call into question the assumption that established RfD and RfC values represent negligibly small risk levels.

Benchmarking↗

Measuring community benefits provided by for-profit and nonprofit hospitals.

Nonprofit hospitals are expected to provide benefits to their community in return for being exempt from most taxes. In this paper we develop a new method of identifying activities that should qualify as community benefits and of determining a benchmark for the amount of community benefits a nonprofit hospital should be expected to provide. We then compare estimates of nonprofits' current level of community benefits with our benchmark and show that actual provision appears to fall short. Either nonprofit hospitals as a group ought to provide more community benefits, or they are performing activities that cannot be measured. In either case, better measurement and accounting of community benefits would improve public policy.

Benchmarking↗

U.S. health system performance: a national scorecard.

This paper presents the findings of a new scorecard designed to assess and monitor multiple domains of U.S. health system performance. The scorecard uses national and international data to identify performance benchmarks and calculates simple ratio scores comparing U.S averages to benchmarks. Average ratio scores range from 51 to 71 across domains of health outcomes, quality, access, equity, and efficiency. The overall picture that emerges from the scorecard is one of missed opportunities and room for improvement. The findings underscore the importance of policies that take a coherent, whole-system approach to change and address the interaction of access, quality, and cost.

Benchmarking↗

Decisions, decisions: analysis of age, cohort, and time of testing on framing of risky decision options.

Decision making in uncertain environments is a daily challenge faced by adults of all ages. Framing decision options as either gains or losses is a common method of altering decision-making behavior. In the experiment reported here, benchmark decision-making data collected in the 1970s by Tversky and Kahneman (1981, 1988) were compared with data collected from current samples of young and older adults to determine whether behavior was consistent across time. Although differences did emerge between the benchmark and the present samples, the effect of framing on decision behavior was relatively stable. The present findings suggest that adults of all ages are susceptible to framing effects. Results also indicated that apparent age differences might be better explained by an analysis of cohort and time-of-testing effects. Actual or potential applications of this research include an understanding of how framing might influence the decision-making behavior of people of all ages in a number of applied contexts, such as product warning interactions and medical decision scenarios.

Adult↗

Characteristics and financial performance of a pediatric faculty inpatient attending service: a resource-based relative value scale analysis.

OBJECTIVES: In many children's hospitals, inpatient attending physician services are provided by academic faculty who function as part-time inpatient specialists or hospitalists. Although some have claimed that hospitalist care can reduce length of stay and total hospital resource use and expenses, there are few benchmarks or data regarding physician productivity or the characteristics and financial performance of these programs. The resource-based relative value scale (RBRVS) is a valuable tool for developing national benchmarks and comparing the financial performance of inpatient programs at varying daily census and reimbursement levels. The objectives of this study were to 1) describe physician productivity on an inpatient service as measured by total relative value units (TRVUs) and professional charges, 2) determine whether inpatient collections were adequate to support faculty salaries for the time spent attending, and 3) develop a model to evaluate financial performance of inpatient programs at varying census and TRVU reimbursement levels. METHODS: A retrospective review of hospital discharge and faculty practice billing data between June 1997 and July 1998 was conducted in a general medical service in a regional, 208-bed, university-affiliated children's hospital in the Pacific Northwest. RESULTS: Of 4113 patients who were admitted to the children's hospital general medical service during a 12-month period, faculty part-time hospitalists (N = 28) served as the attending physician for 1738 (42%). On an annual basis, faculty attended for an average of 29.1 days (median: 21.0; range: 7.0-97.0), with an average daily patient census (ADC) of 7.2 (median: 6.5; range: 2.8-12.0). Inpatient attendings billed for 1738 initial visits and 3957 subsequent visits. Total physician productivity for the inpatient attending group during 1 year included 12 085 TRVUs and gross professional charges of $777 743. The average payment, or conversion factor (CF), was $24.46/TRVU (71% of Medicare CF). The cash collection rate was 38%, reflecting a payor mix that included 54% Medicaid, 28% commercial payors, 12% health maintenance organization, and 6% other payors. On a weekly basis, physicians generated an average of 109 TRVUs and collected $2665 in cash. The average salary cost per RVU was $23.40, and weekly faculty salary and benefit expenses were $2550. After operating expenses and academic taxes totaling 24% were deducted ($5.87/TRVU), RBRVS-based payments and cash collections covered 79% of average faculty weekly salaries. Financial modeling showed that either an average CF of $31/TRVU or an ADC of 9 patients per day on the inpatient service would be required to generate sufficient revenue to support physician salaries and operating expenses. CONCLUSIONS: For a faculty inpatient attending service in a children's hospital with an ADC of 7, a $24.46 RBRVS-based CF payment is inadequate to support faculty salaries and operating expenses for the time spent attending. Inpatient services in similar payor environments with comparable expenses and staffed by faculty who care for fewer than 9 patients per day will not cover typical faculty salary costs and operating expenses.

Benchmarking↗

The value of improving the productivity of the drug development process: faster times and better decisions.

OBJECTIVES: This study examines the financial benefits that can accrue to drug developers from improvements in the drug development process. The effect on drug development costs from faster development, earlier decisions on project failures, and higher approval success rates are quantified. DATA AND METHODS: The results from a recent study of research and development (R&D) costs for new drugs are used as a benchmark against which improvements in the discovery and development processes are simulated. The cost results in the benchmark study were based on a sample of 68 randomly selected investigational drugs from 10 pharmaceutical firms. RESULTS: Simultaneous 25% reductions in phase lengths lower capitalized total cost per approved drug by 16%, or $US129 million; 50% reductions in time lower cost by 29%, or $US235 million. Earlier decisions to terminate research on drugs that will ultimately fail significantly reduce clinical costs. For example, shifting 5% of all clinical failures from phase III/regulatory review to phase I reduces out-of-pocket clinical costs by 5.5 to 7.1%; and capitalized clinical cost is lowered by 5.1 to 6.3%. If more productive discovery programmes or better preclinical screens increase success rates from 21.5% to one in three, firms can reduce capitalized total cost per approved drug by $US221 million to $US242 million. CONCLUSIONS: Whether faster development times, quicker termination decisions or higher success rates derive from public policy initiatives, better management, or new technologies, the impact on R&D costs can be substantial. Ultimately, the increased efficiency could result in more innovation and new therapies reaching patients sooner.

Benchmarking↗

Can we use contingent valuation to assess the demand for childhood immunisation in developing countries?: a systematic review of the literature.

Childhood immunisation is one of the most cost-effective public health interventions, yet its population coverage in low- and middle-income countries is severely limited by the fiscal constraints that health services face. A recent proposal suggested that commitments to purchase vaccines and make them available to developing countries for modest co-payments could solve the problem. However, this is dependent on communities being willing and able to share the cost in this way, which is difficult to assess. One possible method to assess this demand is contingent valuation (CV). This article evaluates the usefulness of using CV in this way, by reviewing applications of CV in developing countries against current 'standards' for CV of immunisation in the literature. A structured review was adopted with reference to the standard frameworks for methodological evaluation. A set of five criteria were developed for evaluating an 'acceptable' CV study: (i) response rate; (ii) association between willingness to pay (WTP) and socioeconomic status (SES); (iii) sensitivity of WTP to benefit scale/scope; (iv) predictive validity; and (v) reliability in elicitation formats. Two strands of literature search were conducted using electronic databases (MEDLINE, EMBASE, HEALTHSTAR and Econlit) from 1966 to 2003, one for CV studies of immunisation and one for CV studies in developing countries. Twelve CV studies of vaccination and 13 CV studies undertaken within developing countries were identified and reviewed. The quality of existing CV studies conducted in developing countries exceeded the benchmark standard set by studies of immunisation in the developed world in four of the five criteria. WTP estimates appeared both internally valid (i.e. associations with SES) and externally valid (i.e. predictive validity), reliability in developing countries was no less than that of the benchmark level in the existing literature, and the high response rates suggested that CV can be administered to a rural, and perhaps less literate, population. Only sensitivity to scale/scope was not well demonstrated. Our assessment indicated that the CV technique offers a promising tool to estimate the demand for childhood immunisation in low- and middle-income countries. International agencies are therefore encouraged to devote resources to such an application when designing their support to the immunisation programmes.

Benchmarking↗

Demonstration of a tool for automatic learning and re-use of knowledge in the activated sludge process.

Wastewater treatment plant operators encounter complex operational problems related to the activated sludge process and usually respond to these by applying their own intuition and by taking advantage of what they have learnt from past experiences of similar problems. However, previous process experiences are not easy to integrate in numerical control, and new tools must be developed to enable re-use of plant operating experience. The aim of this paper is to investigate the usefulness of a case-based reasoning (CBR) approach to apply learning and re-use of knowledge gained during past incidents to confront actual complex problems through the IWA/COST Benchmark protocol. A case study shows that the proposed CBR system achieves a significant improvement of the benchmark plant performance when facing a high-flow event disturbance.

Artificial Intelligence↗