Search PubMed⌕ Search

SEARCH · Search PubMed

Results for “Program Evaluation”

Search indexed PubMed citations on genomics, clinical trials, systematic reviews and public health. Explore titles, authors and supplied subject terms, then open the PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 829 records · Page 46Linked to original sources

Improving management through evaluation: techniques and strategies for family planning programs.

Evaluation aimed at providing managers with the information needed for day-to-day decision making has generally received less emphasis in family planning programs than evaluation of long-term programmatic and demographic achievements. A series of evaluation techniques are reviewed that are applicable to the key management areas of operational target setting, administrative monitoring, measuring interim achievements, and cost concerns. Barriers to such evaluation inherent in the training of and relationship between managers and evaluators are reviewed, and means to ease the barriers are proposed.

Costs and Cost Analysis↗

Evaluating prevention programs with the Results Mapping evaluation tool: a case study of a youth substance abuse prevention program.

The harmful effects of alcohol and other drug abuse are widespread. Our health care, social service, education and legal systems are strained under the impact of substance abuse, not to mention the economic costs associated with substance abuse. Consequently, effective strategies which prevent substance abuse must be identified and replicated. Yet, user-friendly and cost-effective evaluation tools for community-based substance abuse prevention programs are rare. A recently developed tool that has promise to overcome some of the barriers which exist when evaluating prevention programs is 'Results Mapping'. Results Mapping documents and aims to quantify the contributions of a program to future outcomes of its target population with the intention of making data meaningful at the program and funding agency level. This case study was conducted to assess the feasibility of implementing the Results Mapping evaluation tool for community-based prevention programs. The study assessed qualitatively how well Results Mapping worked for one community-based substance abuse prevention program, as well as how much time and funding it took to implement this new tool. Results suggested that Results Mapping may be a valuable documentation, planning and learning tool, but funding agencies should be cautious about using Results Mapping scores to determine funding allocations.

Adolescent↗

An inexpensive hospital-based program for outcome evaluation.

A relatively low-cost outcome evaluation program was developed for a 147-bed psychiatric hospital with a variety of inpatient programs and extensive outpatient and partial hospital facilities. The evaluation staff consists of the research director, a senior research assistant, and a secretary. Much of the program's data comes from documents completed by clinical staff, which are then scanned by an optical mark-reading scanner. The data are automatically entered into a data base and analyzed using PC-based software, SPSS for Windows. Data are used to produce in-house reports that are distributed to clinical programs and the hospital's quality assurance committee. This in-house system can be tailored to an individual hospital's needs and is a less expensive alternative to evaluation by an external contractor.

Adolescent↗

Patient satisfaction with an antepartum home-care program.

Evaluation of patient satisfaction with alternative health-care delivery models is an important component of program evaluation. Patient satisfaction occurs when there is congruence between expected care and the care received. This descriptive study investigated patient satisfaction with the Antepartum Home Care Program in Winnipeg, Canada. A convenience sample of 66 pregnant women completed the Antepartum Home Care Program Evaluation Questionnaire. Most respondents were very satisfied with the physical and emotional care they received at home, including the information they received. Ninety-eight percent of the women indicated that the care they received from the program met their expectations. Being able to receive care at home, rather than in the hospital, was the most frequently identified benefit of the Antepartum Home Care Program. These results will assist program planners with decisions concerning program improvements and growth.

Adolescent↗

Development and implementation of a web-based evaluation system for an internal medicine residency program.

Evaluation and feedback are fundamental components of graduate medical education. Paper-based evaluation systems are inefficient and costly and the evaluation data they provide are difficult to retrieve and analyze. In view of these problems, in 1996-1997, the authors developed and implemented a World Wide Web-based electronic evaluation system for the internal medicine residency program at the University of Minnesota. Residents were evaluated using the American Board of Internal Medicine Resident Evaluation Form. Custom evaluations were created for the assessment of sites, rotations, and faculty. The evaluations were completed by accessing an evaluation Web site from any location using standard computers and Web browsers. The evaluations were submitted electronically and automatically entered into a database. The system tracked compliance and automatically sent out reminders. Other features of the system included extensive reporting capabilities, automatic notification of substandard performance, and the ability to send confidential information to the program director. The total compliance rate ranged between 81% and 92% during the first 12 months of operation, with no significant difference in compliance observed between faculty and residents. The system was easy to use and could quickly and confidentially identify performance problems of residents and faculty from large numbers of evaluations.

Educational Measurement↗

NLM Medical Library Resource Improvement Grant Program: an evaluation.

The Extramural Programs, NLM, undertook a staff study to evaluate the Medical Library Resource Improvement Grant Program in order to determine impact on hospital library development and to assess factors significant to regional medical library (RML) network development. Initiated in fiscal year 1971, the improvement grant program provides one-year, one-time grant awards of a maximum of $3,000 to assist in establishing a basic collection of books, journals, and other health science information resources for community hospitals and comparable health facilities. Applicants who received grant awards were compared to applicants who did not receive awards and to nonapplicants, using nine dependent variables, four independent variables, and responses to an RML questionnaire. Results show that the applicants who received awards outperformed the other groups, and that the improvement grant program has been successful in stimulating library development. As a result of this study, the improvement grant program will be modified to support consortium arrangements as well as individual institutions, and to extend the period of grant support to two years. Future grant support will be a maximum of $4,000 in the first year, and up to $3,000 with a provision of $1,000 in matching funds from the grantee in the second year.

Economics, Hospital↗

Optimizing evaluation of nursing education programs.

Program evaluation data must be meaningful, credible, objective, and responsive. The content, inputs, process, and product model provides an effective and useful framework for organizing the evaluation process. The model is a decision/accountability-oriented approach that emphasizes both proactive and retroactive evaluation to assess program improvement and quality. The authors describe the steps used in developing an evaluation plan to address undergraduate, graduate, and specialty standards and to serve as a framework for data collection, decision-making, continuous quality improvement, and demonstration of outcomes.

Accreditation↗

Understanding evaluations of home visitation programs.

This journal issue comprises reports concerning program evaluations of key national home visitation models. No single evaluation can answer all the questions of interest about a program, nor is any evaluation perfect, which means that readers must carefully weigh the intended purpose of the evaluation and the evaluation's strengths and weaknesses before deciding what conclusions can credibly be drawn from its results. This article begins with a discussion of the role of evaluation both in improving programs and in determining program effects. The choices required to craft a strong and methodologically rigorous evaluation are described: what outcomes to measure and how; what methods to use in designing the evaluation and building a comparison group; how many participants to enroll; and how to devise a strong plan for data analysis involving subgroups of the enrolled families. The article then discusses additional factors policymakers and practitioners should consider when interpreting the results of home visiting evaluations: attrition, the policy and functional importance of the outcomes, and the likely generalizability of the results to other communities or other populations. The evaluations that appear in this journal issue are used as examples throughout the article, and the measures that were used in those evaluations are summarized. The evaluations included in this journal issue have both strengths and weaknesses but are probably among the better evaluations in the home visiting field.

Child↗

[What is the effect of therapeutic programs? An evaluation of a diabetic care program in Sogn and Fjordane].

The impact of a regional treatment programme for diabetes has been evaluated through a questionnaire to general practitioners in the region. The programme differs from other programmes with respect to the size of the target group and the process by which it was made. 53 general practitioners responded (response rate 78). 24 (45%) of them claim to have changed their practice as a consequence of the programme. The changes are further described. The effects are compared with those of other treatment programmes. The ability of treatment programmes to change doctors' behaviour is briefly discussed.

Diabetes Mellitus↗

Updates and five-year evaluation of the S.A.F.E. program: a family psychoeducational program for serious mental illness.

This brief report reviews recent updates to the S.A.F.E. Program, a family psychoeducational intervention for serious mental illness created in the Veterans Affairs (VA) system. The improvements and significant content additions to the curriculum are outlined. Further, positive five-year program evaluation data are described, including high levels of participant retention and satisfaction. Program attendance is positively correlated with understanding of mental illness, awareness of VA resources, and ability to engage in self-care activities-and inversely correlated with caregiver distress. This data lays the groundwork for a randomized clinical trial and raises questions about the necessity of diagnostic-specific family programming.

Adaptation, Psychological↗

Evaluating the program effects of a radio drama about AIDS in Zambia.

This study describes an approach to the analysis of data that is designed to isolate program effects for evaluations and applies that approach to a program in Zambia designed to disseminate AIDS information. Evidence is considered that a radio drama broadcast for nine months had an impact on knowledge and behavior related to AIDS among Bemba speakers in northern Zambia. Using results from large sample surveys (1,600 men and women), conducted before and after the drama was broadcast, the analyses compare changes in knowledge and behavior in those most likely and least likely to have listened to the broadcast. While the population as a whole had improved its knowledge substantially, and some people reported having reduced risky behavior, attributing these changes to the program itself was not possible.

Acquired Immunodeficiency Syndrome↗

Evaluating clinical programs: methodological guidelines.

Evaluations can be defined as investigations of the merits of clinical programs, and they provide information about program goals/objectives, processes, outcomes, impact, and costs. How can reliable and credible evaluations be conducted? In this article, criteria are given for posing evaluation questions; selecting samples and research designs; collecting, analyzing, interpreting, and reporting data.

Drug Information Services↗

Models for evaluating nursing education programs.

Systematic evaluations of nursing educational programs can be difficult, time-consuming, contentious, and unrewarding processes. Yet there is little doubt of the value of a well-designed, systematic evaluation. Nurse educators and administrators currently face challenges to maximize the value of educational resources by increasing productivity, allocating resources appropriately, and accounting for their use. Credible, ongoing evaluations are necessary for meeting these challenges and maintaining high standards in nursing education. Several heuristic models are available to assist nurse educators and administrators in establishing systematic, ongoing processes of program evaluation. Each of the models described offers a slightly different perspective and organizing framework. Each also has various advantages and disadvantages, depending on individual program needs.

Education, Nursing↗

Designing an evaluation for a multiple-strategy community intervention: the North Coast Stay on Your Feet program.

Evaluation of the North Coast Stay on Your Feet falls prevention program is described as a case study of a comprehensive evaluation design for multi-strategic community interventions. Qualitative and quantitative methods were used to evaluate the program at formative, process and outcome levels. Formative evaluation used literature review, focus groups, mail-out and telephone survey methods to gather evidence from publications, older people, health workers, local business, media and government bodies. It included an analysis of demographic and hospital databases and identified incidence, causal pathways, knowledge, attitudes, behaviour, consequences and effectiveness of potential strategies. Process evaluation employed auditing, monitoring and telephone surveys to maintain an inventory of intervention activities and to track the reach of the program. Outcome evaluation involved a longitudinal study of intervention and control cohorts, surveyed before, during and after the intervention by telephone to monitor changes in knowledge, attitudes, risk and falls incidence. The survey instrument was designed for both formative and outcome evaluation, and analysis reflected the research design by incorporating repeat measures and adjusting for bias and confounding. Outcome validity was cross-checked via hospital admission rates. A novel, integrated framework for presenting inputs, activities and outcomes from all stages of the program is described. This framework facilitated feedback to stakeholders and enabled subsequent rapid adjustment of the intervention. Rigorous evaluation combined with clear presentation of findings helped to engender intersectoral support and obtain funding grants for extended implementation and evaluation. It also helped Stay on Your Feet to become a model for other falls prevention programs within Australia and internationally.

Accidental Falls↗

Overcoming barriers to evaluating federal health education and training programs.

The effectiveness of federal programs is often difficult to measure because many are authorized to support a broad range of objectives without common outcome goals, measures, and reporting requirements. When direct program evaluation is not possible, it may be possible instead to evaluate how well the strategies that federal programs support have worked to achieve certain objectives. This alternative to direct program evaluation was demonstrated in a General Accounting Office review of federal health professions education and training programs within Titles 7 and 8 of the Public Health Service Act.

Financing, Government↗