Search PubMed⌕ Search

SEARCH · Search PubMed

Results for “Program Evaluation”

Search indexed PubMed citations on genomics, clinical trials, systematic reviews and public health. Explore titles, authors and supplied subject terms, then open the PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45Linked to original sources
PubMed1992

Linking empirically based theory and evaluation: the Family Bereavement Program.

Evaluated the effects of a theoretically derived program to prevent mental health problems in children who had experienced the death of a parent. The program was designed to improve variables in the family environment which were specified as mediators of the effects of parental death on child mental health. The evaluation design involved the random assignment of families to either an intervention or control group. The program led to parental ratings of increased warmth in their relationships with their children, increased satisfaction with their social support, and the maintenance of family discussion of grief-related issues. The program also led to parent ratings of decreased conduct disorder and depression problems and overall problems in older children. Significant correlations between the family environment variables and child mental health problems provided further empirical support for the theory underlying the program. Implications for program redesign were derived by reconsidering the adequacy of the program components to change theoretically mediating variables.

Adaptation, Psychological↗
PubMed2006

Characterization of Minnesota dairy herds participating in a Johne's disease control program and evaluation of the program risk assessment tool.

The objectives of this study were to: (1) characterize Minnesota dairy herds participating in a Johne's disease control program (JDCP) based on herd size, milk production, and clinical Johne's disease (JD) history, (2) evaluate if change in farm management practices, expressed in risk assessment (RA) total score, is associated with the change between the first and most recent ELISA test herd seroprevalence or change in clinical JD culling rate, and (3) identify farm factors associated with ELISA seroprevalence. A total of 1234 RA, performed between January 2000 and February 2004, were available for analysis from 714 dairy herds. ELISA test results from herd sampling between 2000 and 2004 were obtained from the Minnesota board of animal health (MBAH) database, and were available for 474 herds. Both the first and the most recent ELISA test results for herds with more than one RA were available for 262 herds. Mean herd size and mean annual milk production per cow was higher in JDCP dairy herds (161 milking cows) than either all Minnesota dairy herds or Minnesota dairy herd improvement association (DHIA) herds. For herds with more than one RA available, the most recent RA total score was significantly lower (mean 11% less) than the first. The change in RA total score (and any RA subtotal scores) between the first and most recent RA was not associated with the change between the first and the most recent ELISA within-herd seroprevalence or the change in JD culling rate between the first and most recent RA. The most recent ELISA test results were positively associated with postweaned heifer score and JD culling rate. The RA score was not found to be an effective tool for the prediction of ELISA seroprevalence.

Animal Husbandry↗
PubMed1978

An evaluation of undergraduate family care programs.

Evaluation of the many new family care programs (FCP), and others of similar intent, however defined, is as essential as determining the value of any other curriculum change. Replies to a questionnaire from 101 U.S. and 15 Canadian medical schools indicated that 80% of the former and 93% of the latter had FCPs; 35% and 29%, respectively, were not evaluating their program by any method. No single evaluative technique was used by more than 42% of the American medical schools. A review of the literature on FCPs frequently indicated that the conclusions that could be drawn about the programs were ambiguous. Students in the University of Cincinnati Medical Center FCPs elected family practice or pediatric internships significantly more often than did the FCP nonparticipants, but they indicated that the program had little effect on this choice, despite almost uniformly favorable testimonials. We discuss the possibility that FCPs may be educating the wrong students, that FCPs, if not reinforced in other clinical areas, may have few lasting effects on student attitudes or career choice, and that we may be asking the wrong questions, and with inadequate methods.

Adult↗
PubMed1993

Use of NBME and USMLE examinations to evaluate medical education programs.

Criteria are presented for determining whether licensure and/or achievement test results should be used as a basis for making various types of comparisons and judgments about medical education programs for program evaluation purposes. United States Medical Licensing Examination (USMLE) examinations and National Board of Medical Examiners (NBME) subject tests are then considered as sources of evaluation data for medical education programs by evaluating these examinations in the light of the proposed criteria. It is concluded that NBME examination and USMLE results may properly be considered one of several tools to use in an evaluation of medical education programs but are not recommended as the sole basis for a judgment of program effectiveness. However, care must be taken to ensure that test score differences are large enough to be real and to have practical significance. Furthermore, changes in curriculum should not be considered or implemented on the basis of NBME/USMLE results unless the changes in test scores are maintained for at least two years. The focus should generally be on inordinately high failure rates rather than on changes in mean class scores. Efforts to develop objective, standardized, and controlled measures of other clinical competencies for national use should be encouraged to minimize the temptation to use USMLE Step 1 and Step 2 scores as the sole basis for comparisons of medical education programs.

Education, Medical, Undergraduate↗
PubMed2005

The ACGME core competencies: a national survey of family medicine program directors.

BACKGROUND AND OBJECTIVES: Beginning in July 2002, all residencies were required to show that their residents were obtaining competency in six core areas defined by the Accreditation Council for Graduate Medical Education (ACGME). METHODS: In 2003, we surveyed all 444 family medicine program directors regarding the ACGME Core Competencies and how programs evaluated them. RESULTS: A total of 287/444 (64.6%) responded. Almost all (279/287) had heard of the ACGME Core Competencies, and most (257/287) had begun to implement evaluation programs. Of program directors responding, 67.6% identified patient care as the most important competency. Evaluation methods most frequently used were active precepting (76.0%), record review (72.8%), and procedure logs (63.8%). The least commonly used tools were OSCE (9.1%), audit of computer utilization and knowledge (10.5%), and simulations (11.1%). Respondents identified time (74.3 %) and faculty development (13.0%) as primary implementation barriers. CONCLUSIONS: Program directors believe that patient care is the most important competency. Some programs are not yet attempting to address the competencies, and some were unaware of the accreditation implications of noncompliance with the Outcome Project. Time was identified as the major barrier to implementing core competency evaluation methods.

Data Collection↗
PubMed2002

[Evaluation of the program for timely detection of cervical cancer in Durango, Mexico].

In Mexico, more of 36% of malignant tumors in the women are cervical cancer, representing an important public health problem. Although cytologic screening for cervical cancer was introduced in 1974, the mortality rate for this disease has been increasing. The state of Durango represents the second national place in mortality by CaCu (3.4/100,000). Since there are few the studies of DOC program evaluation in Mexico were considered important to evaluated the cervical screening program (coverage, assiduity, diagnoses and pursuit) in the state of Durango. Of 40,000 active sexually women attended in the IMSS; we received 11,185 slides during May of 1999 to April of 2000 for cytologic screening. The coverage in this population was 27.96% (11,185/40,000), 8,187 women (73.2%) had cytologic control at least previous two years, 652 (5.83%) had more of four years without control and 2,346 (21%) assisted for first time. The cytological diagnostic showed 189 abnormal Pap (1.68%), and only 40 of them (21.16%) had cytohistopatholgic pursuit and clinic treatment. According to these results we concluded that DOC program in Gomez Palacio, Durango has a deficiency of coverage (72.04%) and pursuit (78.84%). These results indicated the need for development institutional activities of prevention for increase efficiency of preventive services.

Carcinoma in Situ↗
PubMed1990

A case mix procedure for matching the clinical characteristics of patients with dual disorders to planned treatment and treatment costs.

A procedure for matching the clinical characteristics of patients with a dual substance abuse psychiatric disorder to planned treatment resource consumption is described. The procedure uses current standards and practices within the mental health literature on dual diagnosed patients, providing an empirical basis for quality assurance, utilization review, and program evaluation. These procedures permit an empirical linking of clinical service performance to the costs of clinical resources, thereby providing a means of: (a) evaluating program costs in terms of the specific clinical characteristics of patients and (b) planning budgets based on the patients' clinical needs. The methods are sufficiently flexible so that as new clinical research recommend changes in assessment and treatment, the case mix definitions and evaluation procedures can be easily modified.

Comorbidity↗
PubMed1982

Medicaid spending and state cost control: assessing policy impact on drug expenditures.

This article introduces a new approach to the study of Medicaid policy and its role in state efforts to limit program costs. The approach is based upon recent work in the field of program evaluation, particularly in the areas of impact assessment and intervention modeling. To illustrate its use in evaluating program changes, the study focuses on policy reforms recently adopted by the state of Maryland as a means of cutting Medicaid expenditures for prescription drugs. Data on spending levels are taken from monthly claims reports filed with the federal government between January, 1974, and December, 1979. Preliminary findings indicate an abrupt decline in program costs following the introduction of new procedures for reimbursing drug providers and the automation of previous procedures for processing payment claims.

Cost Control↗
PubMed1975

Linking planning with evaluation in community mental health.

A suggested example of a systematic approach for linking planning with evaluation is presented. The proposed systematic processes would help deal with the ambiguities of the mental health field and provide a more objective way of planning and evaluating programs. Program evaluation can then be related to the predetermined effectiveness criteria of the planning processes. The planning and evaluation processes are described as a part of a 13-stage cycle of 18 months.

Community Mental Health Services↗
PubMed2001

Journal publications in radiologic education: a review of the literature, 1987-1997.

RATIONALE AND OBJECTIVES: This study was designed to analyze articles on radiologic education quantitatively and qualitatively, comparing those published in 1987-1997 with those published in 1966-1986. MATERIALS AND METHODS: An initial literature search used four major databases to identify and retrieve articles related to radiologic education. Additional articles were identified through manual cross-checking of references from the original articles. All articles were reviewed by two radiologists as to type of article (editorial, expository, survey, correlational, or experimental, including preexperimental, quasi-experimental, or true experimental), statistics used (inferential or descriptive), educational emphasis (medical student, resident, postgraduate, or other), and topic of article (philosophical or political, technology, program evaluation, program description, examinations, or career decisions). Interrater agreement was estimated by means of the kappa statistic. A chi2 test for independence was used to assess whether the relative distribution of articles was similar for the two periods. RESULTS: More articles per year were published in 1987-1997 (n = 12.6, P < .01) compared with 1966-1986 (n = 9.2). Articles pertinent to radiologic resident education predominated (50.7% vs 29.9% in the prior study, P < .01). In both periods, most articles were expository (37.7% vs 49.5%), and the most common topic was program description (34% vs 35%). Editorials decreased from 35.5% to 18.1%. Experimental studies accounted for 12.3%, increased from 8.7%. The fastest-growing topic of study was technology (30.4% vs 17.5%, P < .01). CONCLUSION: The increased number of articles addressing radiologic education is encouraging. Although the percentage of experimental studies increased slightly in this period, there is still little empirical research in radiologic education.

Bibliometrics↗
PubMed1996

Where's the best medicine? The hospital rating game.

On July 18, 1994, U.S. News and World Report published its annual ranking of America's best hospitals. The rankings were based on a model developed by the National Opinion Research Center (NORC). National rankings are a type of program evaluation that deserve careful scrutiny with regard to their methods. While problems with measurement validity are discussed, the principle concern here was the model used to compile a final ranking of hospitals. The News-NORC model is typical of ranking schemes that usually reduce higher levels of measurement to lower ones in order to compute final scores. Such simple tabulation techniques, however, distort the ratios between the scores and bias the results. A type of percentaging, using part/whole percentages (P/W%), was used to show the differences between hospital rankings when data are kept at higher levels of measurement, such as interval or ratio levels. Percentaging methods produce more valid results when comparatively evaluating programs whether the goal is to produce national rankings or some other outcome.

Data Collection↗
PubMed1998

Lives on hold: evaluation of a caregiver's support program.

Evaluation research of a caregiver community-based support program is described. Initially, caregiver-participants characterized their lives as being "on hold." They were overwhelmed, isolated, and lacking time for a personal life. Socialization activities and learning to care for themselves were the most powerful and helpful aspects of the program. Suggestions are made for developing a caregivers' support program within a home healthcare agency.

Adult↗
PubMed2006

Reflections on the evaluation of a Cambodian youth dance program.

Evaluating a youth program whose goals are to provide instruction in Cambodian dance, increase awareness and pride in Cambodian culture, promote healthy behaviors, and create linkages within the community has been a challenge. A primary source of conflict was incorporating evaluation methods that were required of all funded programs with our own specifically tailored measures. One of our concerns was that the required tools were not culturally appropriate for our participants. Our experiences reinforce the importance of forming partnerships that embrace principles of respect, equity, and empowerment among all involved before establishing a research agenda. The choices we made and did not make contributed to our struggles and frustration and also to the insight that was gained. Our analysis examines the importance of clear communication, cultural awareness, tailoring evaluation, and meaningful participation. We believe that the lessons we learned will help facilitate the conduct of culturally sensitive community-based research.

Adolescent↗
PubMed1981

Showing them what you can do: a practical guide for evaluating child life programming.

To successfully compete with other services for scarce hospital funds, Child Life professionals must be able to demonstrate accountability through competent program evaluation. In addition to the function of assessing the achievement of programs goals, evaluation offers an opportunity to educate supervisory personnel by indicating: (1) the value of the services offered, (2) the competence of Child Life personnel and their concern for quality, and (3) the need for additional hospital support. Guidelines for conducting and submitting an evaluation and the relationship between evaluation and the promotion of Child Life goals are discussed.

Child↗
PubMedDate not supplied

The value of student portfolios to evaluate undergraduate nursing programs.

A growing trend in nursing education is the use of student portfolios for program evaluation. Incorporating portfolio analysis into a school's evaluation plan requires that faculty consider how the benefits and limitations of the portfolio development process impact the entire curriculum. The primary benefit of portfolio evaluation is that it permits the correlation of competencies attained by graduates with curricular outcomes. However, portfolio development also promotes increased student responsibility for learning, enhances faculty-student interaction, and facilitates changes in curriculum and instruction. The principal limitations of portfolio evaluation are the lack of research-based evidence that demonstrates the validity and reliability of portfolio analysis, time required to create a portfolio, and documentation storage.

Documentation↗
PubMed1996

How to have a high success rate in treatment: advice for evaluators of alcoholism programs.

Two seasoned alcohol treatment researchers offer tongue-in-cheek advice to novice program evaluators faced with increasing pressure to show high success rates. Based on published examples, they advise: (1) choose only good prognosis cases to evaluate; (2) keep follow-up periods as short as possible; (3) avoid control and comparison groups; (4) choose measures carefully; (5) focus only on alcohol outcomes; (6) use liberal definitions of success; (7) rely solely upon self-report and (8) always declare victory regardless of findings.

Alcoholism↗
PubMedDate not supplied

Impact of the Caring for Aging Relatives Group program: an evaluation.

Caregiver support programs have been developed with the goal of alleviating the stress associated with the demanding role of caring for an older person. The majority of these programs, however, have not been formally evaluated. This study is a formal program evaluation which assessed the impact of a caregiver support program on its participants. Both the intervention and matched comparison groups included a convenience sample of 23 female caregivers. A quasi-experimental pretest-posttest design was used to measure morale, social support, and information. Findings showed there was a positive relationship between morale and social support. In the comparison group only, there was a positive relationship between morale and information in both the pretest and posttest. Within the intervention group, there was a significant increase (t = 2.79, p = 0.01) in the information scores between the pretest and posttest. Caregivers in the intervention group reported that the Caring for Aging Relatives Group (CARG) provided them with social support. The results of this study partially supported the usefulness of a caregiver support program; that is, information was gained, morale was maintained, and caregivers perceived the support program as helpful. Future research is needed to address what factors lead caregivers to attend a support program and what type of social support they receive from attending such a program.

Adult↗
PubMedDate not supplied

Formative evaluation of a nursing orientation program: self-paced vs. lecture-discussion.

Formative program evaluation is a useful process to assess the effectiveness and stability of changes in a program over time. This process documented the effectiveness of changing a medical center nursing orientation program from traditional lecture-discussion to self-learning modules (SLMs). The results of the formative program evaluation confirmed that SLMs were the method of choice for most learners. SLMs focus on adult learning principles more than traditional methods, i.e., lecture-discussion. However, the results of this program evaluation also indicate that staff development educators need to vary teaching methods along with the use of SLMs.

Education, Nursing, Continuing↗