Search PubMed⌕ Search

SEARCH · Search PubMed

Results for “Program Evaluation”

Search indexed PubMed citations on genomics, clinical trials, systematic reviews and public health. Explore titles, authors and supplied subject terms, then open the PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49Linked to original sources

[The evaluation process in the National Program of Continuous Academic Development for the General Physician (PRONADAMEG)].

In this brief diagnostic description of medical education in Mexico, we present the origin and first 10 years of the Program that arose from the agreement for collaboration of the National Academy of Medicine of Mexico and the National Autonomous University of Mexico for development of the general physician. By comparing elements used in the national survey of continuous medical education with that of the Program, we are able to obtain the level achieved through positioning, academic administrative organization, and national coverage. With regard to the characteristics of the Program, evaluation of learning is detailed. We conclude with the observation that the second decide of the Program should be total institutionalization.

Education, Medical, Continuing↗

Evaluation of clinical experience in a radiology residency program with quantitative profiling: rationale, methods, and application.

RATIONALE AND OBJECTIVES: The author developed a technique for residency program evaluation, called "quantitative profiling," that is based on computer retrieval of radiologic reports. The hypothesis was that it would provide insights into the contributions of residents to clinical service, measures of resident experience and productivity for program evaluation, and benchmarks for comparison. MATERIALS AND METHODS: The radiology residency program of a major teaching hospital was studied retrospectively from 1989 to 1997. The number of radiologic reports signed by individual residents and faculty members was retrieved. The clinical experience of the 1993-1997 cohort of residents was described according to subspecialty area and modality. RESULTS: Residents signed 46.5% of all reports, with a mean total of 14,445 reports +/- 1,292 per resident during the entire residency. The distribution of examinations was as follows: thoracic, 42.1%; musculoskeletal, 26.1%; abdominal, 13.4%; sonography, 8.7%; neuroradiology, 4.3%; nuclear, 2.4%; breast, 1.6%; and vascular, 1.4%. The most frequently reported results were for one-view chest radiography. CONCLUSION: Quantitative profiling can help track the range and progress of resident experience, help determine the deployment of residents, and provide empirical data upon which decisions to modify residency programs may be based.

Humans↗

Hepatitis B vaccination of high-risk neonates in the South West Region of New South Wales: evaluation of program coverage.

The authors evaluated the high-risk neonate hepatitis B vaccination program in the South West Region of New South Wales. Infants from ethnic groups with a high rate of chronic hepatitis B virus (HBV) infection and infants of HBV carrier mothers were targeted. The program identified 323 infants born between October 1987 and December 1990 who were at high risk of HBV infection, of whom 68.7 per cent were Aboriginal. Overall, 194 infants (60.1 per cent) received three doses of vaccine. Although the number of infants identified increased from 46 in 1988 to 119 in 1990, the proportion fully vaccinated each year did not increase, remaining at around 60 per cent. The authors stress the importance of promoting the program and educating the high-risk groups and health professionals involved, in order to improve vaccination coverage.

Carrier State↗

Training directors' opinions about the psychiatry resident in-training examination (PRITE).

OBJECTIVE: The American College of Psychiatrists conducted research to validate the content outline of the Psychiatry Resident In-Training Examination (PRITE) and to assess what residency training directors think about the examination. METHOD: A mail survey was sent to the 218 psychiatry residency training directors who subscribe to the PRITE. RESULTS: The survey response rate was 70%. A majority of the respondents indicated agreement with the relative emphasis given to each content area in the PRITE (range = 52%-80% agreement). Eighty-one percent of the respondents were strongly in favor of continuing the practice of releasing the examination and the correct responses each year after the examinations have been scored. The majority of the respondents use results on the PRITE for individual resident evaluation and program evaluation (90% and 94%, respectively). Very few respondents use the PRITE results as the sole measure for assessing residents' cognitive competence or use it for marketing their residency programs. CONCLUSIONS: The survey provided strong support for the content areas covered in the PRITE and their relative emphases. The current practice of releasing PRITE items and answers (a main difference between the PRITE and the certification examination of the American Board of Psychiatry and Neurology) was well supported by the survey results. The stated purpose of the PRITE, to provide educationally useful feedback for individuals and groups in the form of comparisons with peers in specific areas of knowledge, was supported by a large majority of the respondents.

Attitude of Health Personnel↗

Evaluation of a computer tracking program for resident-patient encounters.

OBJECTIVE: To examine the effectiveness of a formal tracking system for residents' clinical experiences. DESIGN: We examined three shifts, selected at random, for each resident (without residents' knowledge) during emergency rotations. Information from patient charts was compared with residents' computerized records for rotation (location and preceptor) and patient (age, sex, diagnosis, and procedure) information. SETTING: The Northeastern Ontario Family Medicine Program, a program designed to provide remote, rural, and northern resident experience. PARTICIPANTS: First-, second-, and third-year residents on emergency rotations in the academic years 1992 to 1994. MAIN OUTCOME MEASURES: Compliance, reliability, and validity of tracking records. RESULTS: Residents recorded patient encounters 88% of the time. Compliance with rotation information was high (100% rotation, 94% preceptor). Agreement on patient age and sex was high. Procedure compliance was somewhat lower (83%). Intrarater reliability (91%) and inter-rater reliability (78%) are acceptably high, as is validity when compared with a gold standard entry (88%). CONCLUSIONS: Regular entry of reliable and valid data is facilitated by the computerized resident-patient encounter tracking program. This computer tool should prove useful for multilevel program evaluation in the future.

Cooperative Behavior↗

A computerized assessment program for forensic science evaluations: a preliminary report.

The development of the innovative use of an on-line, computer-assisted evaluation program is discussed, with a brief review of pertinent literature. The particular applications within a forensic psychiatric center of the Tandem 16 computer system, utilizing both "canned psychological tests" and specialized assessment techniques, are examined and highlighted with a case vignette. A highly relevant problem within forensic psychiatry, malingering or exaggeration of symptoms, is examined in more detail as it relates to computer assessments. The advantages and limitations of a computer-assisted evaluation are described relative to both its clinical and research application.

Adult↗

Using problem-based learning in neurosciences education for medical students.

BACKGROUND: A Curriculum Task Force proposed problem-based learning as one important educational strategy and recommended changes to a traditional medical curriculum. METHODS: This paper describes how a problem-based learning course in neurosciences was developed and has evolved since its inception in the Dalhousie University Faculty of Medicine. The curriculum planning and design phases are outlined, followed by a description of how the course has been implemented and evaluated. RESULTS: Program evaluation results are presented, describing student performance on examinations and their feedback about the course. CONCLUSION: The authors summarize lessons learned and identify future issues to continue the ongoing development of the course.

Curriculum↗

Consumers: from perceptions to participation.

As Winston Churchill once said, "Personally, I am always ready to learn, although I don't always like being taught." In behavioral health, consumers can make important contributions to the design and evaluation of programs and services. As demonstrated by this case study, progress can be made in incremental steps, over several years. Another reason for BABH's success was progression from very concrete projects to an ongoing organizational structure that consumers could identify as providing a role in policy and procedure development, program evaluation, strategic planning, and programmatic changes. Performance improvement professionals, through their contributions to the organizational design of committees and communication structures, are in ideal positions to promote the full participation of consumers across all healthcare settings. Just imagine what could be achieved in understanding how to design systems if current issues and recent research results were routinely explored--such as those by Harrington et al. regarding Medicare beneficiary complaints (2001) and Gines et al. (2001) on chronic care and satisfaction with managed care--with a consistent group of consumers. Consider adding consumer participation as a new exciting goal in the next edition of your performance improvement and strategic plans!

Behavioral Medicine↗

Health professions students as research partners in community oriented primary care.

This paper describes the process of involving health professions students in research in rural primary care and how their research has contributed to the development and expansion of a rural community health center. Since 1978 over 400 students have completed rotations at the center, and more than 200 have been health profession students, including medical, nursing, physician assistant, pharmacy, and health administration students. A total of 96 research projects were completed. These projects lie in two main areas: medical services and community outreach. Those related to medical services include measures of access to care, quality of care audits, clinical guideline development, practice patterns, prevalence studies, and qualitative research. Projects focusing on community outreach include community surveys, screening follow-ups, program evaluation, and program development. Principles that guide the selection and conduct of research projects include: Projects should be directly related to important work of the practice and reflect an interest of the student; projects are structured to include some or all of the following: literature search, data analysis, a visual display of quantitative information (table or graph), and application of relevant statistical tools; the student has a project supervisor; the student is a participant rather than an independent investigator; and a research flow sheet is used to orient students and NRHA staff to the larger research effort. Students are expected to present results, conclusions and recommendations to an appropriate group. Student research has made a significant contribution to both practice activities and practice policies.

Community Health Centers↗

Guidelines for clinical nurse specialist education.

A recent survey of clinical nurse specialist (CNS) programs found significant differences among the programs in the number of classroom and clinical hours required and some variation in curricular content. To address these differences, the National Association of Clinical Nurse Specialists (NACNS) developed Guidelines for Clinical Nurse Specialist Education and charged the Education Committee of NACNS with testing and refining them. This article describes the methods used by the Education Committee to test and refine the Guidelines and presents the finalized document. The 18 Guidelines provide quality indicators for CNS programs in the areas of organization and faculty, program admissions, curriculum, clinical resources and experiences, and program evaluation. NACNS recommends that these Guidelines be used in addition to accreditation standards to evaluate CNS programs and to guide development of new CNS programs.

Curriculum↗

Summer program for pre-matriculating nursing students.

The National League for Nursing reported in 1984 that while Black nursing students represent 15.89% of admissions to baccalaureate programs in the southern region of the United States, they represent only 8.17% of the graduating nursing students. The average percentage of enrolled Black nursing students at the Medical College of Georgia School of Nursing for 1981-85 was only 7.68%. In view of the need for minority nursing students, it is necessary to increase the number of minorities enrolled and to improve retention rates of these students. A Nursing Student Educational Enrichment Program (S.E.E.P.), a summer pre-matriculating curriculum, was developed for minority nursing students which utilized a variety of campus-wide services and was based in the School of Nursing. The S.E.E.P. nursing students attended classes with all campus S.E.E.P. students who were enrolled in other health profession classes, and also completed two courses specific for nursing students: Decision-Making and Therapeutic Communication. This article examines the development and implementation of the nursing courses, with a focus on the curriculum design, program evaluation, and program specifics.

Black or African American↗

A set of BASIC programs to evaluate relationships among protein sequences by optimum alignment and distance matrix analysis.

These six programs evaluate relationships among a number (> 2) of protein (or DNA) sequences. Program 1 automatically computes optimum alignments and total distances for all pairwise sequence combinations over any user desired range of the two gap penalties. Programs 2, 3 and 4 generate a square, symmetrical distance matrix, which can be exported for cluster analysis, or further analysed with programs 5 and 6 to give specific distances between sequences and extract sequence relationships. Data and results are exchanged among these programs, which are written in BASIC and compiled to run on Macintosh (68020/030/040) type machines with coprocessor and at least one MB of RAM. BASIC graphics commands or those for the Macintosh interface are avoided to facilitate use on other machines. Two groups of sequences are used to demonstrate (a) alignment, inter sequence distance calculation and dendrogram generation and (b) specific distance calculation and its usage in detecting sub groups of related sequences in dendrograms.

Algorithms↗

Evaluation of an occupational rehabilitation program.

OBJECTIVE: The purpose of this study was to report the findings of a program evaluation for an occupational rehabilitation program in the Midwest. METHOD: An ex-post facto chart review was performed on 50 charts using demographic data, results from tests of performance and pain measures, and data from patient satisfaction questionnaires to find evidence of excellence in the program, and to identify areas for improvement. RESULTS: Over 97% of the participants actually completed the program and 76% returned to work within 3 months after program completion. Ninety-two percent indicated overall satisfaction with the program, and all aspects of the program were rated with a mean score of 4.25 or above on a 1 to 5 Likert scale. Evaluation of perceived pain scales of the participants indicate no discernable relationship between intensity of pain and successful return to work. CONCLUSION: The program showed a high completion rate, a high return to work rate, and high levels of patient satisfaction. Suggestions for improvement include an increase in use of real and simulated work activities, better documentation of pain measures, better programs to address psychosocial issues, lengthening the program, and increased communication with case managers and professionals outside of the work program.

Adult↗

Measuring the impact of a Web-based data query system: the logic model as a tool in the evaluation process.

A review of program evaluation perspectives, including the concept of a logic model and its applicability to the evaluation of Web-based data query systems (WDQSs), is presented. A logic model is used to flesh out evaluation components of a WDQS, including inputs, constraints, program activities, program outputs, and outcomes. For each component, a list of potential items is presented for inclusion in the model, along with examples of initial, intermediate, and ultimate outcomes for a WDQS. Program evaluation is a process that is important to conduct both early in WDQS development to promote clarity of its vision and objectives and throughout the course of the WDQS implementation and maintenance to ensure that its objectives are being met. Should the WDQS not be producing desirable results, the logic model provides a road map for understanding which activities are not meeting the WDQS's objectives so that the course of WDQS development, implementation, and maintenance may be altered to improve the probability of reaching desirable outcomes.

Internet↗

Primary prevention research: a preliminary review of program outcome studies.

This article reviews 35 drug abuse prevention program evaluations employing drug-specific outcome measures. Many of these evaluations assessed the effects of "new generation" prevention strategies: affective, peer-oriented, and multidimensional approaches. Only 14 studies evaluated purely informational programs. Evaluations were analyzed to ascertain (1) characteristics of the programs under study, (2) characteristics of the research designs, and (3) patterns among findings. This review provides some evidence that the newer prevention strategies may produce more positive and fewer negative outcomes than did older drug information approaches. Over 70% of the programs using the newer strategies produced some positive effects; only 29% showed negative effects. In contrast, 46% of informational programs showed positive effects; 46% showed negative effects. These findings must be approached with great caution, since the research was frequently scientifically inadequate, and since rigor of research was negatively correlated with intensity and duration of program services.

Adolescent↗

Empirically based conversion factors for calculating couple-years of protection.

Couple-years of protection (CYP) is one of several commonly used indicators to assess international family planning efforts. It has been the subject of much debate, relating in part to the specific conversion factors used to translate the quantity of the respective contraceptive methods distributed to a single measure of protection. This article outlines a comprehensive effort to revisit those conversion factors based on the best available empirical evidence. In most instances, the analysis supports previously established standard conversion factors. However, there are two notable departures. Fewer condoms and spermicides are recommended for each CYP (120 vs. 150), primarily because coital frequency among condom users is lower than previously assumed. Furthermore, for sterilization, the authors recommend the use of country or region-specific conversion factors. Every program evaluation indicator has strengths and weaknesses, and the best program evaluation efforts use a variety of indicators. If CYP is used to evaluate programs, however, the authors believe that the conversion factors presented reflect the best available evidence.

Adolescent↗

Sustainable urban development in Brisbane City--the Holy Grail?

Impacts from urban stormwater runoff on receiving environments have been well documented, particularly through specific regional scientific studies. Using various local government planning and management elements, urban developments in Brisbane City are now able to address stormwater management in an increasingly holistic context. One key initiative includes facilitating Water Sensitive Urban Design (WSUD) components within an Integrated Water Management Strategy that looks at policy formation, planning strategies, design option, community marketing and acceptance, maintenance programs and finally evaluation of various WSUD approaches. These can include the use of Natural Channel Designs, grassed swales, bio-filtration systems, porous pavements and roofwater tanks in several economic combinations. By linking with the Cooperative Research Centre for Catchment Hydrology, Brisbane City Council has influenced the design of WSUD planning tools and benefited the city with academic inputs into extensive evaluation programs. As well, it has also contributed to the Cooperative Research Centre's research outcomes. These evaluation programs are increasingly providing better understanding of various stormwater quality best management practices throughout Australia. As part of the overall implementation process, active involvement by a range of stakeholders has been crucial. These stakeholders have included internal planning, development assessment and design staff, external consultants, developers, and other local and state government agencies. The latter two groups are assisting in the important task of "regionalisation" of Brisbane City Council's policies and guidelines. Implementation of WSUD initiatives and stormwater re-use strategies under Council's new "Integrated Water Management" agenda are showing some excellent results, suggesting that sustainable urban development is no longer like the search for the Holy Grail.

Conservation of Natural Resources↗