Search PubMed⌕ Search
Home/Archive/PubMed

PubMed · 16639210

Using an outcomes-logic-model approach to evaluate a faculty development program for medical educators.

Elizabeth G Armstrong·Sylvia J Barsion
View original source ↗Export metadata ↓

Abstract

PURPOSE: This study used an outcomes-logic-model approach to examine the impact of participating in a nontraditional professional development program. Building and using a logic model provides a structure for the program to examine the degree that the desired learner outcomes, the program delivery methods, and the measurement approaches are aligned. METHOD: Structured telephone interviews were conducted in 2001 with 16 Harvard Medical School (HMS) participants in the Harvard Macy Program for Physician Educators (HM-PE): five who completed the program in 1998, five in 1999, and six in 2000. Interviews were also conducted with four Faculty Scholars, alumni of the HM-PE program who taught in subsequent programs. In 2004, online questionnaires were sent to the 16 participants and four Faculty Scholars. Immediate outcomes, such as greater use of active learning principles, and intermediate outcomes, such as commitment to medical education, were examined. RESULTS: Of those interviewed in 2001, 80% responded to the 2004 online questionnaire. Thirteen of 16 (81%) HMS respondents reported increased knowledge about and confidence using learner-center teaching methods; 10 of 16 (63%) said they gave fewer lectures and added alternative educational methods. Thirteen of 16 (81%) reported a stronger commitment to the field of medical education: almost one third felt the HM-PE program was a turning point in their careers. CONCLUSIONS: The outcomes logic model provided data to judge how well the program mission and plan were implemented, and whether outcomes had been attained.

Explore related subjects

BostonCompetency-Based EducationEducation, Medical, ContinuingFaculty, MedicalHumansInterviews as TopicLearningModels, EducationalProgram EvaluationSchools, MedicalStaff DevelopmentSurveys and QuestionnairesTeachingJournal Article

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Elizabeth G Armstrong, Sylvia J Barsion. 2006. Using an outcomes-logic-model approach to evaluate a faculty development program for medical educators.. https://doi.org/10.1097/01.acm.0000222259.62890.71

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related citations

PubMed2007

Multivariate scan statistics for disease surveillance.

In disease surveillance, there are often many different data sets or data groupings for which we wish to do surveillance. If each data set is analysed separately rather than combined, the statistical power to detect an outbreak that is present in all data sets may suffer due to low numbers in each. On the other hand, if the data sets are added by taking the sum of the counts, then a signal that is primarily present in one data set may be hidden due to random noise in the other data sets. In this paper, we present an extension of the spatial and space-time scan statistic that simultaneously incorporates multiple data sets into a single likelihood function, so that a signal is generated whether it occurs in only one or in multiple data sets. This is done by defining the combined log likelihood as the sum of the individual log likelihoods for those data sets for which the observed case count is more than the expected. We also present another extension, where the concept of combining likelihoods from different data sets is used to adjust for covariates. Using data from the National Bioterrorism Syndromic Surveillance Demonstration Project, we illustrate the new method using physician telephone calls, regular physician visits and urgent care visits by Harvard Pilgrim Health Care members cared for by Harvard Vanguard Medical Associates, a large multi-specialty group practice in Massachusetts. For upper and lower gastrointestinal (GI) illness, there were on average 20 telephone calls, nine urgent care visits and 22 regular physician visits per day. The strongest signal was generated by a single data set and due to a familial outbreak of pinworm disease. The second and third strongest signals were generated by the combined strength of two of the three data sets.

Boston↗
PubMed2007

Visual screening for malignant melanoma: a cost-effectiveness analysis.

OBJECTIVE: To evaluate the cost-effectiveness of various melanoma screening strategies proposed in the United States. DESIGN: We developed a computer simulation Markov model to evaluate alternative melanoma screening strategies. PARTICIPANTS: Hypothetical cohort of the general population and siblings of patients with melanoma. Intervention We considered the following 4 strategies: background screening only, and screening 1 time, every 2 years, and annually, all beginning at age 50 years. Prevalence, incidence, and mortality data were taken from the Surveillance, Epidemiology, and End Results Program. Sibling risk, recurrence rates, and treatment costs were taken from the literature. MAIN OUTCOME MEASURES: Outcomes included life expectancy, quality-adjusted life expectancy, and lifetime costs. Cost-effectiveness ratios were in dollars per quality-adjusted life year (US dollars/QALY) gained. RESULTS: In the general population, screening 1 time, every 2 years, and annually saved 1.6, 4.4, and 5.2 QALYs per 1000 persons screened, with incremental cost-effectiveness ratios of US dollars 10,100/QALY, US dollars 80,700/QALY, and US dollars 586,800/QALY, respectively. In siblings of patients with melanoma (relative risk, 2.24 compared with the general population), 1-time, every-2-years, and annual screenings saved 3.6, 9.8, and 11.4 QALYs per 1000 persons screened, with incremental cost-effectiveness ratios of US dollars 4000/QALY, US dollars 35,500/QALY, and US dollars 257,800/QALY, respectively. In higher risk siblings of patients with melanoma (relative risk, 5.56), screening was more cost-effective. Results were most sensitive to screening cost, melanoma progression rate, and specificity of visual screening. CONCLUSIONS: One-time melanoma screening of the general population older than 50 years is very cost-effective compared with other cancer screening programs in the United States. Screening every 2 years in siblings of patients with melanoma is also cost-effective.

Boston↗
PubMed2007

Spaced education improves the retention of clinical knowledge by medical students: a randomised controlled trial.

PURPOSE: Medical knowledge learned by trainees is often quickly forgotten. How can the educational process be tailored to shift learning into longer-term memory? We investigated whether 'spaced education', consisting of weekly e-mailed case scenarios and clinical questions, could improve the retention of students' learning. METHODS: During the 2004-5 surgery clerkships, 3rd-year students completed a mandatory 1-week clinical rotation in urology and validated web-based teaching programme on 4 core urology topics. Spaced educational e-mails were constructed on all 4 topics based on a validated urology curriculum. Each consisted of a short clinically relevant question or clinical case scenario in multiple-choice question format, followed by the answer, teaching point summary and explanations of the answers. Students were randomised to receive weekly e-mailed case scenarios in only 2 of the 4 urology topics upon completion of their urology rotation. Students completed a validated 28-item test (Cronbach's alpha = 0.76) on all 4 topics prior to and after the rotation and at the end of the academic year. RESULTS: A total of 95 of 133 students (71%) completed the end-of-year test. There were no significant differences in baseline characteristics between randomised cohorts. Spaced education significantly improved composite end-of-year test scores (P < 0.001, paired t-test). The impact of the spaced educational e-mails was largest for those students who completed their urology education 6-8 and 9-11 months previously (Cohen's effect sizes of 1.01 and 0.73, respectively). CONCLUSION: Spaced education consisting of clinical scenarios and questions distributed weekly via e-mail can significantly improve students' retention of medical knowledge.

Boston↗