Search PubMed⌕ Search

PubMed · 10726219

Evaluating faculty development outcomes by using curriculum vitae analysis.

Abstract

BACKGROUND AND OBJECTIVES: Many faculty development (FD) programs depend on external private and public sponsors that routinely require systematic studies on FD outcomes. The results of evaluation studies can influence whether or not programs continue to be funded. To better evaluate program outcomes on academic productivity, this paper presents and illustrates an evaluation method that uses the curricula vitae (CVs) of FD program graduates. METHODS: The evaluation method is implemented by first preparing a record-review template of coding categories that is applied to FD graduates' updated CVs. Next, semi-structured interviews are held with subjects to resolve uncertain CV codes. Finally, coded data are entered into standardized forms and analyzed to yield descriptive findings. The method was piloted with two groups of FD graduates (n = 17) to determine its utility and limitations. RESULTS: Results show excellent inter-rater reliability (Cohen's Kappa = .79). There was an overall increase in productivity, measured by the CV, during and after the FD program. CONCLUSIONS: CV analysis can be a useful method for assessing FD program outcomes. Several limitations of the method, such as incomplete CVs and self-report bias, must be considered.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

J A Morzinski, D B Schubot. 2000. Evaluating faculty development outcomes by using curriculum vitae analysis.. https://pubmed.ncbi.nlm.nih.gov/10726219/

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related citations

A boosting approach to flexible semiparametric mixed models.

In linear mixed models the influence of covariates is restricted to a strictly parametric form. With the rise of semi- and non-parametric regression also the mixed model has been expanded to allow for additive predictors. The common approach uses the representation of additive models as mixed models. An alternative approach that is proposed in the present paper is likelihood based boosting. Boosting originates in the machine learning community where it has been proposed as a technique to improve classification procedures by combining estimates with reweighted observations. Likelihood based boosting is a general method which may be seen as an extension of L2 boost. In additive mixed models the advantage of boosting techniques in the form of componentwise boosting is that it is suitable for high dimensional settings where many explanatory variables are present. It allows to fit additive models for many covariates with implicit selection of relevant variables and automatic selection of smoothing parameters. Moreover, boosting techniques may be used to incorporate the subject-specific variation of smooth influence functions by specifying 'random slopes' on smooth effects. This results in flexible semiparametric mixed models which are appropriate in cases where a simple random intercept is unable to capture the variation of effects across subjects.

Cohort Studies↗

Estimation of attributable number of deaths and standard errors from simple and complex sampled cohorts.

Estimates of the attributable number of deaths (AD) from all causes can be obtained by first estimating population attributable risk (AR) adjusted for confounding covariates, and then multiplying the AR by the number of deaths determined from vital mortality statistics that occurred in the population for a specific time period. Proportional hazard regression estimates of adjusted relative hazards obtained from mortality follow-up data from a cohort is combined with a joint distribution of risk factor and confounders to compute an adjusted AR. Two estimators of adjusted AR are examined. These estimators differ according to which reference population is used to obtain the joint distribution of risk factor and confounders. Two types of reference populations were considered: (i) the population represented by the baseline cohort and (ii) a population that is external to the cohort. Methods used in survey sampling are applied to obtain estimates of the variance of the AD estimator. These variances can be applied to data that range from simple random samples to multistage stratified cluster samples, which are used in national household surveys. The variance estimation of AD is illustrated in an analysis of excess deaths due to having a non-ideal body mass index using the second National Health and Examination Survey (NHANES) Mortality Study and the 1999-2002 NHANES. These methods can also be used to estimate the attributable number of cause-specific deaths and their standard errors when the time period for the accrual of deaths is short.

Cohort Studies↗

Longitudinal variable selection by cross-validation in the case of many covariates.

Longitudinal models are commonly used for studying data collected on individuals repeatedly through time. While there are now a variety of such models available (marginal models, mixed effects models, etc.), far fewer options exist for the closely related issue of variable selection. In addition, longitudinal data typically derive from medical or other large-scale studies where often large numbers of potential explanatory variables and hence even larger numbers of candidate models must be considered. Cross-validation is a popular method for variable selection based on the predictive ability of the model. Here, we propose a cross-validation Markov chain Monte Carlo procedure as a general variable selection tool which avoids the need to visit all candidate models. Inclusion of a 'one-standard error' rule provides users with a collection of good models as is often desired. We demonstrate the effectiveness of our procedure both in a simulation setting and in a real application.

Cohort Studies↗