[Educational evaluation in the nursing facility--a precious tool].
Explore the source record for details and available documents.
SEARCH · Search PubMed
Search indexed PubMed citations on genomics, clinical trials, systematic reviews and public health. Explore titles, authors and supplied subject terms, then open the PubMed record.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
This article reviews the published literature on diabetes education evaluations and makes recommendations for outcome measures to be used in future research. We conclude that program evaluations to date have focused too narrowly on assessing knowledge and GHb outcomes to the exclusion of other important variables. To reflect the changing emphasis and conceptual basis of diabetes education, we recommend that future evaluations do the following: 1) report on the program's target population, recruitment methods, and representativeness of participants; 2) collect measures of self-efficacy and patient-provider interaction; 3) include quality of life and patient-functioning outcomes; and 4) use more standardized and objective measures of diabetes management behaviors. We close by providing practical examples of feasible collection measures for most settings and references to studies that have done so.
Evaluation is an important component of developing educational software. Ideally, such evaluation quantifies and qualifies the effects of a new educational intervention on the learning process and outcomes. Conducting meaningful and rigorous educational evaluation is difficult, however. Challenges include defining and measuring educational outcomes, accounting for media effects, coping with practical problems in designing studies, and asking the right research questions. Practical considerations that make the design of evaluation studies difficult include confounding, potentially small effect sizes, contamination effects, and ethics. Two distinct approaches to evaluation are objectivist and subjectivist. These two complement each other in describing the whole range of effects a new educational program can have. Objectivist demonstration studies should be preceded by measurement studies that assess the reliability and validity of the evaluation instrument(s) used. Many evaluation studies compare the performance of learners who are exposed to either the new program or a more traditional approach. However, this method is problematic because test or exam performance is often a weak indicator of competence and may fail to capture important nuances in outcomes. Subjectivist studies are more qualitative in nature and may provide insights complementary to those gained with objectivist studies. Several published examples are used in this article to illustrate different evaluation methods. Readers are encouraged to contemplate a wide range of evaluation study designs and explore increasingly complex questions when evaluating educational software.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Understanding the learning needs of students is a vital step in planning the delivery of effective education. Evaluating the impact of such interventions is not always easy and many methods rely on self-reported behaviour or simple changes in knowledge--whose relationship to action is not always clear. Using conjoint analysis, within the theoretical framework of social judgement theory, this study illustrates a novel means of examining nurses' use of clinical information when diagnosing hypovolemic shock in a series of simulated cases presented via computer. The study examines changes in information usage before and after a traditional lecture. The results show that nurses' information use is not linear and the utility for decision judgement derived from clinical information is not distributed equally. The study also suggests that some clinical information (for example, the Glasgow Coma Score) is not well understood and incorporated into clinical judgement. The study has implications for those designing and evaluating educational interventions and those studying information use, clinical judgement and decision making.
A comprehensive evaluation of the Clinical Education Program (CEP) of the American Diabetes Association on type II diabetes was undertaken in a cohort of 5640 primary-care physicians to determine whether practice patterns are affected by such continuing medical education programs. The educational and behavioral objectives were defined and the extent to which these objectives were met was evaluated by use of questionnaires completed by conference attendees both before and after they participated in the program and by in-office interviews 2 mo later with 288 of the primary-care physicians who had attended the conference. Prior to participation, approximately half of the primary-care physicians described diabetes practice patterns consistent with excellent care. The proportion who stated that they intended to improve their practice patterns increased significantly after the conference. Similarly, the majority of these same physicians knew the basic educational objectives before the conference, with a significant increase in the proportion of physicians knowing these objectives after the conference. The office interviews indicated that the changes noted in the proportion of physicians intending to carry out a practice at the end of the conference were sustained or actually increased in this cohort. Exceptions to this trend occurred in the area of use of glucosylated hemoglobin and perhaps in the area of periodic assessment of macrovascular circulation. Two interesting additional findings from the in-office interviews were that physicians prefer the conference format for learning and that distribution of printed material alone is not very effective in influencing knowledge and behavior in primary-care physicians. The CEP met its educational and behavioral objectives.(ABSTRACT TRUNCATED AT 250 WORDS)
Evaluation is important for accountability, for planning, and for learning how to continuously refine and improve nutrition education with low-income families. The tools described in this special issue are intended to provide a resource to such evaluations. The special issue grew out of a series of USDA working groups to identify evaluation tools for nutrition education with low-income families.* I express my thanks to the many individuals who contributed to this effort.
This paper analyses the methodological issues inherent in evaluating healthcare education and considers approaches for addressing these. Recent policies have exhorted practitioners to base their practice on evidence; however in healthcare education the evidence base is not extensive. Whilst educational evaluation has advanced in the last decades, standardised designs and toolkits are not available. Each evaluation has different aims and occurs in specific contexts, thus the design has to fit the circumstances, yet meet the challenge of scientific credibility. Indicators of educational processes and outcomes are not scientifically verified; no toolkit of standardised 'off-the-shelf' valid, reliable and sensitive measures exists. The evidence base of educational practice is largely derived from small-scale, single case studies; the majority of measures are self-devised, unvalidated tools of unproven reliability, thus meta-synthesis is not appropriate and results are not generalisable. Healthcare educational evaluators need valid and reliable assessments of both knowledge acquisition and its application to practice. The need to establish and explain attribution, i.e. the relationship between educational inputs and outcomes is complex and requires experimental/quasi-experimental design. In addition, educational evaluators face the pragmatic challenge of practice in healthcare contexts, where confounding variables are hard to control and resources are scarce.
In this paper, the history of educational evaluation is considered through a review of the literature, in order to try and understand how current evaluation methods have developed. It is important that a historical perspective is gained, as there has been a big shift in thinking from a strongly behaviourist code of practice to a more investigative and less prescriptive approach, during the relatively short time span that evaluation has had to develop as a subject in its own right. The application of the theory to practice is also considered in terms of a working evaluation model developed through work on continuing education courses in Scotland.
Explore the source record for details and available documents.
Systematic evaluations of nursing educational programs can be difficult, time-consuming, contentious, and unrewarding processes. Yet there is little doubt of the value of a well-designed, systematic evaluation. Nurse educators and administrators currently face challenges to maximize the value of educational resources by increasing productivity, allocating resources appropriately, and accounting for their use. Credible, ongoing evaluations are necessary for meeting these challenges and maintaining high standards in nursing education. Several heuristic models are available to assist nurse educators and administrators in establishing systematic, ongoing processes of program evaluation. Each of the models described offers a slightly different perspective and organizing framework. Each also has various advantages and disadvantages, depending on individual program needs.