Search PubMed⌕ Search

Biomedical subjects

Yvonne Steinert

Publications and source records attributed to Yvonne Steinert.

14 recordsLinked to original sources

A systematic review of faculty development initiatives designed to improve teaching effectiveness in medical education: BEME Guide No. 8.

BACKGROUND: Preparing healthcare professionals for teaching is regarded as essential to enhancing teaching effectiveness. Although many reports describe various faculty development interventions, there is a paucity of research demonstrating their effectiveness. OBJECTIVE: To synthesize the existing evidence that addresses the question: "What are the effects of faculty development interventions on the knowledge, attitudes and skills of teachers in medical education, and on the institutions in which they work?" METHODS: The search, covering the period 1980-2002, included three databases (Medline, ERIC and EMBASE) and used the keywords: staff development; in-service training; medical faculty; faculty training/development; continuing medical education. Manual searches were also conducted. Articles with a focus on faculty development to improve teaching effectiveness, targeting basic and clinical scientists, were reviewed. All study designs that included outcome data beyond participant satisfaction were accepted. From an initial 2777 abstracts, 53 papers met the review criteria. Data were extracted by six coders, using the standardized BEME coding sheet, adapted for our use. Two reviewers coded each study and coding differences were resolved through discussion. Data were synthesized using Kirkpatrick's four levels of educational outcomes. Findings were grouped by type of intervention and described according to levels of outcome. In addition, 8 high-quality studies were analysed in a 'focused picture'. RESULTS: The majority of the interventions targeted practicing clinicians. All of the reports focused on teaching improvement and the interventions included workshops, seminar series, short courses, longitudinal programs and 'other interventions'. The study designs included 6 randomized controlled trials and 47 quasi-experimental studies, of which 31 used a pre-test-post-test design. KEY POINTS: Despite methodological limitations, the faculty development literature tends to support the following outcomes: Overall satisfaction with faculty development programs was high. Participants consistently found programs acceptable, useful and relevant to their objectives. Participants reported positive changes in attitudes toward faculty development and teaching. Participants reported increased knowledge of educational principles and gains in teaching skills. Where formal tests of knowledge were used, significant gains were shown. Changes in teaching behavior were consistently reported by participants and were also detected by students. Changes in organizational practice and student learning were not frequently investigated. However, reported changes included greater educational involvement and establishment of collegiate networks. Key features of effective faculty development contributing to effectiveness included the use of experiential learning, provision of feedback, effective peer and colleague relationships, well-designed interventions following principles of teaching and learning, and the use of a diversity of educational methods within single interventions. Methodological issues: More rigorous designs and a greater use of qualitative and mixed methods are needed to capture the complexity of the interventions. Newer methods of performance-based assessment, utilizing diverse data sources, should be explored, and reliable and valid outcome measures should be developed. The maintenance of change over time should also be considered, as should process-oriented studies comparing different faculty development strategies. CONCLUSIONS: Faculty development activities appear highly valued by participants, who also report changes in learning and behavior. Notwithstanding the methodological limitations in the literature, certain program characteristics appear to be consistently associated with effectiveness. Further research to explore these associations and document outcomes, at the individual and organizational level, is required.

Cooperative Behavior↗

The Professionalism Mini-evaluation Exercise: a preliminary investigation.

BACKGROUND: As the evaluation of professional behaviors has been identified as an area for development, the Professionalism Mini-Evaluation Exercise (P-MEX) was developed using the mini-Clinical Examination Exercise (mini-CEX) format. METHOD: From a set of 142 observable behaviors reflective of professionalism identified at a McGill workshop, 24 were converted into an evaluation instrument modeled on the mini-CEX. This instrument, designed for use in multiple settings, was tested on clinical clerks in medicine, surgery, obstetrics and gynecology, psychiatry, and pediatrics. In all, 211 forms were completed on 74 students by 47 evaluators. RESULTS: Results indicate content and construct validity. Exploratory factor analysis yielded 4 factors: doctor-patient relationship skills, reflective skills, time management, and interprofessional relationship skills. A decision study showed confidence intervals sufficiently narrow for many measurement purposes with as few as 8 observations. Four items frequently marked below expectations may be identifiers for "problem" students. CONCLUSION: This preliminary study suggests that the P-MEX is a feasible format for evaluating professionalism in clinical training.

Clinical Clerkship↗

From novice to informed educator: the teaching scholars program for educators in the health sciences.

The Teaching Scholars Program for Educators in the Health Sciences at McGill University, in Montreal, Quebec, was designed to promote the professional development of health science educators by increasing their expertise in developing and implementing educational programs and taking on leadership roles in education. This program, which was initiated in 1997 and is tailored to the individual needs of the participants, consists of participation in: two university courses; a monthly seminar; a research study or an educational project, consisting of curriculum design and evaluation; and faculty-wide faculty development activities. As of 2006, 34 scholars have completed this program. Outcome data indicate that the majority of teaching scholars have taken on new roles and responsibilities in medical education; maintained the changes implemented in their teaching practices; continued to participate in faculty development activities; and presented their work at educational meetings. A number of scholars have also applied successfully for educationally related grants and have published their educational projects. Five of the scholars have pursued advanced studies. This program, which aims to move beyond the improvement of teaching skills by providing a foundation for educational leadership and scholarship, resembles many others in its emphasis on independent study, peer support, and the maintenance of ongoing responsibilities. It is innovative in that scholars participate in university courses and are encouraged to attend an "outside" conference or course. The overall benefits of this program, as noted by the scholars, include increased knowledge and skills, introduction to a "community of practice," and new career paths and opportunities.

Adult↗

Faculty development: principles and practices.

Instructors in the health professions today must acquire knowledge and competencies that go beyond disciplinary expertise. It is now generally accepted that educational training as a teacher is essential to a faculty member's effectiveness as an educator. The educational challenges across the health professions share many similarities. In this article, we draw on the medical education literature and focus on faculty development designed to enhance teaching effectiveness. We first address commonly included faculty development topics, including instructional improvement, organizational development, the development of professional academic skills, and the teaching of specific content areas. We then review a variety of educational approaches and formats that are described in the literature. Included in this discussion are commonly used workshops, seminars, short courses, and fellowships, as well as longitudinal programs, peer coaching, mentorship, self-directed learning, and computer-aided instruction. We also briefly explore learning at work and in communities of practice, and we discuss several frequently encountered challenges in designing and implementing faculty development activities, including motivating colleagues and assessing program effectiveness. We conclude the discussion by presenting a set of guidelines for the design of effective faculty development programs.

Education, Veterinary↗

Surgery residents and attending surgeons have different perceptions of feedback.

Feedback plays an important role in Postgraduate Medical Education and is indispensable in surgical training. Improvement in operating skills, for example, requires constant feedback between teacher and learner to promote reflection on performance. Prior to providing workshops on giving effective feedback, the goal of this study was to assess the perceptions of attending surgeons and residents on feedback practices in our program. We show a startling disparity in perceptions of feedback frequency and skills. The results were used in planning a Workshop on Giving Feedback for our faculty. The effectiveness of this Workshop will be assessed at a later date by administering the same questionnaire.

Attitude of Health Personnel↗

Learning together to teach together: interprofessional education and faculty development.

Interprofessional education for collaborative patient-centered practice has been identified as a key mechanism to address health care needs and priorities. Faculty development can play a unique role in promoting interprofessional education (IPE) by addressing some of the barriers to teaching and learning that exist at both the individual and the organizational level, and by providing individuals with the knowledge and skills needed to design and facilitate IPE. This article highlights a number of approaches and strategies that can facilitate IPE. In particular, it is recommended that faculty development initiatives aim to bring about change at the individual and the organizational level; target diverse stakeholders; address three main content areas, notably interprofessional education and collaborative patient-centred practice, teaching and learning, and leadership and organizational change; take place in a variety of settings, using diverse formats and educational strategies; model the principles and premises of interprofessional education and collaborative practice; incorporate principles of effective educational design; and consider the adoption of a dissemination model to implementation. Clearly, faculty members play a critical role in the teaching and learning of IPE and they must be prepared to meet this challenge.

Canada↗

Faculty development for teaching and evaluating professionalism: from programme design to curriculum change.

INTRODUCTION: The recent emphasis on the teaching and evaluation of professionalism for medical students and residents has placed significant demands on medicine's educational institutions. The traditional method of transmitting professional values by role modelling is no longer adequate, and professionalism must be taught explicitly and evaluated effectively. However, many faculty members do not possess the requisite knowledge and skills to teach this content area and faculty development is therefore required. PROGRAMME DESCRIPTION: A systematic, integrated faculty development programme was designed to support the teaching and evaluation of professionalism at our institution. The programme consisted of think tanks to promote consensus and "buy-in", and workshops to convey core content, examine teaching strategies and evaluation methods, and promote reflection and self-awareness. PROGRAMME EVALUATION: The programme was evaluated using a CIPP (context, input, process, product) analysis. The institution supported this initiative and local expertise was available. A total of 152 faculty members, with key educational responsibilities, attended 1 or more faculty development activities. Faculty participation resulted in agreement on the cognitive base and attributes of professionalism, consensus on the importance of teaching and evaluating professionalism, and self-reported changes in teaching practices. This initiative also led to the development of new methods of evaluation, site-specific activities and curriculum change. DISCUSSION: A faculty development programme designed to support the teaching and evaluation of professionalism can lead to self-reported changes in teaching and practice as well as new educational initiatives. It can also help to develop more knowledgeable faculty members, who will, it is hoped, become more effective role models.

Curriculum↗

Student perceptions of effective small group teaching.

PURPOSE: The goal of this study was to assess student perceptions of effective small group teaching during preclinical training in a medical school that promotes an integrated, systems-based undergraduate curriculum. In particular, students were asked to comment on small group goals, effective tutor behaviours, pedagogical materials and methods of evaluation. METHODS: Six focus groups were held with 46 Year 1 and 2 medical students to assess their perceptions of effective small group teaching in the 'Basis of Medicine' component of the undergraduate curriculum. Ethnographic content analysis guided the interpretation of the focus group data. RESULTS: Students identified tutor characteristics, a non-threatening group atmosphere, clinical relevance and integration, and pedagogical materials that encourage independent thinking and problem solving as the most important characteristics of effective small groups. Tutor characteristics included personal attributes and the ability to promote group interaction and problem solving. Small group teaching goals providing included opportunities to ask questions, to work as a team, and to learn to problem solve. CONCLUSION: This study highlighted the benefits of soliciting student impressions of effective small group teaching. The students' emphasis on group atmosphere and facilitation skills underscored the value of the tutor as a 'guide' to student learning. Similarly, their comments on effective cases emphasised the importance of clinical relevance, critical thinking and the integration of basic and clinical sciences. This study also suggested future avenues for research, such as a comparison of student and teacher perceptions of small group teaching as well as an analysis of perceptions of effective small group learning across the educational continuum, including undergraduate, postgraduate and continuing professional education.

Attitude of Health Personnel↗

The ABCs of pedagogy for clinical teachers.

BACKGROUND: Clinical teachers rarely receive formal instruction in the basic concepts and principles of education. It is usually assumed that expertise as a practitioner will translate into effectiveness as a teacher. PURPOSE: To identify the important concepts and pedagogic principles, which, if known and understood by clinical practitioners, might enhance their teaching prowess and success. METHOD: We developed a long list of potentially important concepts identified in the education literature. We then conducted a 3-round Delphi expert opinion-soliciting process to identify which of the concepts were of most importance to clinical teachers. RESULTS: Thirteen of the 14 panel members successfully completed the process and achieved 94% reliability in rating the potential importance of the concepts on the e-mailed ratings list. CONCLUSION: We have identified a limited list of core pedagogic concepts, knowledge of which may enhance the success of clinical teachers.

Curriculum↗

Executive skills for medical faculty: a workshop description and evaluation.

As the healthcare system continues to change, healthcare professionals will need to assume an increasing number of administrative and management responsibilities. The goal of this article is to describe a two-day workshop on Executive Skills for Medical Faculty and the results of an evaluation conducted one year later. This workshop consisted of specific modules on analyzing time-management skills, determining goals and priorities, improving time-management strategies, assessing leadership styles and skills, and conducting effective meetings. The workshop evaluation consisted of an immediate post-workshop questionnaire administered to all of the participants, and semi-structured interviews, conducted on the telephone, with half of the attendees. Both evaluations were designed to assess perceptions of the workshop's usefulness and areas of individual change. Feedback from the participants immediately after the workshop indicated an overall satisfaction with the workshop content and methodology and a desire to try new time-management strategies. Evaluation of the workshop one year later indicated that the majority of the participants had determined their priorities more clearly, altered their time-management strategies, and planned more effective meetings. Less change was noted in the area of leadership styles and skills. Both the immediate and delayed workshop evaluations indicated that the most useful sessions were those devoted to determining goals and priorities, time management and effective meetings. These results suggest that a two-day workshop can improve health care professionals' administrative and management skills in certain areas. A longer workshop and built-in 'follow-up' activities would enhance the potential for change.

Attitude of Health Personnel↗

A teaching scholars program to develop leaders in medical education.

The authors describe a year-long faculty development initiative to develop leaders in medical education. The Teaching Scholars Program for Educators in the Health Sciences at McGill University enables faculty to improve their educational knowledge and skills while maintaining their clinical, teaching, and research responsibilities. The program, tailored to the participant's individual needs, consists of five main components: two university courses; independent study; participation in faculty-wide faculty development workshops and medical education rounds; a monthly seminar; and attendance at a national or international conference or course. Since its inception in 1997, 22 faculty members have completed the program; four are currently participating in it. This report discusses the experience of 15 scholars who completed the program by September 2000. Evaluations indicate that the scholars achieved most of their stated objectives. The university courses provided a foundation in educational principles and methodology; independent study allowed them to work on educational projects relevant to their disciplines; and the monthly seminars, faculty development workshops, and outside courses offered opportunities for skill acquisition and reflection. Participants also appreciated the opportunity to meet others interested in medical education and to become aware of available educational resources. A year after completing the program, many had joined new educational committees, taken on new leadership roles in medical education, and developed new courses for students and residents. Some of their projects had been presented at national meetings and were being prepared for publication. Two scholars had pursued further study at a master's level. Despite the ongoing challenge of protecting time for educational pursuits, this program has been beneficial in helping to develop educational leaders in the Faculty of Medicine.

Curriculum↗

An online discussion for medical faculty: an experiment that failed.

OBJECTIVE: Although online discussion groups are being used with increasing frequency in undergraduate and postgraduate education, their usefulness in faculty development has not been explored. The goal of this innovation was to offer an online discussion group following a faculty development workshop in order to reinforce workshop concepts and to allow participants to seek advice related to specific teaching and learning problems. We also wanted to assess the benefits of this educational tool. DESCRIPTION: We originally wanted to implement an online discussion group following a one-day workshop "The "Problem" Resident: Whose Problem Is It?" However, once this proposal was presented to our academic administrators, they asked us not to implement the discussion group because of concerns related to confidentiality and due process. They were worried that an online discussion might replace the faculty's evaluation and promotion guidelines, that teachers might no longer go to the "right" person to discuss a problem, and that we would give teachers a false sense of security. To respect these concerns, we changed the discussion topic and decided to implement an online discussion following a workshop "Promoting Interaction in Small-group Teaching." We chose this venue because it was less "emotionally charged" and because online discussions are seen as a potential adjunct to small-group teaching. We introduced the idea of a facilitated WebCT group discussion at the end of the workshop, and gave faculty members clear instructions on how to access the discussion group. Most of the workshop participants liked the idea of a follow-up to the workshop, but they preferred an e-mail listserv. We therefore decided to offer the WebCT discussion group to half of the participants, and an e-mail listserv to the others. To initiate the discussion, we posted several issues for both groups, and we awaited the participants' responses. To our surprise, only two individuals (8%) responded on the e-mail listserv, after several attempts to stimulate discussion. DISCUSSION: In looking back at our "medical experiment" we were disappointed that our efforts to facilitate an online discussion following a faculty development workshop were not successful. However, based on personal reflections and conversations with a number of the workshop participants, we feel that some important lessons were learned. Time and competing demands clearly pose a major barrier. In addition, the "perceived need" of the initiative is critical. Our faculty members did not see the need for discussing interactive small-group teaching techniques online. Faculty members' comfort with technology must also be considered. Many of our teachers were not familiar with the potential uses of online learning. Moving faculty development beyond workshops also remains a challenge. With these lessons in mind, we plan to initiate another online discussion with faculty members, based on a need that they have defined around a topic that they have identified as critical to their own development as faculty members. We continue to believe that follow-up activities are essential in faculty development and that we need to further assess the potential value of this educational method.

Communication↗

Improving teachers' skills in working with 'problem' residents: a workshop description and evaluation.

Working with 'problem' residents is a common challenge in medical education. This article describes a workshop designed to improve teachers' skills in this area as well as the results of an evaluation conducted to assess its effectiveness. Workshop modules focused on defining the problem, confirming the diagnosis, designing and implementing the intervention, and assuring residents' rights. Feedback on the workshop indicated that the participants were satisfied with the workshop content and format, and that they particularly valued the framework by which to analyze resident problems, gather relevant information, and design the intervention. Results on a self-assessment questionnaire indicated that the participants increased their knowledge in problem definition, data gathering, and the principles underlying an intervention strategy. This experience suggests that a two-day workshop focusing on the 'problem' resident can increase teachers' skills in working with 'problem' residents and can be adapted to diverse settings and disciplines.

Journal Article↗