Search PubMed⌕ Search

Biomedical subjects

Jocelyn Lockyer

Publications and source records attributed to Jocelyn Lockyer.

17 recordsLinked to original sources
PubMed2006

The development and testing of a performance checklist to assess neonatal resuscitation megacode skill.

PURPOSE: The purpose of this work was to develop and assess the feasibility, reliability, and validity of a brief performance checklist to evaluate skills during a simulated neonatal resuscitation ("megacode") for the Neonatal Resuscitation Program of the American Academy of Pediatrics. METHODS: A performance checklist of items was created, validated, and modified in sequential phases involving: an expert committee, review, and feedback by Neonatal Resuscitation Program instructors for feasibility and criticality and use of the performance checklist by Neonatal Resuscitation Program instructors reviewing videotaped megacodes. The final 20-item performance checklist used a 3-point scale and was assessed by student and instructor volunteers. Megacode scores, the NRP multiple-choice examination scores, student assessments of their ability and performance, and sociodemographic descriptors for both students and instructors were collected. Data were analyzed descriptively. In addition, we assessed the megacode score internal consistency reliability, the correlations between megacode and multiple-choice examination scores, and the variance in scores based on instructor and student characteristics. RESULTS: A total of 468 students and 148 instructors volunteered for the study. The instrument was reliable and internally consistent. Student's scores were high on most items. There was a significant but low correlation between the megacode score and the written knowledge examination. Instructor and student characteristics had little effect on the variance in scores. CONCLUSIONS: This performance checklist provides a feasible assessment tool. There is evidence for its reliability and validity.

Clinical Competence↗
PubMed2006

Self and peer assessment of pediatricians, psychiatrists and medicine specialists: implications for self-directed learning.

Self-regulation in medicine depends on accurate self-assessment. The purpose of the present study was to examine the discrepancy between self and peer assessments for a group of specialist physicians from internal medicine (IM), pediatrics, and psychiatry clinical domains (i.e., patient management, clinical assessment, professional development, and communication). Data from 304 psychiatrists, pediatricians and internal medicine specialists were used. Each physician had data from an identical self and 8 peer (38 item/4 clinical domains assessment). A total of 2306 peer assessments were available. Physicians were classified into quartiles based on mean assessment peer data and compared with self-assessment data. The analyses showed that self and peer assessment profiles were consistent across specialties and domains. Physicians assessed in the lowest and highest quartiles (i.e., <25th and >75th) by colleagues tended to rate themselves 30-40 percentile ranks higher and lower than peers, respectively. This study suggests that practicing physicians are inaccurate in assessing their own performance. These data suggest that systems to provide practicing physicians with regular and routine feedback may be appropriate if we are to ensure physicians are able to accurately assess themselves in a profession in which self-regulation is predicated upon the assumption that physicians know their capabilities and limitations.

Clinical Competence↗
PubMed2006

Evaluation of learning outcomes in Web-based continuing medical education.

BACKGROUND: There has been significant growth in use of Web-based continuing medical education (CME) by physicians. A number of evaluation and metareview studies have examined the effectiveness of Web-based CME to varying degrees. One of the main limitations of this literature has been the lack of systematic evaluation across different clinical subject matter areas using standardized Web-based CME learning formats. METHOD: One group of pretest-postest designs were used to evaluate knowledge and self-reported confidence change across multiple Web-based courses using a standardized instructional format but comprising distinct clinical subject matter. Participants also completed a participant satisfaction survey and a self-reported retrospective skill/ability change survey. RESULTS: The majority of courses evaluated demonstrated significant pre to post knowledge and confidence effect size change, as well as significant self-reported retrospective practice change. CONCLUSIONS: A Web-based CME instructional format comprising multimedia-enhanced learning tutorials supplemented by asynchronous computer-mediated conferencing for case-based discussions was found to be effective in enhancing knowledge, confidence, and self-reported practice change outcomes across a variety of clinical subject matter areas.

Attitude of Health Personnel↗
PubMed2006

A study of a multi-source feedback system for international medical graduates holding defined licences.

OBJECTIVE: To develop and assess the feasibility and psychometric properties of multi-source feedback questionnaires to monitor international medical graduates practising in Canada under 'defined' licences. METHOD: Four questionnaires (patient, co-worker, colleague and self) were developed and administered in 2 phases through paper-based and telephone or Internet formats. Reliability was assessed with Cronbach's alpha and generalisability coefficient analyses. Validity was established through mean ratings, 'unable to respond' rates and factor analyses. RESULTS: A total of 37 doctors participated in the 2 phases. Overall response rates were 70% for patients, 86% for co-workers, 72% for medical colleagues and 92% for self, with response rates higher for the paper-based format than the Internet and phone formats. The instruments had high internal consistency reliability, with Cronbach's alphas of 0.83 for self-assessment and > 0.90 for the other instruments. The generalisability coefficients were Ep(2) = 0.71 for 25 patients on a 13-item survey, Ep(2) = 0.59 for 8 co-workers on a 13-item survey, and Ep(2) = 0.67 for 8 colleagues on a 21-item questionnaire. The range of mean scores was narrow (between 4 and 5) for all items and all surveys. The factor analyses identified that 2 factors accounted for 70% or more of the variance for the patient and colleague surveys and 60% of the variance for the co-worker survey. CONCLUSION: These data suggest that the instruments have reasonable psychometric properties. Traditional survey methods (i.e. paper-based) yielded better results than Internet or phone methods for this group of doctors.

Accreditation↗
PubMed2005

Twelve tips for effective short course design.

Short courses are commonly used by physicians to stay up-to-date and acquire new skills for practice. Unfortunately, many short courses are not designed to maximize their impact on practice as they fail to acknowledge how people learn and change. Designers of effective short course planning should pay attention to writing outcomes based objectives; conducting needs assessments; determining the optimal content, resources, speakers and format; preparing ancillary materials (handouts and pre- and post-course assessments); and preparing speakers and evaluation. This paper discusses how each of the components of the curriculum design can be used to enhance the learning experience and obtain the desired course outcomes.

Canada↗
PubMed2005

An analysis of the development of a successful medical collaboration to create and sustain family physician anaesthesiology capacity in rural Canada.

BACKGROUND: Initial efforts to increase the availability of training positions, standardise training, and obtain national recognition for family physicians who wished to practise anaesthesia had stalled. OBJECTIVE: To describe the work undertaken to create and sustain family medicine anaesthesiology capacity in Canada. METHODS: In our review, we examined the critical aspects of successful intersectoral work, namely, involvement by key stakeholders; the development of decision-making mechanisms; clearly defined objectives, roles and responsibilities; official support and legitimisation from participating organisations and adequate resources for partnership building. SETTING: Canadian rural family medicine anaesthesiology practice. RESULTS: A small steering committee obtained funding for a national meeting of stakeholders and subsequent committee work over an 18-month period. The national meeting brought together the necessary stakeholders to review and discuss the issues and agree on a group-determined agenda, determine a work plan, identify priority areas and allow the College of Family Physicians of Canada to be the lead organisation in moving the work ahead. Within 18 months, the boards of the key organisations had accepted a common set of standards for training and a national curriculum. Work remains in the longer term to identify sustainable funding for training of family physician as well as the provision of continuing medical education for those trained. CONCLUSIONS: Appropriate attention to the key components of successful intersectoral work may enable previously stalled and complex work to move ahead despite opposition.

Anesthesiology↗
PubMed2005

The nature of the interaction between participants and facilitators in online asynchronous continuing medical education learning environments.

BACKGROUND: MDcme.ca offers an online asynchronous continuing medical education (CME) environment for family physicians. The nature of participation in online CME using computer-mediated conferencing (CMC) discussion systems and the characteristics of interaction between participants and facilitators is not well understood. PURPOSE: To examine the association between participant and facilitator participation in online asynchronous CME learning environments. METHODS: We analyzed registration and participation data including participant and facilitator postings to an asynchronous CMC discussion system for CME programs offered through MDcme.ca using frequency counts. Pearson r correlation was used to assess the association between numbers of participants and participant postings, facilitator postings and participant postings, and the number of discussion items accessed and participant postings. RESULTS: MDcme.ca offered 25 programs to 327 registrants, of whom 180 actually participated by accessing course materials and online discussion postings. Pearson r correlations showed a significant association between the number of participants and the number of postings, the number of facilitator postings and the number of participant postings, and the mean number of discussion items accessed by participants and the overall number of participant postings. DISCUSSION: Both the number of facilitator postings and the number of discussion items accessed by participants appeared to be important determinants of the amount of interaction that will occur in asynchronous online CME. Curriculum planners and facilitators of asynchronous CME need to be aware of the importance of fostering interactive, stimulating discussions if the potential of asynchronous learning for physicians is to reach its potential in supporting higher levels of critical, reflective, practice-based learning.

Attitude of Health Personnel↗
PubMed2004

Knowledge translation: the role and place of practice reflection.

Reflection is the mechanism by which we contemplate and try to understand relatively complex and sometimes troubling ideas for which there is no obvious solution. Reflection allows us to transform current ideas and experiences into new knowledge and action. Personal experiences and organizational feedback can trigger reflection, whereas a lack of time, available colleagues, and social networks detract from the ability professionals have to reflect. Educational programs can encourage reflection through the judicious use of case-based discussion, formal and informal needs assessments, and commitment to change exercises. Learning journals and personal learning projects are self-directed methods that facilitate reflection. In the workplace, critical incident techniques and debriefing of cases provide opportunities for thoughtful inquiry. Additional study is needed to understand how and why reflection works to transform surface learning into deep learning and change in practice; how reflection enhances the integration of reading, collegial interchange, and classroom discussion into practice; and how technology can enhance reflection.

Education, Medical↗
PubMed2004

Hidden curriculum in continuing medical education.

In developing curricula for undergraduate and graduate medical education, educators have become increasingly aware of an interweaving of the formal, informal, and hidden curricula and their influences on the outcomes of teaching and learning. But, to date, there is little in the literature about the hidden curriculum of medical practice, which takes place after graduation and certification. This article initiates that discussion with influences of the hidden curriculum on the actions physicians take or do not take in caring for patients. Hafferty's framework of institutional policies, evaluation activities, resource-allocation decisions, and institutional slang, along with our knowledge of health services research and the continuing medical education (CME) research literature, suggests that there is a hidden and powerful curriculum that affects physician performance. Determining whether the hidden curriculum conflicts with the messages that we are delivering through formal CME (courses, clinical practice guidelines, peer review journals) may contribute to improving our impact on physician performance.

Curriculum↗
PubMed2003

Multisource feedback in the assessment of physician competencies.

Multisource feedback (MSF), or 360-degree employee evaluation, is a questionnaire-based assessment method in which rates are evaluated by peers, patients, and coworkers on key performance behaviors. Although widely used in industrial settings to assess performance, the method is gaining acceptance as a quality improvement method in health systems. This article describes MSF, identifies the key aspects of MSF program design, summarizes some of the salient empirical research in medicine, and discusses possible limitations for MSF as an assessment tool in health care. In industry and in health care, experience suggests that MSF is most likely to succeed and result in changes in performance when attention is paid to structural and psychometric aspects of program design and implementation. A carefully selected steering committee ensures that the behaviors examined are appropriate, the communication package is clear, and the threats posed to individuals are minimized. The instruments that are developed must be tested to ensure that they are reliable, achieve a generalizability coefficient of Ep2 = .70, have face and content validity, and examine variance in performance ratings to understand whether ratings are attributable to how the physician performs and not to factors beyond the physician's control (e.g., gender, age, or setting). Research shows that reliable data can be generated with a reasonable number of respondents, and physicians will use the feedback to contemplate and initiate changes in practice. Performance may be affected by familiarity between rater and ratee and sociodemographic and continuing medical education characteristics; however, little of the variance in performance is explained by factors outside the physician's control. MSF is not a replacement for audit when clinical outcomes need to be assessed. However, when interpersonal, communication, professionalism, or teamwork behaviors need to be assessed and guidance given, it is one of the better tools that may be adopted and implemented to provide feedback and guide performance.

Clinical Competence↗
PubMed2003

Discourse analysis of computer-mediated conferencing in World Wide Web-based continuing medical education.

INTRODUCTION: Computer-mediated conferencing (CMC) is a computer messaging system that allows users to engage in asynchronous text-based communications that are independent of time and place. It has been suggested that CMC is an effective modality for facilitating constructivist learning environments that enable adult learners to engage in a continuous, collaborative process of building and reshaping knowledge and understanding. The goals of this exploratory study were to assess the nature of the interactions and collaborative learning characteristics exhibited in World Wide Web-based continuing medical education courseware programs that used CMC and to examine physicians' satisfaction with on-line CMC discussion as a planned learning activity of Web-based CME. METHOD: The Transcript Analysis Tool (TAT) was used to analyze the nature of the discourse that took place in four different Web-based CME courseware programs. Course evaluation surveys and interviews were also conducted with participants to evaluate their satisfaction with on-line CMC discussion. RESULTS: The results suggest that the nature of participation in the programs consisted primarily of independent messages with a minimal amount of learner-to-learner interaction. Elements of critical reflection, interaction, and debate between participants appeared to be missing from these discussions. As such, these discussions were not characteristic of the principles of constructivist learning environments. DISCUSSION: Interactive participation will not occur just because CMC is being used. The design of Web-based CME learning activities, participant characteristics, and facilitation are key factors that influence the effective use of CMC.

Communication↗
PubMed2003

The use of the opinion leader in continuing medical education.

This paper describes a process evaluation of an opinion leader (OL) project for a geriatric medical education program in dementia. Structured interviews with OLs were conducted to understand their experience as formal OLs from their initial training to the project's completion. Thirteen of 15 physicians involved in an OL project were interviewed. The adoption of a formal educational OL role was not an easy transition for most identified OLs. Some physicians struggled with the role and would have preferred more specific guidance. For this subject some content expertise was felt to be essential. Strong project leadership and some measures of success are important to sustain the OL commitment to a project. More attention needs to be devoted to the appropriate selection and training of OLs for educational projects to ensure that they have the relevant clinical expertise and skills to be effective and feel comfortable adopting a formal OL role.

Aged↗
PubMed2003

Likelihood of change: a study assessing surgeon use of multisource feedback data.

BACKGROUND: Multisource feedback, using questionnaire-based data from patients, coworkers, and medical colleagues, is designed to provide broad-based information about clinical performance to facilitate change. PURPOSE: To determine and explain the likelihood that surgeons would implement change following receipt of performance data. METHODS: Surgeons were surveyed to determine the likelihood they would make changes based on specific feedback about their clinical practices. RESULTS: One hundred fifty-three surgeons (76.5%) responded to the follow-up survey. There was little correlation between performance ratings provided by self or medical colleagues and the likelihood of change. A linear regression analysis indicated that 19.2% of the variance in likelihood to change could be explained by age, time spent reviewing feedback, the gap between self- and other ratings, and surgical specialty. CONCLUSION: Surgeons made few changes in practice in response to feedback data. Attention needs to be paid to methods that might increase surgeon use of performance data

Alberta↗
PubMed2002

Permanent small groups: group dynamics, learning, and change.

INTRODUCTION: The concept of "communities of practice," a special facet of social constructivist learning theory, provides a new template against which we can examine the learning that goes on within permanent small groups of physicians. We interviewed participants and facilitators about the dynamics of these groups, their learning in conjunction with these groups, and the role the facilitator played to see the extent to which they captured the essence of communities of practice. METHODS: Semistructured interviews were conducted with physicians known to be participants or facilitators of small groups that met regularly. A constant comparative method was used for data gathering and analysis leading to coded themes, categories, and subcategories. The coding schemas were tested, the analyses were reviewed, and data were recoded as necessary. To ensure accuracy, interviewees were provided with a preliminary copy of the manuscript to ensure that the interpretation of the data was appropriately handled. RESULTS: Interviews were conducted with 10 facilitators and 22 group members representing 24 different groups of physicians. The groups appeared to function as communities of practice in which the members were supportive of each other's learning and respectful of one another, reporting little conflict. Members preferred to agree to disagree rather than pursue a "right" answer or consensus. Most of the discussion focused on scientific information and the way in which their colleagues approached common problems. Practice refinement rather than new directions in patient care appeared to be the goal. The facilitators in these groups played a key role in providing administrative support for the group and often the energy needed to sustain them. DISCUSSION: Small groups that meet regularly provide a supportive network to share knowledge and validate clinical experience. There is some evidence that the groups have the potential to become communities of practice but do not actually achieve that level of sharing. Research needs to be done to determine how these groups could become more powerful as communities of practice and vehicles for more substantive learning and change.

Attitude of Health Personnel↗