Search PubMed⌕ Search

Biomedical subjects

R Reznick

Publications and source records attributed to R Reznick.

At least 19 recordsLinked to original sources

Getting teams to talk: development and pilot implementation of a checklist to promote interprofessional communication in the OR.

BACKGROUND: Pilot studies of complex interventions such as a team checklist are an essential precursor to evaluating how these interventions affect quality and safety of care. We conducted a pilot implementation of a preoperative team communication checklist. The objectives of the study were to assess the feasibility of the checklist (that is, team members' willingness and ability to incorporate it into their work processes); to describe how the checklist tool was used by operating room (OR) teams; and to describe perceived functions of the checklist discussions. METHODS: A checklist prototype was developed and OR team members were asked to implement it before 18 surgical procedures. A research assistant was present to prompt the participants, if necessary, to initiate each checklist discussion. Trained observers recorded ethnographic field notes and 11 brief feedback interviews were conducted. Observation and interview data were analyzed for trends. RESULTS: The checklist was implemented by the OR team in all 18 study cases. The rate of team participation was 100% (33 vascular surgery team members). The checklist discussions lasted 1-6 minutes (mean 3.5) and most commonly took place in the OR before the patient's arrival. Perceived functions of the checklist discussions included provision of detailed case related information, confirmation of details, articulation of concerns or ambiguities, team building, education, and decision making. Participants consistently valued the checklist discussions. The most significant barrier to undertaking the team checklist was variability in team members' preoperative workflow patterns, which sometimes presented a challenge to bringing the entire team together. CONCLUSIONS: The preoperative team checklist shows promise as a feasible and efficient tool that promotes information exchange and team cohesion. Further research is needed to determine the sustainability and generalizability of the checklist intervention, to fully integrate the checklist routine into workflow patterns, and to measure its impact on patient safety.

Communication↗

Toward reliable operative assessment: the reliability and feasibility of videotaped assessment of laparoscopic technical skills.

BACKGROUND: Decision making on the competency of surgical trainees to perform laparoscopic procedures has been hampered by the lack of reliable methods to evaluate operative performance. The goal of this study was to develop a feasible and reliable method of evaluation. METHODS: Twenty-nine senior surgical residents were videotaped performing a low anterior resection and a Nissen fundoplication in a pig. Ten blinded laparoscopists rated the videos independently on two scales. Rating time was minimized by allowing raters to fast-forward through the tapes at their discretion. Interrater reliability and the time required to rate a procedure were assessed. RESULTS: Rating time per procedure was a median of 15 min (range, 6-40). The mean interrater reliability for the two scales was 0.74. CONCLUSIONS: The use of videotapes of operations enabled multiple raters to assess a performance reliably and shortened assessment times by 80%. This assessment technique shows potential as a means of evaluating the performance of advanced laparoscopic procedures by surgical trainees.

Clinical Competence↗

Communication failures in the operating room: an observational classification of recurrent types and effects.

BACKGROUND: Ineffective team communication is frequently at the root of medical error. The objective of this study was to describe the characteristics of communication failures in the operating room (OR) and to classify their effects. This study was part of a larger project to develop a team checklist to improve communication in the OR. METHODS: Trained observers recorded 90 hours of observation during 48 surgical procedures. Ninety four team members participated from anesthesia (16 staff, 6 fellows, 3 residents), surgery (14 staff, 8 fellows, 13 residents, 3 clerks), and nursing (31 staff). Field notes recording procedurally relevant communication events were analysed using a framework which considered the content, audience, purpose, and occasion of a communication exchange. A communication failure was defined as an event that was flawed in one or more of these dimensions. RESULTS: 421 communication events were noted, of which 129 were categorized as communication failures. Failure types included "occasion" (45.7% of instances) where timing was poor; "content" (35.7%) where information was missing or inaccurate, "purpose" (24.0%) where issues were not resolved, and "audience" (20.9%) where key individuals were excluded. 36.4% of failures resulted in visible effects on system processes including inefficiency, team tension, resource waste, workaround, delay, patient inconvenience and procedural error. CONCLUSION: Communication failures in the OR exhibited a common set of problems. They occurred in approximately 30% of team exchanges and a third of these resulted in effects which jeopardized patient safety by increasing cognitive load, interrupting routine, and increasing tension in the OR.

Anesthesia Department, Hospital↗

Forming professional identities on the health care team: discursive constructions of the 'other' in the operating room.

BACKGROUND: Inter-professional health care teams represent the nucleus of both patient care and the clinical education of novices. Both activities depend upon the'talk' that team members use to interact with one another. This study explored team members' interpretations of tense team communications in the operating room (OR). METHODS: The study was conducted using 52 team members divided into 14 focus groups. Team members comprised 13 surgeons, 19 nurses, nine anaesthetists and 11 trainees. Both uni-disciplinary (n = 11) and multi-disciplinary (n = 3) formats were employed. All groups discussed three communication scenarios, derived from prior ethnographic research. Discussions were audio-recorded and transcribed. Using a grounded theory approach, three researchers individually analysed sample transcripts, after which group discussions were held to resolve discrepancies and confirm a coding structure. Using the confirmed code, the complete data set was coded using the 'NVivo' qualitative data analysis software program. RESULTS: There were substantial differences in surgeons', nurses', anaesthetists', and trainees' interpretations of the communication scenarios. Interpretations were accompanied by subjects' depictions of disciplinary roles on the team. Subjects' constructions of other professions' roles, values and motivations were often dissonant with those professions' constructions of themselves. CONCLUSIONS: Team members, particularly novices, tend to simplify and distort others' roles and motivations as they interpret tense communication. We suggest that such simplifications may be rhetorical, reflecting professional rivalries on the OR team. In addition, we theorise that novices' echoing of role simplification has implications for their professional identity formation.

Clinical Competence↗

Teaching invasive perinatal procedures: assessment of a high fidelity simulator-based curriculum.

OBJECTIVE: Learning curves pose a difficult problem in the teaching of technical skills: how do you teach procedural skills without compromising patients' health? A simulator-based curriculum has been designed to minimize the risks to patients undergoing amniocentesis by shifting the learning curve away from patients and into the laboratory. This study evaluated the effectiveness of a high-fidelity simulator-based curriculum in improving the performance of amniocentesis by obstetric trainees. DESIGN: Thirty trainees received a course on the practice of amniocentesis. The curriculum consisted of a lecture, a syllabus, and a hands-on training session with the simulator. Pre- and post-training performance were evaluated with two rating scales. Training and performance evaluation were completed using the same simulator. The effectiveness of the simulator-based workshop and the effect of year of training were assessed using a two-way analysis of variance. RESULTS: Performance scores improved from a mean score of 55% to 94% using checklist scoring and from 57% to 88% using global ratings. The two-way analysis of variance revealed a significant effect of training (F1,60 = 43.57; P < 0.001) accounting for 45% of the variance in scores, and a significant effect of experience level (F2,60 = 9.16; P < 0.001) accounting for 25% of the variance in scores. CONCLUSIONS: A comprehensive curriculum based on a high-fidelity simulator was effective at improving skills demonstrated on the simulator. The challenge remains to establish that skills acquired on a simulator are transferable to the clinical setting.

Amniocentesis↗

Exporting a technical skills evaluation technology to other sites.

BACKGROUND: The Objective Structured Assessment of Technical Skill (OSATS) is a multistation performance-based examination that assesses the technical skills of surgery residents. This study explores the implementation issues involved in remote administration of the OSATS focusing on feasibility and the psychometric properties of the examination. METHODS: An eight-station OSATS was administered to surgical residents in Los Angeles and Chicago. The University of Toronto and the local institutions shared responsibility for organization and administration of the examination. RESULTS: There was good reliability for both the checklist (alpha = 0.68 for LA, 0.73 for Chicago) and global rating forms (alpha = 0.82 for both sites). Both iterations also showed evidence of construct validity, with a significant effect of training year for the checklist and global rating forms at both sites (analysis of variance: F = 8.66 to 19.93, P <0.01). Despite some challenges, the model of central organization and peripheral delivery was effective for the administration of the examinations. CONCLUSIONS: Two iterations of the OSATS at remote sites demonstrated psychometric properties that are highly consistent with previously reported data suggesting that the examination is portable. Both faculty and residents indicated satisfaction with the examination experience. A model of central administration with peripheral delivery was feasible and effective.

California↗

Structured assessment of minor surgical skills (SAMSS) for family medicine residents.

PURPOSE: To develop a valid and reliable examination to assess the technical proficiency of family medicine residents' performance of minor surgical office procedures. METHOD: A multi-station OSCE-style examination using bench-model simulations of minor surgical procedures was developed. Participants were a randomly selected group of 33 family medicine residents (PGY-1 = 16, PGY-2 = 17) and 14 senior surgical residents who functioned as a validation group. Examiners were qualified surgeons and family physicians who used both checklists and global rating scales to score the participants' performances. RESULTS: When family medicine residents were evaluated by family physicians, interstation reliabilities were .29 for checklists and .42 for global ratings. When family medicine residents were evaluated by surgeons, the reliabilities were .53 for checklists and .75 for global ratings. Interrater reliability, measured as a correlation for total examination scores, was .97. Mean scores on the examination were 60%, 64%, and 87% for PGY-1 family medicine, PGY-2 family medicine, and surgery residents, respectively. The difference in scores between family medicine and surgery residents was significant (p < .001), providing evidence of construct validity. CONCLUSION: A new examination developed for assessing family medicine residents' skills with minor surgical office procedures is reliable and has evidence for construct validity. The examination has low reliability when family physicians serve as examiners, but moderate reliability when surgeons are the evaluators.

Ambulatory Surgical Procedures↗

Internal sphincterotomy is superior to topical nitroglycerin in the treatment of chronic anal fissure: results of a randomized, controlled trial by the Canadian Colorectal Surgical Trials Group.

PURPOSE: This was a multicenter, randomized, controlled trial to compare the effectiveness of topical nitroglycerin with internal sphincterotomy in the treatment of chronic anal fissure. METHODS: Patients with symptomatic chronic anal fissures were randomly assigned to 0.25 percent nitroglycerin tid or internal sphincterotomy. Both groups received stool softeners and fiber supplements and were assessed at six weeks and six months. RESULTS: Ninety patients were accrued, but 8 were excluded from the analysis because they refused internal sphincterotomy after randomization (6), the fissure healed before surgery (1), or a fissure was not observed at surgery (1). There were 38 patients in the internal sphincterotomy group (22 males; mean age, 40.3 years) and 44 patients in the nitroglycerin group (15 males; mean age, 38.7 years). At six weeks 34 patients (89.5 percent) in the internal sphincterotomy group compared with 13 patients (29.5 percent) in the nitroglycerin group had complete healing of the fissure (P = 5x10(-8)). Five of the 13 patients in the nitroglycerin group relapsed, whereas none in the internal sphincterotomy group did. At six months fissures in 35 (92.1 percent) patients in the internal sphincterotomy group compared with 12 (27.2 percent) patients in the nitroglycerin group had healed (P = 3x10(-9)). One (2.6 percent) patient in the internal sphincterotomy group required further surgery for a superficial fistula compared with 20 (45.4 percent) patients in the nitroglycerin group who required an internal sphincterotomy (P = 9x10(-6)). Eleven (28.9 percent) patients in the internal sphincterotomy group developed side effects compared with 37 (84 percent) patients in the nitroglycerin group (P<0.0001). Nine (20.5 percent) patients discontinued the nitroglycerin because of headaches (8) or a severe syncopal attack (1). CONCLUSIONS: Internal sphincterotomy is superior to topical nitroglycerin 0.25 percent in the treatment of chronic anal fissure, with a high rate of healing, few side effects, and low risk of early incontinence. Thus, internal sphincterotomy remains the treatment of choice for chronic anal fissure.

Administration, Topical↗

Using operative outcome to assess technical skill.

BACKGROUND: This study examined whether an operative product and time to completion could serve as measures of technical skill. METHODS: Nine final-year (PGY5) and 11 penultimate-year (PGY4) general surgery residents participated in a 6-station bench model examination. Time to completion was recorded. Twelve faculty surgeons (2 per station) evaluated the quality of the final product using a 5-point scale. RESULTS: The mean interrater reliability was 0. 59 for product quality. Interstation reliability was 0.59 for analysis of the final product and 0.72 for time to completion. There was 63% and 78% agreement between attendings' ratings and product quality and time scores respectively. PGY5s' mean product quality score was 4.14 +/- 0.26, compared with 3.82 +/- 0.33 for PGY4s (P < 0.05). PGY5s' mean time was 110 +/- 19 minutes compared with PGY4s' 132 +/- 15 (P < 0.05). CONCLUSIONS: Analysis of the operative end product and time to completion offer efficient alternatives to on-line examiner scoring for bench model examinations of technical competence.

Benchmarking↗

Testing technical skill via an innovative "bench station" examination.

BACKGROUND: A new approach to testing operative technical skills, the Objective Structured Assessment of Technical Skill (OSATS), formally assesses discrete segments of surgical tasks using bench model simulations. This study examines the interstation reliability and construct validity of a large-scale administration of the OSATS. METHODS: A 2-hour, eight-station OSATS was administered to 48 general surgery residents. Residents were assessed at each station by one of 48 surgeons who evaluated the resident using two methods of scoring: task-specific checklists and global rating scales. RESULTS: Interstation reliability was 0.78 for the checklist score, and 0.85 for the global score. Analysis of variance revealed a significant effect of training for both the checklist score, F(3,44) = 20.08, P <0.001, and the global score, F(3,44) = 24.63, P <0.001. CONCLUSIONS: The OSATS demonstrates high reliability and construct validity, suggesting that we can effectively measure residents' technical ability outside the operating room using bench model simulations.

Clinical Competence↗

A new assessment tool: the patient assessment and management examination.

BACKGROUND: The major goal of certification is to assure the public that the candidate is competent in all facets required of the position. The patient assessment and management examination (PAME) was developed to enable a more comprehensive assessment of competence in the practice of surgery. METHODS: A six-station, 3-hour, standardized-patient-based evaluation was developed. Each station was scored using a set of five-point global rating scales. PAME results were compared to the last two in training evaluation reports (ITER), the clinical knowledge component of the ITER (ITER-CK), an in-house oral examination (OE), and the Canadian Association of General Surgeons' multiple-choice examination (CAGS). RESULTS: Eighteen senior general surgery residents were evaluated. Overall reliability was 0.70 (Cronbach's alpha). Fifth-year residents scored significantly better than fourth-year residents (t = 3.062; p = 0.0074), with 1 year of training accounting for 37% of the variance in scores. Correlations between the PAME and each of the other measures were ITER, 0.24; ITER-CK, 0.38; OE, -0.13; and CAGS, 0.061, with the PAME demonstrating better reliability and stronger evidence of validity than any other. CONCLUSIONS: The PAME had better psychometric properties than other measures and assessed areas often not evaluated. This type of evaluation may be useful for feedback, remediation, or certification decisions.

Adult↗

Objective structured assessment of technical skill (OSATS) for surgical residents.

BACKGROUND: The technical skill of surgical trainees is not well assessed. This study aimed (1) to compare the reliability of three scoring systems, (2) to compare live and bench formats and (3) to assess construct validity of a test of operative skill. METHODS: Parallel examinations of operative skill, one using live animals and one using simulations, were developed. Performance was graded using operation-specific checklists, detailed global rating forms and pass/fail judgements. Twenty surgical residents each took both formats. RESULTS: Disattenuated correlations between live and bench scores were high (0.69-0.72). Mean interrater reliability across stations ranged from 0.64 to 0.72. Internal consistency was moderate to high (alpha: 0.61-0.74) for the live format using the checklist and for live and bench formats using global ratings. Global ratings discriminated between resident levels for both formats (bench: F(2,17) = 4.45, P < 0.05; live: F(2,17) = 3.55, P < 0.05), checklists did not. CONCLUSION: This preliminary study suggests that the Objective Structured Assessment of Technical Skill can reliably and validly assess surgical skills. Global ratings are a better method of assessment than task-specific checklists. Bench model simulation gives equivalent results to use of live animals for this test format.

Clinical Competence↗

Squamous cell carcinoma in perineal inflammatory disease.

Four patients with squamous cell carcinoma of the perineal region were diagnosed and treated during the last 4 years in our institutions. The underlying diagnoses consisted of recurrent pilonidal disease, Crohn's disease, and hidradenitis suppurativa. In all patients, a pattern of a long-term inflammatory process was evident. Current concepts regarding the pathophysiology of a chronic inflammatory state and malignant transformation are reviewed. We conclude that regardless of the original pathology, all chronic inflammatory processes in the perineal region should be evaluated for malignant degeneration. A high index of suspicion may potentiate an early diagnosis, possibly improving the chance of cure.

Abscess↗

Validation of an objective structured assessment of technical skill for surgical residents.

PURPOSE: This study examined the concurrent validity of the Objective Structured Assessment of Technical Skill (OSATS), a new test of technical skill for general surgery residents. METHOD: Twelve residents (six in their senior, or fifth, year and six in their junior, or third, year) at the University of Toronto in 1994-95 were ranked within level of training according to their OSATS marks and by surgical faculty. Correspondence between OSATS and faculty rankings was assessed using Spearman rank-order correlation coefficients. RESULTS: The correlations between test scores and faculty rankings were generally high for the senior residents but low for the junior residents. CONCLUSION: Scores on the OSATS accurately reflect the independent opinions of faculty regarding the technical skills of senior residents, suggesting that it is a valid measure of technical skill for these individuals. The scores did not, however, reproduce faculty rankings of the junior residents. Whether this was a failing of the OSATS or the faculty rankings requires further study.

Clinical Competence↗

The consistency and uncertainty in examiners' definitions of pass/fail performance on OSCE (objective structured clinical examination) stations.

The Medical Council of Canada has made use of examiners' pass/fail classifications of candidates' behaviors in objective structured clinical examination (OSCE) stations in defining cutting scores for these stations. This process assumes that there is consistency in the judgments of examiners employed in the same stations at different testing sites and in the cutting scores derived from these judgments. These assumptions were tested using the results of the fall 1993 administration of part 2 of the Medical Council of Canada's Evaluating Examination to 744 candidates. The results of this study provided evidence of the consistency of the pass/fail and cutting score definitions for the stations used across examiners.

Canada↗