Search PubMed⌕ Search

Biomedical subjects

J J Rethans

Publications and source records attributed to J J Rethans.

At least 19 recordsLinked to original sources
PubMed2005

The role of a computerised case-based testing procedure in practice performance assessment.

INTRODUCTION: For postgraduate training of doctors there is a need for valid and reliable instruments to assess their daily performance. Various instruments have been suggested, some of which use incognito simulated patients (SPs). These methods are resource intensive. Computerised Case-based testing (CCT) is logistically simpler and may still predict performance well. The research question was to evaluate the predictive validity of CCT for performance. METHODS: Seventeen rheumatologists were each visited by eight incognito SPs presenting various rheumatological complaints, and scoring the performance of the rheumatologists using a predefined checklist. From this checklist a panel of experts identified essential items. In addition the rheumatologists sat a CCT test containing 55 cases with a total of 121 items. RESULTS: Negative correlations were found between the SP scores and the CCT scores. This was unexpected. Therefore, background variables on experience were used to compare both methods. The correlation between these and CCT were high and positive and with the SP scores high and negative. This pattern did not differ when using the essential items of the checklist. Reliabilities of the SP scores were markedly high. DISCUSSION: Although CCT was not predictive of SP scores, it was related to working experience. There are good reasons to assume that although SP-scores were more authentic, they were less valid than CCT scores, mainly because they focussed more on thoroughness than on efficiency in data gathering. The results underpin the assumption that for valid performance assessment the most important issue is what information about the candidate is collected and now how authentic the method is.

Clinical Competence↗
PubMed2004

Setting priorities and identifying barriers for general practice research in Europe. Results from an EGPRW meeting.

BACKGROUND: In spring 2002, WONCA Europe, the European Society of General Practice/Family Medicine and its Network organizations reached consensus on a 'new' European definition of general practice. Subsequently, the European General Practice Research Workshop (EGPRW) started working on a European General Practice Research Agenda. This topic was addressed during the 2002 EGPRW autumn meeting. OBJECTIVE: Our aim was to explore the views of European general practice researchers on needs and priorities as well as barriers for general practice research in Europe. METHODS: In seven discussion groups, 43 general practice researchers from 18 European countries had to answer the following questions. (i) What major topics should be included in a research agenda for general practice in your country? (ii) What are the barriers to adequate implementation of general practice research in your country? Group answers were listed and subsequently categorized by two authors. RESULTS: Research on 'clinical issues' (common diseases, chronic diseases, etc.), including diagnostic strategies, was considered to be the core content of general practice research, with primary care-based morbidity registration essential for surveillance of disease, clinical research and teaching in general practice. There was also consensus on the need for research on education and teaching. 'Insufficient funding opportunities' was perceived to be the major barrier to the development of general practice research. CONCLUSIONS: These findings could be used as a basis for national checklists of 'content of' and 'conditions for' general practice research. European general practice research training programmes should be developed further.

Communication Barriers↗
PubMed2002

Psoriatic arthritis: performance of rheumatologists in daily practice.

OBJECTIVES: To assess, using standardised patients (SPs), how rheumatologists diagnose psoriatic arthritis, whether the diagnostic efficiency is influenced by specific characteristics of the rheumatologists, and to study the relationship with costs. METHODS: Twenty three rheumatologists were each visited by one of two SPs (one male, one female) presenting as a patient with psoriatic arthritis. SPs remained incognito for all meetings for the duration of the study. Immediately after the encounter, SPs completed case-specific checklists on the medical content of the encounter. Information on ordered laboratory and imaging tests was obtained from each hospital. RESULTS: Fourteen rheumatologists diagnosed psoriatic arthritis correctly. They inspected the skin for psoriatic lesions more often than those rheumatologists who established other diagnoses. Rheumatologists diagnosing psoriatic arthritis spent more on additional laboratory and imaging investigations. These were carried out after the diagnosis to confirm it and to record the extent and severity of the disease. No differences in type of practice, number of outpatients seen each week, working experience, or sex were found between rheumatologists who made the correct diagnosis and those who made other diagnoses. The correct diagnosis was more often missed by rheumatologists who saw the male SP, who presented with clear distal interphalangeal DIP joint arthritis only, causing confusion with osteoarthritis of the DIP joints. CONCLUSION: There is a considerable amount of variation in the delivery of care among rheumatologists who see an SP with psoriatic arthritis. Rheumatologists focusing too much on the most prominent features (DIP joint arthritis) sometimes seem to forget "the hidden (skin) symptoms".

Adult↗
PubMed2001

Rhemulatologists' performance in dailiy practice.

OBJECTIVE: To assess rheumatologists' performance for 8 rheumatologic conditions and to explore possible explanatory factors. METHODS: After written informed consent was obtained, 27 rheumatologists (21% of all Dutch rheumatologists) practicing in 16 outpatient departments were each visited by 8 incognito "standardized patients" (SPs). The diagnoses of these 8 cases account for about 23% of all new referred patients in the Netherlands. Results for ordered lab tests as well as real radiographs with corresponding results from a radiologist were simulated. Information from the visits was obtained from the SPs, who completed predefined case-specific checklists, and by collecting data on resource utilization. Feedback was provided. RESULTS: Altogether 254 encounters took place, of which 201 were first visits and 53 were followup visits. SPs were unmasked twice during a visit. There was considerable variation in resource utilization (lab tests and imaging) between cases and between rheumatologists. Mean costs per rheumatologist ranged from US $ 4.67 to $ 65.36 per visit for lab tests and from US $ 33.15 to $ 226.84 per visit for imaging tests. No significant correlations were seen between resource utilization costs and number of years of clinical experience or performance on checklist scores. Rheumatologists with longer experience had lower total item checklist scores (r = -0.47; P < 0.05). CONCLUSION: A considerable variation in resource utilization was found among 27 Dutch rheumatologists. The information obtained is an excellent source for discussion on the appropriateness of care.

Adult↗
PubMed2001

On the relationship between the efficiency and the quality of the consultation. A validity study.

OBJECTIVES: The aim of this study was to determine how the medical performance of physicians during consultations is related to doctor-patient communication and satisfaction of patients, taking into account the actual length of the consultations. In addition, we studied the validity of the 'efficiency-per-time score' as a measure of competence. METHODS: General practice trainees participated in a test situation in which they were confronted with six consultations with standardized (simulated) patients (SPs). All consultations were videotaped and evaluated by multiple observers, using national guidelines on medical content and on communication. The SPs scored satisfaction with the consultation using a satisfaction checklist. Forty GP-trainees were invited, of whom 34 participated. The main outcome measures were the number of obligatory actions undertaken by the GP-trainees, total number of actions undertaken, consultation time, efficiency-per-time score, patient satisfaction and quality of communication score, and the Pearson correlations between these measures. RESULTS: There was a negative correlation between the 'efficiency-per-time score' of the GP-trainees and the satisfaction of the SPs in five of the six consultations [Pearson r from -0.29 (P < 0.05) to -0.58 (P < 0.001)] and between the 'efficiency-per-time score' and the quality of the communication in three of the six consultations [Pearson r from -0.34 (P <.05) to -0.51 (P < 0.001)]. CONCLUSIONS: Short consultations with high technical medical efficiency seem to be related to bad communication and dissatisfied patients, thus questioning the validity of the 'efficiency-per-time score' as a measure of competence.

Belgium↗
PubMed2000

Effect of a short skills training course on competence and performance in general practice.

OBJECTIVES: Evaluation of the efficacy of a short course of technical clinical skills to change performance in general practice. DESIGN: Subjects were self-selected general practitioners (n=59) who were unaware of the study design. They were assigned to the intervention group (n=31) or control group (n=28) according to their preference for course date. The course covered four different technical clinical skills (shoulder injection technique, PAP-smear, laboratory examination of vaginal discharge, ophthalmoscopic control in diabetes mellitus). Main outcome measures used were pre- and post-training scores on a knowledge test of skills (60 multiple choice items), and pre- and post-training performance of procedures in practice using a log-diary covering 20 days. SETTING: University of Maastricht, The Netherlands. SUBJECTS: Self-selected general practitioners. RESULTS: Competence, as measured by the knowledge test of skills, improved significantly as a result of the training and skills test scores were satisfactory after training. A significant effect on performance in practice was found for PAP-smear and shoulder injection technique, whereas no effect could be demonstrated for examination of vaginal discharge and ophthalmoscopic control in diabetes mellitus. CONCLUSIONS: A good degree of competence is a necessary but not always sufficient condition for a physician to change his performance in practice. While some skills training seems adequate to bring about desired changes, for other skills more complex interventions are probably needed.

Education, Medical, Undergraduate↗
PubMed2000

Developing case-specific checklists for standardized-patient-based assessments in internal medicine: A review of the literature.

PURPOSE: To review the literature on the methods used in writing case-specific checklists for studies of internal medicine physicians' performances that were assessed by standardized patients. METHOD: The authors searched Medline, Embase, Psychlit, and ERIC for articles in English published between 1966 and February 1998. The following search string was used: "[(standardi(*) or simulat(*) or programm(*)) near (patient(*) or client(*) or consultati(*))] and internal medicine." The authors then searched the reference lists of papers retrieved from the database searches, as well as those from seven proceedings of the International Ottawa Conference on Medical Education and Assessment. RESULTS: The procedure yielded 29 relevant articles: database searches yielded 14 published reports dealing with case-specific checklists, 11 articles were culled from the reference lists of these papers, and the Ottawa Conference proceedings yielded four articles. Only 12 articles reported specifically on the development of checklists. In general, there were three sources used for developing checklists: panels of experts, the investigators themselves, and responses from expert physicians to written protocols. No article indicated that researchers had relied exclusively on data from the literature to compose their checklists. Only three articles indicated that literature sources had informed their checklist development. All articles except one relied on explicit criteria for the inclusion of items on the checklists. In 21 of the 29 articles, the checklists had been scored by SPs, but the scoring of specific items on the checklists varied according to the purpose of the SP-physician encounter. Only four of the articles made the checklists available or indicated that the checklists could be obtained from the authors. CONCLUSION: The development of case-specific checklists for SP examinations of physicians' performance has received little attention. To judge the validity of studies of physicians' performances that use SPs, the development processes for the checklists need to be more fully described to enable readers to evaluate the validity and reliability of the studies.

Clinical Competence↗
PubMed1999

The NECTAR-study: development of nutrition modules for general practice vocational training; determinants of nutrition guidance practices of GP-trainees. Nutrition Education by Computerized Training And Research.

OBJECTIVE: To identify determinants of nutrition guidance practices of general practitioner-trainees (GP-trainees), to investigate whether these determinants differ from those found by experienced general practitioners; to reveal educational directions towards the development of computer-based instruction on nutrition. DESIGN: Cross-sectional study by means of validated questionnaires. SUBJECTS: All GP-trainees in training at the eight university departments for vocational training in the Netherlands in September, 1998 (n = 985). MAIN OUTCOME MEASURES: Reliability of determinants of nutrition guidance practices was calculated by means of Crohnbach's alpha. The mechanism of action of determinants was identified by means of linear structural relationship analysis (LISREL) using a model developed for GPs. RESULTS: Crohnbach's alphas for factors ranged from 0.58-0.90. The empirical GP-trainee-data fitted with the corresponding GP-model on the mechanism of action. CONCLUSIONS: The same predisposing factors, driving forces and barriers as found with GPs were identified with GP-trainees. Comparing the GP-and GP-trainee-models, only minor differences were found in the path coefficients between factors. Lack of nutrition training and education proved to be of great influence on the extent of nutrition information given. The GP-trainee-model will be of use in developing computer-based instruction on nutrition. It is expected that GPs may also benefit from this instruction.

Algorithms↗
PubMed1999

Assessment in general practice: the predictive value of written-knowledge tests and a multiple-station examination for actual medical performance in daily practice.

This study compares the predictive values of written-knowledge tests and a standardized multiple-station examination for the actual medical performance of general practitioners (GPs) in order to select effective assessment methods to be used in quality-improvement activities. A comprehensive assessment was performed in four phases. First, 100 GPs from the southern part of the Netherlands were assessed by a general medical knowledge test and by a knowledge test on technical skills. Second, in order to check for time-order effects, participants were randomly divided into two groups of 50 each, comparable on scores of both knowledge tests and on professional characteristics. Finally, both groups went through a multiple station examination using standardized patients and a practice video assessment of real surgery, but in opposite orders. Consultations were videotaped and assessed by well-trained peer observers. The drop-out rate was 10%. In both groups the predictive value of medical knowledge tests, ranging from 0.43 to 0.56 (Pearson correlation disattenuated), proved to be comparable with the predictive value of the multiple-station examination for actual performance (0.33-0.59). The overall explained variance of scores of the practice video assessment, measured by multiple regression analysis with performance scores as dependent variables and scores on the knowledge tests and the multiple-station examination as independent variables was moderate (19%). A time-order effect showed in only one direction: from practice video assessment to the multiple-station examination. The GP's professional characteristics did not contribute to the explanation of variation in performance. Medical knowledge tests can predict actual clinical performance to the same extent as a multiple-station examination. Compared with a station examination, a knowledge test may be a good alternative method for assessment the procedures of a large number of practising GPs.

Clinical Competence↗
PubMed1999

Assessment of general practitioners by video observation of communicative and medical performance in daily practice: issues of validity, reliability and feasibility.

OBJECTIVES: To develop a video assessment method for General Practitioners (GPs) by analysing issues of validity, reliability and feasibility of observation of videotaped regular consultations. DESIGN: In a cross-sectional study consultations of 93 GPs were video recorded in the practice during 1 week. The GPs registered consultation and patient data in a logbook; 16 consultations per GP were selected using preset criteria. The quality of communicative and medical performance of these consultations was assessed by GP observers with a validated instrument. The validity of the procedure was evaluated by checking the content of each GP's sample using specific sample criteria. Selection bias was estimated by multiple regression analysis, with sample characteristics as independent variables and scores on communication and medical performance as dependent variables. The influence of observation on GPs and patients was assessed by a questionnaire. Generalizability theory was used to estimate reliability. Feasibility was assessed by conducting a questionnaire, by keeping accounts, and by checking the technical quality of the videotaped consultations. SETTING: Universities of Nijmegen and Maastricht, The Netherlands. SUBJECTS: General Practitioners (GPs). RESULTS: The domain of general practice was well covered in the samples; content validity was satisfactory. With regard to the sample characteristics, only the total duration of consultations appeared to correlate significantly with both the score on communication and the score on medical performance. A majority (71%) of GPs reported not being influenced by the observation, except in the first cases, and recognizing their usual daily performance in the videotaped consultations. An acceptable level of reliability was reached after 2.5 hours of observation, i.e. 12 cases by a single observer. The method was well accepted by both GPs and patients. The costs were pound250 per GP. CONCLUSIONS: Video assessment of GPs in daily practice according to the procedures described is a valid and reliable method, one which is useful for education and quality improvement. There is a trade-off between feasibility on one hand and validity, reliability and credibility on the other hand. Compared to investments in observation methods in standardized settings, the costs of video observation of GPs' actual performance are acceptable.

Clinical Competence↗
PubMed1999

Assessment of practicing family physicians: comparison of observation in a multiple-station examination using standardized patients with observation of consultations in daily practice.

PURPOSE: Looking for a valid, reliable, and feasible method to collect data on the performances of practicing family physicians, the authors compare the measurement characteristics of a multiple-station examination (MSE) using standardized patients with those of a video assessment of regular consultations in daily practice (practice video assessment, PVA). METHOD: In a cross-sectional study, consultations of 90 family physicians were videotaped both in an MSE and in their daily practices. Peer-observers used a validated instrument (MAAS-Global) to assess the physicians' communication with patients and their medical performances. The physicians were randomly divided into two groups, comparable for demographic characteristics, and half underwent the assessments in reverse order to test for time-order effects. Content validity, criterion validity, reliability, and feasibility of the two methods were compared. RESULTS: Content validity of the PVA was superior to that of the MSE, since the domain of general family practice care was better covered. Observed participants judged the videotaped practice consultations to be "natural," whereas hardly any family physician, after reviewing the videotaped consultations of the MSE, recognized his or her usual working style. Specific criteria made it possible to standardize real practice. Concerning criterion validity, only the medical-performance components of the two methods correlated. No correlation was found for the communication components. Real-practice performance proved to be less influenced by observation than was performance during the MSE. The reliabilities of the two methods, expected to be better in the controlled MSE, were comparable. The administration of the PVA was more flexible, less costly, and better accepted by the family physicians than was that of the MSE. CONCLUSION: Assessment for quality improvement of family physicians' practices by video observation in daily practice is superior to video assessment in a simulated setting using standardized patients.

Adult↗
PubMed1998

Structure and process: the relationship between practice management and actual clinical performance in general practice.

OBJECTIVES: The precise relationship between practice management (structure) and the doctor's actual performance (process) in general practice is tenuous. Analysis of their mutual relationship may yield insight into the way they contribute to outcome and into corresponding assessment procedures. METHOD: In a cross-sectional study, consultations of 93 GPs were videotaped in their own practice and assessed by peer-observers on medical performance and on communication with patients, followed by a practice visit by a non-physician observer using a validated Visitation Instrument to assess Practice management and organization (VIP). Pearson correlations (observed and disattenuated for unreliability of the instruments) between scores on 22 practice management dimensions and scores of 16 selected cases on medical performance and communication were calculated. The predictive value of specific practice management aspects for actual performance was determined by multiple regression analysis, with performance scores as dependent variables and scores on the 22 management dimensions and GPs' professional characteristics as independent variables. RESULTS: Nine practice management dimensions correlated significantly with medical performance and so did five dimensions with actual communication. Overall, most associations were weak. Combined with demographic variables (age for medical performance and working single-handedly for communication), 26% of variance in medical performance scores could be explained by only three practice management dimensions. One practice dimension (delegation of medical tasks to the practice assistant) explained 11% of variance in communication with patients. Organization of quality assessment activities explained most of the variation in medical performance. CONCLUSIONS: Practice management (structure) and actual performance (process) seem to be largely autonomous constructs. Quality improvement and assessment activities should emphasize that practice management is different from actual performance. Structure and process may contribute to patient outcome independently of each other.

Adult↗
PubMed1997

Do general practitioners act consistently in real practice when they meet the same patient twice? Examination of intradoctor variation using standardised (simulated) patients.

OBJECTIVE: To assess the variation within individual general practitioners facing the same problem twice in actual practice under unbiased conditions. DESIGN: General practitioners were consulted during normal surgery hours by a standardised patient portraying a patient with angina pectoris. Six weeks later the same general practitioners were consulted again by a similar standardised patient portraying a similar case. The patients reported on the consultations. SETTING: Trondheim, Norway. SUBJECTS: Of 87 general practitioners invited by letter, 28 (32%) agreed to participate without hesitation; nine others (10%) wanted more information before consenting. From these 24 were selected and visited. MAIN OUTCOME MEASURES: Number of actions undertaken from a guideline in both rounds of consultations. Duration of consultations. RESULTS: The mean (range, interquartile range) guideline score, total score, and duration of consultation were not significantly different between the first and second patient encounters for the group as a whole. For individual doctors the mean (SD) difference was -0.09 (3.36) for the guideline score, 0.30 (8.1) for the total score, and -0.87 (9.01) for consultation time. CONCLUSIONS: The study shows that assessment of performance in real practice for a group of general practitioners is consistent from the first round of consultations to the second round. However, significant variation occurs in performance of individual physicians.

Family Practice↗
PubMed1997

The use of standardized patients in research in general practice.

Standardized patients (SPs) are simulated patients or actual patients who have been carefully coached to present their illness in a standardized way. Much is known about the use of standardized patients in medical education. This article reviews advantages and disadvantages, reliability and validity of the use of standardized patients in general practice and primary care research. Performance in general practice can be measured with direct or indirect methods. With direct methods the physician-patient contact is directly observed or heard. Indirect methods are seldom complete and seldom accurate and therefore often invalid. Direct methods (observation, video, audiotapes, etc.) have face validity, but nevertheless have shortcomings. The SP method can mainly avoid the disadvantages of the other methods. The presentation of the case by the SP is accurate. The judgement of physician's behaviour during the consultation by the SP is accurate and reliable. SPs are generally believable. Less than one in five SPs is detected by the physicians, so the method has face validity. To obtain sufficient reliability and validity, a thorough selection and training of SPs is required, as is careful organization with an eye for detail. The SP method also has some important shortcomings. The method is time and work demanding, limiting the number of physicians that can be measured. In addition, measurement is usually limited to one consultation. In reality, however, diagnostic and therapeutic interventions are often spread over several consultations. This 'first-visit-bias' hampers conclusive answering of some research questions.

Family Practice↗
PubMed1997

Educational objectives and requirements of an undergraduate clerkship in general practice. The outcome of a consensus procedure.

OBJECTIVES: The main aim of this study was to reach consensus between students, faculty and general practice teachers on the educational objectives and requirements of the clerkship in general practice. METHOD: The consensus procedure consisted of four steps and all active general practice teachers (n = 116) were asked to participate in the study. RESULTS: We identified 189 educational objectives: 127 complaints (problems, symptoms, syndromes), 29 clinical skills and 37 objectives concerning the theoretical dimensions of general practice. Educational requirements crystallized to 16 essential preconditions of a teaching practice and 35 didactic activities to be performed by the general practice teachers. CONCLUSIONS: These consensus results will be used to structure the medical curriculum and as guidelines for the educational process during the clerkship.

Australia↗
PubMed1997

Management of patients with angina pectoris by GPs: a study with standardized (simulated) patients in actual practice.

BACKGROUND: Little is known about the management of patients with angina pectoris by GPs. OBJECTIVE: The purpose of this study was to assess how a group of GPs managed a patient with angina pectoris complaints in a real-life practice setting during unbiased consultations with standardized patients. METHODS: GPs were consulted during normal surgery hours by a standardized patient portraying a patient with angina pectoris. The setting was Trondheim, Norway. All 87 GPs in the city of Trondheim (Norway) were informed by letter about a study with standardized patients and invited to take part. They were asked to give consent to be visited during actual surgery hours by standardized patients. The date, number and content of the visits planned were not mentioned. They were not told that the study focused on angina pectoris. For budgetary reasons it was decided to ask 24 physicians to participate. The GPs were consulted during normal surgery hours by a standardized patient portraying a patient with angina pectoris. The patients reported on the consultations using a checklist based on guidelines for management of angina pectoris. Outcome measures were the content and number of actions undertaken from the guidelines. RESULTS: Twenty-eight GPs (32%) agreed to participate. Of these, 24 were selected and visited. One doctor detected the standardized patient. The results showed that the participating physicians met 76% of the guidelines used. However, the GPs ordered 31 different types of laboratory test (mean = 7.9, range = 1-18 per physician). In addition, the 23 consultations resulted in seven referrals (two for chest X-rays, four for an exercise test and one referral to a specialist in cardiology). Twenty-two of the 23 doctors made the correct diagnosis and informed the patient accordingly. CONCLUSIONS: When assessed in an unbiased situation in real practice, GPs performed well against a pre-set standard for management of angina pectoris patients. Much variation was found in the request for laboratory tests. These real-life practice data suggest that there is a need for discussing guidelines for effective ordering of laboratory tests in general practice.

Aged↗
PubMed1996

[Various opinions of family physicians and rheumatologists about the management of patients with rheumatoid arthritis].

OBJECTIVE: To make an inventory of the opinions about professional duties and of the cooperation of general practitioners (GPs) and rheumatologists in the care of patients with rheumatoid arthritis (RA), after the publication of the standard 'Rheumatoid arthritis' issued by the Dutch College of General Practitioners in 1994. DESIGN: Descriptive. SETTING: Maastricht University, the Netherlands. METHOD: Information was collected by means of a written questionnaire submitted to a random sample of 500 GPs and all 148 (assistant) rheumatologists in the Netherlands, and by means of focus group interviews with GPs, rheumatologists and RA patients. This information focused on the opinion of both groups of professionals on their professional duties in diagnosis and management of RA, existing models of cooperation, the satisfaction with mutual consultations, experienced problems and possibilities to improve cooperation. RESULTS: Substantial differences existed between both groups of professionals in their views on the duties of the GP and the rheumatologist respectively, in the care of RA patients. GPs tended to an expectative policy in cases of suspected or even diagnosed RA, whereas rheumatologists preferred early referral. Hardly any cooperation model was found with agreements committed to paper on the mutual duties regarding RA patients. CONCLUSION: Inadequate mutual contacts and inadequate insight of both parties into each other's abilities appeared to be major problems impeding improvement of the mutual communication. Both groups recognized the need to improve the mutual cooperation.

Adult↗