Search PubMed⌕ Search

Biomedical subjects

Johanna I Westbrook

Publications and source records attributed to Johanna I Westbrook.

At least 19 recordsLinked to original sources

Protocol for the Quick Clinical study: a randomised controlled trial to assess the impact of an online evidence retrieval system on decision-making in general practice.

BACKGROUND: Online information retrieval systems have the potential to improve patient care but there are few comparative studies of the impact of online evidence on clinicians' decision-making behaviour in routine clinical work. METHODS/DESIGN: A randomized controlled parallel design is employed to assess the effectiveness of an online evidence retrieval system, Quick Clinical (QC) in improving clinical decision-making processes in general practice. Eligible clinicians are randomised either to receive access or not to receive access to QC in their consulting rooms for 12 months. Participants complete pre- and post trial surveys.Two-hundred general practitioners are recruited. Participants must be registered to practice in Australia, have a computer with Internet access in their consulting room and use electronic prescribing. Clinicians planning to retire or move to another practice within 12 months or participating in any other clinical trial involving electronic extraction of prescriptions data are excluded from the study. The primary end-points for the study is clinician acceptance and use of QC and the resulting change in decision-making behaviour. The study will examine prescribing patterns related to frequently prescribed medications where there has been a recent significant shift in recommendations regarding their use based upon new evidence. Secondary outcome measures include self-reported changes in diagnosis, patient education, prescriptions written, investigations and referrals. DISCUSSION: A trial under experimental conditions is an effective way of examining the impact of using QC in routine general practice consultations.

Adult↗

The effect of physicians' long-term use of CPOE on their test management work practices.

OBJECTIVE: To explore physicians' work practices in relation to their long-term use of a computerized physician order entry system (CPOE). DESIGN: A cross-sectional qualitative study was conducted in four clinical units in two large Australian teaching hospitals. One hospital had used CPOE for over 10 years to order all clinical laboratory and radiology tests and view test results and the other had used the computerized viewing facility of the system for over seven years with tests ordered manually. Data were collected by non-participatory observations of physicians (55 sessions) and 28 interviews. MEASUREMENTS: Content analysis of the observation field notes, reflections on observations and interview transcripts were conducted by two researchers independently. A thematic grounded theory approach was used to derive key themes that would explain physicians work practices associated with CPOE use. RESULTS: Three themes relating to physicians' established use of CPOE were identified: (1) the effect of the hospital and clinical environment; (2) changes to work practices; and (3) physicians' management of information. Physicians' test management work practices using CPOE were related to diversity between: the hospitals; the clinical units' environment, and the users of the system. CONCLUSION: Hospitals need to understand and analyze physicians' test management work practices prior to and during the implementation of CPOE to accommodate their diverse ways of working with computerized information systems. In the current mixed media environment, physicians' use of manual and computerized information systems for sourcing and recording information impacts on efficiency and patient safety.

Attitude of Health Personnel↗

What factors are associated with the integration of evidence retrieval technology into routine general practice settings?

BACKGROUND: Information retrieval systems have the potential to improve patient care but little is known about the variables which influence clinicians' uptake and use of systems in routine work. AIM: To determine which factors influenced use of an online evidence retrieval system. DESIGN OF STUDY: Computer logs and pre- and post-system survey analysis of a 4-week clinical trial of the Quick Clinical online evidence system involving 227 general practitioners across Australia. RESULTS: Online evidence use was not linked to general practice training or clinical experience but female clinicians conducted more searches than their male counterparts (mean use=14.38 searches, S.D.=11.68 versus mean use=8.50 searches, S.D.=9.99; t=2.67, d.f.=157, P=0.008). Practice characteristics such as hours worked, type and geographic location of clinic were not associated with search activity. Information seeking was also not related to participants' perceived information needs, computer skills, training nor Internet connection speed. Clinicians who reported direct improvements in patient care as a result of system use had significantly higher rates of system use than other users (mean use=12.55 searches, S.D.=13.18 versus mean use=8.15 searches, S.D.=9.18; t=2.322, d.f.=154 P=0.022). Comparison of participants' views pre- and post- the trial, showed that post-trial clinicians expressed more positive views about searching for information during a consultation (chi(2)=27.40, d.f.=4, P< or =0.001) and a significantly greater number reported seeking information between consultations as a result of having access to an online evidence system in their consulting rooms (chi(2)=9.818, d.f.=2, P=0.010). CONCLUSION: Clinicians' use of an online evidence system was directly related to their reported experiences of improvements in patient care. Post-trial clinicians positively changed their views about having time to search for information and pursued more questions during clinic hours.

Adult↗

Ambulance officers' use of online clinical evidence.

BACKGROUND: Hospital-based clinicians have been shown to use and attain benefits from online evidence systems. To our knowledge there have been no studies investigating whether and how ambulance officers use online evidence systems if provided. We surveyed ambulance officers to examine their knowledge and use of the Clinical Information Access Program (CIAP), an online evidence system providing 24-hour access to information to support evidence-based practice. METHODS: A questionnaire was completed by 278 ambulance officers in New South Wales, Australia. Comparisons were made between those who used CIAP and officers who had heard of, but not used CIAP. RESULTS: Half the sample (48.6%) knew of, and 28.8% had used CIAP. Users were more likely to have heard of CIAP from a CIAP representative/presentation, non-users from written information. Compared to ambulance officers who had heard of but had not used CIAP, users were more likely to report better computer skills and that their supervisors regarded use of CIAP as a legitimate part of ambulance officers' clinical role. The main reasons for non-use were lack of access(49.0%) and training(31.4%). Of users, 51.3% rated their skills at finding information as good/very good, 67.5% found the information sought all/most of the time, 87.3% believed CIAP had the potential to improve patient care and 28.2% had directly experienced this. Most access to CIAP occurred at home. The databases frequently accessed were MIMS (A medicines information database) (73.8%) and MEDLINE(67.5%). The major journals accessed were Journal of Emergency Nursing(37.5%), American Journal of Medicine(30.0%) and JAMA(27.5%). CONCLUSION: Over half of ambulance officers had not heard of CIAP. The proportion who knew about and used CIAP was also low. Reasons for this appear to be a work culture not convinced of CIAP's relevance to pre-hospital patient care and lack of access to CIAP at work. Ambulance officers who used CIAP accessed it primarily from home and valued it highly. Lack of access to CIAP at central work locations deprives ambulance officers of many of the benefits of an online evidence system.

Adult↗

Critical incidents and journey mapping as techniques to evaluate the impact of online evidence retrieval systems on health care delivery and patient outcomes.

BACKGROUND: Online evidence retrieval systems are a potential tool in supporting evidence-based practice. Effective and tested techniques for assessing the impact of these systems on care delivery and patient outcomes are limited. PURPOSE AND METHODS: In this study we applied the critical incident (CI) and journey mapping (JM) techniques to assess the integration of an online evidence system into everyday clinical practice and its impact on decision making and patient care. To elicit incidents semi-structured interviews were conducted with 29 clinicians (13 hospital physician specialists, 16 clinical nurse consultants (CNCs)) who were experienced users of the online evidence system. Clinicians were also asked questions about how they had first used the system and how their use and experiences had changed over time. These narrative accounts were then mapped and scored using the journey mapping technique. RESULTS: Clinicians generated 85 critical incidents. Three categories of impact were identified: impact on clinical practice, impact on individual clinicians and impact on colleagues through the dissemination of information gained from the online evidence system. One quarter of these included specific examples of system use leading to improvements in patient care. Clinicians obtained an average journey mapping score of 22 out of a possible score of 36, demonstrating a good level of system integration. Average scores of doctors and CNCs were similar. However individuals with the same scores often had very different journeys in system integration. CONCLUSIONS: The CI technique provided clear examples of the way in which system use had influenced practice and care delivery. The JM technique was found to be a useful method for providing a quantification of the different ways and extent to which, clinicians had integrated system use into practice, and insights into how system use can influence organisational culture. The development of the journey mapping stages provides a structure by which the program logic of a clinical information system and its desired outcomes can be made explicit and be based upon users' experiences in everyday practice. Further work is required using this technique to assess its value as an evaluation method.

Clinical Competence↗

The impact of computerised physician order entry systems on pathology services: a systematic review.

PURPOSE: Computerised physician order entry (CPOE) systems hold the promise of significant improvements to health care delivery and patient care. The implementation of such systems is costly and complex. The purpose of this paper is to review current evidence of the impact of CPOE on hospital pathology services. METHODS: This paper presents a review of the literature (1990-August 2004) about CPOE systems and identifies indicators for measuring the impact of CPOE on pathology services. RESULTS: Nineteen studies which contained some form of 'control' group, were identified. They featured a variety of designs including randomised controlled trials, quasi-experimental and before and after studies. We categorised these into three groups: studies comparing pathology CPOE systems (with no decision support) to paper systems; pathology CPOE systems (with decision support) to paper systems; and pathology CPOE systems with specific pathology features compared to systems without those features. We identified 10 areas of impact assessment and 39 indicators used to measure the impact of CPOE on different stages of the pathology test ordering and reporting process. CONCLUSION: We conclude that while some data suggest that CPOE systems are beneficial for clinical and laboratory work processes, these data are limited, and further research is needed. Few data are available regarding the impact of CPOE on patient outcomes.

Diffusion of Innovation↗

Computerised order entry systems and pathology services--a synthesis of the evidence.

Computerised Physician Order Entry (CPOE) systems have been promoted in Australia and internationally for their potential to improve the quality of care. The existing research of the effect of CPOE on pathology laboratories has been variable, pointing to the potential to increase efficiency and effectiveness and contribute to enhancing the quality of patient care on the one hand, while leading to significant disruptions in work organisation with a negative impact on departmental relations on the other hand. In this paper we provide an overview of the research evidence about the impact of CPOE on four areas associated with pathology services; a) efficiency of the ordering process, e.g. test turnaround times, b) effectiveness as measured by test ordering volumes and test order appropriateness, c) quality of care, particularly its effects on patient care and d) work organisation patterns, which can be severely disrupted by CPOE. We discuss the possible ramifications of CPOE and offer three broad, but important recommendations for pathology laboratories, based on our own research experience investigating CPOE implementations over three years. Firstly, pathology laboratories need to be active participants in planning the implementation of CPOE. Secondly, the importance of building a firm organisational foundation for the introduction of the new system that includes openness and responsiveness to feedback. And thirdly, the implementation process needs to be underpinned by a strong commitment to a multi-method evaluation at every stage of the process to be able to measure the impact of the system on work practices and outcomes.

Journal Article↗

Do online information retrieval systems help experienced clinicians answer clinical questions?

OBJECTIVE: To assess the impact of clinicians' use of an online information retrieval system on their performance in answering clinical questions. DESIGN: Pre-/post-intervention experimental design. MEASUREMENTS: In a computer laboratory, 75 clinicians (26 hospital-based doctors, 18 family practitioners, and 31 clinical nurse consultants) provided 600 answers to eight clinical scenarios before and after the use of an online information retrieval system. We examined the proportion of correct answers pre- and post-intervention, direction of change in answers, and differences between professional groups. RESULTS: System use resulted in a 21% improvement in clinicians' answers, from 29% (95% confidence interval [CI] 25.4-32.6) correct pre- to 50% (95% CI 46.0-54.0) post-system use. In 33% (95% CI 29.1-36.9) answers were changed from incorrect to correct. In 21% (95% CI 17.1-23.9) correct pre-test answers were supported by evidence found using the system, and in 7% (95% CI 4.9-9.1) correct pre-test answers were changed incorrectly. For 40% (35.4-43.6) of scenarios, incorrect pre-test answers were not rectified following system use. Despite significant differences in professional groups' pre-test scores [family practitioners: 41% (95% CI 33.0-49.0), hospital doctors: 35% (95% CI 28.5-41.2), and clinical nurse consultants: 17% (95% CI 12.3-21.7; chi(2) = 29.0, df = 2, p < 0.01)], there was no difference in post-test scores. (chi(2) = 2.6, df = 2, p = 0.73). CONCLUSIONS: The use of an online information retrieval system was associated with a significant improvement in the quality of answers provided by clinicians to typical clinical problems. In a small proportion of cases, use of the system produced errors. While there was variation in the performance of clinical groups when answering questions unaided, performance did not differ significantly following system use. Online information retrieval systems can be an effective tool in improving the accuracy of clinicians' answers to clinical questions.

Clinical Competence↗

A 9 year prospective cohort study of endoscoped patients with upper gastrointestinal symptoms.

Despite the high prevalence of upper gastrointestinal symptoms and associated costs of diagnosis and management, evidence regarding long-term outcomes is scant. We studied symptom outcomes 18 months (FU1) and 8/9 years (FU2) post-index endoscopy to identify demographic, diagnostic and treatment factors associated with outcomes. A retrospective review of medical records at two Australian teaching hospitals identified a cohort of 302 patients who had an index endoscopy (performed by 23 endoscopists) 18 months previously. Patients were interviewed at FU1 and FU2. In total 34% (95%CI: 29.0 39.8) of patients were asymptomatic at FUI and 41% (95%CI: 35.6-46.6) at FU2. For 63%, outcomes at FUI predicted long-term outcome, with 19% (95%CI: 14.6-23.4) asymptomatic and 44% (95%CI: 38.4-50.0) symptomatic at both times. Those whose symptom status changed were as likely to deteriorate as improve (p > 0.05). Number and severity of presenting symptoms (F = 3.3, df = 3,277, p < 0.05) and older age (F = 2.8, df = 2,301, p < 0.05) were associated with poorer outcomes. Long-term outcome was unrelated to endoscopic diagnosis. Those symptomatic were significantly more likely to be on proton pump inhibitors (PPIs) or Histamine2 Receptor Antagonists (H2RAs) than those who were asymptomatic. Use of PPIs at FU2 was associated with a significantly better outcome than use of H2RAs. However this impact was relatively small, with 69% of patients on PPIs and 84% on H2RAs symptomatic at FU2. Upper gastrointestinal symptoms prompting endoscopy are chronic for the majority of patients regardless of diagnosis. Endoscopic diagnosis is of limited value in predicting long-term outcomes. The association between poor outcome and use of H2RAs and PPIs challenges views about their long-term effectiveness in symptom control.

Analysis of Variance↗

General practitioners' use of online evidence during consultations.

BACKGROUND: Clinicians have many unanswered questions during clinical encounters which may impact on the quality and outcomes of decisions made. Provision of online evidence at the point of care is one strategy that provides clinicians with easy access to up-to-date evidence in clinical settings to support evidence-based decision-making. AIM: To determine if and when general practitioners use an online evidence system in routine clinical practice, the type of questions for which clinicians seek evidence and the extent to which the system provides clinically useful answers. DESIGN OF STUDY: A prospective cohort study which involved a 4-week clinical trial of Quick Clinical, an online evidence system specifically designed around the needs of general practitioners. SETTING: Two hundred and twenty-seven clinicians who had a computer with Internet access in their consulting rooms. METHODS: Computer logs and survey analysis. RESULTS: One hundred and ninety-three general practitioners used the online evidence system to conduct on average 8.7 searches/month. The majority of these (81%) were conducted from consulting rooms and carried out between 9a.m. and 7p.m. (83%). The most frequent searches conducted related to diagnosis (40%) and treatment (35%). 83% of clinicians believed that Quick Clinical (QC) had the potential to improve patient care, and one in four users reported direct experience of improvements in care. In 73% of queries with clinician feedback participants reported that they were able to find clinically useful information during their routine work. CONCLUSION: General practitioners will use an online evidence retrieval system in routine practice, and report that its use improves the quality of patient care.

Adult↗

Measuring the Impact of Online Evidence Retrieval Systems using Critical Incidents & Journey Mapping.

Online evidence retrieval systems are one potential tool in supporting evidence-based practice. We have undertaken a program of research to investigate how hospital-based clinicians (doctors, nurses and allied health professionals) use these systems, factors influencing use and their impact on decision-making and health care delivery. A central component of this work has been the development and testing of a broad range of evaluation techniques. This paper provides an overview of the results obtained from three stages of this evaluation and details the results derived from the final stage which sought to test two methods for assessing the integration of an online evidence system and its impact on decision making and patient care. The critical incident and journey mapping techniques were applied. Semi-structured interviews were conducted with 29 clinicians who were experienced users of the online evidence system. Clinicians were asked to described recent instances in which the information obtained using the online evidence system was especially helpful with their work. A grounded approach to data analysis was taken producing three categories of impact. The journey mapping technique was adapted as a method to describe and quantify clinicians' integration of CIAP into their practice and the impact of this on patient care. The analogy of a journey is used to capture the many stages in this integration process, from introduction to the system to full integration into everyday clinical practice with measurable outcomes. Transcribed interview accounts of system use were mapped against the journey stages and scored. Clinicians generated 85 critical incidents and one quarter of these provided specific examples of system use leading to improvements in patient care. The journey mapping technique proved to be a useful method for providing a quantification of the ways and extent to which clincians had integrated system use into practice, and insights into how information systems can influence organisational culture. Further work is required on this technique to assess its value as an evaluation method. The study demonstrates the strength of a triangulated evidence approach to assessing the use and impact of online clinical evidence systems.

Attitude of Health Personnel↗

Allied health professionals' use of online evidence: a survey of 790 staff working in the Australian public hospital system.

OBJECTIVE: To measure the impact of a state health department policy to provide allied health professional staff with access to a point-of-care, 24h, online evidence system in terms of awareness, use and clinical impact of the system on clinical practice; to identify perceived barriers to use, and differences in measures between seven professional groups (physiotherapists, occupational therapists, speech pathologists, dieticians, clinical psychologists, pharmacists and social workers). METHOD: A convenience sample of 790 allied health professionals from 65 randomly selected hospitals in New South Wales, Australia. A self-administered questionnaire was distributed. Rates of use, frequency and types of resources accessed were calculated. Comparisons between professional groups were undertaken using Chi-square analyses and t-tests. RESULTS: The results showed that 82% of allied health professionals had heard of the online evidence system, and of those 76% had used it. Pharmacists had the highest rates of use and social workers the lowest. Of users, 90% agreed that use of the system had the potential to improve patient care and 45% reported direct experience of this. Computer skills and easy access were significantly associated with use and frequency of use. Among non-users, lack of specific training in the use of the online evidence system and lack of time were the most frequently reported reasons for not using the system. However, among users there was no relationship between this training and the frequency or effectiveness of use, i.e. the ability to find the information required. CONCLUSIONS: Allied health professionals will use an online evidence system when it is provided, however there are marked differences in use by professional groups. General training aimed at improving computer skills appears more important in encouraging use of an online evidence system, than specific system-based training. Perceptions of organisational and professional support for allied health professionals to use online evidence as a legitimate part of their work play an important role in influencing system use.

Allied Health Personnel↗

Nurses' use of online clinical evidence.

BACKGROUND: The 'information explosion' presents a significant challenge to the nursing profession. One way to assist access to information is to provide electronic information resources at the point of care. A large-scale survey of nurses working in the public health system in New South Wales, Australia, was undertaken as part of a 2-year evaluation of the Clinical Information Access Program (CIAP). This is a website which provides 24 hour, online access to a range of evidence sources at the point of care. AIM: This paper reports a study to investigate factors influencing nurses' use of online evidence available at the point of care and to examine differences between nurses in different roles. METHOD: Nurses from 65 randomly selected hospitals were surveyed. A convenience sample representing 25% of nursing staff at these hospitals was sought. Eighty-four per cent of the survey quota was met and 3128 questionnaires were completed and returned. RESULTS: The results showed that 58% of nurses had heard of the CIAP and, of those, 70% had used the website's resources. Senior nurses had greater awareness and use than others. The most frequent reasons for use were to fill a knowledge gap and for personal education. Lack of training was the most frequently cited reason for not using the website. Use of online evidence, particularly amongst senior staff, was higher than reported in previous studies. CONCLUSION: Use of online evidence was associated with nursing role, and with managerial and organizational support. Diffusion of innovation theory can help to explain some of the patterns observed. The use and impact of online evidence should be interpreted in the context of nursing practice and culture.

Adult↗

Clinicians' assessments of the usefulness of online evidence to answer clinical questions.

Family physicians' experience of using an online evidence retrieval system in routine clinical work was measured. Participants' assessments regarding the usefulness of the online evidence to answer their clinical questions were determined using three feedback channels: voluntary online feedback during the trial; randomized prompted feedback during a specific online evidence search; and responses in a post-trial survey. Using an analysis of the web logs, search outcome was related to patterns of searching in terms of number of searches and documents viewed. The majority of clinicians' searches were related to patient care and information retrieved was rated as useful in answering these questions. On average clinicians conducted two searches and viewed one document per clinical question. Search sessions which resulted in "completely answering" a clinical question involved significantly fewer searches than less successful searches. The three feedback channels provided different information but consistent overall results. The findings indicate that clinicians' assessments of online evidence use are linked to search patterns and online feedback is useful for measuring the effectiveness of systems.

Analysis of Variance↗

Evaluating the impact of information communication technologies on complex organizational systems: a multi-disciplinary, multi-method framework.

The health informatics research community has been undertaking work at the organization-technology intersection for some time now. However there is no one place in the literature which presents a rigorously-defined evaluation framework for use by practitioners and researchers seeking to assess the impact of information and communication technologies on organizational processes and outcomes. There are two main challenges. One is to conceptualize the design features of such an evaluation framework. The second is to specify what data will be gathered and how. This paper aims to address each of these problems.

Academic Medical Centers↗

Do clinicians use online evidence to support patient care? A study of 55,000 clinicians.

OBJECTIVES: To determine clinicians' (doctors', nurses', and allied health professionals') "actual" and "reported" use of a point-of-care online information retrieval system; and to make an assessment of the extent to which use is related to direct patient care by testing two hypotheses: hypothesis 1: clinicians use online evidence primarily to support clinical decisions relating to direct patient care; and hypothesis 2: clinicians use online evidence predominantly for research and continuing education. DESIGN: Web-log analysis of the Clinical Information Access Program (CIAP), an online, 24-hour, point-of-care information retrieval system available to 55,000 clinicians in public hospitals in New South Wales, Australia. A statewide mail survey of 5,511 clinicians. MEASUREMENTS: Rates of online evidence searching per 100 clinicians for the state and for the 81 individual hospitals studied; reported use of CIAP by clinicians through a self-administered questionnaire; and correlations between evidence searches and patient admissions. RESULTS: Monthly rates of 48.5 "search sessions" per 100 clinicians and 231.6 text hits to single-source databases per 100 clinicians (n = 619,545); 63% of clinicians reported that they were aware of CIAP and 75% of those had used it. Eighty-eight percent of users reported CIAP had the potential to improve patient care and 41% reported direct experience of this. Clinicians' use of CIAP on each day of the week was highly positively correlated with patient admissions (r = 0.99, p < 0.001). This was also true for all ten randomly selected hospitals. CONCLUSION: Clinicians' online evidence use increases with patient admissions, supporting the hypothesis that clinicians' use of evidence is related to direct patient care. Patterns of evidence use and clinicians' self-reports also support this hypothesis.

Attitude to Computers↗

Clinical team functioning and IT innovation: a study of the diffusion of a point-of-care online evidence system.

OBJECTIVES: To investigate the association between clinical team functioning and diffusion (awareness, use, and impact) of a 24-hour online evidence retrieval system. To examine the relationships between clinical team characteristics and the adoption of the online evidence system. DESIGN: 18 clinical teams, consisting of 180 clinicians from three Australian hospitals, were identified and studied. Teams were categorized as small ( 15). MEASUREMENTS: Clinical team functioning was assessed using the Team Climate Inventory (TCI). Awareness, use, and impact of an online evidence retrieval system were measured using a self-administered questionnaire. The relationships between TCI scores and awareness, use, and impact were examined using t-tests and one-way ANOVAs. Chi square analyses were used to examine differences between small and large teams. RESULTS were interpreted within a diffusion of innovations framework. RESULTS: Clinical team functioning was not related to awareness or use of the online evidence retrieval system. However, clinical team functioning was significantly associated with the impact of online evidence in terms of reported experience of improved patient care following system use. Clinicians in small teams ( 15) teams. CONCLUSIONS: Team functioning had the greatest impact on the fourth stage of innovation diffusion, the effective use of online evidence for clinical care. This supports Rogers' diffusion of innovation theory, to the effect that different types of communication about an innovation are important at different stages in the diffusion process. Members of small teams were more aware of the system than members of large teams. Team functioning is amenable to improvement through interventions. The findings suggest that the role of team climate in the diffusion of information systems is a promising area for future research.

Analysis of Variance↗