SEARCH · Search PubMed

Results for “Reliability”

Search indexed PubMed citations on genomics, clinical trials, systematic reviews and public health. Explore titles, authors and supplied subject terms, then open the PubMed record.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,495 records · Page 83Linked to original sources

PubMedDate not supplied

Methods for assessing accuracy and reliability in functional MRI.

In this paper, methods for assessing the accuracy and the reliability of functional magnetic resonance imaging techniques are presented. First, a modified receiver operating characteristic analysis is described for evaluating the accuracy of fMRI studies. With this modified approach, the true positives or the activated pixels are estimated based on highly averaged experimental data acquired with the same stimulation/task. Unlike ROC analysis based on simulated activation data, the present approach can be applied to experimentally acquired data without simplifying the activation related changes. To assess the reliability of fMRI studies, the kappa statistic was adopted for evaluating the overall agreement of functional activation maps from repeated experiments in individual subjects. To demonstrate the utility of these techniques, both the ROC analysis and the reliability assessment were applied to quantitatively evaluate the improvement in accuracy and reliability of a retrospective technique for physiological noise reduction in fMRI.

Magnetic Resonance Imaging↗

PubMed1978

Reliability and stability of the Comrey Personality Scales in a clinical setting.

Examined split-half reliabilities, retest reliabilities, and stability of the Comrey Personality Scales (CPS) (Comrey, 1970) for a Navy sample of 200 young drug abusers tested at the beginning and end of rehabilitation in a no-feedback, compulsory participation setting. The pre-rehabilitation split-half reliabilities for the eight personality scales ranged from .73 to .94, with an average of .85, and ranged from .74 to .91, with an average of .83, on the post-rehabilitation administration. Retest reliabilities for the eight scales were between .39 and .64, with an average of .52. Post-rehabilitation means were significantly higher on four of the eight scales, and one scale mean was significantly lower. It is concluded that the CPS is appropriate in a clinical setting in which test participation is compulsory and test feedback is not made available to the respondents.

Adolescent↗

PubMed1990

Notes on the reliability of Wechsler short forms.

Information is provided on the reliability of random short forms of Wechsler's intelligence scales and on the reliability of short forms that reduce the number of items within subtests rather than the number of subtests. The results demonstrate how much better than random the most reliable short forms of the scales are. They also show that reducing the number of items within subtests rather than the number of subtests exacts a steep price in reliability.

Humans↗

PubMed1991

Reliability of score differences on Wechsler's intelligence scales.

Comparisons are made between the results given by two formulae for the reliability of the difference between an individual subtest score and the average subtest score on a scale to which that subtest belongs. For the WAIS-R and the WISC-R, the correct reliabilities reported here are appreciably higher than the incorrect reliabilities reported previously, and the apparent reversal of this result for the WPPSI is explained as an artifact. Even the correct reliabilities are very low, however, more than three-quarters of them below .70.

Child↗

PubMed1993

Reliability of the Turkish version of the Perceived Social Support from Friends and Family scales, Scale for Interpersonal Behavior, and Suicide Probability Scale.

This study investigated the reliability of the Turkish version of the Perceived Social Support (PSS) from Friends (PSS-Fr) and Family (PSS-Fa) scales, the Scale for Interpersonal Behavior (SIB), and the Suicide Probability Scale (SPS). Both test-retest and internal consistency reliability estimates were computed. Highly adequate reliability coefficients are recorded for the subscales and the total scales of the PSS, SIB, and SPS. The results of the present study clearly support the use of Turkish versions of the PSS-Fr, PSS-Fa, SIB, and SPS as reliable methods for assessing perceived social support from friends and family, assertiveness, and suicide risk.

Adult↗

PubMed2000

Preference measurement using conjoint methods: an empirical investigation of reliability.

The application of conjoint measurement to the field of health economics is relatively new, although there is growing interest and there have been a number of studies undertaken recently. Wider acceptance of the technique requires methodological issues concerning both reliability and validity to be addressed. This paper reports an empirical investigation of the test-retest reliability of the discrete choice conjoint measurement approach in health care. This investigation of conjoint reliability was framed using the clinical context of investigation and treatment of knee injuries. A high level of reliability at both the input data and results levels was demonstrated.

Adolescent↗

PubMed1999

Tests of functional limitations in fibromyalgia syndrome: a reliability study.

OBJECTIVE: To evaluate the reliability and discriminative ability of a test battery consisting of 7 tests designed for the assessment of functional limitations in patients with fibromyalgia syndrome (FMS). METHODS: The intrarater reliability of the test battery was evaluated for 15 women with FMS. Interrater reliability was calculated on 4 tests separately. Fifteen healthy women constituted a reference group. RESULTS: The intrarater coefficient of variation was < 8% for the shoulder range of motion tests, chair test, and 6-minute walk test, and < 21% for the shoulder endurance test, with correlation coefficients above 0.80 for all tests. Kappa was 0.70-0.80 for the hand-to-scapula tests. The interrater coefficient of variation was < 5% for shoulder range of motion. The performances of the FMS patients were significantly decreased in comparison with healthy subjects in all the tests except for the hand-to-scapula movement. CONCLUSIONS: All but 1 of the selected 7 tests were considered to possess acceptable intrarater reliability for use in FMS in clinical physical therapy practice.

Activities of Daily Living↗

PubMed2000

Reliability of the six-minute walk test in people with fibromyalgia.

OBJECTIVE: To determine the test-retest reliability of the 6-minute walk test in people with fibromyalgia. METHODS: Twenty-six subjects (27-59 years of age) performed 3 walk tests over consecutive days before and after a 4-week treatment program. Reliability was determined using a one-way repeated measures analysis of variance and the intraclass correlation coefficient (ICC2,1). RESULTS: Reliability of the 6-minute walk test was excellent both at program intake (ICC2,1 = 0.91) and program completion (ICC2,1 = 0.98). On program intake, significant differences (P < 0.01) were found between test 1 (478 +/- 61 m) and test 2 (492 +/- 57 m), and between test 1 and test 3 (495 +/- 60 m). On program completion, there were no significant differences across the 3 replicate tests (507 m, 505 m, and 509 m). CONCLUSIONS: The 6-minute walk test is a reliable measure in people with fibromyalgia. In this study, two trials were required to achieve a stable walk performance before a treatment program. This learning effect was not present following the intervention.

Adult↗

PubMed1999

Clinical rating of dyskinesias in Parkinson's disease: use and reliability of a new rating scale.

Drug-induced dyskinesias (DID) manifested as hyperkinetic and/or dystonic movements or postures are common problems in Parkinson's disease (PD). Novel therapeutic interventions may offer possibilities to counteract these common adverse effects of an otherwise necessary treatment. To be able to evaluate the effects of such interventions on DID, reliable and relevant clinical assessment tools are needed. We tested the inter- and intrarater reliability of a new clinical dyskinesia rating scale consisting of separate ratings of different body parts, including lateralization and separate ratings of dystonia and hyperkinesias. Interrater reliability was tested both with and without a defined scoring code and clarification of the dystonia section. The nondefined version was also tested for intrarater reliability. Thirteen raters independently reviewed 23 videotape sequences showing PD patients performing standardized motor tests. Inter- and intrarater agreement was significant in all evaluations, and no differences were detected when comparing ratings performed with the defined and nondefined version of the scale. The rationale for, and the role and use of, the present scale are addressed.

Antiparkinson Agents↗

PubMed2002

A reliability study of potential risk factors for acute traumatic occupational hand injuries.

BACKGROUND: A reliability study of transient workplace exposures was conducted within a case-crossover study of acute traumatic occupational hand injuries. Exposures examined included features of work equipment (unusual performance of equipment or materials, glove use), work practices (performing an uncommon work task, using an unusual work method), and worker-related factors (being rushed, distracted, ill, or working overtime). METHODS: Interviewers administered a follow-up questionnaire about exposure up to 4 days after the initial interview. The reliability of the usual frequency of exposure in the past month, exposure reported at the time of the injury, and the degree to which subjects had confidence in the accuracy of their memory for exposure was assessed. RESULTS: The test-retest reliability for the estimated number of hours of exposure during the past month was high for six of the eight potential risk factors (intraclass correlation coefficients (ICC) ranging from 0.84-0.99). ICC for the frequency per month and minutes per exposure, used to calculate the estimated number of hours per month, ranged from 0.12-0.99 and 0.49-0.99, respectively. Agreement of reported exposure at the time of the injury, evaluated using the kappa statistic, ranged from substantial agreement to perfect agreement (0.65-1.0). However, for some factors, there was little or no reported exposure. Most subjects (74-100%) reported being "very confident" or "certain" in their memory for each exposure. CONCLUSIONS: These findings suggest that the frequency and duration of unusual transient workplace exposures can be reliably recalled by subjects interviewed by telephone within 4 days of an injury.

Accidents, Occupational↗

PubMed1983

Interobserver reliability of methods for paleopathological diagnosis of dental caries.

There is disagreement as to whether clinical methods of caries diagnosis will produce reliable results in skeletal material, and studies vary greatly in the extent to which such methods are employed. The purpose of this study is, therefore, to evaluate the interobserver reliability of visual, tactile, and radiographic methods of scoring dental caries in ancient populations. Thirty-three individuals from a Mogollon skeletal sample were scored on three occasions by pairs of examiners. The first exam employed visual criteria alone. In the second exam, visual methods were supplemented with the dental explorer. For the third exam, mesial and distal surfaces were scored from "intraoral" radiographs. Examiners worked independently, but did calibrate on material from clinical populations prior to the second and third exams. Exams were conducted on a "blind" basis, and analysis was delayed until all exams were completed. Caries scores were expressed as a percentage of total surfaces present per individual. Repeat-measures ANOVA and intraclass correlation coefficients (ICC) were used to estimate interobserver reliabilities. For visual scores, ICC = 0.97, and there is no significant difference between examiners (P = 0.897). For visual plus explorer scores, ICC drops to 0.90, and there is a significant difference between examiners (P = 0.003). For the radiographs, ICC = 0.86, and there is no significant difference between observers (P = 0.117). These results suggest that clinical methods are less reliable in skeletal populations.(ABSTRACT TRUNCATED AT 250 WORDS)

Dental Caries↗

PubMed1989

Reliability of anthropometric methods and replicate measurements.

The Spearman-Brown Prophesy formula, derived from psychometrics, may be used in anthropometric studies to describe the relationship between the intraclass reliability coefficient for a single measurement and the reliability resulting from the mean of replicate measurements. This theory may be applied to determine expected reliabilities of anthropometric protocols using replicate measurements and to determine the numbers of replicate measurements necessary to achieve desired levels of reliability.

Analysis of Variance↗

PubMed2002

The PedsQL in pediatric rheumatology: reliability, validity, and responsiveness of the Pediatric Quality of Life Inventory Generic Core Scales and Rheumatology Module.

OBJECTIVE: The Pediatric Quality of Life Inventory (PedsQL) is a modular instrument designed to measure health-related quality of life (HRQOL) in children and adolescents ages 2-18 years. The 23-item PedsQL 4.0 Generic Core Scales are multidimensional child self-report and parent proxy-report scales developed as the generic core measure to be integrated with the PedsQL disease-specific modules. The 22-item PedsQL 3.0 Rheumatology Module was designed to measure pediatric rheumatology-specific HRQOL. This study was undertaken to demonstrate the reliability, validity, and responsiveness of the PedsQL 4.0 Generic Core Scales and the PedsQL 3.0 Rheumatology Module in pediatric rheumatology. METHODS: The 4 PedsQL 4.0 Generic Core Scales (physical, emotional, social, and school functioning) and the 5 PedsQL 3.0 Rheumatology Module scales (pain and hurt, daily activities, treatment, worry, and communication) were administered to 231 children and 244 parents (271 subjects accrued overall) recruited from a pediatric rheumatology clinic. RESULTS: Internal consistency reliability for the PedsQL Generic Core total scale score (alpha = 0.91 for child self report, alpha = 0.93 for parent proxy report), physical health summary score (alpha = 0.87 for child self report, alpha = 0.89 for parent proxy report), and psychosocial health summary score (alpha = 0.86 for child self report, alpha = 0.90 for parent proxy report) were acceptable for group comparisons. The Rheumatology Module scales also demonstrated acceptable reliability for group comparisons (alpha = 0.75-0.86 for child self report, alpha = 0.82-0.91 for parent proxy report). Validity was demonstrated using the known-groups method. The PedsQL distinguished between healthy children and children with rheumatic diseases as a group. The responsiveness of the PedsQL was demonstrated through patient change over time as a result of clinical intervention. CONCLUSION: The results demonstrate the reliability, validity, and responsiveness of the PedsQL 4.0 Generic Core Scales and the PedsQL 3.0 Rheumatology Module in pediatric rheumatology.

Adolescent↗

PubMed2003

Disease activity score for children with juvenile dermatomyositis: reliability and validity evidence.

OBJECTIVE: To assess the reliability and validity of the Disease Activity Score (DAS), an instrument used to evaluate children with juvenile dermatomyositis (JDM). METHODS: Psychometric study of internal consistency, reliability, rater agreement, and the relationship with measures of muscle strength and disability was conducted. RESULTS: The DAS ratings are internally consistent (reliability = 0.89) and describe a wide range of disease activity. The pediatric rheumatologists in this study agree on the presence of most of the disease indicators. Their disagreements tend to cancel each other, resulting in highly correlated (r = 0.79) overall measures across raters. Estimates of muscle weakness using the DAS and ratings of muscle strength obtained independently from therapists are highly related (r = -0.77), but estimates of disease activity and disability are weakly related (r = 0.20). CONCLUSION: The DAS exhibits evidence of good reliability and validity. The combination of skin and muscle strength assessments makes this easily administered instrument a useful addition in the evaluation of children with JDM.

Adolescent↗

PubMed1991

The validity and reliability of parental ratings of disease activity in juvenile rheumatoid arthritis.

This study assessed the validity and reliability of parental ratings of morning stiffness, activity limitations, and pain complaints on a sample of 31 patients with juvenile rheumatoid arthritis (JRA). Parental ratings were found to be significant predictors of active joint counts, accounting for 40% of the variance in joint counts. Internal consistency reliability was moderately high (0.819), but test-retest reliability was moderate to low; this is not unexpected given the fluctuations in symptoms of JRA over time. The results suggest that parental ratings are valid and moderately reliable measures of disease activity in JRA. Regular monitoring of symptoms by parents could be a useful source of information for health care providers in making treatment decisions and can increase parental and patient involvement in the treatment process.

Arthritis, Juvenile↗

PubMed2004

Reliability and validity of the Duruoz Hand Index in persons with systemic sclerosis (scleroderma).

OBJECTIVE: To examine the test-retest reliability and concurrent validity of the Duruoz Hand Index (DHI) in persons with scleroderma. METHODS: Forty patients with scleroderma and no other major medical problems completed the DHI at 2 points in time to assess test-retest reliability. To assess validity, participants were administered the Arthritis Hand Function Test (AHFT), the Hand Mobility in Scleroderma Test (HAMIS), and the Keital Function Test (KFT), all performance-based tests. In addition, participants completed the Health Assessment Questionnaire (HAQ), a self report of functional ability. RESULTS: Test-retest reliability intraclass correlation coefficients for the DHI ranged from 0.81 to 0.97. Scores on the DHI did not correlate with HAMIS scores, but were significantly correlated with scores from the KFT (rs = 0.48, P < 0.01), HAQ (rs = 0.79, P < 0.01), and all sections of the AHFT (rs = 0.34-0.60, P < 0.05-0.01). CONCLUSION: The results from this study show the DHI to be a reliable and valid test for persons with scleroderma.

Activities of Daily Living↗

PubMed2005

The lateral view radiograph for assessment of the tibiofemoral joint space in knee osteoarthritis: its reliability, sensitivity to change, and longitudinal validity.

OBJECTIVE: To evaluate the reliability, validity, and sensitivity to change of tibiofemoral (TF) narrowing on lateral radiographic views. METHODS: In a natural history study of symptomatic knee osteoarthritis (OA), both lateral view and fluoroscopically positioned posteroanterior (PA) semiflexed view radiographs of the knee in 30 degrees of flexion and with weight bearing were obtained at baseline and at 30 months. Test-retest reliability was evaluated using repeat radiographs, with joint space width measured using electronic calipers. All radiographs were scored on a 0-3 scale, and progression of joint space loss was defined as narrowing of the joint space by 1 grade. We evaluated sensitivity to change compared with the PA view. We evaluated validity by examining whether knees with progression showed expected malalignment on full-limb films. RESULTS: Test-retest reliability of the TF joint space using the lateral view had a root mean square error of 0.303 mm, with 92.5% of repeats within 1 mm. More knees showed progression on the lateral view alone (n = 41) than on the PA view alone (n = 27). Compared with knees without joint space loss, knees with medial compartment loss on the lateral view only were more varus malaligned (P < 0.001), while those with lateral compartment loss were more valgus malaligned (P = 0.008). CONCLUSION: In the assessment of TF joint space loss, lateral view radiographs are reliable, valid, and more sensitive to change than fluoroscopically positioned PA radiographs.

Cartilage, Articular↗

PubMed2005

Using the SWAP-200 in a personality-disordered forensic population: is it valid, reliable and useful?

BACKGROUND: Treatment and risk management of forensic patients relies heavily on diagnosing psychopathology, yet the reliability of clinical diagnoses of personality disorder has been found to be only fair to low. Structured instruments for the global assessment of personality disorder are infrequently used in clinical assessments possibly due to their limited validity and clinical utility. AIMS/METHODS: The Shedler-Westen Assessment Procedure-200 (SWAP-200) was developed in an effort to address these limitations. Although good reliability and validity in relation to clinicians' diagnosis of personality disorder has been reported, to date the validity of this instrument has not been assessed in relation to other standardized instruments or in a personality-disordered, forensic population. This study aims to establish the reliability and validity of the SWAP-200 against other diagnostic instruments and measures of interpersonal functioning in a personality disordered forensic population. RESULTS: This paper reports the results of 30 subjects from a high secure hospital in the UK who were assessed with the SWAP-200, the Structured Clinical Interview for DSM-IV Personality Disorders (SCID-II), the Adult Attachment Interview (AAI) and the Chart of Interpersonal Reactions in Closed Living Environments (CIRCLE). Preliminary results suggest that the SWAP-200 is a reliable instrument for the diagnosis of personality disorder in forensic patients. CONCLUSIONS: Although the small sample size allows only preliminary conclusions about the validity of this instrument, early results show a reduction of the diagnosis of comorbidity compared with the SCID-II, together with an increased number of expected associations between independent measures of interpersonal functioning and categories of personality disorder.

Adult↗