Search PubMed⌕ Search
Home/Archive/PubMed

PubMed · 11004873

Large-sample confidence intervals for validity and reliability coefficients.

J L Mendoza·K L Stafford·J M Stauffer
View original source ↗Export metadata ↓

Abstract

Large-sample confidence intervals (CI) for reliability, validity, and unattenuated validity are presented. The CI for unattenuated validity is based on the Bonferroni inequality, which relies on one CI for test-retest reliability and one for validity. Covered are four reliability-validity situations: (a) both estimates were from random samples; (b) reliability was from a random sample but validity was from a selected sample; (c) validity was from a random sample but reliability was from a selected sample; and (d) both estimates were from selected samples. All CIs were evaluated by using a simulation. CIs on reliability, validity, or unattenuated validity are accurate as long as selection ratio is at least 20% and selected sample size is 100 or larger. When selection ratio is less than 20%, estimators tend to underestimate their parameters.

Explore related subjects

Confidence IntervalsHumansMonte Carlo MethodPsychometricsReproducibility of ResultsSample SizeSampling StudiesJournal Article

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

J L Mendoza, K L Stafford, J M Stauffer. 2000. Large-sample confidence intervals for validity and reliability coefficients.. https://doi.org/10.1037/1082-989x.5.3.356

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related citations

PubMed2007

Covariates-dependent confidence intervals for the difference or ratio of two median survival times.

In this paper, we are concerned with the estimation of the discrepancy between two treatments when right-censored survival data are accompanied with covariates. Conditional confidence intervals given the available covariates are constructed for the difference between or ratio of two median survival times under the unstratified and stratified Cox proportional hazards models, respectively. The proposed confidence intervals provide the information about the difference in survivorship for patients with common covariates but in different treatments. The results of a simulation study investigation of the coverage probability and expected length of the confidence intervals suggest the one designed for the stratified Cox model when data fit reasonably with the model. When the stratified Cox model is not feasible, however, the one designed for the unstratified Cox model is recommended. The use of the confidence intervals is finally illustrated with a HIV+ data set.

Confidence Intervals↗
PubMed2007

Inferences on standardized mean difference: the generalized variable approach.

The standardized mean difference has been widely used as the most common index of effect magnitude in many applied fields. In this paper, we propose a novel approach using the concept of generalized variable for the confidence interval estimation and hypothesis testing of standardized mean difference. Furthermore, we extend this approach to compare standardized mean differences between two studies or between two strata. Simulation results demonstrate that the proposed approach can provide confidence intervals with excellent coverage properties and can perform hypothesis testing with satisfactory type-I error control.

Confidence Intervals↗
PubMed2007

Interval estimation for rank correlation coefficients based on the probit transformation with extension to measurement error correction of correlated ranked data.

The Spearman (rho(s)) and Kendall (tau) rank correlation coefficient are routinely used as measures of association between non-normally distributed random variables. However, confidence limits for rho(s) are only available under the assumption of bivariate normality and for tau under the assumption of asymptotic normality of tau. In this paper, we introduce another approach for obtaining confidence limits for rho(s) or tau based on the arcsin transformation of sample probit score correlations. This approach is shown to be applicable for an arbitrary bivariate distribution. The arcsin-based estimators for rho(s) and tau (denoted by rho(s,a), tau(a)) are shown to have asymptotic relative efficiency (ARE) of 9/pi2 compared with the usual estimators rho(s) and tau when rho(s) and tau are, respectively, 0. In some nutritional applications, the Spearman rank correlation between nutrient intake as assessed by a reference instrument versus nutrient intake as assessed by a surrogate instrument is used as a measure of validity of the surrogate instrument. However, if only a single replicate (or a few replicates) are available for the reference instrument, then the estimated Spearman rank correlation will be downwardly biased due to measurement error. In this paper, we use the probit transformation as a tool for specifying an ANOVA-type model for replicate ranked data resulting in a point and interval estimate of a measurement error corrected rank correlation. This extends previous work by Rosner and Willett for obtaining point and interval estimates of measurement error corrected Pearson correlations.

Confidence Intervals↗