Search PubMed⌕ Search

PubMed · 14674870

Potential problems with "well fitting" models.

Abstract

The assessment of model fit is a more complex and indeterminate process than is commonly acknowledged by researchers who use structural equation modeling (SEM) techniques. Even models that are well fitting according to commonly used statistical tests and descriptive fit indices can have significant problems and ambiguities. The authors discuss 7 potential difficulties that can arise and that should temper researchers' conclusions: equivalent models, nonequivalent but well-fitting alternative models, omitted variables, problematic lower-order model components, the failure to parse composite models into meaningful partitions (e.g., measurement vs. structural), inattention to the multiple factors that affect the sensitivity of measures of fit to model misspecifications, and reliance on specification searches. In addition to providing examples of each of these problems, the authors offer recommendations for psychopathologists who conduct SEM analyses.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Andrew J Tomarken, Niels G Waller. 2003. Potential problems with "well fitting" models.. https://doi.org/10.1037/0021-843x.112.4.578

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related citations

Molecular heterochrony and the evolution of sociality in bumblebees (Bombus terrestris).

Sibling care is a hallmark of social insects, but its evolution remains challenging to explain at the molecular level. The hypothesis that sibling care evolved from ancestral maternal care in primitively eusocial insects has been elaborated to involve heterochronic changes in gene expression. This elaboration leads to the prediction that workers in these species will show patterns of gene expression more similar to foundress queens, who express maternal care behaviour, than to established queens engaged solely in reproductive behaviour. We tested this idea in bumblebees (Bombus terrestris) using a microarray platform with approximately 4500 genes. Unlike the wasp Polistes metricus, in which support for the above prediction has been obtained, we found that patterns of brain gene expression in foundress and queen bumblebees were more similar to each other than to workers. Comparisons of differentially expressed genes derived from this study and gene lists from microarray studies in Polistes and the honeybee Apis mellifera yielded a shared set of genes involved in the regulation of related social behaviours across independent eusocial lineages. Together, these results suggest that multiple independent evolutions of eusociality in the insects might have involved different evolutionary routes, but nevertheless involved some similarities at the molecular level.

Analysis of Variance↗

A simple hybrid variance estimator for the Kaplan-Meier survival function.

In this paper, we propose a hybrid variance estimator for the Kaplan-Meier survival function. This new estimator approximates the true variance by a Binomial variance formula, where the proportion parameter is a piecewise non-increasing function of the Kaplan-Meier survival function and its upper bound, as described below. Also, the effective sample size equals the number of subjects not censored prior to that time. In addition, we consider an adjusted hybrid variance estimator that modifies the regular estimator for small sample sizes. We present a simulation study to compare the performance of the regular and adjusted hybrid variance estimators to the Greenwood and Peto variance estimators for small sample sizes. We show that on average these hybrid variance estimators give closer variance estimates to the true values than the traditional variance estimators, and hence confidence intervals constructed with these hybrid variance estimators have more nominal coverage rates. Indeed, the Greenwood and Peto variance estimators can substantially underestimate the true variance in the left and right tails of the survival distribution, even with moderately censored data. Finally, we illustrate the use of these hybrid and traditional variance estimators on a data set from a leukaemia clinical trial.

Analysis of Variance↗