Monitoring data quality through comparisons between data systems.

Abstract

Since its creation in 1960, the National Center for Health Statistics (NCHS) has placed a high value on the quality of the information and statistics collected and published by its data systems. An important component of a comprehensive data quality monitoring system for a statistical agency such as NCHS is the comparison of statistics between data systems. Between-data-systems comparisons are used to monitor the consistency and comparability of statistics across data systems and between NCHS data systems and outside sources of data. This paper focuses on between-data-systems comparisons and describes a number of methodological analyses that can be used to evaluate data quality. The methodological analyses presented include the evaluation of time trends, the estimation of survey method effects, the evaluation of response error, the measurement of definitional and concept effects, and the detection of inconsistencies between data systems. The paper concludes with a discussion of the complexities of the between-data-systems comparisons and an assessment of the net benefits from such comparisons.