Search PubMed⌕ Search

Biomedical subjects

J A Schnaier

Publications and source records attributed to J A Schnaier.

5 recordsLinked to original sources

The use of cognitive testing to develop and evaluate CAHPS 1.0 core survey items. Consumer Assessment of Health Plans Study.

OBJECTIVES: The main goal of the Consumer Assessments of Health Plans Study (CAHPS) is to develop an integrated set of tested, standardized surveys to obtain meaningful information from health plan enrollees about their experiences. The CAHPS project benefits from the complementary strengths of psychometric and cognitive testing. METHODS: The CAHPS team conducted 150 cognitive interviews across three organizations in different geographic locations using multiple interview methods with different consumer populations. This article explains how cognitive testing was used in the CAHPS survey development process and shares the main findings from the cognitive interviews. RESULTS: A modified report format is more appropriate when asking about specific aspects of plan enrollees' experiences, whereas a rating format is useful for asking about overall assessments. Specifying a longer reference period is preferable to asking about the most recent visit when capturing experiences with care, because some respondents get frustrated when they cannot include experiences other than the most recent visit. Explicit screeners and tailored inapplicable response categories are beneficial in mail questionnaires, so people know that they should not answer questions about which they have no relevant experience. CONCLUSION: Cognitive testing was integral in the development and refinement of the CAHPS instrument. The cognitive testing findings contributed to an improved instrument that should capture consumers' health care and plan experiences with less response error than one not subjected to such testing. The cognitive testing process and findings can be useful to other researchers with similar survey development goals.

Adult↗

Special issues addressed in the CAHPS survey of Medicare managed care beneficiaries. Consumer Assessment of Health Plans Study.

OBJECTIVES: This article describes the process through which the MMC survey was developed and examines issues in using this survey with Medicare beneficiaries that have implications for all CAHPS surveys. These include the ability of Medicare beneficiaries to use MMC navigational features, whether access measures are meaningful for this population, and whether beneficiaries' familiarity with managed care influences their health plan assessments. BACKGROUND: The Health Care Financing Administration (HCFA) is mandated to provide comparative plan information, based partly on consumer surveys, to Medicare beneficiaries. The Consumer Assessments of Health Plans Study (CAHPS) is an integrated set of tested, standardized surveys of health plan enrollees. To meet its goal, HCFA has invested in the development of a CAHPS survey of beneficiaries enrolled in Medicare Managed Care plans (MMC). METHODS: Cognitive interviews were completed with 31 Medicare beneficiaries. A field test also was conducted with beneficiaries to examine patterns of survey response. A sample of 956 eligible individuals was selected from six health plans. Using a combination of mail and telephone data collection, 663 (69%) questionnaires were completed. This article provides selective results from these tests. RESULTS: The use of screening questions, skip instructions, and tailored "not applicable" response options appeared to facilitate the response task. Some CAHPS access questions were not meaningful to Medicare beneficiaries. The data do not support the need to adjust for length of plan enrollment. CONCLUSION: Analyses suggested changes to improve the MMC survey and to make other CAHPS surveys consistent with these changes.

Aged↗

Epilogue: Early lessons from CAHPS Demonstrations and Evaluations. Consumer Assessment of Health Plans Study.

OBJECTIVES: The Consumer Assessment of Health Plans Study (CAHPS) was developed to provide an integrated set of tested, standardized surveys to obtain meaningful information from health plan enrollees and their experiences. Many organizations began to implement CAHPS in 1997. Formal evaluations of the experiences of three demonstration sites with implementing CAHPS (ie, process evaluations) and the impact of CAHPS on consumer's choices (ie, outcome evaluations) were conducted. This article reports on the early findings and feedback from our process evaluations about the sites' experiences with using CAHPS. Results are presented from the first round demonstration sites, including the lessons learned during the demonstrations. Our plans for future demonstrations and evaluations are included. METHODS: A similar evaluation design and instruments were used across demonstration sites. The process evaluation to monitor program intervention included on-site interviews, off-site review of documents, and focus groups with consumers. RESULTS: There are 4 early results from the CAHPS demonstrations: (1) the CAHPS survey covers topics of importance to sponsors, is of reasonable length, and can be administered quickly; (2) the report templates are being used effectively, but sponsors vary widely in their preferences for summarizing and presenting CAHPS ratings; (3) standardized or off-the-shelf products are aspects of CAHPS that sponsors value highly, while emphasizing need for further development; and (4) because surveys like CAHPS require multiple within-plan samples to make plan comparisons, they require a substantial investment and may be affordable only for large sponsors. CONCLUSION: The first round CAHPS demonstrations highlighted the strengths of the integrated surveys and the areas for improving the products and the implementation process.

Consumer Behavior↗

Medicare beneficiary counseling programs: what are they and do they work?

Medicare beneficiaries face myriad rules, conditions, and exceptions under the Medicare program. As a result, State Information, Counseling, and Assistance (ICA) programs were established or enhanced with Federal funding as part of the Omnibus Budget Reconciliation Act (OBRA) of 1990. ICA programs utilize a volunteer-based and locally-sponsored support system to deliver free and unbiased counseling on the Medicare program and related health insurance issues. This article discusses the effectiveness of the ICA model. Because the ICA programs serve as a vital link between HCFA and its beneficiaries, information about the programs' success may be useful to HCFA and other policymakers during this era of consumer information.

Centers for Medicare and Medicaid Services, U.S.↗

Consumer information development and use.

The availability of informational materials to aid consumer health care purchasing decisions is increasing. Organizations developing and disseminating materials include public- and private-sector employers, providers, purchasing cooperatives, State agencies, counseling programs, and accreditation bodies. Based on case study interviews with 24 organizations, we learned that 10 included consumer satisfaction ratings and performance measures based on medical records. An additional four organizations developed materials with consumer satisfaction ratings exclusively. Printed materials were the most common medium used to convey information to consumers. However, other mechanisms for conveying the information were also employed. On the whole, the materials have not been rigorously evaluated. Evaluations are needed to determine if consumers find the information useful and how different individuals prefer to receive the information.

Centers for Medicare and Medicaid Services, U.S.↗