The Influence of Respondent Characteristics on the Validity of Self-Reported Survey Responses

Barbara Guerard, Vincent K Omachonu, Raymond A. Harvey, S. Robert Hernandez, Bisakha Sen

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

Objective: To examine concordance between member self-reports and the organization's administrative claims data for two key health factors: number of chronic conditions, and number of prescription drugs. Data: Medicare Advantage plan claims data and member survey data from 2011 to 2012. Design: Mailed surveys to 15,000 members, enrolled minimum 6 months, drawn from a random sample of primary care physician practices with at least 200 members. Methods: Descriptive statistics were generated for extent of concordance. Multivariable logistic regressions were used to analyze the association of selected respondent characteristics with likelihood of concordance. Findings: Concordance for number of chronic conditions was 58.4 percent, with 27.3 percent under-reporting, 14.2 percent over-reporting. Concordance for number of prescription drugs was 56.6 percent with 38.9 percent under-reporting, 4.5 percent over-reporting. Number of prescriptions and assistance in survey completion were associated with higher likelihood of concordance for chronic conditions. Assistance in survey completion and number of chronic conditions were associated with higher concordance, and age and number of prescriptions were associated with lower concordance, for prescription drugs. Conclusions: Self-reported number of chronic conditions and prescription medications are not in high concordance with claims data. Health care researchers and policy makers using patient self-reported data should be aware of these potential biases.

Original languageEnglish (US)
JournalHealth Services Research
DOIs
StateAccepted/In press - 2015

Fingerprint

Prescription Drugs
Prescriptions
Medicare Part C
Primary Care Physicians
Health Policy
Administrative Personnel
Self Report
Logistic Models
Research Personnel
Surveys and Questionnaires
Organizations
Delivery of Health Care
Health

Keywords

  • Agreement
  • Chronic condition
  • Elderly
  • Medicare
  • Survey

ASJC Scopus subject areas

  • Health Policy

Cite this

The Influence of Respondent Characteristics on the Validity of Self-Reported Survey Responses. / Guerard, Barbara; Omachonu, Vincent K; Harvey, Raymond A.; Hernandez, S. Robert; Sen, Bisakha.

In: Health Services Research, 2015.

Research output: Contribution to journalArticle

@article{d1e31b87e10a49c99b8f47a4939d8106,
title = "The Influence of Respondent Characteristics on the Validity of Self-Reported Survey Responses",
abstract = "Objective: To examine concordance between member self-reports and the organization's administrative claims data for two key health factors: number of chronic conditions, and number of prescription drugs. Data: Medicare Advantage plan claims data and member survey data from 2011 to 2012. Design: Mailed surveys to 15,000 members, enrolled minimum 6 months, drawn from a random sample of primary care physician practices with at least 200 members. Methods: Descriptive statistics were generated for extent of concordance. Multivariable logistic regressions were used to analyze the association of selected respondent characteristics with likelihood of concordance. Findings: Concordance for number of chronic conditions was 58.4 percent, with 27.3 percent under-reporting, 14.2 percent over-reporting. Concordance for number of prescription drugs was 56.6 percent with 38.9 percent under-reporting, 4.5 percent over-reporting. Number of prescriptions and assistance in survey completion were associated with higher likelihood of concordance for chronic conditions. Assistance in survey completion and number of chronic conditions were associated with higher concordance, and age and number of prescriptions were associated with lower concordance, for prescription drugs. Conclusions: Self-reported number of chronic conditions and prescription medications are not in high concordance with claims data. Health care researchers and policy makers using patient self-reported data should be aware of these potential biases.",
keywords = "Agreement, Chronic condition, Elderly, Medicare, Survey",
author = "Barbara Guerard and Omachonu, {Vincent K} and Harvey, {Raymond A.} and Hernandez, {S. Robert} and Bisakha Sen",
year = "2015",
doi = "10.1111/1475-6773.12356",
language = "English (US)",
journal = "Health Services Research",
issn = "0017-9124",
publisher = "Wiley-Blackwell",

}

TY - JOUR

T1 - The Influence of Respondent Characteristics on the Validity of Self-Reported Survey Responses

AU - Guerard, Barbara

AU - Omachonu, Vincent K

AU - Harvey, Raymond A.

AU - Hernandez, S. Robert

AU - Sen, Bisakha

PY - 2015

Y1 - 2015

N2 - Objective: To examine concordance between member self-reports and the organization's administrative claims data for two key health factors: number of chronic conditions, and number of prescription drugs. Data: Medicare Advantage plan claims data and member survey data from 2011 to 2012. Design: Mailed surveys to 15,000 members, enrolled minimum 6 months, drawn from a random sample of primary care physician practices with at least 200 members. Methods: Descriptive statistics were generated for extent of concordance. Multivariable logistic regressions were used to analyze the association of selected respondent characteristics with likelihood of concordance. Findings: Concordance for number of chronic conditions was 58.4 percent, with 27.3 percent under-reporting, 14.2 percent over-reporting. Concordance for number of prescription drugs was 56.6 percent with 38.9 percent under-reporting, 4.5 percent over-reporting. Number of prescriptions and assistance in survey completion were associated with higher likelihood of concordance for chronic conditions. Assistance in survey completion and number of chronic conditions were associated with higher concordance, and age and number of prescriptions were associated with lower concordance, for prescription drugs. Conclusions: Self-reported number of chronic conditions and prescription medications are not in high concordance with claims data. Health care researchers and policy makers using patient self-reported data should be aware of these potential biases.

AB - Objective: To examine concordance between member self-reports and the organization's administrative claims data for two key health factors: number of chronic conditions, and number of prescription drugs. Data: Medicare Advantage plan claims data and member survey data from 2011 to 2012. Design: Mailed surveys to 15,000 members, enrolled minimum 6 months, drawn from a random sample of primary care physician practices with at least 200 members. Methods: Descriptive statistics were generated for extent of concordance. Multivariable logistic regressions were used to analyze the association of selected respondent characteristics with likelihood of concordance. Findings: Concordance for number of chronic conditions was 58.4 percent, with 27.3 percent under-reporting, 14.2 percent over-reporting. Concordance for number of prescription drugs was 56.6 percent with 38.9 percent under-reporting, 4.5 percent over-reporting. Number of prescriptions and assistance in survey completion were associated with higher likelihood of concordance for chronic conditions. Assistance in survey completion and number of chronic conditions were associated with higher concordance, and age and number of prescriptions were associated with lower concordance, for prescription drugs. Conclusions: Self-reported number of chronic conditions and prescription medications are not in high concordance with claims data. Health care researchers and policy makers using patient self-reported data should be aware of these potential biases.

KW - Agreement

KW - Chronic condition

KW - Elderly

KW - Medicare

KW - Survey

UR - http://www.scopus.com/inward/record.url?scp=84941711640&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84941711640&partnerID=8YFLogxK

U2 - 10.1111/1475-6773.12356

DO - 10.1111/1475-6773.12356

M3 - Article

C2 - 26369710

AN - SCOPUS:84941711640

JO - Health Services Research

JF - Health Services Research

SN - 0017-9124

ER -