TY - JOUR
T1 - Development and validation of electronic quality measures to assess care for patients with transient ischemic attack and minor ischemic stroke
AU - Bravata, Dawn M.
AU - Myers, Laura J.
AU - Cheng, Eric
AU - Reeves, Mathew
AU - Baye, Fitsum
AU - Yu, Zhangsheng
AU - Damush, Teresa
AU - Miech, Edward J.
AU - Sico, Jason
AU - Phipps, Michael
AU - Zillich, Alan
AU - Johanning, Jason
AU - Chaturvedi, Seemant
AU - Austin, Curt
AU - Ferguson, Jared
AU - Maryfield, Bailey
AU - Snow, Kathy
AU - Ofner, Susan
AU - Graham, Glenn
AU - Rhude, Rachel
AU - Williams, Linda S.
AU - Arling, Greg
N1 - Funding Information:
From the Department of Veterans Affairs (VA) Health Services Research and Development (HSR&D) Stroke Quality Enhancement Research Initiative (QUERI), Washington, DC (D.M.B., L.J.M., E.C., M.R., T.D., E.J.M., B.M., G.G., L.S.W., G.A.); VA HSR&D Center for Health Information and Communication (CHIC), Richard L. Roudebush VA Medical Center, Indianapolis, IN (D.M.B., L.J.M., T.D., E.J.M., C.A., J.F., B.M., K.S., L.S.W.); Department of Internal Medicine (D.M.B., L.J.M., T.D., E.J.M., C.A.) and Department of Neurology (D.M.B., L.S.W.), and Department of Emergency Medicine (E.J.M.), Indiana University School of Medicine, Indianapolis; Regenstrief Institute, Indianapolis, IN (D.M.B., T.D., E.J.M., L.S.W.); VA Nebraska-Western Iowa Health Care System-Omaha Division, Omaha, NE (J.J.); Department of Surgery, University of Nebraska, Lincoln (J.J.); Clinical Epidemiology Research Center, VA Connecticut Healthcare System, West Haven, CT (J.S.); Departments of Internal Medicine and Neurology, Yale University School of Medicine, New Haven, CT (J.S., J.F.); School of Nursing, Purdue University, West Lafayette, IN (G.A.); Department of Biostatistics, Indiana University School of Medicine, IUPUI, Indianapolis (F.B., Z.Y., S.O.); Department of Neurology, University of Maryland School of Medicine, Baltimore (M.P.); Miami VA Medical Center (S.C.); Department of Neurology, School of Medicine, University of Miami, FL (S.C.); Department of Pharmacy Practice, College of Pharmacy, Purdue University, West Lafayette, IN (A.Z.); Department of Epidemiology, Michigan State University, East Lansing (M.R.); Department of Neurology, VA Greater Los Angeles Healthcare System, Los Angeles, CA (E.C.); Department of Neurology, David Geffen School of Medicine, University of California at Los Angeles (E.C.); and Department of Veterans Affairs, Office of Analytics and Business Intelligence, In-Patient Evaluation Center (IPEC), Cincinnati, OH (R.R.). The Data Supplement is available at http://circoutcomes.ahajournals.org/lookup/suppl/doi:10.1161/CIRCOUTCOMES.116.003157/-/DC1.
Funding Information:
The American Heart Association/American Stroke Association (AHA/ASA) has proposed a set of process measures for use in evaluating quality of care for patients with acute ischemic stroke and transient ischemic attack (TIA).8 Similar measures have been supported by the Joint Commission (JC) and the National Quality Forum.9,10The JC stroke measures are part of the CMS Hospital Inpatient Quality Reporting Program.7Yet, the evaluation of stroke care quality focused on processes of care has historically relied on chart review. Although some investigators have examined the challenges in constructing certain ischemic stroke quality measures from EHR data,11 this study has not included all harmonized stroke quality measures or the processes of care that have been associated with improved outcomes for patients with TIA.12–14
Funding Information:
This study was supported by the Department of Veterans Affairs (VA), Health Services Research & Development Service (HSRD), Stroke Quality Enhancement Research Initiative (QUERI) Service Directed Project (SDP 12–178). Dr Sico was supported by a VA HSRD Career Development Award (HX001388-01A1). Support for VA/Centers for Medicare and Medicaid Service (CMS) data was provided by the VA Information Resource Center (SDR 02–237 and 98-004).
Publisher Copyright:
© 2017 American Heart Association, Inc.
PY - 2017/6/1
Y1 - 2017/6/1
N2 - Background-Despite interest in using electronic health record (EHR) data to assess quality of care, the accuracy of such data is largely unknown. We sought to develop and validate transient ischemic attack and minor ischemic stroke electronic quality measures (eQMs) using EHR data. Methods and Results-A random sample of patients with transient ischemic attack or minor ischemic stroke, cared for in Veterans Health Administration facilities (fiscal year 2011), was identified. We constructed 31 eQMs based on existing quality measures. Chart review was the criterion standard for validating the eQMs. To evaluate eQMs in terms of eligibility, we calculated the proportion of patients who were genuinely not eligible to receive a process (based on chart review) and who were correctly identified as not eligible by the EHR data (specificity). To assess eQMs about classification of whether patients received a process, we calculated the proportion of patients who actually received the process (based on chart review) and who were classified correctly by the EHR data as passing (sensitivity). Seven hundred sixty-Three patients were included. About eligibility, specificity varied from 25% (brain imaging; carotid imaging) to 99% (anticoagulation quality). About pass rates, sensitivity varied from 30% (antihypertensive class) to 100% (coronary risk assessment; international normalized ratio measured). The 16 eQMs with ≥70% specificity in eligibility and ≥70% sensitivity in pass rates included coronary risk assessment, international normalized ratio measured, HbA1c measurement, speech language pathology consultation, anticoagulation for atrial fibrillation, discharge on statin, lipid management, neurology consultation, Holter, deep vein thrombosis prophylaxis, oral hypoglycemic intensification, cholesterol medication intensification, antihypertensive intensification, antihypertensive class, carotid stenosis intervention, and substance abuse referral for alcohol. Conclusions-It is feasible to construct valid eQMs for processes of transient ischemic attack and minor ischemic stroke care. Healthcare systems with EHRs should consider using electronic data to evaluate care for their patients with transient ischemic attack and to complement and expand quality measurement programs currently focused on patients with stroke.
AB - Background-Despite interest in using electronic health record (EHR) data to assess quality of care, the accuracy of such data is largely unknown. We sought to develop and validate transient ischemic attack and minor ischemic stroke electronic quality measures (eQMs) using EHR data. Methods and Results-A random sample of patients with transient ischemic attack or minor ischemic stroke, cared for in Veterans Health Administration facilities (fiscal year 2011), was identified. We constructed 31 eQMs based on existing quality measures. Chart review was the criterion standard for validating the eQMs. To evaluate eQMs in terms of eligibility, we calculated the proportion of patients who were genuinely not eligible to receive a process (based on chart review) and who were correctly identified as not eligible by the EHR data (specificity). To assess eQMs about classification of whether patients received a process, we calculated the proportion of patients who actually received the process (based on chart review) and who were classified correctly by the EHR data as passing (sensitivity). Seven hundred sixty-Three patients were included. About eligibility, specificity varied from 25% (brain imaging; carotid imaging) to 99% (anticoagulation quality). About pass rates, sensitivity varied from 30% (antihypertensive class) to 100% (coronary risk assessment; international normalized ratio measured). The 16 eQMs with ≥70% specificity in eligibility and ≥70% sensitivity in pass rates included coronary risk assessment, international normalized ratio measured, HbA1c measurement, speech language pathology consultation, anticoagulation for atrial fibrillation, discharge on statin, lipid management, neurology consultation, Holter, deep vein thrombosis prophylaxis, oral hypoglycemic intensification, cholesterol medication intensification, antihypertensive intensification, antihypertensive class, carotid stenosis intervention, and substance abuse referral for alcohol. Conclusions-It is feasible to construct valid eQMs for processes of transient ischemic attack and minor ischemic stroke care. Healthcare systems with EHRs should consider using electronic data to evaluate care for their patients with transient ischemic attack and to complement and expand quality measurement programs currently focused on patients with stroke.
KW - Ischemic attack
KW - Sensitivity and specificity
KW - Stroke
KW - Transient
KW - electronic health records
UR - http://www.scopus.com/inward/record.url?scp=85032196276&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85032196276&partnerID=8YFLogxK
U2 - 10.1161/CIRCOUTCOMES.116.003157
DO - 10.1161/CIRCOUTCOMES.116.003157
M3 - Article
C2 - 28912200
AN - SCOPUS:85032196276
VL - 10
JO - Circulation: Cardiovascular Quality and Outcomes
JF - Circulation: Cardiovascular Quality and Outcomes
SN - 1941-7713
IS - 9
M1 - e003157
ER -