Limitations of patient experience reports to evaluate physician quality in spine surgery: analysis of 7485 surveys

Nitin Agarwal Department of Neurological Surgery and

Search for other papers by Nitin Agarwal in
jns
Google Scholar
PubMed
Close
 MD
,
Andrew Faramand Department of Neurological Surgery and

Search for other papers by Andrew Faramand in
jns
Google Scholar
PubMed
Close
 MD, MS
,
Johanna Bellon Wolff Center, University of Pittsburgh Medical Center, Pittsburgh, Pennsylvania

Search for other papers by Johanna Bellon in
jns
Google Scholar
PubMed
Close
 PhD
,
Jeffrey Borrebach Wolff Center, University of Pittsburgh Medical Center, Pittsburgh, Pennsylvania

Search for other papers by Jeffrey Borrebach in
jns
Google Scholar
PubMed
Close
 MS
,
D. Kojo Hamilton Department of Neurological Surgery and

Search for other papers by D. Kojo Hamilton in
jns
Google Scholar
PubMed
Close
 MD
,
David O. Okonkwo Department of Neurological Surgery and

Search for other papers by David O. Okonkwo in
jns
Google Scholar
PubMed
Close
 MD, PhD
, and
Adam S. Kanter Department of Neurological Surgery and

Search for other papers by Adam S. Kanter in
jns
Google Scholar
PubMed
Close
 MD
Restricted access

Purchase Now

USD  $45.00

Spine - 1 year subscription bundle (Individuals Only)

USD  $384.00

JNS + Pediatrics + Spine - 1 year subscription bundle (Individuals Only)

USD  $624.00
USD  $45.00
USD  $384.00
USD  $624.00
Print or Print + Online Sign in

OBJECTIVE

The Clinician and Group Consumer Assessment of Healthcare Providers and Systems (CG-CAHPS) is a standardized patient experience survey that is used to evaluate the quality of care delivered by physicians. The authors sought to determine which factors influenced CG-CAHPS scores for spine surgery, and compare them to their cranial-focused cohorts.

METHODS

A retrospective study of prospectively obtained data was performed to evaluate CG-CAHPS scores. Between May 2013 and May 2017, all patients 18 years of age or older with an outpatient encounter with a neurosurgeon (5 spine-focused neurosurgeons and 20 cranial-focused neurosurgeons) received a CG-CAHPS survey. Three domains were assessed: overall physician rating, likelihood to recommend, and physician communication. Statistical analyses were performed using chi-square tests.

RESULTS

Seven thousand four hundred eighty-five patient surveys (2319 spine and 5166 cranial) were collected from patients presenting to the outpatient offices of an attending neurosurgeon. Analysis of the overall physician rating showed that 81.1% of spine neurosurgeons received a “top-box” score (answers of “yes, definitely”), whereas 86.2% of cranial neurosurgeons received a top-box response (p < 0.001). A similar difference was observed with the domains of “likelihood to recommend” and “physician communication.” Overall physician rating was also significantly influenced by the general and mental health of the patients surveyed (p < 0.001). For spine surgeons seeing patients at more than one facility, the scores with respect to location were also significantly different in all domains for each individual provider (p < 0.001).

CONCLUSIONS

Overall, spine-focused neurosurgeon ratings differed significantly from those of cranial-focused neurosurgical subspecialty providers. Office location also affected provider ratings for spine neurosurgeons. These results suggest that physician ratings obtained via patient experience surveys may be representative of factors aside from just the quality of physician care provided. This information should be considered as payers, government, and health systems design performance programs based on patient experience scores.

ABBREVIATIONS

CG-CAHPS = Clinician and Group Consumer Assessment of Healthcare Providers and Systems; CMS = Centers for Medicare and Medicaid Services; H-CAHPS = Hospital Consumer Assessment of Healthcare Providers and Systems; MIPS = Merit-based Incentive Payment System; VBP = Value-Based Purchasing.
  • Collapse
  • Expand

Multidisciplinary surgical planning for a patient with myxoid liposarcoma extending from C4 to T1. See the article by Ahmed et al. (pp 424–431).

  • 1

    Bible JE, Shau DN, Kay HF, Cheng JS, Aaronson OS, Devin CJ: Are low patient satisfaction scores always due to the provider? Determinants of patient satisfaction scores during spine clinic visits. Spine (Phila Pa 1976) 43:5864, 2018

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 2

    Borah BJ, Rock MG, Wood DL, Roellinger DL, Johnson MG, Naessens JM: Association between value-based purchasing score and hospital characteristics. BMC Health Serv Res 12:464, 2012

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 3

    Burroughs TE, Waterman BM, Cira JC, Desikan R, Claiborne Dunagan W: Patient satisfaction measurement strategies: a comparison of phone and mail methods. Jt Comm J Qual Improv 27:349361, 2001

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 4

    Elliott MN, Lehrman WG, Goldstein EH, Giordano LA, Beckett MK, Cohea CW, et al.: Hospital survey shows improvements in patient experience. Health Aff (Millwood) 29:20612067, 2010

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 5

    Elliott MN, Zaslavsky AM, Goldstein E, Lehrman W, Hambarsoomians K, Beckett MK, et al.: Effects of survey mode, patient mix, and nonresponse on CAHPS hospital survey scores. Health Serv Res 44:501518, 2009

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 6

    Goldstein E, Elliott MN, Lehrman WG, Hambarsoomian K, Giordano LA: Racial/ethnic differences in patients’ perceptions of inpatient care using the HCAHPS survey. Med Care Res Rev 67:7492, 2010

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 7

    Mazur MD, McEvoy S, Schmidt MH, Bisson EF: High self-assessment of disability and the surgeon’s recommendation against surgical intervention may negatively impact satisfaction scores in patients with spinal disorders. J Neurosurg Spine 22:666671, 2015

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 8

    McFarland DC, Shen MJ, Parker P, Meyerson S, Holcombe RF: Does hospital size affect patient satisfaction? Qual Manag Health Care 26:205209, 2017

  • 9

    Menendez ME, Loeffler M, Ring D: Patient satisfaction in an outpatient hand surgery office: A comparison of English- and Spanish-speaking patients. Qual Manag Health Care 24:183189, 2015

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 10

    Merlino J: Speaking from experience. When doctors improve communication, patients become better partners. Mod Healthc 42:30, 2012

  • 11

    Merlino JI, Kestranek C, Bokar D, Sun Z, Nissen SE, Longworth DL: HCAHPS survey results: impact of severity of illness on hospitals’ performance on HCAHPS survey results. J Patient Exp 1:1621, 2014

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 12

    Polatin PB, Kinney RK, Gatchel RJ, Lillo E, Mayer TG: Psychiatric illness and chronic low-back pain. The mind and the spine—which goes first? Spine (Phila Pa 1976) 18:6671, 1993

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation

Metrics

All Time Past Year Past 30 Days
Abstract Views 1552 231 14
Full Text Views 221 33 1
PDF Downloads 205 45 2
EPUB Downloads 0 0 0