Nonroutine discharge after elective spine surgery increases healthcare costs, negatively impacts patient satisfaction, and exposes patients to additional hospital-acquired complications. Therefore, prediction of nonroutine discharge in this population may improve clinical management. The authors previously developed a machine learning algorithm from national data that predicts risk of nonhome discharge for patients undergoing surgery for lumbar disc disorders. In this paper the authors externally validate their algorithm in an independent institutional population of neurosurgical spine patients.
Medical records from elective inpatient surgery for lumbar disc herniation or degeneration in the Transitional Care Program at Brigham and Women’s Hospital (2013–2015) were retrospectively reviewed. Variables included age, sex, BMI, American Society of Anesthesiologists (ASA) class, preoperative functional status, number of fusion levels, comorbidities, preoperative laboratory values, and discharge disposition. Nonroutine discharge was defined as postoperative discharge to any setting other than home. The discrimination (c-statistic), calibration, and positive and negative predictive values (PPVs and NPVs) of the algorithm were assessed in the institutional sample.
Overall, 144 patients underwent elective inpatient surgery for lumbar disc disorders with a nonroutine discharge rate of 6.9% (n = 10). The median patient age was 50 years and 45.1% of patients were female. Most patients were ASA class II (66.0%), had 1 or 2 levels fused (80.6%), and had no diabetes (91.7%). The median hematocrit level was 41.2%. The neural network algorithm generalized well to the institutional data, with a c-statistic (area under the receiver operating characteristic curve) of 0.89, calibration slope of 1.09, and calibration intercept of −0.08. At a threshold of 0.25, the PPV was 0.50 and the NPV was 0.97.
This institutional external validation of a previously developed machine learning algorithm suggests a reliable method for identifying patients with lumbar disc disorder at risk for nonroutine discharge. Performance in the institutional cohort was comparable to performance in the derivation cohort and represents an improved predictive value over clinician intuition. This finding substantiates initial use of this algorithm in clinical practice. This tool may be used by multidisciplinary teams of case managers and spine surgeons to strategically invest additional time and resources into postoperative plans for this population.
ABBREVIATIONSACS = American College of Surgeons; ASA = American Society of Anesthesiologists; AUC = area under the ROC curve; CCI = Charlson Comorbidity Index; IQR = interquartile range; NPV = negative predictive value; NSQIP = National Surgical Quality Improvement Program; PPV = positive predictive value; RAT = Risk Assessment Tool; ROC = receiver operating characteristic; TCP = Transitional Care Program.
Correspondence William B. Gormley: Brigham and Women’s Hospital, Harvard Medical School, Boston, MA. firstname.lastname@example.org.INCLUDE WHEN CITING Published online July 26, 2019; DOI: 10.3171/2019.5.SPINE1987.Disclosures The authors report no conflict of interest concerning the materials or methods used in this study or the findings specified in this paper.
BerkowitzREFangZHelfandBKIJonesRNSchreiberRPaasche-OrlowMK: Project ReEngineered Discharge (RED) lowers hospital readmissions of patients discharged from a skilled nursing facility. J Am Med Dir Assoc14:736–7402013
BilimoriaKYLiuYParuchJLZhouLKmiecikTEKoCY: Development and evaluation of the universal ACS NSQIP surgical risk calculator: a decision aid and informed consent tool for patients and surgeons. J Am Coll Surg217:833–42.e1 32013
BilimoriaKY, LiuY, ParuchJL, ZhouL, KmiecikTE, KoCY, : Development and evaluation of the universal ACS NSQIP surgical risk calculator: a decision aid and informed consent tool for patients and surgeons. 217:833–42.e1, 3, 201310.1016/j.jamcollsurg.2013.07.385)| false
CollinsGS, ReitsmaJB, AltmanDG, MoonsKG: Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD Statement. 13:1, 20152556306210.1186/s12916-014-0241-z)| false
CookCCoronadoRABettgerJPGrahamJE: The association of discharge destination with 30-day rehospitalization rates among older adults receiving lumbar spinal fusion surgery. Musculoskelet Sci Pract34:77–822018
CookC, CoronadoRA, BettgerJP, GrahamJE: The association of discharge destination with 30-day rehospitalization rates among older adults receiving lumbar spinal fusion surgery. 34:77–82, 201810.1016/j.msksp.2018.01.00329358104)| false
KarhadeAVOginkPThioQBroekmanMChaTGormleyWB: Development of machine learning algorithms for prediction of discharge disposition after elective inpatient surgery for lumbar degenerative disc disorders. Neurosurg Focus45(5):E62018
KarhadeAV, OginkP, ThioQ, BroekmanM, ChaT, GormleyWB, : Development of machine learning algorithms for prediction of discharge disposition after elective inpatient surgery for lumbar degenerative disc disorders. 45(5):E6, 20183045346310.3171/2018.8.FOCUS18340)| false
McGirtMJSivaganesanAAsherALDevinCJ: Prediction model for outcome after low-back surgery: individualized likelihood of complication, hospital readmission, return to work, and 12-month improvement in functional disability. Neurosurg Focus39(6):E132015
McGirtMJ, SivaganesanA, AsherAL, DevinCJ: Prediction model for outcome after low-back surgery: individualized likelihood of complication, hospital readmission, return to work, and 12-month improvement in functional disability. 39(6):E13, 20152662141110.3171/2015.8.FOCUS15338)| false
MurphyMEMaloneyPRMcCutcheonBARinaldoLShepherdDKerezoudisP: Predictors of discharge to a nonhome facility in patients undergoing lumbar decompression without fusion for degenerative spine disease. Neurosurgery81:638–6492017
MurphyME, MaloneyPR, McCutcheonBA, RinaldoL, ShepherdD, KerezoudisP, : Predictors of discharge to a nonhome facility in patients undergoing lumbar decompression without fusion for degenerative spine disease. 81:638–649, 201728486638)| false
PiazzaM, SharmaN, OsiemoB, McClintockS, MissimerE, GardinerD, : Initial assessment of the risk assessment and the prediction tool in a heterogeneous neurosurgical patient population. 85:50–57, 201910.1093/neuros/nyy197)| false
RobertsonFC, LogsdonJL, DasenbrockHH, YanSC, RafterySM, SmithTR, : Transitional care services: a quality and safety process improvement program in neurosurgery. 128:1570–1577, 201810.3171/2017.2.JNS16177028707992)| false
SheridanSLDonahueKEBrennerAT: Beginning with high value care in mind: A scoping review and toolkit to support the content, delivery, measurement, and sustainment of high value care. Patient Educ Couns102:238–2522019
SheridanSL, DonahueKE, BrennerAT: Beginning with high value care in mind: A scoping review and toolkit to support the content, delivery, measurement, and sustainment of high value care. 102:238–252, 201910.1016/j.pec.2018.05.014)| false
UgiliwenezaB, KongM, NosovaK, HuangKT, BabuR, LadSP, : Spinal surgery: variations in health care costs and implications for episode-based bundled payments. 39:1235–1242, 20142483150310.1097/BRS.0000000000000378)| false
VaziriS, WilsonJ, AbbatematteoJ, KubilisP, ChakrabortyS, KshitijK, : Predictive performance of the American College of Surgeons universal risk calculator in neurosurgical patients. 128:942–947, 20182845261510.3171/2016.11.JNS161377)| false