The authors describe the artificial neural network (ANN) as an innovative and powerful modeling tool that can be increasingly applied to develop predictive models in neurosurgery. They aimed to demonstrate the utility of an ANN in predicting survival following traumatic brain injury and compare its predictive ability with that of regression models and clinicians.
The authors designed an ANN to predict in-hospital survival following traumatic brain injury. The model was generated with 11 clinical inputs and a single output. Using a subset of the National Trauma Database, the authors “trained” the model to predict outcome by providing the model with patients for whom 11 clinical inputs were paired with known outcomes, which allowed the ANN to “learn” the relevant relationships that predict outcome. The model was tested against actual outcomes in a novel subset of 100 patients derived from the same database. For comparison with traditional forms of modeling, 2 regression models were developed using the same training set and were evaluated on the same testing set. Lastly, the authors used the same 100-patient testing set to evaluate 5 neurosurgery residents and 4 neurosurgery staff physicians on their ability to predict survival on the basis of the same 11 data points that were provided to the ANN. The ANN was compared with the clinicians and the regression models in terms of accuracy, sensitivity, specificity, and discrimination.
Compared with regression models, the ANN was more accurate (p < 0.001), more sensitive (p < 0.001), as specific (p = 0.260), and more discriminating (p < 0.001). There was no difference between the neurosurgery residents and staff physicians, and all clinicians were pooled to compare with the 5 best neural networks. The ANNs were more accurate (p < 0.0001), more sensitive (p < 0.0001), as specific (p = 0.743), and more discriminating (p < 0.0001) than the clinicians.
When given the same limited clinical information, the ANN significantly outperformed regression models and clinicians on multiple performance measures. While this paradigm certainly does not adequately reflect a real clinical scenario, this form of modeling could ultimately serve as a useful clinical decision support tool. As the model evolves to include more complex clinical variables, the performance gap over clinicians and logistic regression models will persist or, ideally, further increase.
Abbreviations used in this paper: ANN = artificial neural network; AUROC = area under the receiver operating characteristic curve; ED = emergency department; GCS = Glasgow Coma Scale; GOS = Glasgow Outcome Scale; ICP = intracranial pressure; NTDB = National Trauma Data Bank; TBI = traumatic brain injury.
Address correspondence to: Anand I. Rughani, M.D., 111 Colchester Avenue, Fletcher 5, Burlington, Vermont 05401. email: firstname.lastname@example.org.Please include this information when citing this paper: published online December 18, 2009; DOI: 10.3171/2009.11.JNS09857.
ChesnutRMMarshallSBPiekJBluntBAKlauberMRMarshallLF: Early and late systemic hypotension as a frequent and fundamental source of cerebral ischemia following severe brain injury in the Traumatic Coma Data Bank. Acta Neurochir Suppl (Wien)59:121–1251993
ChesnutRM, MarshallSB, PiekJ, BluntBA, KlauberMR, MarshallLF: Early and late systemic hypotension as a frequent and fundamental source of cerebral ischemia following severe brain injury in the Traumatic Coma Data Bank. 59:121–125, 1993)| false
EftekharBMohammadKArdebiliHEGhodsiMKetabchiE: Comparison of artificial neural network and logistic regression models for prediction of mortality in head trauma based on initial clinical data. BMC Med Inform Decis Mak5:32005. (Abstract)
EftekharB, MohammadK, ArdebiliHE, GhodsiM, KetabchiE: Comparison of artificial neural network and logistic regression models for prediction of mortality in head trauma based on initial clinical data. 5:3, 2005. (Abstract))| false
LuZRughaniAITranmerBIBongardJ: Informative sampling for large unbalanced data sets. Proceedings of the 2008 GECCO conference companion on Genetic and evolutionary computationNew YorkACM Press2008. 2047–2054
LuZ, RughaniAI, TranmerBI, BongardJ: Informative sampling for large unbalanced data sets. New York, ACM Press, 2008. 2047–2054)| false