In-hospital mortality after traumatic brain injury surgery: a nationwide population-based comparison of mortality predictors used in artificial neural network and logistic regression models
Clinical article
Search for other papers by Hon-Yi Shi in
Current site
Google Scholar
PubMed
Faculty of Medicine, College of Medicine, and
Search for other papers by Shiuh-Lin Hwang in
Current site
Google Scholar
PubMed
Division of Hepatobiliary Surgery, Department of Surgery, Kaohsiung Medical University, Kaohsiung, Taiwan, Republic of China
Search for other papers by King-Teh Lee in
Current site
Google Scholar
PubMed
Faculty of Medicine, College of Medicine, and
Search for other papers by Chih-Lung Lin in
Current site
Google Scholar
PubMed
Object
Most reports compare artificial neural network (ANN) models and logistic regression models in only a single data set, and the essential issue of internal validity (reproducibility) of the models has not been adequately addressed. This study proposes to validate the use of the ANN model for predicting in-hospital mortality after traumatic brain injury (TBI) surgery and to compare the predictive accuracy of ANN with that of the logistic regression model.
Methods
The authors of this study retrospectively analyzed 16,956 patients with TBI nationwide who were surgically treated in Taiwan between 1998 and 2009. For every 1000 pairs of ANN and logistic regression models, the area under the receiver operating characteristic curve (AUC), Hosmer-Lemeshow statistics, and accuracy rate were calculated and compared using paired t-tests. A global sensitivity analysis was also performed to assess the relative importance of input parameters in the ANN model and to rank the variables in order of importance.
Results
The ANN model outperformed the logistic regression model in terms of accuracy in 95.15% of cases, in terms of Hosmer-Lemeshow statistics in 43.68% of cases, and in terms of the AUC in 89.14% of cases. The global sensitivity analysis of in-hospital mortality also showed that the most influential (sensitive) parameters in the ANN model were surgeon volume followed by hospital volume, Charlson comorbidity index score, length of stay, sex, and age.
Conclusions
This work supports the continued use of ANNs for predictive modeling of neurosurgery outcomes. However, further studies are needed to confirm the clinical efficacy of the proposed model.
Abbreviations used in this paper:
ANN = artificial neural network; AUC = area under the receiver operating characteristic curve; BNHI = Bureau of National Health Insurance; GCS = Glasgow Coma Scale; LOS = length of stay; MLP = multilayer perceptron; NPV = negative predictive value; PPV = positive predictive value; TBI = traumatic brain injury; VSR = variable sensitivity ratio.
© Copyright 1944-2023 American Association of Neurological Surgeons