Validation of a prognostic score for early mortality in severe head injury cases

Clinical article

Pedro A. Gómez M.D., Ph.D.1, Javier de-la-Cruz M.D.2, David Lora M.Sc.2, Luis Jiménez-Roldán M.D.1, Gregorio Rodríguez-Boto M.D., Ph.D.3, Rosario Sarabia M.D., Ph.D.4, Juan Sahuquillo M.D., Ph.D.5, Roberto Lastra M.D.5, Jesus Morera M.D.6, Eglis Lazo M.D.7, Jaime Dominguez M.D., Ph.D.7, Javier Ibañez M.D., Ph.D.8, Marta Brell M.D., Ph.D.8, Adolfo de-la-Lama M.D.9, Ramiro D. Lobato M.D., Ph.D.1, and Alfonso Lagares M.D., Ph.D.1
View More View Less
  • 1 Department of Neurosurgery and
  • | 2 Clinical Research Unit, IMAS12-CIBERESP, University Hospital 12 Octubre, Medical Faculty Complutense University, Madrid;
  • | 3 Department of Neurosurgery, Clinical University Hospital, Madrid;
  • | 4 Department of Neurosurgery, Clinical University Hospital Río Ortega, Valladolid;
  • | 5 Department of Neurosurgery, Clinical University Hospital Val d′Hebrón, Barcelona;
  • | 6 Department of Neurosurgery, Clinical University Hospital Dr. Negrín, Las Palmas de Gran Canaria;
  • | 7 Department of Neurosurgery, Clinical University Hospital Virgen de la Candelaria, Tenerife;
  • | 8 Department of Neurosurgery, Clinical University Hospital Son Dureta, Palma de Mallorca; and
  • | 9 Department of Neurosurgery, Clinical University Hospital, Hospital Xeral, Vigo, Spain
Restricted access

Purchase Now

USD  $45.00

JNS + Pediatrics - 1 year subscription bundle (Individuals Only)

USD  $515.00

JNS + Pediatrics + Spine - 1 year subscription bundle (Individuals Only)

USD  $612.00
Print or Print + Online

Object

Traumatic brain injury (TBI) represents a large health and economic burden. Because of the inability of previous randomized controlled trials (RCTs) on TBI to demonstrate the expected benefit of reducing unfavorable outcomes, the IMPACT (International Mission on Prognosis and Analysis of Clinical Trials in TBI) and CRASH (Corticosteroid Randomisation After Significant Head Injury) studies provided new methods for performing prognostic studies of TBI. This study aimed to develop and externally validate a prognostic model for early death (within 48 hours). The secondary aim was to identify patients who were more likely to succumb to an early death to limit their inclusion in RCTs and to improve the efficiency of RCTs.

Methods

The derivation cohort was recruited at 1 center, Hospital 12 de Octubre, Madrid (1990–2003, 925 patients). The validation cohort was recruited in 2004–2006 from 7 study centers (374 patients). The eligible patients had suffered closed severe TBIs. The study outcome was early death (within 48 hours post-TBI). The predictors were selected using logistic regression modeling with bootstrapping techniques, and a penalized reduction was used. A risk score was developed based on the regression coefficients of the variables included in the final model.

Results

In the validation set, the final model showed a predictive ability of 50% (Nagelkerke R2), with an area under the receiver operating characteristic curve of 89% and an acceptable calibration (goodness-of-fit test, p = 0.32). The final model included 7 variables, and it was used to develop a risk score with a range from 0 to 20 points. Age provided 0, 1, 2, or 3 points depending on the age group; motor score provided 0 points, 2 (untestable), or 3 (no response); pupillary reactivity, 0, 2 (1 pupil reacted), or 6 (no pupil reacted); shock, 0 (no) or 2 (yes); subarachnoid hemorrhage, 0 or 1 (severe deposit); cisternal status, 0 or 3 (compressed/absent); and epidural hematoma, 0 (yes) or 2 (no). Based on the risk of early death estimated with the model, 4 risk of early death groups were established: low risk, sum score 0–3 (< 1% predicted mortality); moderate risk, sum score 4–8 (predicted mortality between 1% and 10%); high risk, sum score 9–12 (probability of early death between 10% and 50%); and very high risk, sum score 13–20 (early mortality probability > 50%). This score could be used for selecting patients for clinical studies. For example, if patients with very high risk scores were excluded from our study sample, the patients included (eligibility score < 13) would represent 80% of the original sample and only 23% of the patients who died early.

Conclusions

The combination of Glasgow Coma Scale score, CT scanning results, and secondary insult data into a prognostic score improved the prediction of early death and the classification of TBI patients.

Abbreviations used in this paper:

GCS = Glasgow Coma Scale; RCT = randomized controlled trial; ROC = receiver operating characteristic; SAH = subarachnoid hemorrhage; TBI = traumatic brain injury.

JNS + Pediatrics - 1 year subscription bundle (Individuals Only)

USD  $515.00

JNS + Pediatrics + Spine - 1 year subscription bundle (Individuals Only)

USD  $612.00
  • 1

    Balestreri M, , Czosnyka M, , Chatfield DA, , Steiner LA, , Schmidt EA, & Smielewski P, et al.: Predictive value of Glasgow Coma Scale after brain trauma: change in trend over the past ten years. J Neurol Neurosurg Psychiatry 75:161162, 2004

    • Search Google Scholar
    • Export Citation
  • 2

    Boto GR, , Gómez PA, , De La Cruz J, & Lobato RD: Severe head injury and the risk of early death. J Neurol Neurosurg Psychiatry 77:10541059, 2006

    • Search Google Scholar
    • Export Citation
  • 3

    Brain Trauma Foundation, American Association of Neurological Surgeons, Joint Section on Neurotrauma and Critical Care: Guidelines for the management of severe head injury: J Neurotrauma 13:641734, 1996

    • Search Google Scholar
    • Export Citation
  • 4

    Bullock MR, , Lyeth BG, & Muizelaar JP: Current status of neuroprotection trials for traumatic brain injury: lessons from animal models and clinical studies. Neurosurgery 45:207220, 1999

    • Search Google Scholar
    • Export Citation
  • 5

    Chesnut RM, , Ghajar J, , Maas AIR, , Marion DW, , Servadei F, & Teasdale G, et al.: Management and prognosis of severe traumatic brain injury. Part 2: Early indicators of prognosis in severe traumatic brain injury. J Neurotrauma 17:555627, 2000

    • Search Google Scholar
    • Export Citation
  • 6

    Clifton GL, , Grossman RG, , Makela ME, , Miner ME, , Handel S, & Sadhu V: Neurological course and correlated computerized tomography findings after severe closed head injury. J Neurosurg 52:611624, 1980

    • Search Google Scholar
    • Export Citation
  • 7

    Clifton GL, , McCormick WF, & Grossman RG: Neuropathology of early and late deaths after head injury. Neurosurgery 8:309314, 1981

  • 8

    Combes P, , Fauvage B, , Colonna M, , Passagia JG, , Chirossel JP, & Jacquot C: Severe head injuries: an outcome prediction and survival analysis. Intensive Care Med 22:13911395, 1996

    • Search Google Scholar
    • Export Citation
  • 9

    Coronado VG, , Xu L, , Basavaraju SV, , McGuire LC, , Wald MM, & Faul MD, et al.: Surveillance for traumatic brain injury-related deaths—United States, 1997-2007. MMWR Surveill Summ 60:132, 2011

    • Search Google Scholar
    • Export Citation
  • 10

    Cremer OL, , Moons KG, , van Dijk GW, , van Balen P, & Kalkman CJ: Prognosis following severe head injury: development and validation of a model for prediction of death, disability, and functional recovery. J Trauma 61:14841491, 2006

    • Search Google Scholar
    • Export Citation
  • 11

    Gómez PA, , Lobato RD, , Boto GR, , De la Lama A, , González PJ, & de la Cruz J: Age and outcome after severe head injury. Acta Neurochir (Wien) 142:373381, 2000

    • Search Google Scholar
    • Export Citation
  • 12

    Hanley JA, & McNeil BJ: The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 143:2936, 1982

    • Search Google Scholar
    • Export Citation
  • 13

    Harrell FE Jr: Regression Modeling Strategies New York, Springer Verlag, 2001

  • 14

    Hosmer DW, & Lemeshow S: Goodness of fit test for the multiple logistic regression model. Commun Stat Theory Methods 9:10431069, 1980

  • 15

    Hukkelhoven CW, , Rampen AJ, , Maas AI, , Farace E, , Habbema JD, & Marmarou A, et al.: Some prognostic models for traumatic brain injury were not valid. J Clin Epidemiol 59:132143, 2006

    • Search Google Scholar
    • Export Citation
  • 16

    Hukkelhoven CW, , Steyerberg EW, , Habbema JD, , Farace E, , Marmarou A, & Murray GD, et al.: Predicting outcome after traumatic brain injury: development and validation of a prognostic score based on admission characteristics. J Neurotrauma 22:10251039, 2005

    • Search Google Scholar
    • Export Citation
  • 17

    Hukkelhoven CW, , Steyerberg EW, , Rampen AJ, , Farace E, , Habbema JD, & Marshall LF, et al.: Patient age and outcome following severe traumatic brain injury: an analysis of 5600 patients. J Neurosurg 99:666673, 2003

    • Search Google Scholar
    • Export Citation
  • 18

    Jennett B, & MacMillan R: Epidemiology of head injury. Br Med J (Clin Res Ed) 282:101104, 1981

  • 19

    Jennett B, , Teasdale G, , Braakman R, , Minderhoud J, , Heiden J, & Kurze T: Prognosis of patients with severe head injury. Neurosurgery 4:283289, 1979

    • Search Google Scholar
    • Export Citation
  • 20

    Lobato RD, , Gomez PA, , Alday R, , Rivas JJ, , Dominguez J, & Cabrera A, et al.: Sequential computerized tomography changes and related final outcome in severe head injury patients. Acta Neurochir (Wien) 139:385391, 1997

    • Search Google Scholar
    • Export Citation
  • 21

    Maas AI, , Marmarou A, , Murray GD, , Teasdale SG, & Steyerberg EW: Prognosis and clinical trial design in traumatic brain injury: the IMPACT study. J Neurotrauma 24:232238, 2007

    • Search Google Scholar
    • Export Citation
  • 22

    Maas AI, , Roozenbeek B, & Manley GT: Clinical trials in traumatic brain injury: past experience and current developments. Neurotherapeutics 7:115126, 2010

    • Search Google Scholar
    • Export Citation
  • 23

    Maas AI, , Steyerberg EW, , Butcher I, , Dammers R, , Lu J, & Marmarou A, et al.: Prognostic value of computerized tomography scan characteristics in traumatic brain injury: results from the IMPACT study. J Neurotrauma 24:303314, 2007

    • Search Google Scholar
    • Export Citation
  • 24

    Maas AI, , Steyerberg EW, , Marmarou A, , McHugh GS, , Lingsma HF, & Butcher I, et al.: IMPACT recommendations for improving the design and analysis of clinical trials in moderate to severe traumatic brain injury. Neurotherapeutics 7:127134, 2010

    • Search Google Scholar
    • Export Citation
  • 25

    Machado SG, , Murray GD, & Teasdale GM: Evaluation of designs for clinical trials of neuroprotective agents in head injury. J Neurotrauma 16:11311138, 1999

    • Search Google Scholar
    • Export Citation
  • 26

    Marion DW, & Carlier PM: Problems with initial Glasgow Coma Scale assessment caused by prehospital treatment of patients with head injuries: results of a national survey. J Trauma 36:8995, 1994

    • Search Google Scholar
    • Export Citation
  • 27

    Marmarou A, , Lu J, , Butcher I, , McHugh GS, , Murray GD, & Steyerberg EW, et al.: Prognostic value of the Glasgow Coma Scale and pupil reactivity in traumatic brain injury assessed pre-hospital and on enrollment: an IMPACT analysis. J Neurotrauma 24:270280, 2007

    • Search Google Scholar
    • Export Citation
  • 28

    Marshall LF, , Gautille T, , Klauber MR, , Eisenberg HM, , Jane JA, & Luerssen TG, et al.: The outcome of severe closed head injury. J Neurosurg 75:1s S28S36, 1991

    • Search Google Scholar
    • Export Citation
  • 29

    McHugh GS, , Butcher I, , Steyerberg EW, , Lu J, , Mushkudiani N, & Marmarou A, et al.: Statistical approaches to the univariate prognostic analysis of the IMPACT database on traumatic brain injury. J Neurotrauma 24:251258, 2007

    • Search Google Scholar
    • Export Citation
  • 30

    Moons KG, , Donders AR, , Steyerberg EW, & Harrell FE: Penalized maximum likelihood estimation to directly adjust diagnostic and prognostic prediction models for overoptimism: a clinical example. J Clin Epidemiol 57:12621270, 2004

    • Search Google Scholar
    • Export Citation
  • 31

    Moons KG, , Harrell FE, & Steyerberg EW: Should scoring rules be based on odds ratios or regression coefficients?. J Clin Epidemiol 55:10541055, 2002

    • Search Google Scholar
    • Export Citation
  • 32

    Murray GD, , Teasdale GM, , Braakman R, , Cohadon F, , Dearden M, & Iannotti F, et al.: The European Brain Injury Consortium survey of head injuries. Acta Neurochir (Wien) 141:223236, 1999

    • Search Google Scholar
    • Export Citation
  • 33

    Mushkudiani NA, , Hukkelhoven CW, , Hernández AV, , Murray GD, , Choi SC, & Maas AI, et al.: A systematic review finds methodological improvements necessary for prognostic models in determining traumatic brain injury outcomes. J Clin Epidemiol 61:331343, 2008

    • Search Google Scholar
    • Export Citation
  • 34

    Nagelkerke NJ: A note on general definition of the coefficient of determination. Biometrika 78:691692, 1991

  • 35

    Nissen JJ, , Jones PA, , Signorini DF, , Murray LS, , Teasdale GM, & Miller JD: Glasgow head injury outcome prediction program: an independent assessment. J Neurol Neurosurg Psychiatry 67:796799, 1999

    • Search Google Scholar
    • Export Citation
  • 36

    Panczykowski DM, , Puccio AM, , Scruggs BJ, , Bauer JS, , Hricik AJ, & Beers SR, et al.: Prospective independent validation of IMPACT modeling as a prognostic tool in severe traumatic brain injury. J Neurotrauma 29:4752, 2012

    • Search Google Scholar
    • Export Citation
  • 37

    Perel P, , Arango M, , Clayton T, , Edwards P, , Komolafe E, & Poccock S, et al.: Predicting outcome after traumatic brain injury: practical prognostic models based on large cohort of international patients. BMJ 336:425429, 2008

    • Search Google Scholar
    • Export Citation
  • 38

    Ross SE, , Leipold C, , Terregino C, & O'Malley KF: Efficacy of the motor component of the Glasgow Coma Scale in trauma triage. J Trauma 45:4244, 1998

    • Search Google Scholar
    • Export Citation
  • 39

    Signorini DF, , Andrews PJ, , Jones PA, , Wardlaw JM, & Miller JD: Predicting survival using simple clinical variables: a case study in traumatic brain injury. J Neurol Neurosurg Psychiatry 66:2025, 1999

    • Search Google Scholar
    • Export Citation
  • 40

    Steyerberg EW, , Bleeker SE, , Moll HA, , Grobbee DE, & Moons KG: Internal and external validation of predictive models: a simulation study of bias and precision in small samples. J Clin Epidemiol 56:441447, 2003

    • Search Google Scholar
    • Export Citation
  • 41

    Steyerberg EW, , Harrell FE Jr, , Borsboom GJ, , Eijkemans MJ, , Vergouwe Y, & Habbema JD: Internal validation of predictive models: efficiency of some procedures for logistic regression analysis. J Clin Epidemiol 54:774781, 2001

    • Search Google Scholar
    • Export Citation
  • 42

    Steyerberg EW, , Mushkudiani N, , Perel P, , Butcher I, , Lu J, & McHugh GS, et al.: Predicting outcome after traumatic brain injury: development and international validation of prognostic scores based on admission characteristics. PLoS Med 5:e165, 2008

    • Search Google Scholar
    • Export Citation
  • 43

    Thornhill S, , Teasdale GM, , Murray GD, , McEwen J, , Roy CW, & Penny KI: Disability in young people and adults one year after head injury: prospective cohort study. BMJ 320:16311635, 2000

    • Search Google Scholar
    • Export Citation

Metrics

All Time Past Year Past 30 Days
Abstract Views 911 310 36
Full Text Views 438 30 1
PDF Downloads 293 35 1
EPUB Downloads 0 0 0