Thoracolumbar Injury Classification and Severity Score in children: a reliability study

Restricted access

OBJECTIVE

There are many classification systems for injuries of the thoracolumbar spine. The recent Thoracolumbar Injury Classification and Severity Score (TLICS) has been shown to be a reliable tool for adult patients. The aim of this study was to assess the reliability of the TLICS system in pediatric patients. The validity of the TLICS system is assessed in a companion paper.

METHODS

The medical records of pediatric patients with acute, traumatic thoracolumbar fractures at a single Level 1 trauma center were retrospectively reviewed. A TLICS was calculated for each patient using CT and MRI, along with the neurological examination recorded in the patient’s medical record. TLICSs were compared with the type of treatment received. Five raters scored all patients separately to assess interrater reliability.

RESULTS

TLICS calculations were completed for 81 patients. The mean patient age was 10.9 years. Girls represented 51.8% of the study population, and 80% of the study patients were white. The most common mechanisms of injury were motor vehicle accidents (60.5%), falls (17.3%), and all-terrain vehicle accidents (8.6%). The mean TLICS was 3.7 ± 2.8. Surgery was the treatment of choice for 33.3% of patients. The agreement between the TLICS-suggested treatment and the actual treatment received was statistically significant (p < 0.0001). The interrater reliability of the TLICS system ranged from moderate to very good, with a Fleiss’ generalized kappa (κ) value of 0.69 for the TLICS treatment suggestion among all patients; however, interrater reliability decreased when MRI was used to contribute to the TLICS. The κ value decreased from 0.73 to 0.57 for patients with CT only vs patients with CT/MRI or MRI only, respectively (p < 0.0001). Furthermore, the agreement between suggested treatment and actual treatment was worse when MRI was used as part of injury assessment.

CONCLUSIONS

The TLICS system demonstrates good interrater reliability among physicians assessing thoracolumbar fracture treatment in pediatric patients. Physicians should be cautious when using MRI to aid in the surgical decision-making process.

ABBREVIATIONS CI = confidence interval; ICC = intraclass correlation coefficient; MVA = motor vehicle accident; OR = odds ratio; PLC = posterior ligamentous complex; TLICS = Thoracolumbar Injury Classification and Severity Score.
Article Information

Contributor Notes

Correspondence Ross L. Dawkins: University of Alabama at Birmingham, AL. ross.dawkins.md@gmail.com.INCLUDE WHEN CITING Published online January 12, 2018; DOI: 10.3171/2017.7.PEDS1720.

Drs. Dawkins and Miller contributed equally to this work.

Disclosures The authors report no conflict of interest concerning the materials or methods used in this study or the findings specified in this paper.
Headings
References
  • 1

    Cicchetti DV: Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess 6:2842901994

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 2

    Cirak BZiegfeld SKnight VMChang DAvellino AMPaidas CN: Spinal injuries in children. J Pediatr Surg 39:6076122004

  • 3

    Daniels AHSobel ADEberson CP: Pediatric thoracolumbar spine trauma. J Am Acad Orthop Surg 21:7077162013

  • 4

    Denis F: The three column spine and its significance in the classification of acute thoracolumbar spinal injuries. Spine (Phila Pa 1976) 8:8178311983

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 5

    Dogan SSafavi-Abbasi STheodore NChang SWHorn EMMariwalla NR: Thoracolumbar and sacral spinal injuries in children and adolescents: a review of 89 cases. J Neurosurg 106 (6 Suppl):4264332007

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 6

    Fleiss JL: Measuring nominal scale agreement among many raters. Psychol Bull 76:3783821971

  • 7

    Fleiss JL: Statistical Methods for Rates and Proportionsed 2. New York: Wiley1981

  • 8

    Joaquim AFLawrence BDaubs MBrodke DTedeschi HVaccaro AR: Measuring the impact of the Thoracolumbar Injury Classification and Severity Score among 458 consecutively treated patients. J Spinal Cord Med 37:1011062014

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 9

    Junkins EP JrStotts ASantiago RGuenther E: The clinical presentation of pediatric thoracolumbar fractures: a prospective study. J Trauma 65:106610712008

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 10

    Kendall MGibbons J: Rank Correlation Methodsed 5. London: Edward Arnold1990

  • 11

    Kimberlin CLWinterstein AG: Validity and reliability of measurement instruments used in research. Am J Health Syst Pharm 65:227622842008

  • 12

    Koh YDKim DJKoh YW: Reliability and validity of Thoracolumbar Injury Classification and Severity Score (TLICS). Asian Spine J 4:1091172010

  • 13

    Landis JRKoch GG: The measurement of observer agreement for categorical data. Biometrics 33:1591741977

  • 14

    Lee GYLee JWChoi SWLim HJSun HYKang Y: MRI inter-reader and intra-reader reliabilities for assessing injury morphology and posterior ligamentous complex integrity of the spine according to the thoracolumbar injury classification system and severity score. Korean J Radiol 16:8898982015

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 15

    Lee JYVaccaro ARLim MRÖner FCHulbert RJHedlund R: Thoracolumbar injury classification and severity score: a new paradigm for the treatment of thoracolumbar spine trauma. J Orthop Sci 10:6716752005

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 16

    Lenarz CJPlace HMLenke LGAlander DHOliver D: Comparative reliability of 3 thoracolumbar fracture classification systems. J Spinal Disord Tech 22:4224272009

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 17

    Lewkonia PPaolucci EOThomas K: Reliability of the thoracolumbar injury classification and severity score and comparison with the Denis classification for injury to the thoracic and lumbar spine. Spine (Phila Pa 1976) 37:216121672012

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 18

    Magerl FAebi MGertzbein SDHarms JNazarian S: A comprehensive classification of thoracic and lumbar injuries. Eur Spine J 3:1842011994

  • 19

    McGraw KOWong SP: Forming inferences about some intraclass correlation coefficients. Psychol Methods 1:30461996

  • 20

    Parent SDimar JDekutoski MRoy-Beaudry M: Unique features of pediatric spinal cord injury. Spine (Phila Pa 1976) 35 (21 Suppl):S202S2082010

    • Search Google Scholar
    • Export Citation
  • 21

    Patel AADailey ABrodke DSDaubs MHarrop JWhang PG: Thoracolumbar spine trauma classification: the Thoracolumbar Injury Classification and Severity Score system and case examples. J Neurosurg Spine 10:2012062009

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 22

    Patel AAVaccaro AR: Thoracolumbar spine trauma classification. J Am Acad Orthop Surg 18:63712010

  • 23

    Patel AAWhang PGBrodke DSAgarwal AHong JFernandez C: Evaluation of two novel thoracolumbar trauma classification systems. Indian J Orthop 41:3223262007

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 24

    Raja Rampersaud YFisher CWilsey JArnold PAnand NBono CM: Agreement between orthopedic surgeons and neurosurgeons regarding a new algorithm for the treatment of thoracolumbar injuries: a multicenter reliability study. J Spinal Disord Tech 19:4774822006

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 25

    Reilly CW: Pediatric spine trauma. J Bone Joint Surg Am 89 (Suppl 1):981072007

  • 26

    Rihn JAAnderson DTHarris ELawrence JJonsson HWilsey J: A review of the TLICS system: a novel, user-friendly thoracolumbar trauma classification system. Acta Orthop 79:4614662008

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 27

    Savage JWMoore TAArnold PMThakur NHsu WKPatel AA: The reliability and validity of the thoracolumbar injury classification system in pediatric spine trauma. Spine (Phila Pa 1976) 40:E1014E10182015

    • Search Google Scholar
    • Export Citation
  • 28

    Schweitzer KMVaccaro ARHarrop JSHurlbert JCarrino JARechtine GR: Interrater reliability of identifying indicators of posterior ligamentous complex disruption when plain films are indeterminate in thoracolumbar injuries. J Orthop Sci 12:4374422007

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 29

    Sellin JNSteele WJ IIISimpson LHuff WXLane BCChern JJ: Multicenter retrospective evaluation of the validity of the Thoracolumbar Injury Classification and Severity Score system in children. J Neurosurg Pediatr 18:1641702016

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 30

    Sethi MKSchoenfeld AJBono CMHarris MB: The evolution of thoracolumbar injury classification systems. Spine J 9:7807882009

  • 31

    Shrout PEFleiss JL: Intraclass correlations: uses in assessing rater reliability. Psychol Bull 86:4204281979

  • 32

    Slotkin JRLu YWood KB: Thoracolumbar spinal trauma in children. Neurosurg Clin N Am 18:6216302007

  • 33

    Vaccaro ARLehman RA JrHurlbert RJAnderson PAHarris MHedlund R: A new classification of thoracolumbar injuries: the importance of injury morphology, the integrity of the posterior ligamentous complex, and neurologic status. Spine (Phila Pa 1976) 30:232523332005

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 34

    Vaccaro ARRihn JASaravanja DAnderson DGHilibrand ASAlbert TJ: Injury of the posterior ligamentous complex of the thoracolumbar spine: a prospective evaluation of the diagnostic accuracy of magnetic resonance imaging. Spine (Phila Pa 1976) 34:E841E8472009

    • Search Google Scholar
    • Export Citation
  • 35

    Wood KBKhanna GVaccaro ARArnold PMHarris MBMehbod AA: Assessment of two thoracolumbar fracture classification systems as used by multiple surgeons. J Bone Joint Surg Am 87:142314292005

    • PubMed
    • Search Google Scholar
    • Export Citation
TrendMD
Cited By
Metrics

Metrics

All Time Past Year Past 30 Days
Abstract Views 498 454 40
Full Text Views 112 65 1
PDF Downloads 166 44 1
EPUB Downloads 0 0 0
PubMed
Google Scholar