External validation of the Chicago Chiari Outcome Scale

Clinical article

View More View Less
  • Department of Neurosurgery, St. Louis Children's Hospital, Washington University School of Medicine, St. Louis, Missouri
Restricted access

Purchase Now

USD  $45.00

JNS + Pediatrics - 1 year subscription bundle (Individuals Only)

USD  $505.00

JNS + Pediatrics + Spine - 1 year subscription bundle (Individuals Only)

USD  $600.00
Print or Print + Online

Object

Historically, assessment of clinical outcomes following surgical management of Chiari malformation Type I (CM-I) has been challenging due to the lack of a validated instrument for widespread use. The Chicago Chiari Outcome Scale (CCOS) is a novel system intended to provide a less subjective evaluation of outcomes for patients with CM-I. The goal of this study was to externally validate the performance of the CCOS.

Methods

Patients undergoing surgery for CM-I between 2001 and 2012 were reviewed (n = 292). Inclusion criteria for this study were as follows: 1) patients receiving primary posterior fossa decompression; 2) at least 5.5 months of postoperative clinical follow-up; and 3) patients ≤ 18 years of age at the time of surgery. Outcomes were evaluated using the CCOS, along with a “gestalt” impression of whether patients experienced significant improvement after surgery. A subgroup of 118 consecutive patients undergoing operations between 2008 and 2010 was selected for analysis of interrater reliability (n = 73 meeting inclusion/exclusion criteria). In this subgroup, gestalt and CCOS scores were independently determined by 2 reviewers, and interrater reliability was assessed using the intraclass correlation coefficient (ICC) and kappa (κ) statistic.

Results

The median CCOS score was 14, and 67% of patients had improved gestalt scores after surgery. Overall, the CCOS was effective at identifying patients with improved outcome after surgery (area under curve = 0.951). The interrater reliability of the CCOS (ICC = 0.71) was high, although the reliability of the component scores ranged from poor to good (ICC 0.23–0.89). The functionality subscore demonstrated a low ICC and did not add to the predictive ability of the logistic regression model (likelihood ratio = 1.8, p = 0.18). When analyzing gestalt outcome, there was moderate agreement between raters (κ = 0.56).

Conclusions

In this external validation study, the CCOS was effective at identifying patients with improved outcomes and proved more reliable than the authors' gestalt impression of outcome. However, certain component subscores (functionality and nonpain symptoms) were found to be less reliable, and may benefit from further definition in score assignment. In particular, the functionality subscore does not add to the predictive ability of the CCOS, and may be unnecessary. Overall, the authors found the CCOS to be an improvement over the previously used assessment of outcome at their institution.

Abbreviations used in this paper:CCOS = Chicago Chiari Outcome Scale; CM-I = Chiari malformation Type I; ICC = intraclass correlation coefficient; ROC = receiver operating characteristic; SLCH = St. Louis Children's Hospital.

JNS + Pediatrics - 1 year subscription bundle (Individuals Only)

USD  $505.00

JNS + Pediatrics + Spine - 1 year subscription bundle (Individuals Only)

USD  $600.00

Contributor Notes

Address correspondence to: Chester K. Yarbrough, M.D., Department of Neurosurgery, Washington University School of Medicine, 660 S. Euclid Ave., Campus Box 8057, St. Louis, MO 63110. email: yarbroughc@wudosis.wustl.edu.

Please include this information when citing this paper: published online April 11, 2014; DOI: 10.3171/2014.3.PEDS13503.

  • 1

    Aboulezz AO, , Sartor K, , Geyer CA, & Gado MH: Position of cerebellar tonsils in the normal population and in patients with Chiari malformation: a quantitative approach with MR imaging. J Comput Assist Tomogr 9:10331036, 1985

    • Search Google Scholar
    • Export Citation
  • 2

    Aitken LA, , Lindan CE, , Sidney S, , Gupta N, , Barkovich AJ, & Sorel M, : Chiari type I malformation in a pediatric population. Pediatr Neurol 40:449454, 2009

    • Search Google Scholar
    • Export Citation
  • 3

    Alden TD, , Ojemann JG, & Park TS: Surgical treatment of Chiari I malformation: indications and approaches. Neurosurg Focus 11:1 E2, 2001

  • 4

    Aliaga L, , Hekman KE, , Yassari R, , Straus D, , Luther G, & Chen J, : A novel scoring system for assessing Chiari malformation type I treatment outcomes. Neurosurgery 70:656665, 2012

    • Search Google Scholar
    • Export Citation
  • 5

    Alzate JC, , Kothbauer KF, , Jallo GI, & Epstein FJ: Treatment of Chiari I malformation in patients with and without syringomyelia: a consecutive series of 66 cases. Neurosurg Focus 11:1 E3, 2001

    • Search Google Scholar
    • Export Citation
  • 6

    Caldarelli M, , Novegno F, , Vassimi L, , Romani R, , Tamburrini G, & Di Rocco C: The role of limited posterior fossa craniectomy in the surgical treatment of Chiari malformation Type I: experience with a pediatric series. J Neurosurg 106:3 Suppl 187195, 2007

    • Search Google Scholar
    • Export Citation
  • 7

    Di X: Endoscopic suboccipital decompression on pediatric Chiari type I. Minim Invasive Neurosurg 52:119125, 2009

  • 8

    Erdogan E, , Cansever T, , Secer HI, , Temiz C, , Sirin S, & Kabatas S, : The evaluation of surgical treatment options in the Chiari Malformation Type I. Turk Neurosurg 20:303313, 2010

    • Search Google Scholar
    • Export Citation
  • 9

    Galarza M, , Sood S, & Ham S: Relevance of surgical strategies for the management of pediatric Chiari type I malformation. Childs Nerv Syst 23:691696, 2007

    • Search Google Scholar
    • Export Citation
  • 10

    Hanley JA, & McNeil BJ: The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 143:2936, 1982

    • Search Google Scholar
    • Export Citation
  • 11

    Hekman KE, , Aliaga L, , Straus D, , Luther A, , Chen J, & Sampat A, : Positive and negative predictors for good outcome after decompressive surgery for Chiari malformation type 1 as scored on the Chicago Chiari Outcome Scale. Neurol Res 34:694700, 2012

    • Search Google Scholar
    • Export Citation
  • 12

    Milhorat TH, , Chou MW, , Trinidad EM, , Kula RW, , Mandell M, & Wolpert C, : Chiari I malformation redefined: clinical and radiographic findings for 364 symptomatic patients. Neurosurgery 44:10051017, 1999

    • Search Google Scholar
    • Export Citation
  • 13

    Navarro R, , Olavarria G, , Seshadri R, , Gonzales-Portillo G, , McLone DG, & Tomita T: Surgical results of posterior fossa decompression for patients with Chiari I malformation. Childs Nerv Syst 20:349356, 2004

    • Search Google Scholar
    • Export Citation
  • 14

    Parker SL, , Godil SS, , Zuckerman SL, , Mendenhall SK, , Wells JA, & Shau DN, : Comprehensive assessment of 1-year outcomes and determination of minimum clinically important difference in pain, disability, and quality of life after suboccipital decompression for Chiari malformation I in adults. Neurosurgery 73:569581, 2013

    • Search Google Scholar
    • Export Citation
  • 15

    Parker SR, , Harris P, , Cummings TJ, , George T, , Fuchs H, & Grant G: Complications following decompression of Chiari malformation Type I in children: dural graft or sealant? Clinical article. J Neurosurg Pediatr 8:177183, 2011

    • Search Google Scholar
    • Export Citation
  • 16

    Stovner Lj, , Hagen K, , Jensen R, , Katsarava Z, , Lipton R, & Scher A, : The global burden of headache: a documentation of headache prevalence and disability worldwide. Cephalalgia 27:193210, 2007

    • Search Google Scholar
    • Export Citation
  • 17

    Tubbs RS, , Beckman J, , Naftel RP, , Chern JJ, , Wellons JC III, & Rozzelle CJ, : Institutional experience with 500 cases of surgically treated pediatric Chiari malformation Type I. Clinical article. J Neurosurg Pediatr 7:248256, 2011

    • Search Google Scholar
    • Export Citation
  • 18

    Ventureyra EC, , Aziz HA, & Vassilyadi M: The role of cine flow MRI in children with Chiari I malformation. Childs Nerv Syst 19:109113, 2003

    • Search Google Scholar
    • Export Citation

Metrics