Intrarater and interrater reliability of the pediatric arteriovenous malformation compactness score in children

Clinical article

Restricted access

Object

Cerebral arteriovenous malformations (AVMs) have a higher postresection recurrence rate in children than in adults. The authors' previous study demonstrated that a diffuse AVM (low compactness score) predicts postresection recurrence. The aims of this study were to evaluate the intra- and interrater reliability of the AVM compactness score.

Methods

Angiograms of 24 patients assigned a preoperative compactness score (scale of 1–3; 1 = most diffuse, 3 = most compact) in the authors' previous study were rerated by the same pediatric neuroradiologist 9 months later. A pediatric neurosurgeon, pediatric neuroradiology fellow, and interventional radiologist blinded to each other's ratings, the original ratings, and AVM recurrence also rated each AVM's compactness. Intrarater and interrater reliability were calculated using the κ statistic.

Results

Of the 24 AVMs, scores by the original neuroradiologist were 1 in 6 patients, 2 in 16 patients, and 3 in 2 patients. Intrarater reliability was 1.0. The κ statistic among the 4 raters was 0.69 (95% CI 0.44–0.89), which indicates substantial reliability. The interrater reliability between the neuroradiologist and neuroradiology fellow was moderate (κ = 0.59 [95%CI 0.20–0.89]) and was substantial between the neuroradiologist and neurosurgeon (κ = 0.74 [95% CI 0.41–1.0]). The neuroradiologist and interventional radiologist had perfect agreement (κ = 1.0).

Conclusions

Intrarater and interrater reliability of the AVM compactness score were excellent and substantial, respectively. These results demonstrate that the AVM compactness score is reproducible. However, the neuroradiologist and interventional radiologist had perfect agreement, which indicates that the compactness score is applied most accurately by those with extensive angiography experience.

Abbreviation used in this paper:AVM = arteriovenous malformation.

Article Information

Address correspondence to: Lauren A. Beslow, M.D., M.S.C.E., Departments of Pediatrics and Neurology, Yale University School of Medicine, 333 Cedar Street, New Haven, Connecticut 06520. email: lauren.beslow@yale.edu.

Please include this information when citing this paper: published online March 15, 2013; DOI: 10.3171/2013.2.PEDS12465.

© AANS, except where prohibited by US copyright law.

Headings

Figures

  • View in gallery

    Examples of AVM compactness Score 1. A: Lateral cerebral angiogram demonstrating a large diffuse AVM (arrows). B: Lateral cerebral angiogram demonstrating a small but diffuse AVM near the vertex (arrows). The AVM does not have a compact nidus. An early draining vein is seen along its superior margin (uppermost arrow). C: Cerebral angiogram showing a large diffuse AVM. There is a more compact portion of the AVM with a large early draining vein, but there is also a larger yet less compact component of abnormal vascularity with large amounts of intervening brain tissue as well (arrows), which make this a diffuse AVM with a compactness score of 1. D: Lateral cerebral angiogram demonstrating another small but diffuse AVM (arrows). A number of narrow-caliber, small, abnormal vessels are seen in the region of the AVM, without a compact nidus.

  • View in gallery

    Cerebral angiogram demonstrating an AVM with a compactness score of 2.

  • View in gallery

    Cerebral angiogram demonstrating a highly compact AVM with a compactness score of 3.

References

  • 1

    Ali MJBendok BRRosenblatt SRose JEGetch CCBatjer HH: Recurrence of pediatric cerebral arteriovenous malformations after angiographically documented resection. Pediatr Neurosurg 39:32382003

    • Search Google Scholar
    • Export Citation
  • 2

    Di Rocco CTamburrini GRollo M: Cerebral arteriovenous malformations in children. Acta Neurochir (Wien) 142:1451582000

  • 3

    Du RKeyoung HMDowd CFYoung WLLawton MT: The effects of diffuseness and deep perforating artery supply on outcomes after microsurgical resection of brain arteriovenous malformations. Neurosurgery 60:6386482007

    • Search Google Scholar
    • Export Citation
  • 4

    Hladky JPLejeune JPBlond SPruvo JPDhellemmes P: Cerebral arteriovenous malformations in children: report on 62 cases. Childs Nerv Syst 10:3283331994

    • Search Google Scholar
    • Export Citation
  • 5

    Hoh BLOgilvy CSButler WELoeffler JSPutman CMChapman PH: Multimodality treatment of nongalenic arteriovenous malformations in pediatric patients. Neurosurgery 47:3463582000

    • Search Google Scholar
    • Export Citation
  • 6

    Kader AGoodrich JTSonstein WJStein BMCarmel PWMichelsen WJ: Recurrent cerebral arteriovenous malformations after negative postoperative angiograms. J Neurosurg 85:14181996

    • Search Google Scholar
    • Export Citation
  • 7

    Klimo P JrRao GBrockmeyer D: Pediatric arteriovenous malformations: a 15-year experience with an emphasis on residual and recurrent lesions. Childs Nerv Syst 23:31372007

    • Search Google Scholar
    • Export Citation
  • 8

    Kondziolka DHumphreys RPHoffman HJHendrick EBDrake JM: Arteriovenous malformations of the brain in children: a forty year experience. Can J Neurol Sci 19:40451992

    • Search Google Scholar
    • Export Citation
  • 9

    Krayenbühl HA: Angiographic contribution to the problem of enlargement of cerebral arteriovenous malformations. Acta Neurochir (Wien) 36:2152421977

    • Search Google Scholar
    • Export Citation
  • 10

    Landis JRKoch GG: The measurement of observer agreement for categorical data. Biometrics 33:1591741977

  • 11

    Lang SSBeslow LABailey RLVossough AEkstrom JHeuer GG: Follow-up imaging to detect recurrence of surgically treated pediatric arteriovenous malformations. Clinical article. J Neurosurg Pediatr 9:4975042012

    • Search Google Scholar
    • Export Citation
  • 12

    Niazi TNKlimo P JrAnderson RCRaffel C: Diagnosis and management of arteriovenous malformations in children. Neurosurg Clin N Am 21:4434562010

    • Search Google Scholar
    • Export Citation
  • 13

    Spetzler RFMartin NA: A proposed grading system for arteriovenous malformations. J Neurosurg 65:4764831986

Metrics

Metrics

All Time Past Year Past 30 Days
Abstract Views 54 54 13
Full Text Views 44 44 0
PDF Downloads 150 150 0
EPUB Downloads 0 0 0

PubMed

Google Scholar