1Division of Neurosurgery, St. Michael's Hospital, Labatt Family Centre of Excellence in Brain Injury and Trauma Research, Keenan Research Centre of the Li Ka Shing Knowledge Institute of St. Michael's Hospital, Toronto;
2Department of Surgery, University of Toronto, Ontario, Canada; and
3Institute of Neuroradiology, Johann Wolfgang Goethe-Universität Frankfurt, Germany
Numerous abnormal findings may be evident on CT scans after aneurysmal subarachnoid hemorrhage (SAH). Here, the authors assess the interobserver variability in the radiological interpretation of the initial CT scan following SAH.
Two experienced reviewers, a neurosurgeon and a neuroradiologist, independently prospectively reviewed the initial CT scans of 413 patients enrolled in the CONSCIOUS-1 trial. Measured variables included SAH, intraventricular hemorrhage, intracerebral hemorrhage, subdural hematoma, chronic infarction, midline shift, and hydrocephalus. To assess interobserver variability, weighted kappa values and intraclass correlation coefficients (ICCs) were calculated and Bland-Altman analysis was performed.
Moderate to substantial agreement was found for most of the CT scanning findings. There was fair to moderate interobserver agreement between reviewers when determining the extent of SAH based on a descriptive categorical classification (kappa 0.41; 95% CI 0.33–0.49), and better agreement when a semiquantitative scale was used (ICC 0.56; 95% CI 0.49–0.62). There was poor agreement between reviewers for the presence of hydrocephalus (kappa 0.34; 95% CI 0.20–0.48), but substantial to near perfect agreement on ventriculocranial ratio measurements (ICC 0.77; 95% CI 0.72–0.81).
The authors' findings suggest that there is considerable interobserver variability in the interpretation of CT scans after SAH. Quantitative measures may reduce interobserver variability in comparison with qualitative or categorical scales. Variability in interpretation of CT scans has implications for patient care and conduct of clinical trials. It may be beneficial to develop standardized assessments to ensure consistent evaluation of measured variables.
Abbreviations used in this paper: EDH = epidural hematoma; ICC = intraclass correlation coefficient; ICH = intracerebral hemorrhage; IVH = intraventricular hemorrhage; SAH = subarachnoid hemorrhage; SDH = subdural hematoma; VCR = ventriculocranial ratio.
AdamsHPJrKassellNFTornerJCHaleyECJr: Predicting cerebral ischemia after aneurysmal subarachnoid hemorrhage: influences of clinical condition, CT results, and antifibrinolytic therapy. A report of the Cooperative Aneurysm Study. Neurology37:1586–15911987
ClaassenJBernardiniGLKreiterKBatesJDuYECopelandD: Effect of cisternal and ventricular blood on risk of delayed cerebral ischemia after subarachnoid hemorrhage: the Fisher scale revisited. Stroke32:2012–20202001
ShimizuH: Re: Subarachnoid hemorrhage on computed tomography scanning and the development of cerebral vasospasm: the Fisher grade revisited (Smith ML et al. Surg Neurol 2005;63:229–35). Surg Neurol66:551–5522006. (Letter)
SmithMLAbrahamsJMChandelaSSmithMJHurstRWLe RouxPD: Subarachnoid hemorrhage on computed tomography scanning and the development of cerebral vasospasm: the Fisher grade revisited. Surg Neurol63:229–2352005
SzeRWGhioniVWeinbergerESeidelKDEllenbogenRG: Rapid computed tomography technique to measure ventricular volumes in the child with suspected ventriculoperitoneal shunt failure II. Clinical application. J Comput Assist Tomogr27:668–6732003
van NordenAGvan DijkGWvan HuizenMDAlgraARinkelGJ: Interobserver agreement and predictive value for outcome of two rating scales for the amount of extravasated blood after aneurysmal subarachnoid haemorrhage. J Neurol253:1217–12202006