Observer reliability in histological grading of astrocytoma stereotactic biopsies

Restricted access

✓ This study provides an objective assessment of the reliability of histological grading of astrocytoma specimens obtained using stereotactic biopsy. Pathological diagnosis of brain tumors provides an index of disease severity and guides clinical practice in their treatment. It also functions as the gold standard in assessing the validity of diagnostic tests such as magnetic resonance imaging. Often diagnoses are made from biopsy material obtained using stereotactic technique. The current study was designed to evaluate this gold standard with regard to interobserver and intraobserver variability.

Four certified neuropathologists from academic centers in the United States and Canada were asked to grade 30 brain biopsy specimens obtained stereotactically in patients with astrocytomas. Intraobserver agreement was analyzed in individual observers by comparing their first and second readings, separated by 5 to 14 weeks. Interobserver data were analyzed by comparing initial readings across all observers for individual diagnoses. Kappa analysis was used to measure agreement beyond chance.

Intraobserver agreement was 74.73% for glioblastomas multiforme, 51.43% for anaplastic astrocytomas, and 65.22% for low-grade astrocytomas. The most common disagreements were between anaplastic astrocytomas and glioblastomas multiforme, followed by disagreements between anaplastic and low-grade astrocytomas. Interobserver agreement on initial readings was 62.41% (κ 0.39) for glioblastomas, 36.04% (κ 0.06) for anaplastic astrocytomas, and 57.14% (κ 0.48) for low-grade astrocytomas.

A significantly greater degree of reliability was seen in histopathological diagnoses of low- or high-grade astrocytomas than in those of intermediate-grade astrocytomas. Therefore, the highest variability occurs at the point of clinical decision making—namely, intermediate-grade tumors that may or may not be selected to receive adjuvant therapy. This considerable variability is an issue that needs to be recognized and further addressed by analysis of current and proposed astrocytoma grading schemes.

Article Information

Address reprint requests to: Beverly C. Walters, M.D., Department of Neurosurgery, The Miriam Hospital, 164 Summit Avenue, Providence, Rhode Island 02906.

© AANS, except where prohibited by US copyright law.

Headings

References

  • 1.

    Adelman LS: Grading astrocytomas. Neurosurg Clin North Am 5:35411994Adelman LS: Grading astrocytomas. Neurosurg Clin North Am 5:35–41 1994

    • Search Google Scholar
    • Export Citation
  • 2.

    Bailey PCushing H: Medulloblastoma cerebelli: a common type of mid-cerebellar glioma of childhood. Arch Neurol Psychiatry 14:1922231925Bailey P Cushing H: Medulloblastoma cerebelli: a common type of mid-cerebellar glioma of childhood. Arch Neurol Psychiatry 14:192–223 1925

    • Search Google Scholar
    • Export Citation
  • 3.

    Braakman RAvezaat CJJMaas AIRet al: Inter observer agreement in the assessment of the motor response of the Glasgow ‘coma’ scale. Clin Neurol Neurosurg 80:1001061979Braakman R Avezaat CJJ Maas AIR et al: Inter observer agreement in the assessment of the motor response of the Glasgow ‘coma’ scale. Clin Neurol Neurosurg 80:100–106 1979

    • Search Google Scholar
    • Export Citation
  • 4.

    Chandrasoma PTSmith MMApuzzo MLJ: Stereotactic biopsy in the diagnosis of brain masses: comparison of results of biopsy and resected surgical specimens. Neurosurgery 24:1601651989Chandrasoma PT Smith MM Apuzzo MLJ: Stereotactic biopsy in the diagnosis of brain masses: comparison of results of biopsy and resected surgical specimens. Neurosurgery 24:160–165 1989

    • Search Google Scholar
    • Export Citation
  • 5.

    Childhood Brain Tumor Consortium: Intraobserver reproducibility in assigning brain tumors to classes in the World Health Organization diagnostic scheme. J Neuroncol 7:2112241989Childhood Brain Tumor Consortium: Intraobserver reproducibility in assigning brain tumors to classes in the World Health Organization diagnostic scheme. J Neuroncol 7:211–224 1989

    • Search Google Scholar
    • Export Citation
  • 6.

    Cohen J: A coefficient of agreement for nominal scales. Educ Psychol Meas 20:37461960Cohen J: A coefficient of agreement for nominal scales. Educ Psychol Meas 20:37–46 1960

    • Search Google Scholar
    • Export Citation
  • 7.

    Daumas-Duport C: Histological grading of gliomas. Curr Opin Neurol Neurosurg 5:9249311992Daumas-Duport C: Histological grading of gliomas. Curr Opin Neurol Neurosurg 5:924–931 1992

    • Search Google Scholar
    • Export Citation
  • 8.

    Daumas-Duport C: Histoprognosis of gliomas. Adv Tech Stand Neurosurg 21:43761994Daumas-Duport C: Histoprognosis of gliomas. Adv Tech Stand Neurosurg 21:43–76 1994

    • Search Google Scholar
    • Export Citation
  • 9.

    Daumas-Duport CScheithauer BO'Fallon Jet al: Grading of astrocytomas. A simple and reproducible method. Cancer 62:215221651988Daumas-Duport C Scheithauer B O'Fallon J et al: Grading of astrocytomas. A simple and reproducible method. Cancer 62:2152–2165 1988

    • Search Google Scholar
    • Export Citation
  • 10.

    Dean BLDrayer BPBird CRet al: Gliomas: classification with MR imaging. Radiology 174:4114151990Dean BL Drayer BP Bird CR et al: Gliomas: classification with MR imaging. Radiology 174:411–415 1990

    • Search Google Scholar
    • Export Citation
  • 11.

    Feinstein AR: A bibliography of publications on observer variability. J Chronic Dis 38:6196321985Feinstein AR: A bibliography of publications on observer variability. J Chronic Dis 38:619–632 1985

    • Search Google Scholar
    • Export Citation
  • 12.

    Feinstein AR: Clinical Epidemiology: The Architecture of Clinical Research. Philadelphia: WB Saunders1985 pp 182186632–648Feinstein AR: Clinical Epidemiology: The Architecture of Clinical Research. Philadelphia: WB Saunders 1985 pp 182–186 632–648

    • Search Google Scholar
    • Export Citation
  • 13.

    Gilles FHWinston KFulchiero Aet al: Histologic features and observational variation in cerebellar gliomas in children. J Natl Cancer Inst 58:1751811977Gilles FH Winston K Fulchiero A et al: Histologic features and observational variation in cerebellar gliomas in children. J Natl Cancer Inst 58:175–181 1977

    • Search Google Scholar
    • Export Citation
  • 14.

    Glantz MJBurger PCHerndon JE IIet al: Influence of the type of surgery on the histologic diagnosis in patients with anaplastic gliomas. Neurology 41:174117441991Glantz MJ Burger PC Herndon JE II et al: Influence of the type of surgery on the histologic diagnosis in patients with anaplastic gliomas. Neurology 41:1741–1744 1991

    • Search Google Scholar
    • Export Citation
  • 15.

    Kepes JJ: Pitfalls and problems in the histopathologic evaluation of stereotactic needle biopsy specimens. Neurosurg Clin North Am 5:19331994Kepes JJ: Pitfalls and problems in the histopathologic evaluation of stereotactic needle biopsy specimens. Neurosurg Clin North Am 5:19–33 1994

    • Search Google Scholar
    • Export Citation
  • 16.

    Kernohan JWMabon RFSvien HJ: Symposium on new and simplified concepts of gliomas. A simplified classification of the gliomas. Proc Staff Meet Mayo Clin 24:71751949Kernohan JW Mabon RF Svien HJ: Symposium on new and simplified concepts of gliomas. A simplified classification of the gliomas. Proc Staff Meet Mayo Clin 24:71–75 1949

    • Search Google Scholar
    • Export Citation
  • 17.

    Kleihues PBurger PCScheithauer BW: The new WHO classification of brain tumours. Brain Pathol 3:2552681993Kleihues P Burger PC Scheithauer BW: The new WHO classification of brain tumours. Brain Pathol 3:255–268 1993

    • Search Google Scholar
    • Export Citation
  • 18.

    Koran LM: The reliability of clinical methods, data and judgments. N Engl J Med 293:642646695–7011975 (Two parts)Koran LM: The reliability of clinical methods data and judgments. N Engl J Med 293:642–646 695–701 1975 (Two parts)

    • Search Google Scholar
    • Export Citation
  • 19.

    Landis JRKoch GG: The measurement of observer agreement for categorical data. Biometrics 33:1591741977Landis JR Koch GG: The measurement of observer agreement for categorical data. Biometrics 33:159–174 1977

    • Search Google Scholar
    • Export Citation
  • 20.

    Loewenson RBBearman JEResch JA: Reliability of measurements for studies of cerebrovascular atherosclerosis. Biometrics 28:5575691972Loewenson RB Bearman JE Resch JA: Reliability of measurements for studies of cerebrovascular atherosclerosis. Biometrics 28:557–569 1972

    • Search Google Scholar
    • Export Citation
  • 21.

    McCance CWatt JAHall DJ: An evaluation of the reliability and validity of the plantar response in a psychogeriatric population. J Chronic Dis 21:3693741968McCance C Watt JA Hall DJ: An evaluation of the reliability and validity of the plantar response in a psychogeriatric population. J Chronic Dis 21:369–374 1968

    • Search Google Scholar
    • Export Citation
  • 22.

    Revesz TScaravilli FCoutinho Let al: Reliability of histological diagnosis including grading in gliomas biopsied by image-guided stereotactic technique. Brain 116:7817931993Revesz T Scaravilli F Coutinho L et al: Reliability of histological diagnosis including grading in gliomas biopsied by image-guided stereotactic technique. Brain 116:781–793 1993

    • Search Google Scholar
    • Export Citation
  • 23.

    Ringertz N: Grading of gliomas. Acta Pathol Microbiol Scand 27:51641950Ringertz N: Grading of gliomas. Acta Pathol Microbiol Scand 27:51–64 1950

    • Search Google Scholar
    • Export Citation

TrendMD

Cited By

Metrics

Metrics

All Time Past Year Past 30 Days
Abstract Views 121 121 53
Full Text Views 146 124 0
PDF Downloads 87 76 0
EPUB Downloads 0 0 0

PubMed

Google Scholar