Standards for reporting randomized controlled trials in neurosurgery

A review

Restricted access

Object

The Consolidated Standards for Reporting of Trials (CONSORT) criteria were published in 1996 to standardize the reporting and improve the quality of clinical trials. Despite having been endorsed by major medical journals and shown to improve the quality of reported trials, neurosurgical journals have yet to formally adopt these reporting criteria. The purpose of this study is to evaluate the quality and reporting of randomized controlled trials (RCTs) in neurosurgery and the factors that may affect the quality of reported trials.

Methods

The authors evaluated all neurosurgical RCTs published in 2006 and 2007 in the principal neurosurgical journals (Journal of Neurosurgery; Neurosurgery; Surgical Neurology; Journal of Neurology, Neurosurgery, and Psychiatry; and Acta Neurochirurgica) and in 3 leading general medical journals (Journal of the American Medical Association, Lancet, and the New England Journal of Medicine). Randomized controlled trials that addressed operative decision making or the treatment of neurosurgical patients were included in this analysis. The RCT quality was evaluated using the Jadad score and the CONSORT checklist.

Results

In 2006 and 2007, 27 RCTs relevant to intracranial neurosurgery were reported. Of these trials, only 59% had a Jadad score ≥ 3. The 3 major medical journals all endorsed the CONSORT guidelines, while none of the neurosurgical journals have adopted these guidelines. Randomized controlled trials published in the 3 major medical journals had a significantly higher mean CONSORT score (mean 41, range 39–44) compared with those published in neurosurgical journals (mean 26.4, range 17–38; p < 0.0001). Jadad scores were also significantly higher for the major medical journals (mean 3.42, range 2–5) than neurosurgical journals (mean 2.45, range 1–5; p = 0.05).

Conclusions

Despite the growing volume of RCTs in neurosurgery, the quality of reporting of these trials remains suboptimal, especially in the neurosurgical journals. Improved awareness of the CONSORT guidelines by journal editors, reviewers, and authors of these papers could improve the methodology and reporting of RCTs in neurosurgery.

Abbreviations used in this paper:CONSORT = Consolidated Standards for Reporting of Trials; RCT = randomized controlled trial.
Article Information

Contributor Notes

Address correspondence to: Aaron S. Dumont, M.D., Department of Neurological Surgery, Thomas Jefferson University, 909 Walnut Street, 2nd Floor, Philadelphia, Pennsylvania 19107. email: aaron.dumont@jefferson.edu.Please include this information when citing this paper: published online November 5, 2010; DOI: 10.3171/2010.8.JNS091770.
Headings
References
  • 1

    Abouzari MRashidi ARezaii JEsfandiari KAsadollahi MAleali H: The role of postoperative patient posture in the recurrence of traumatic chronic subdural hematoma after burr-hole surgery. Neurosurgery 61:7947972007

    • Search Google Scholar
    • Export Citation
  • 2

    Al-Rawi PGTurner CLWaran VNg IKirkpatrick PJ: A randomized trial of synthetic patch versus direct primary closure in carotid endarterectomy. Neurosurgery 59:8228292006

    • Search Google Scholar
    • Export Citation
  • 3

    Altman DGBland JM: Absence of evidence is not evidence of absence. BMJ 311:4851995

  • 4

    Angevine PDMcCormick PC: Wrong science: the SPORT trial and its potential impact on neurosurgery. Clin Neurosurg 51:1201252004

  • 5

    Aoyama HShirato HTago MNakagawa KToyoda THatano K: Stereotactic radiosurgery plus whole-brain radiation therapy vs stereotactic radiosurgery alone for treatment of brain metastases: a randomized controlled trial. JAMA 295:248324912006

    • Search Google Scholar
    • Export Citation
  • 6

    Balasubramanian SPWiener MAlshameeri ZTiruvoipati RElbourne DReed MW: Standards of reporting of randomized controlled trials in general surgery: can we do better?. Ann Surg 244:6636672006

    • Search Google Scholar
    • Export Citation
  • 7

    Balch CM: Randomized clinical trials in surgery: why do we need them?. J Thorac Cardiovasc Surg 132:2412422006

  • 8

    Barrow DL: Bad science ISAT: the impact on neurosurgical practice. Clin Neurosurg 51:1261312004

  • 9

    Barth MCapelle HHMünch EThomé CFiedler FSchmiedek P: Effects of the selective endothelin A (ET(A)) receptor antagonist Clazosentan on cerebral perfusion and cerebral oxygenation following severe subarachnoid hemorrhage-preliminary results from a randomized clinical series. Acta Neurochir (Wien) 149:9119182007

    • Search Google Scholar
    • Export Citation
  • 10

    Begg CCho MEastwood SHorton RMoher DOlkin I: Improving the quality of reporting of randomized controlled trials. The CONSORT statement. JAMA 276:6376391996

    • Search Google Scholar
    • Export Citation
  • 11

    Biggs MCurtis JA: Randomized, prospective study comparing ulnar neurolysis in situ with submuscular transposition. Neurosurgery 58:2963042006

    • Search Google Scholar
    • Export Citation
  • 12

    Blackstone EH: CONSORT and beyond. J Thorac Cardiovasc Surg 132:2292322006

  • 13

    Bracken MBShepard MJCollins WFHolford TRYoung WBaskin DS: A randomized, controlled trial of methylprednisolone or naloxone in the treatment of acute spinal-cord injury. Results of the Second National Acute Spinal Cord Injury Study. N Engl J Med 322:140514111990

    • Search Google Scholar
    • Export Citation
  • 14

    Brown JALutsep HLWeinand MCramer SC: Motor cortex stimulation for the enhancement of recovery from stroke: a prospective, multicenter safety study. Neurosurgery 58:4644732006

    • Search Google Scholar
    • Export Citation
  • 15

    Chang SMReynolds SLButowski NLamborn KRBuckner JCKaplan RS: GNOSIS: guidelines for neuro-oncology: standards for investigational studies-reporting of phase 1 and phase 2 clinical trials. Neuro Oncol 7:4254342005

    • Search Google Scholar
    • Export Citation
  • 16

    Cho DYChen CCChang CSLee WYTso M: Endoscopic surgery for spontaneous basal ganglia hemorrhage: comparing endoscopic surgery, stereotactic aspiration, and craniotomy in noncomatose patients. Surg Neurol 65:5475562006

    • Search Google Scholar
    • Export Citation
  • 17

    Deuschl GSchade-Brittinger CKrack PVolkmann JSchäfer HBötzel K: A randomized trial of deep-brain stimulation for Parkinson's disease. N Engl J Med 355:8969082006

    • Search Google Scholar
    • Export Citation
  • 18

    Devereaux PJManns BJGhali WAQuan HLacchetti CMontori VM: Physician interpretations and textbook definitions of blinding terminology in randomized controlled trials. JAMA 285:200020032001

    • Search Google Scholar
    • Export Citation
  • 19

    Elgmark Andersson EEmanuelson IBjörklund RStålhammar DA: Mild traumatic brain injuries: the impact of early intervention on late sequelae. A randomized controlled trial. Acta Neurochir (Wien) 149:1511602007

    • Search Google Scholar
    • Export Citation
  • 20

    Fehlings MG: Editorial: recommendations regarding the use of methylprednisolone in acute spinal cord injury: making sense out of the controversy. Spine 26:24 SupplS56S572001

    • Search Google Scholar
    • Export Citation
  • 21

    Hatton JKryscio RKRyan MOtt LYoung B: Systemic metabolic effects of combined insulin-like growth factor-I and growth hormone therapy in patients who have sustained acute traumatic brain injury. J Neurosurg 105:8438522006

    • Search Google Scholar
    • Export Citation
  • 22

    Hopewell SAltman DGMoher DSchulz KF: Endorsement of the CONSORT Statement by high impact factor medical journals: a survey of journal editors and journal ‘Instructions to Authors’. Trials 9:202008

    • Search Google Scholar
    • Export Citation
  • 23

    Jacquier IBoutron IMoher DRoy CRavaud P: The reporting of randomized clinical trials using a surgical intervention is in need of immediate improvement: a systematic review. Ann Surg 244:6776832006

    • Search Google Scholar
    • Export Citation
  • 24

    Jadad ARMoore RACarroll DJenkinson CReynolds DJGavaghan DJ: Assessing the quality of reports of randomized clinical trials: is blinding necessary?. Control Clin Trials 17:1121996

    • Search Google Scholar
    • Export Citation
  • 25

    Kassell NFDumont AS: Randomized controlled trials in surgery: comic opera no more?. J Thorac Cardiovasc Surg 132:2432442006

  • 26

    Keime-Guibert FChinot OTaillandier LCartalat-Carel SFrenay MKantor G: Radiotherapy for glioblastoma in the elderly. N Engl J Med 356:152715352007

    • Search Google Scholar
    • Export Citation
  • 27

    Kuhn MJPicozzi PMaldjian JASchmalfuss IMMaravilla KRBowen BC: Evaluation of intraaxial enhancing brain tumors on magnetic resonance imaging: intraindividual crossover comparison of gadobenate dimeglumine and gadopentetate dimeglumine for visualization and assessment, and implications for surgical intervention. J Neurosurg 106:5575662007

    • Search Google Scholar
    • Export Citation
  • 28

    Kupsch ABenecke RMüller JTrottenberg TSchneider GHPoewe W: Pallidal deep-brain stimulation in primary generalized or segmental dystonia. N Engl J Med 355:197819902006

    • Search Google Scholar
    • Export Citation
  • 29

    Lauer MS: Believability of clinical trials: a diagnostic testing perspective. J Thorac Cardiovasc Surg 132:2492512006

  • 30

    Maciunas RJMaddux BNRiley DEWhitney CMSchoenberg MROgrocki PJ: Prospective randomized double-blind trial of bilateral thalamic deep brain stimulation in adults with Tourette syndrome. J Neurosurg 107:100410142007

    • Search Google Scholar
    • Export Citation
  • 31

    Mas JLChatellier GBeyssen BBranchereau AMoulin TBecquemin JP: Endarterectomy versus stenting in patients with symptomatic severe carotid stenosis. N Engl J Med 355:166016712006

    • Search Google Scholar
    • Export Citation
  • 32

    Moher DJones ALepage L: Use of the CONSORT statement and quality of reports of randomized trials: a comparative before-and-after evaluation. JAMA 285:199219952001

    • Search Google Scholar
    • Export Citation
  • 33

    Moher DSchulz KFAltman DG: The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials. Lancet 357:119111942001

    • Search Google Scholar
    • Export Citation
  • 34

    Myburgh JCooper DJFinfer SBellomo RNorton RBishop N: Saline or albumin for fluid resuscitation in patients with traumatic brain injury. N Engl J Med 357:8748842007

    • Search Google Scholar
    • Export Citation
  • 35

    Okun MSMann GFoote KDShapira NABowers DSpringer U: Deep brain stimulation in the internal capsule and nucleus accumbens region: responses observed during active and sham programming. J Neurol Neurosurg Psychiatry 78:3103142007

    • Search Google Scholar
    • Export Citation
  • 36

    Pantazis GTsitsopoulos PMihas CKatsiva VStavrianos VZymaris S: Early surgical treatment vs conservative management for spontaneous supratentorial intracerebral hematomas: a prospective randomized study. Surg Neurol 66:4925022006

    • Search Google Scholar
    • Export Citation
  • 37

    Sade RM: Reports of clinical trials: ethical aspects. J Thorac Cardiovasc Surg 132:2452462006

  • 38

    Saitoh YHirayama AKishima HShimokawa TOshino SHirata M: Reduction of intractable deafferentation pain due to spinal cord or peripheral lesion by high-frequency repetitive transcranial magnetic stimulation of the primary motor cortex. J Neurosurg 107:5555592007

    • Search Google Scholar
    • Export Citation
  • 39

    Scheller CRichter HPEngelhardt MKöenig RAntoniadis G: The influence of prophylactic vasoactive treatment on cochlear and facial nerve functions after vestibular schwannoma surgery: a prospective and open-label randomized pilot study. Neurosurgery 61:92982007

    • Search Google Scholar
    • Export Citation
  • 40

    Schmid-Elsaesser RKunz MZausinger SPrueckner SBriegel JSteiger HJ: Intravenous magnesium versus nimodipine in the treatment of patients with aneurysmal subarachnoid hemorrhage: a randomized study. Neurosurgery 58:105410652006

    • Search Google Scholar
    • Export Citation
  • 41

    SPACE Collaborative GroupRingleb PAAllenberg JBrückmann HEckstein HHFraedrich G: 30 day results from the SPACE trial of stent-protected angioplasty versus carotid endarterectomy in symptomatic patients: a randomised non-inferiority trial. Lancet 368:123912472006. (Erratum in Lancet 368:1238 2006)

    • Search Google Scholar
    • Export Citation
  • 42

    Springborg JBMøller CGideon PJørgensen OSJuhler MOlsen NV: Erythropoietin in patients with aneurysmal subarachnoid haemorrhage: a double blind randomised clinical trial. Acta Neurochir (Wien) 149:108911012007

    • Search Google Scholar
    • Export Citation
  • 43

    Tiruvoipati RBalasubramanian SPAtturu GPeek GJElbourne D: Improving the quality of reporting randomized controlled trials in cardiothoracic surgery: the way forward. J Thorac Cardiovasc Surg 132:2332402006

    • Search Google Scholar
    • Export Citation
  • 44

    Tseng MYHutchinson PJTurner CLCzosnyka MRichards HPickard JD: Biological effects of acute pravastatin treatment in patients after aneurysmal subarachnoid hemorrhage: a double-blind, placebo-controlled trial. J Neurosurg 107:109211002007

    • Search Google Scholar
    • Export Citation
  • 45

    Turner CLWilkinson IBKirkpatrick PJ: Use of antihypertension agents for the suppression of arterial pulse pressure waveforms in patients with intracranial aneurysms. J Neurosurg 104:5315362006

    • Search Google Scholar
    • Export Citation
  • 46

    Uetani KNakayama TIkai HYonemoto NMoher D: Quality of reports on randomized controlled trials conducted in Japan: evaluation of adherence to the CONSORT statement. Intern Med 48:3073132009

    • Search Google Scholar
    • Export Citation
  • 47

    van den Bergh WMMASH Study GroupAlgra ADorhout Mees SMvan Kooten FDirven CM: Randomized controlled trial of acetylsalicylic acid in aneurysmal subarachnoid hemorrhage: the MASH Study. Stroke 37:232623302006

    • Search Google Scholar
    • Export Citation
  • 48

    Vandenbroucke JP: STREGA, STROBE, STARD, SQUIRE, MOOSE, PRISMA, GNOSIS, TREND, ORION, COREQ, QUOROM, REMARK... and CONSORT: for whom does the guideline toll?. J Clin Epidemiol 62:5945962009

    • Search Google Scholar
    • Export Citation
  • 49

    Weinstein JNTosteson TDLurie JDTosteson ANHanscom BSkinner JS: Surgical vs nonoperative treatment for lumbar disk herniation: the Spine Patient Outcomes Research Trial (SPORT): a randomized trial. JAMA 296:244124502006

    • Search Google Scholar
    • Export Citation
  • 50

    Wu JSZhou LFTang WJMao YHu JSong YY: Clinical evaluation and follow-up outcome of diffusion tensor imaging-based functional neuronavigation: a prospective, controlled study in patients with gliomas involving pyramidal tracts. Neurosurgery 61:9359492007

    • Search Google Scholar
    • Export Citation
TrendMD
Metrics

Metrics

All Time Past Year Past 30 Days
Abstract Views 297 284 42
Full Text Views 121 58 8
PDF Downloads 137 29 0
EPUB Downloads 0 0 0
PubMed
Google Scholar