Surgical performance evaluation was first described with the OSATS (Objective Structured Assessment of Technical Skills) and modified for aneurysm microsurgery simulation with the OSAACS (Objective Structured Assessment of Aneurysm Clipping Skills). These methods rely on the subjective opinions of evaluators, however, and there is a lack of objective evaluation for proficiency in the microsurgical treatment of brain aneurysms. The authors present a new instrument, the Skill Assessment in Microsurgery for Brain Aneurysms (SAMBA) scale, which can be used similarly in a simulation model and in the treatment of unruptured middle cerebral artery (MCA) aneurysms to predict surgical performance; the authors also report on its validation.
The SAMBA scale was created by consensus among 5 vascular neurosurgeons from 2 different neurosurgical departments. SAMBA results were analyzed using descriptive statistics, Cronbach’s alpha indexes, and multivariate ANOVA analyses (p < 0.05).
Expert, intermediate-level, and novice surgeons scored, respectively, an average of 33.9, 27.1, and 16.4 points in the real surgery and 33.3, 27.3, and 19.4 points in the simulation. The SAMBA interrater reliability index was 0.995 for the real surgery and 0.996 for the simulated surgery; the intrarater reliability was 0.983 (Cronbach’s alpha). In both the simulation and the real surgery settings, the average scores achieved by members of each group (expert, intermediate level, and novice) were significantly different (p < 0.001). Scores among novice surgeons were more diverse (coefficient of variation = 12.4).
Predictive validation of the placenta brain aneurysm model has been previously reported, but the SAMBA scale adds an objective scoring system to verify microsurgical ability in this complex operation, stratifying proficiency by points. The SAMBA scale can be used as an interface between learning and practicing, as it can be applied in a safe and controlled environment, such as is provided by a placenta model, with similar results obtained in real surgery, predicting real surgical performance.
ABBREVIATIONSCV = coefficient of variation; IQR = interquartile range; MANOVA = multivariate analysis of variance; MCA = middle cerebral artery; OSAACS = Objective Structured Assessment of Aneurysm Clipping Skills; SAMBA = Skill Assessment in Microsurgery for Brain Aneurysms; SD = standard deviation.
AounSG, El AhmadiehTY, El TecleNE, DaouMR, AdelJG, ParkCS, : A pilot study to assess the construct and face validity of the Northwestern Objective Microanastomosis Assessment Tool. 123:103–109, 201510.3171/2014.12.JNS13181425658787)| false
BelykhE, MillerEJ, LeiT, ChappleK, ByvaltsevVA, SpetzlerRF, : Face, content, and construct validity of an aneurysm clipping model using human placenta. 105:952–960, 960.e1–960.e2, 201710.1016/j.wneu.2017.06.04528647655)| false
de MontbrunSRobertsPLSatterthwaiteLMacRaeH: Implementing and evaluating a national certification technical skills examination: the Colorectal Objective Structured Assessment Of Technical Skill. Ann Surg264:1–62016
de MontbrunS, RobertsPL, SatterthwaiteL, MacRaeH: Implementing and evaluating a national certification technical skills examination: the Colorectal Objective Structured Assessment Of Technical Skill. 264:1–6, 201610.1097/SLA.0000000000001620)| false
OliveiraMM, AraujoAB, NicolatoA, ProsdocimiA, GodinhoJV, ValleAL, : Face, content, and construct validity of brain tumor microsurgery simulation using a human placenta model. 12:61–67, 201610.1227/NEU.0000000000001030)| false
Oliveira MagaldiM, NicolatoA, GodinhoJV, SantosM, ProsdocimiA, MalheirosJA, : Human placenta aneurysm model for training neurosurgeons in vascular microsurgery. 10 (Suppl 4):592–601, 201410.1227/NEU.0000000000000553)| false
Ribeiro de OliveiraMMNicolatoASantosMGodinhoJVBritoRAlvarengaA: Face, content, and construct validity of human placenta as a haptic training tool in neurointerventional surgery. J Neurosurg124:1238–12442016
Ribeiro de OliveiraMM, NicolatoA, SantosM, GodinhoJV, BritoR, AlvarengaA, : Face, content, and construct validity of human placenta as a haptic training tool in neurointerventional surgery. 124:1238–1244, 201610.3171/2015.1.JNS141583)| false