Review Article| Volume 54, P205-214, September 2020

Video Assessment of Surgeons and Surgery

      Video-based assessment provides a platform for objective, independent, and blinded assessment of surgical skills, therefore overcoming inherent limitations of assessments through direct observation.


      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'


      Subscribe to Advances in Surgery
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect


        • Vassiliou M.C.
        • Feldman L.S.
        Objective assessment, selection, and certification in surgery.
        Surg Oncol. 2011; 20: 140-145
        • Touchie C.
        • Ten Cate O.
        The promise, perils, problems and progress of competency-based medical education.
        Med Education. 2016; 50: 93-100
        • Scott D.J.
        Patient safety, competency, and the future of surgical simulation.
        Simul Healthc. 2006; 1: 164-170
        • Feldman L.S.
        • Hagarty S.E.
        • Ghitulescu G.
        • et al.
        Relationship between objective assessment of technical skills and subjective in-training evaluations in surgical residents.
        J Am Coll Surg. 2004; 198: 105-110
        • Scott D.J.
        • Valentine R.J.
        • Bergen P.C.
        • et al.
        Evaluating surgical competency with the American Board of Surgery In-Training Examination, skill testing, and intraoperative assessment.
        Surgery. 2000; 128: 613-622
        • Abdelsattar J.M.
        • Pandian T.K.
        • Finnesgard E.J.
        • et al.
        Do you see what I see? How we use video as an adjunct to general surgery resident education.
        J Surg Educ. 2015; 72: e145-e150
        • Aggarwal R.
        • Grantcharov T.P.
        • Darzi A.
        Framework for systematic training and assessment of technical skills.
        J Am Coll Surg. 2007; 204: 697-705
        • Wilson B.D.
        Development in video technology for coaching.
        Sports Technology. 2008; 1: 34-40
        • Vassiliou M.C.
        • Feldman L.S.
        • Fraser S.
        • et al.
        Evaluating intraoperative laparoscopic skill: direct observation versus blinded videotaped performances.
        Surg Innov. 2007; 14: 211-216
        • Vogt V.Y.
        • Givens V.M.
        • Keathley C.A.
        • et al.
        Is a resident's score on a videotaped objective structured assessment of technical skills affected by revealing the resident's identity?.
        Am J Obstet Gynecol. 2003; 189: 688-691
        • Birkmeyer J.D.
        • Finks J.F.
        • O'Reilly A.
        • et al.
        Surgical skill and complication rates after bariatric surgery.
        N Engl J Med. 2013; 369: 1434-1442
        • Hogg M.E.
        • Zenati M.
        • Novak S.
        • et al.
        Grading of surgeon technical performance predicts postoperative pancreatic fistula for pancreaticoduodenectomy independent of patient-related variables.
        Ann Surg. 2016; 264: 482-491
        • Mackenzie H.
        • Ni M.
        • Miskovic D.
        • et al.
        Clinical validity of consultant technical skills assessment in the English National Training Programme for Laparoscopic Colorectal Surgery.
        Br J Surg. 2015; 102: 991-997
        • Miskovic D.
        • Wyles S.M.
        • Carter F.
        • et al.
        Development, validation and implementation of a monitoring tool for training in laparoscopic colorectal surgery in the English National Training Program.
        Surg Endosc. 2011; 25: 1136-1142
        • Aggarwal R.
        • Grantcharov T.
        • Moorthy K.
        • et al.
        Toward feasible, valid, and reliable video-based assessments of technical surgical skills in the operating room.
        Ann Surg. 2008; 247: 372-379
        • Dath D.
        • Regehr G.
        • Birch D.
        • et al.
        Toward reliable operative assessment: the reliability and feasibility of videotaped assessment of laparoscopic technical skills.
        Surg Endosc. 2004; 18: 1800-1804
        • Scott D.
        • Rege R.
        • Bergen P.
        • et al.
        Measuring operative performance after laparoscopic skills training: edited videotape versus direct observation.
        J Laparoendosc Adv Surg Tech. 2000; 10: 183-190
        • Langerman A.
        • Grantcharov T.P.
        Are we ready for our close-up?: Why and how we must embrace video in the OR.
        Ann Surg. 2017; 266: 934-936
        • Bonrath E.M.
        • Dedy N.J.
        • Gordon L.E.
        • et al.
        Comprehensive surgical coaching enhances surgical skill in the operating room.
        Ann Surg. 2015; 262: 1
        • Ritter E.M.
        • Gardner A.K.
        • Dunkin B.J.
        • et al.
        Video-based assessment for laparoscopic fundoplication: initial development of a robust tool for operative performance assessment.
        Surg Endosc. 2019; ([Epub ahead of print])
        • Madani A.
        • Watanabe Y.
        • Bilgic E.
        • et al.
        Measuring intra-operative decision-making during laparoscopic cholecystectomy: validity evidence for a novel interactive Web-based assessment tool.
        Surg Endosc. 2017; 31: 1203-1212
        • Davis D.A.
        • Mazmanian P.E.
        • Fordis M.
        • et al.
        Accuracy of physician self-assessment compared with observed measures of competence: a systematic review.
        JAMA. 2006; 296: 1094-1102
        • Stern J.
        • Sharma S.
        • Mendoza P.
        • et al.
        Surgeon perception is not a good predictor of peri-operative outcomes in robot-assisted radical prostatectomy.
        J Robot Surg. 2011; 5: 283-288
        • Prebay Z.J.
        • Peabody J.O.
        • Miller D.C.
        • et al.
        Video review for measuring and improving skill in urological surgery.
        Nat Rev Urol. 2019; 16: 261-267
        • Vaughn C.J.
        • Kim E.
        • O'Sullivan P.
        • et al.
        Peer video review and feedback improve performance in basic surgical skills.
        Am J Surg. 2016; 211: 355-360
        • White L.W.
        • Kowalewski T.M.
        • Dockter R.L.
        • et al.
        Crowd-sourced assessment of technical skill: a valid method for discriminating basic robotic surgery skills.
        J endourology. 2015; 29: 1295-1301
        • Deal S.B.
        • Lendvay T.S.
        • Haque M.I.
        • et al.
        Crowd-sourced assessment of technical skills: an opportunity for improvement in the assessment of laparoscopic surgical skills.
        Am J Surg. 2016; 211: 398-404
        • Deal S.B.
        • Stefanidis D.
        • Telem D.
        • et al.
        Evaluation of crowd-sourced assessment of the critical view of safety in laparoscopic cholecystectomy.
        Surg Endosc. 2017; 31: 5094-5100
        • Chen C.
        • White L.
        • Kowalewski T.
        • et al.
        Crowd-sourced assessment of technical skills: a novel method to evaluate surgical performance.
        J Surg Res. 2014; 187: 65-71
        • Goldenberg M.G.
        • Grantcharov T.P.
        Video-analysis for the assessment of practical skill.
        Tijdschrift Voor Urologie. 2016; 6: 128-136
        • Holst D.
        • Kowalewski T.M.
        • White L.W.
        • et al.
        Crowd-sourced assessment of technical skills: differentiating animate surgical skill through the wisdom of crowds.
        J endourology. 2015; 29: 1183-1188
        • Hashimoto D.A.
        • Rosman G.
        • Witkowski E.R.
        • et al.
        Computer vision analysis of intraoperative video: automated recognition of operative steps in laparoscopic sleeve gastrectomy.
        Ann Surg. 2019; 270: 414-421
        • Hashimoto D.A.
        • Rosman G.
        • Rus D.
        • et al.
        Artificial intelligence in surgery: promises and perils.
        Ann Surg. 2018; 268: 70-76
        • Twinanda A.P.
        • Shehata S.
        • Mutter D.
        • et al.
        Endonet: a deep architecture for recognition tasks on laparoscopic videos.
        IEEE Trans Med Imaging. 2016; 36: 86-97
        • Soguero-Ruiz C.
        • Hindberg K.
        • Rojo-Alvarez J.L.
        • et al.
        Support vector feature selection for early detection of anastomosis leakage from bag-of-words in electronic health records.
        IEEE J Biomed Health Inform. 2014; 20: 1404-1415
        • Monsalve-Torra A.
        • Ruiz-Fernandez D.
        • Marin-Alonso O.
        • et al.
        Using machine learning methods for predicting in-hospital mortality in patients undergoing open repair of abdominal aortic aneurysm.
        J Biomed Inform. 2016; 62: 195-201
      1. Jin A, Yeung S, Jopling J, et al. Tool detection and operative skill assessment in surgical videos using region-based convolutional neural networks. Paper presented at: 2018 IEEE Winter Conference on Applications of Computer Vision (WACV). Lake Tahoe, March 12-15, 2018.

        • Suzuki T.
        • Egi H.
        • Hattori M.
        • et al.
        An evaluation of the endoscopic surgical skills assessment using a video analysis software program.
        Surg Endosc. 2015; 29: 1804-1808
      2. Fard MJ, Ameri S, Chinnam RB, et al. Machine learning approach for skill evaluation in robotic-assisted surgery. arXiv preprint arXiv:161105136. 2016. Proceedings of the World Congress on Engineering and Computer Science, Vol I WCECS. San Francisco (CA), October 19-21, 2016.

        • Wu R.C.
        • Prebay Z.J.
        • Patel P.
        • et al.
        Using video review to understand the technical variation of robot-assisted radical prostatectomy in a statewide surgical collaborative.
        World J Urol. 2019; : 1-7
        • Varban O.A.
        • Thumma J.R.
        • Finks J.F.
        • et al.
        Evaluating the effect of surgical skill on outcomes for laparoscopic sleeve gastrectomy: a video-based study.
        Ann Surg. 2019; ([Epub ahead of print])
        • Ghani K.R.
        • Miller D.C.
        • Linsell S.
        • et al.
        Measuring to improve: peer and crowd-sourced assessments of technical skill with robot-assisted radical prostatectomy.
        Eur Urol. 2016; 69: 547-550
        • Matsuda T.
        • Ono Y.
        • Terachi T.
        • et al.
        The endoscopic surgical skill qualification system in urological laparoscopy: a novel system in Japan.
        J Urol. 2006; 176: 2168-2172
        • Mori T.
        • Kimura T.
        • Kitajima M.
        Skill accreditation system for laparoscopic gastroenterologic surgeons in Japan.
        Minim Invasive Ther Allied Technol. 2010; 19: 18-23