Construct validation of the ProMIS simulator using a novel laparoscopic suturing task
- 21 July 2005
- journal article
- research article
- Published by Springer Science and Business Media LLC in Surgical Endoscopy
- Vol. 19 (9), 1227-1231
- https://doi.org/10.1007/s00464-004-8274-6
Abstract
The use of simulation for minimally invasive surgery (MIS) skills training has many advantages over current traditional methods. One advantage of simulation is that it enables an objective assessment of technical performance. The purpose of this study was to determine whether the ProMIS augmented reality simulator could objectively distinguish between levels of performance skills on a complex laparoscopic suturing task. Ten subjects — five laparoscopic experts and five laparoscopic novices — were assessed for baseline perceptual, visio-spatial, and psychomotor abilities using validated tests. After three trials of a novel laparoscopic suturing task were performed on the simulator, measures for time, smoothness of movement, and path distance were analyzed for each trial. Accuracy and errors were evaluated separately by two blinded reviewers to an interrater reliability of >0.8. Comparisons of mean performance measures were made between the two groups using a Mann-Whitney U test. Internal consistency of ProMIS measures was assessed with coefficient α. The psychomotor performance of the experts was superior at baseline assessment (p < 0.001). On the laparoscopic suturing task, the experts performed significantly better than the novices across all three trials (p < 0.001). They performed the tasks between three and four times faster (p < 0.0001), had three times shorter instrument path length (p < 0.0001), and had four times greater smoothness of instrument movement (p < 0.009). Experts also showed greater consistency in their performance, as demonstrated by SDs across all measures, which were four times smaller than the novice group. Observed internal consistency of ProMIS measures was high (α = 0.95, p < 0.00001). Preliminary results of construct validation efforts of the ProMIS simulator show that it can distinguish between experts and novices and has promising psychometric properties. The attractive feature of ProMIS is that a wide variety of MIS tasks can be used to train and assess technical skills.Keywords
This publication has 15 references indexed in Scilit:
- Virtual reality surgical laparoscopic simulatorsSurgical Endoscopy, 2003
- Laparoscopic skills trainingSurgical Endoscopy, 2003
- Virtual reality as a metric for the assessment of laparoscopic psychomotor skillsSurgical Endoscopy, 2002
- Virtual Reality Training Improves Operating Room PerformanceAnnals of Surgery, 2002
- Training in Laparoscopic Suturing Skills Using a New Computer-Based Virtual Reality Simulator (MIST-VR) Provides Results Comparable to Those with an Established Pelvic Trainer SystemJournal of Laparoendoscopic & Advanced Surgical Techniques, 2002
- Motion analysisSurgical Endoscopy, 2001
- Evaluation of structured and quantitative training methods for teaching intracorporeal knot tyingSurgical Endoscopy, 2001
- The Use of Electromagnetic Motion Tracking Analysis To Objectively Measure Open Surgical Skill in The Laboratory-Based ModelJournal of the American College of Surgeons, 2001
- The need for metrics in surgical educationSurgical Endoscopy, 1999
- Testing technical skill via an innovative “bench station” examinationThe American Journal of Surgery, 1997