Journal Article

Gesture-Controlled Image Management for Operating Room: A Randomized Crossover Study to Compare Interaction Using Gestures, Mouse, and Third Person Relaying

Dubois-Ferrière, Victor, Budry, Sylvain, Hoffmeyer, Pierre, Lovis, Christian, Wipfli, Rolf

2016

Overview

In this work, we aim at comparing formally three different interaction modes for image manipulation that are usable in a surgery setting: 1) A gesture-controlled approach using Kinect ®; 2) oral instructions to a third part dedicated to manipulate the images; and 3) direct manipulation using a mouse. Each participant used the radiology image viewer Weasis with the three interaction modes. In a crossover randomized controlled trial participants were attributed block wise to six experimental groups. For each group, the order for testing the three modes was randomly assigned. Nine standardized scenarios were used. 30 physicians and senior medical students participated in the experiment. Efficiency, measured as time used to pass the scenario, was best when using the mouse (M = 109.10s, SD = 25.96), followed by gesture-controlled (M = 214.97s, SD = 46.29) and oral instructions (M = 246.33s, SD = 76.50). Satisfaction, measured by a questionnaire, was rated highest in the condition mouse (M = 6.63, SD = 0.56), followed by gesture-controlled (M = 5.77, SD = 0.93) and oral instructions (M = 4.40, SD = 1.71). Differences in efficiency and satisfaction rating were significant. No significant difference in effectiveness, measured with error rates, was found. The study shows with formal evaluation that the use of gestures is advantageous over instructions to a third person. In particular, the use of gestures is more efficient than verbalizing instructions. The given gestures could be learned easily and reliability of the tested gesture-control system is good. Under the premise that mouse cannot be used directly during surgery, gesture-controlled approaches demonstrate to be superior to oral instructions for image manipulation.

• Publisher: Public Library of Science,Public Library of Science (PLoS)
• Subject: Biology and Life Sciences / Biomedical engineering / Communication / Control systems / Cross-Over Studies / Error analysis / Female / Gestures / Hospitals / Humans / Image management / Image manipulation / Information science / Innovations / Keyboards / Male / Medical personnel / Medical students / Medicine and Health Sciences / Motion capture / Movement / Normal distribution / Operating Rooms / Pattern Recognition, Automated / People and Places / Physical Sciences / Physicians / Radiology / Randomization / Relaying / Reproducibility of Results / Research and Analysis Methods / Social Sciences / Software / Students, Medical / Surgery / Surveys and Questionnaires / Technology application / Usability / User interface / User-Computer Interface