Touchless interaction in surgery

Abstract

Touchless interaction with medical images lets surgeons maintain sterility during surgical procedures.

References

1. Ebert, L., Hatch, G., Ampanozi, G., Thali, M., and Ross, S. Invisible touch: Control of a DICOM viewer with finger gestures using the Kinect depth camera. Journal of Forensic Radiology and Imaging 1, 1 (Jan. 2013), 10--14.
2. Ebert, L., Hatch, G., Ampanozi, G., Thali, M., and Ross, S. You can't touch this: Touch-free navigation through radiological images. Surgical Innovation 19, 3 (Sept. 2012), 301--307.
3. Gallo, L., Placitelli, A.P., and Ciampi, M. Controller-free exploration of medical image data: Experiencing the Kinect. In Proceedings of the 24^th International Symposium on Computer-Based Medical Systems (Bristol, England, June 27--30). IEEE Press, 2011, 1--6.
4. Graetzel, C., Fong, T., Grange, S., and Baur, C. A non-contact mouse for surgeon-computer interaction. Technology and Health Care 12, 3 (2004), 245--257.
5. Ionescu, A. A mouse in the O.R. Ambidextrous, Stanford University Journal of Design 4 (June 2006), 30--32.
6. Jacob, M., Li, Y., Akingba, G., and Wachs, J.P. Gestonurse: A robotic surgical nurse for handling surgical instruments in the operating room. Journal of Robotic Surgery 6, 1 (Mar. 2012), 53--63.
7. Johnson, R., O'Hara, K., Sellen, A., Cousins, C., and Criminisi, A. Exploring the potential for touchless interaction in image-guided interventional radiology. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, Canada, May 7--12). ACM Press, New York, 2011.
8. Kang, H., Woo Lee, C., and Jung, K. Recognition-based gesture spotting in video games. Pattern Recognition Letters 25, 15 (Nov. 2004), 1701--1714.
9. Kipshagen, T., Graw, M., Tronnier, V., Bonsanto, M., and Hofmann, U. Touch- and marker-free interaction with medical software. In Proceedings of World Congress on Medical Physics and Biomedical Engineering (Munich, Sept. 7--12). Springer, Berlin, Heidelberg, 2009, 75--78.
10. Leganchuk, A., Zhai, S., and Buxton, W. Manual and cognitive benefits of two-handed input: An experimental study. ACM Transactions on Computer-Human Interaction 5, 4 (Dec. 1998), 326--359.
11. Mentis, H., O'Hara, K., Sellen, A., and Trivedi, R. Interaction proxemics and image use in neurosurgery. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, TX, May 5--10). ACM Press, New York, 2012, 927--936.
12. Microsoft Corp. Communicate with computers naturally: Kinect for Windows; http://www.microsoft.com/en-us/kinectforwindows/
13. Mithun, J., Cange, C., Packer, R., and Wachs, J.P. Intention, context, and gesture recognition for sterile MRI navigation in the operating room. In Proceedings of CIARP 2012: Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications, Vol. 7441 LNCS (Buenos Aires, Sept. 3--6, 2012), 220--227.
14. Norman, D. Natural user interfaces are not natural. ACM interactions 17, 3 (May--June 2010), 6--10.
15. O'Hara, K., Gonzalez, G., Mentis, H., Sellen, A., Corish, R., and Criminisi, A. Touchless Interaction in Medical Imaging. Microsoft Corp., June 2012; http://research.microsoft.com/en-us/projects/touchlessinteractionmedical/
16. Ruppert, G., Amorim, P., Moares, T., and Silva, J. Touchless gesture user interface for 3D visualization using Kinect platform and open-source frameworks. In Proceedings of the Fifth International Conference on Advanced Research in Virtual and Rapid Prototyping (Leiria, Portugal, Sept. 28--Oct. 1). Taylor and Francis Group, London, 2011, 215--219.
17. Stern, H., Wachs, J., and Edan. Y. Optimal consensus intuitive hand-gesture vocabulary design. In Proceedings of the IEEE International Conference on Semantic Computing (Santa Clara, CA, Aug. 4--7), IEEE Computer Society Press, 2008, 96--103.
18. Strickland, M., Tremaine, J., Brigley, G., and Law, C. Using a depth-sensing infrared camera system to access and manipulate medical imaging from within the sterile operating field. Canadian Journal of Surgery 56, 3 (June 2013), E1--6.
19. Tan, J., Chao, C., Zawaideh, M., Roberts, A., and Kinney, T. Informatics in radiology: Developing a touchless user interface for intraoperative image control during interventional radiology procedures. Radiographics 33, 2 (Mar.--Apr. 2013), E61--70.
20. Wachs, J., Kolsch, M., Stern, H., and Edan, Y. Vision-based hand-gesture applications. Commun. ACM 54, 2 (Feb. 2011), 60--71.
21. Wachs, J., Stern, H., Edan, Y., Gillam, M., Feied, C., Smith, M., and Handler, J. Real-time hand-gesture interface for browsing medical images. International Journal of Intelligent Computing in Medical Sciences & Image Processing 2, 1 (June 2008), 15--25.

Index Terms

• Applied computing

  • Computers in other domains

  • Life and medical sciences

• Computing methodologies

  • Artificial intelligence

    • Computer vision

      • Computer vision tasks

        • Scene understanding

  • Computer graphics

• Hardware

  • Communication hardware, interfaces and storage

• Human-centered computing

  • Human computer interaction (HCI)

• Information systems

  • Information retrieval

• Networks