VIVATOP

New information technologies can help to supply surgeons with important information before and during surgeries, thereby noticeably increasing the chances of a successful outcome. Goal of the VIVATOP project is to use Virtual Reality (VR), Augmented Reality (AR) and 3D printing to effectively support the planning and execution of surgeries as well as training and education scenarios.

Introducing Virtual & 3D-Printed Models for Improved Collaboration in Surgery Anke V. Reinschluessel, Roland Fischer, Christian Schumann, Verena Uslar, Thomas Muender, Uwe Katzky, Heike Kißner, Valentin Kraft, Marie Lampe, Thomas Lück, Klaus Bock-Müller, Hans Nopper, Sirko Pelzl, Andrea Schenk, Dirk Weyhe, Gabriel Zachmann and Rainer Malaka

Computer-assisted surgery and the use of virtual environments in surgery are getting popular lately, as they provide numerous benefits, especially for visualisation of data. Yet, these tools lack features for direct and interactive discussion with remote experts and intuitive means of control for 3D data. Therefore, we present a concept to create an immersive multi-user system, by using virtual reality, augmented reality and 3D-printed organ models, which enables a collaborative workflow to assist surgeries. The 3D models will be an interaction medium to provide haptic feedback as well as teaching material. Additionally, multiple depth cameras will be used to provide remote users in the virtual environment with a realistic live representation of the operating room. Our system can be used in the planning stage, intraoperatively as well as for training. First prototypes were rated as highly useful by visceral surgeons in a focus group.

Anke V. Reinschluessel, Roland Fischer, Christian Schumann, Verena Uslar, Thomas Muender, Uwe Katzky, Heike Kißner, Valentin Kraft, Marie Lampe, Thomas Lück, Klaus Bock-Müller, Hans Nopper, Sirko Pelzl, Andrea Schenk, Dirk Weyhe, Gabriel Zachmann and Rainer Malaka (2019) Introducing Virtual & 3D-Printed Models for Improved Collaboration in Surgery In CURAC: 18th Annual Meeting of the German Society for Computer- and Robot-Assisted Surgery (18), 253-258. 10.13140/RG.2.2.26468.53129 | BibTex

Application Scenarios for 3D-Printed Organ Models for Collaboration in VR & AR Thomas Muender, Anke V. Reinschluessel, Nima Zargham, Tanja Döring, Dirk Wenig, Rainer Malaka, Roland Fischer, Gabriel Zachmann, Valentin Kraft, Andrea Schenk, Verena Uslar, Dirk Weyhe, Hans Nopper and Thomas Lück

Medical software for computer-assisted surgery often solely supports one phase of the surgical process, e.g., surgery planning. This paper describes a concept for a system, which can be seamlessly used in the preoperative planning phase, in the intraoperative phase for viewing the planning data, as well as for training and education. A combination of virtual and augmented reality with a multi-user functionality will support the three phases. 3D-printed organ models will be used as interaction devices for more intuitive interaction with the visual data and for educating future surgeons. We present the three application scenarios for this concept in detail and discuss the research opportunities.

Thomas Muender, Anke V. Reinschluessel, Nima Zargham, Tanja Döring, Dirk Wenig, Rainer Malaka, Roland Fischer, Gabriel Zachmann, Valentin Kraft, Andrea Schenk, Verena Uslar, Dirk Weyhe, Hans Nopper and Thomas Lück (2019) Application Scenarios for 3D-Printed Organ Models for Collaboration in VR & AR In MuC 2019: Mensch und Computer 2019 - Workshopband. GI e. V., Bonn, Germany. 10.18420/muc2019-ws-625 | BibTex