EasyVis: Flexible, immersive three-dimensional laparoscopic surgical visualization through multi-camera arrays

EasyVis：通过多摄像头阵列实现灵活、身临其境的三维腹腔镜手术可视化

• 批准号: 10442392
• 负责人: Charles P Heise
• 金额: $ 39.23万
• 依托单位: UNIVERSITY OF WISCONSIN-MADISON
• 依托单位国家: 美国
• 财政年份: 2015
• 资助国家: 美国
• 起止时间: 2015-08-01 至 2025-03-31
• 项目状态: 未结题
• 来源: https://reporter.nih.gov/project-details/10442392
• 关键词: 3-Dimensional; Abdomen; Abdominal Cavity; Address; Algorithms; Animal Model; Area; Chest; Clinical; Collaborations; Complex; Computer software; Computers; Depth Perception; Development; Drops; Engineering; Flare; Fogs; Future; Goals; Gold; Hand; Hand functions; Human; Image; Immersion; Interruption; Intra-abdominal; Laparoscopes; Laparoscopic Surgical Procedures; Light; Mechanics; Modeling; Movement; Operative Surgical Procedures; Organ; Patients; Peripheral; Positioning Attribute; Problem Solving; Procedures; Psychology; Public Health; Published Comment; Research; Scientist; Source; Structure; Surface; Surgeon; Surgical Instruments; System; Thoracoscopy; Three-Dimensional Imaging; Time; Trocars; User-Computer Interface; Validation; Visualization; Voice; advanced system; base; bean; design; flexibility; imaging system; improved; instrument; lens; millimeter; miniaturize; minimally invasive; motion sensor; operation; porcine model; remote control; three-dimensional visualization; tool; usability; virtual

Abstract Laparoscopic or “minimally invasive” procedures are frequently performed in surgery today. It provides numerous clinical benefits to patients and has become the gold standard surgical procedure for many intraabdominal and thoracic procedures. Existing laparoscopes provide visualization of the operative field through a video camera inserted into the patient’s abdomen. It occupies a dedicated laparoscopic port and requires a camera operator to maneuver and navigate the camera for visualization. The field of view is narrow and the depth of the scene is difficult to infer. To facilitate surgery, the camera needs to be in proximity to the operative field, making it prone to smudging, fogging, and splatter that may obscure visualization and require cleaning. The position of the camera may also interferes with the operating surgical instruments. To address these deficiencies associated with current laparoscopic visualization, in this project, we will develop a paradigm-shift, integrated, panoramic, flexible, immersive 3D laparoscopic visualization system called EasyVis that could significantly improve the efficiency of laparoscopic surgery. EasyVis directly integrates multiple microcameras and their peripherals including light sources and miniaturized projectors with the surgical ports. It provides an uninterrupted, intra-abdominal, flexible, and immersive 3D view from arbitrary virtual viewpoints and viewing angles, and close-up 3D visualization of any specific area, all under direct, hands-free, easy and full control of the operating surgeon through voice commands, eliminating the need of camera navigation. EasyVis does not occupy any extra surgical port and solves the problems associated with smudging, fogging and splatter, and interference with and occlusion of instruments. With EasyVis, the surgeon is provided with enhanced visualization (better quality, easy control) and less interruption due to laparoscope manipulation during the operation. Three specific aims will be pursued. First, we will develop an imaging system including heterogeneous microcamera arrays, light sources, and miniature projectors. This imaging system provides flexibly selectable viewpoints and viewing angles with auto-focus and zooming capabilities and real-time scene stabilization. A system that can deploy the imaging system through a surgical port will also be developed. Second, we will develop algorithms to achieve flexible global and local views, and immersive, any-view 3D visualization, all through a human-computer interface worn by the operating surgeon. Third, we will validate our laparoscopic visualization system with inanimate and animal models.

抽象的 如今，手术经常进行腹腔镜或“微创”手术。它提供 对患者的许多临床益处，已成为许多人的黄金标准手术程序 腹内和胸腔手术。现有的腹腔镜提供了操作场的可视化 通过插入患者腹部的摄像机。它占据了专用的腹腔镜端口和 需要一个摄像头操作员来操纵和导航相机以进行可视化。视野很狭窄 场景的深度很难推断。为了促进手术，相机需要靠近 操作场，使其容易弄脏，雾气和飞溅，可能会掩盖可视化，并且需要 打扫。相机的位置也可能干扰操作手术仪器。 为了解决与当前腹腔镜可视化相关的这些缺陷，在这个项目中，我们将 开发一个范式转移，集成，全景，柔性，沉浸式3D腹腔镜可视化系统 称为Easyvis，可以显着提高腹腔镜手术的效率。 Easyvis直接 集成了多个微型胶体及其外围设备，包括光源和微型投影仪 手术端口。它提供了一种不间断的，腹腔内，灵活的和沉浸式的3D视图 虚拟观点和查看角度，以及任何特定区域的特写3D可视化，全部直接， 通过语音命令对操作外科医生的免提，轻松和完全控制，消除了需求 相机导航。 Easyvis不占据任何额外的手术端口，并解决了与 弄脏，雾气和飞溅，并干扰仪器的阻塞。与Easyvis，外科医生 提供了增强的可视化（质量更好，易于控制），并且由于腹腔镜的中断而更少 操作过程中的操作。 将追求三个具体目标。首先，我们将开发一个包括异质的成像系统 Microcamera阵列，光源和微型投影仪。该成像系统可灵活地选择 具有自动对焦和缩放功能以及实时场景稳定的观点和查看角度。一个 也将开发可以通过手术端口部署成像系统的系统。第二，我们会的 开发算法以实现灵活的全球和本地视图，以及沉浸式的任何视图3D可视化，所有这些 通过手术外科医生佩戴的人类计算机界面。第三，我们将验证我们的腹腔镜 具有无生命和动物模型的可视化系统。