EasyVis: Flexible, immersive three-dimensional laparoscopic surgical visualization through multi-camera arrays

EasyVis：通过多摄像头阵列实现灵活、身临其境的三维腹腔镜手术可视化

• 批准号: 10442392
• 负责人: Charles P Heise
• 金额: $ 39.23万
• 依托单位: UNIVERSITY OF WISCONSIN-MADISON
• 依托单位国家: 美国
• 财政年份: 2015
• 资助国家: 美国
• 起止时间: 2015-08-01 至 2025-03-31
• 项目状态: 未结题
• 来源: https://reporter.nih.gov/project-details/10442392
• 关键词: 3-Dimensional; Abdomen; Abdominal Cavity; Address; Algorithms; Animal Model; Area; Chest; Clinical; Collaborations; Complex; Computer software; Computers; Depth Perception; Development; Drops; Engineering; Flare; Fogs; Future; Goals; Gold; Hand; Hand functions; Human; Image; Immersion; Interruption; Intra-abdominal; Laparoscopes; Laparoscopic Surgical Procedures; Light; Mechanics; Modeling; Movement; Operative Surgical Procedures; Organ; Patients; Peripheral; Positioning Attribute; Problem Solving; Procedures; Psychology; Public Health; Published Comment; Research; Scientist; Source; Structure; Surface; Surgeon; Surgical Instruments; System; Thoracoscopy; Three-Dimensional Imaging; Time; Trocars; User-Computer Interface; Validation; Visualization; Voice; advanced system; base; bean; design; flexibility; imaging system; improved; instrument; lens; millimeter; miniaturize; minimally invasive; motion sensor; operation; porcine model; remote control; three-dimensional visualization; tool; usability; virtual

Abstract Laparoscopic or “minimally invasive” procedures are frequently performed in surgery today. It provides numerous clinical benefits to patients and has become the gold standard surgical procedure for many intraabdominal and thoracic procedures. Existing laparoscopes provide visualization of the operative field through a video camera inserted into the patient’s abdomen. It occupies a dedicated laparoscopic port and requires a camera operator to maneuver and navigate the camera for visualization. The field of view is narrow and the depth of the scene is difficult to infer. To facilitate surgery, the camera needs to be in proximity to the operative field, making it prone to smudging, fogging, and splatter that may obscure visualization and require cleaning. The position of the camera may also interferes with the operating surgical instruments. To address these deficiencies associated with current laparoscopic visualization, in this project, we will develop a paradigm-shift, integrated, panoramic, flexible, immersive 3D laparoscopic visualization system called EasyVis that could significantly improve the efficiency of laparoscopic surgery. EasyVis directly integrates multiple microcameras and their peripherals including light sources and miniaturized projectors with the surgical ports. It provides an uninterrupted, intra-abdominal, flexible, and immersive 3D view from arbitrary virtual viewpoints and viewing angles, and close-up 3D visualization of any specific area, all under direct, hands-free, easy and full control of the operating surgeon through voice commands, eliminating the need of camera navigation. EasyVis does not occupy any extra surgical port and solves the problems associated with smudging, fogging and splatter, and interference with and occlusion of instruments. With EasyVis, the surgeon is provided with enhanced visualization (better quality, easy control) and less interruption due to laparoscope manipulation during the operation. Three specific aims will be pursued. First, we will develop an imaging system including heterogeneous microcamera arrays, light sources, and miniature projectors. This imaging system provides flexibly selectable viewpoints and viewing angles with auto-focus and zooming capabilities and real-time scene stabilization. A system that can deploy the imaging system through a surgical port will also be developed. Second, we will develop algorithms to achieve flexible global and local views, and immersive, any-view 3D visualization, all through a human-computer interface worn by the operating surgeon. Third, we will validate our laparoscopic visualization system with inanimate and animal models.

抽象的 如今，腹腔镜或“微创”手术在外科手术中经常进行。 为患者带来许多临床益处，并已成为许多人的黄金标准手术程序 现有的腹腔镜可提供手术区域的可视化。 通过插入患者腹部的摄像机它占用专用的腹腔镜端口并 需要摄像机操作员操纵和导航摄像机以实现可视化。视野很窄。 并且场景的深度很难推断，为了便于手术，相机需要靠近。 手术视野，使其容易弄脏、起雾和飞溅，这可能会模糊可视化并需要 摄像头的位置也可能会干扰手术器械的操作。 为了解决与当前腹腔镜可视化相关的这些缺陷，在这个项目中，我们将 开发范式转换、集成、全景、灵活、沉浸式 3D 腹腔镜可视化系统 称为 EasyVis，可以直接显着提高腹腔镜手术的效率。 集成了多个微型相机及其外围设备，包括光源和微型投影仪 它提供不间断、腹腔内、灵活且身临其境的任意 3D 视图。 虚拟视点和视角，以及任何特定区域的特写 3D 可视化，全部在直接、 免提，通过语音命令轻松、全面地控制手术外科医生，无需 EasyVis 相机导航不占用任何额外的手术端口并解决了相关问题。 外科医生使用 EasyVis 可以避免弄脏、起雾和飞溅，以及干扰和遮挡器械。 增强可视化（更好的质量，易于控制）并减少腹腔镜造成的干扰 操作过程中的操纵。 我们将追求三个具体目标：首先，我们将开发一种包括异构的成像系统。 该成像系统提供了灵活选择的微型相机阵列、光源和微型投影仪。 具有自动对焦和变焦功能以及实时场景稳定功能的视点和视角。 其次，我们还将开发可以通过手术端口部署成像系统的系统。 开发算法以实现灵活的全局和局部视图以及沉浸式、任意视图 3D 可视化，所有 第三，我们将验证我们的腹腔镜。 具有无生命和动物模型的可视化系统。