I-Corps: Translation potential of minimally invasive tubular retractors to maximize visualization in spine operations

I-Corps：微创管状牵开器的翻译潜力，可最大限度地提高脊柱手术的可视化

• 批准号: 2422243
• 负责人: Kevin Costa
• 金额: $ 5万
• 依托单位: Icahn School of Medicine at Mount Sinai
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2024
• 资助国家: 美国
• 起止时间: 2024-04-01 至 2025-03-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2422243&HistoricalAwards=false
• 关键词: Corps; Translation; potential; minimally; invasive

The broader impact of this I-Corps project is the development of a system to aid surgeons performing spinal surgery. Currently, minimally invasive surgical techniques are becoming the primary method by which spinal pathologies and deformities are treated. However, the small incision sizes inherent in these approaches prevents optimal visualization of the operating area, and these procedures require the use of cumbersome surgical microscopes at awkward angles, increasing the risk of surgical error and negatively impacting surgical ergonomics. This solution is a camera system with integrated artificial intelligence (AI) software that subtracts obstructive tool shafts from the field of view, and also highlights tooltips and vital anatomy for the surgeon in real time. By allowing for maximal visualization in minimally invasive settings, this technology may increase the accessibility, ease, and reliability of these procedures. In addition, the AI software and modular hardware create a foundation for a database of surgical procedures that may be used to train other algorithms to be applied in a range of surgical settings including laparoscopic, endoscopic, and robotic techniques.This I-Corps project utilizes experiential learning coupled with a first-hand investigation of the industry ecosystem to assess the translation potential of the technology. The solution is based on the previous development of a camera system with integrated artificial intelligence (AI) software that maximizes the visualization of minimally invasive spine operations through minimally invasive tubular retractors (MITRs). Minimally invasive tubular retractors (MITRs) are metal tubes with diameters ranging from 14-22 mm that are used as operating corridors in minimally invasive spine surgeries. They suffer from limited visibility, awkward tool angling, and reliance on cumbersome surgical microscopes. This solution utilizes an array of cameras that focus down the MITR’s operating corridor and capture the operating field from multiple angles. These views are analyzed by the integrated AI software to produce a single live image that removes obstructive and unwanted parts of surgeon tools (e.g., tool shaft) while retaining other necessary components (e.g., tooltip). Specifically, the software aims to combine the array of camera inputs into a singular real-time video output that is segmented and inpainted to increase the surgeons view by over 30%. This is achieved with the help of a specialized deep learning computer vision model that enables the software to identify (via segmentation) and crop out (via inpainting) obstructive objects (tool shafts) within the video feed. Ultimately, this visually maximized image is displayed on a heads-up screen in front of the surgeon, improving outcomes by maximizing the visualization of the operating area and the ergonomics of the procedure.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

该 I-Corps 项目的更广泛影响是开发了一种帮助外科医生进行脊柱手术的系统，目前，微创手术技术正在成为治疗脊柱病理和畸形的主要方法，然而，其固有的小切口尺寸。这些方法可以实现手术区域的最佳可视化，并且这些手术需要在尴尬的角度使用笨重的手术显微镜，从而防止手术错误的风险并对手术人体工程学产生负面影响。该解决方案是具有集成人工智能 (AI) 的摄像头系统。该软件可以消除视野中的障碍性工具轴，并为外科医生实时突出显示工具提示和重要解剖结构。通过在微创环境中实现最大程度的可视化，该技术可以提高这些手术的可访问性、易用性和可靠性。此外，人工智能软件和模块化硬件为外科手术数据库奠定了基础，该数据库可用于训练其他算法，以应用于腹腔镜、内窥镜和机器人技术等一系列外科手术环境。项目用途体验式学习加上对行业生态系统的第一手调查，以评估该技术的转化潜力。该解决方案基于之前开发的带有集成人工智能（AI）软件的摄像头系统，可最大限度地实现微创脊柱的可视化。通过微创管状牵开器 (MITR) 进行手术 微创管状牵开器 (MITR) 是直径范围为 14-22 毫米的金属管，用作微创脊柱手术的手术通道。他们受到视野有限、工具倾斜不方便以及依赖笨重的手术显微镜的困扰。该解决方案利用一系列摄像机聚焦 MITR 的手术走廊并从多个角度捕获手术区域。这些视图由集成的 AI 软件进行分析。生成单个实时图像，去除外科医生工具（例如工具轴）的阻塞和不需要的部分，同时保留其他必要的组件（例如工具提示）具体来说，该软件旨在将相机输入阵列组合成单个图像。实时视频输出经过分段和修复，可将外科医生的视野提高 30% 以上。这是在专门的深度学习计算机视觉模型的帮助下实现的，该模型使软件能够识别（通过分段）和裁剪（通过修复）。 ）视频输入中的障碍物（工具轴）最终，这种视觉最大化的图像显示在外科医生面前的平视屏幕上，通过最大化手术区域的可视化和手术的人体工程学来改善结果。授予 NSF 的法定使命，并通过评估反映使用基金会的智力优点和更广泛的影响审查标准，被认为值得支持。