SBIR Phase II: AI-driven 3D imaging and visualization for endoscopy

SBIR 第二阶段：人工智能驱动的内窥镜 3D 成像和可视化

• 批准号: 2112333
• 负责人: Jesse Adams
• 金额: $ 100万
• 依托单位: Synopic Inc.
• 依托单位国家: 美国
• 项目类别: Cooperative Agreement
• 财政年份: 2021
• 资助国家: 美国
• 起止时间: 2021-09-01 至 2024-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2112333&HistoricalAwards=false
• 关键词: SBIR; Phase; II; AI; driven

The broader impact/commercial potential of this Small Business Innovation Research (SBIR) Phase II project is to improve outcomes of medical endoscopy procedures through 3D imaging where only two-dimensional images were previously obtained. 3D imaging can reduce costs through improved and earlier detection of cancer and other disorders. The proposed technology can also impact other specialties, such as ophthalmology and dermatology, where quantifiable depth imaging can have a profound impact. Additional opportunities for the proposed camera exist in mobile, consumer devices, and in-cabin automotive monitoring.The proposed project will develop technology for a compact, single camera 3D imaging system integrated with endoscopes to capture both high-resolution color images and measurable depth information. Current 3D imaging in minimally invasive procedures, captured by stereo cameras, is limited to laparoscopy using multiple trocars to perform surgery. The stereo cameras take an entire trocar by virtue of the space needed for the two cameras. Stereo imaging is not translatable to endoscopy, which houses all instruments inside a single tube. This new 3D imaging system works by integrating an optimized lens modification and back-end neural network to extract three-dimensional information from the imaged area. Because the proposed modification integrates within the single camera module, it can scale with size, enabling three-dimensional imaging capabilities in smaller endoscopes (e.g., for use in gastrointestinal tract, urology, or gynecology) where instrument sizes are constrained. This project will: (1) develop new algorithms to improve high resolution imaging and accuracy, (2) optimize for real-time performance, (3) miniaturize the imaging system toward endoscopy, (4) design a visualization system for the clinical workflow, and (5) validate the system for tissue imaging.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

这项小型企业创新研究（SBIR）II期项目的更广泛的影响/商业潜力是通过3D成像改善医疗内窥镜检查程序的结果，而先前仅​​获得了二维图像。 3D成像可以通过改善和早期发现癌症和其他疾病来降低成本。 所提出的技术还会影响其他专业，例如眼科和皮肤病学，在那里可量化的深度成像可能会产生深远的影响。该提议的摄像头的其他机会存在于移动，消费者设备和驾驶汽车内汽车监控中。拟议的项目将开发与内窥镜集成的紧凑，单相机3D成像系统的技术，以捕获高分辨率的颜色图像和可测量的深度信息。由立体声摄像机捕获的最小侵入性手术中的当前3D成像仅限于使用多个套筒进行手术的腹腔镜检查。立体声摄像机凭借两个摄像机所需的空间占据了整个套管电。立体成像不能翻译成内窥镜检查，后者将所有乐器都装在单个管中。这个新的3D成像系统通过集成了优化的镜头修改和后端神经网络来从成像区域提取三维信息，从而起作用。由于所提出的修改会集成在单个摄像头模块中，因此它可以按大小扩展，从而在较小的内窥镜（例如，用于胃肠道，泌尿外科或妇科学）中实现三维成像功能，在仪器大小上受到限制。该项目将：（1）开发新算法以改善高分辨率成像和准确性，（2）对实时性能进行优化，（3）将朝向内窥镜检查的成像系统进行小型化，（4）设计一个可视化系统，用于临床工作流程，（5）（5）验证组织成像的系统。该奖项反映了NSF的范围范围的范围，并依赖于NSF的构建范围，并具有法定的构建范围。影响审查标准。