Novel Static Screen Volumetric 3D Display for Medical Image Visualization

用于医学图像可视化的新型静态屏幕体积 3D 显示

• 批准号: 7663381
• 负责人: Jason Geng
• 金额: $ 15.76万
• 依托单位: XIGEN, LLC
• 依托单位国家: 美国
• 财政年份: 2009
• 资助国家: 美国
• 起止时间: 2009-07-01 至 2011-06-30
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/7663381
• 关键词: Address; Adoption; Affect; Anatomic structures; Anatomy; Arts; Breast; Caliber; Clinical; Collaborations; Color; Complex; Computational Science; Computer software; Cues; Development; Devices; Dimensions; Engravings; Eye; Eyeglasses; Feasibility Studies; Future; Glass; Head; Height; Human; Image; Imagery; Imaging technology; Institutes; Knowledge; Lasers; Life; Light; Magnetic Resonance Imaging; Maintenance; Medical; Medical Education; Medical Imaging; Medical Research; Monitor; Nature; Operative Surgical Procedures; Patients; Phase; Physiological; Positioning Attribute; Principal Investigator; Procedures; Production; Prostate; Radiation; Radiation Oncology; Radiation therapy; Research; Resolution; Resources; Retinal blind spot; Safety; Shapes; Small Business Innovation Research Grant; Solutions; Speed; Structure; Surface; System; Technology; Television; Testing; Three-Dimensional Image; Time; Training; Treatment Effectiveness; United States National Institutes of Health; Visual system structure; Work; base; clinical Diagnosis; cost; design; experience; flexibility; image processing; image visualization; imaging modality; innovation; millimeter; novel; oncology; programs; prototype; psychologic; public health relevance; response; success; treatment planning; two-dimensional; ultra high resolution

DESCRIPTION (provided by applicant): Novel Static Screen Volumetric 3D Display for Medical Image Visualization Phase I proposal in response to NIH SBIR PAR-07-160 "Innovations in Biomedical Computational Science and Technology Initiative", Submitted by Xigen LLC on 08/05/2008, in collaboration with Department of Radiation Oncology, Johns Hopkins Medical Institute Project Summary Recent advances in medical imaging technology have led to the availability of high resolution 3D and 4D images of patients. These images are inherently of 3D nature, yet all conventional displays use flat 2D screens that lack important depth cues. While rendering software using 2D display monitors are quite effective in presenting 3D aspects of the imaging modalities, they are often inadequate. This fundamental restriction greatly limits the capability of clinicians to perceive the complexity of the 3D anatomy and treatment plan, therefore affects the safety, speed, accuracy, and effectiveness of the treatment procedures. In contrast to conventional 2D display, the "volumetric 3D display" we proposed herein possesses a true 3D display volume, and places physically each 3D "voxel" in the displayed 3D images at the true 3D (x, y, z) spatial position. Each voxel, analogous to a pixel in a 2D image, emits light from that position to form a real 3D image in the eyes of viewers. The volumetric 3D display technology provides both physiological and psychological depth cues to human visual system to perceive 3D objects and is considered as the Holy Grail solution to true 3D visualization of medical image, as well as many other image display problems. For the past ten years, the principal investigator of this SBIR has been working on developing the state-of- the-art volumetric 3D display technologies. Although our previous development achieved a high success, one of the major limitation of this type of volumetric display systems is that its 3D display volume is generated by a large size moving screen that rotates constantly at the speed of 600~1800 RPM. The structure of a moving screen dramatically complicates the design, production, use, and maintenance of the display system, making it very delicate and fragile for daily uses and expensive for widespread adoption for medical image visualizations. Xigen LLC has recently made a technology breakthrough and developed a revolutionary new concept of volumetric 3D display, which totally eliminates any moving screen. The unique advantages of the proposed static screen volumetric 3D display technology include: z No moving screen; z Inherent parallel mechanism for 3D voxel addressing; z High spatial resolution; z Full color display is easy to implement z Fine voxel size (at a sub-millimeter level); z No blind spot on the display volume and the display volume can be of arbitrary shape. z Simple and elegant system structure design; z No special viewing glasses or any special eyewear is needed to view the 3D images; z No image jitter affect that is associated with moving screen; z Low-cost and low-maintenance. We have already performed considerable preliminary feasibility studies to verify the validity of the proposed concept and implementation strategy. We propose this SBIR program to build a high resolution version of prototype hardware and develop associated software platform. PUBLIC HEALTH RELEVANCE: The primary objective of this Phase I SBIR effort is to demonstrate the feasibility of a novel volumetric 3D display concept with the unprecedented static screen high resolution volumetric 3D display capability. We have already performed considerable preliminary feasibility studies to verify the validity of the proposed concept and implementation strategy. We propose this SBIR program to build a high resolution version of prototype hardware and develop associated software platform to demonstrate its application for medical image visualization. The major innovations of this SBIR effort include: z Introduction of the Laser Sub-surface Engraving technology into the dynamic volumetric 3D display; z The "voxel column" concept that converts the crystal block and a 2D image projection into an addressable dynamic volumetric 3D display device, with a static screen; z The "Time Division" and "Diffraction Wheel" concepts that facilitate the ultra-high-resolution image projection from single DMD projection system for the high-resolution volumetric 3D display. Specific aims of our Phase 1 program include: Aim 1: Working with clinical experts to define the 3D Crystal requirements; Aim 2: Design and build a high resolution prototype of the 3D-Crystal screen; Aim 3: Design and build a high resolution image projection engine; Aim 4: Develop image processing and control software for the 3D-Crystal volumetric 3D display system; Aim 5: Perform extensive tests on the volumetric 3D display prototype; Aim 6: Collaborate with imaging experts at Johns Hopkins to demonstrate advantages of volumetric 3D display for medical image visualization; Aim 7: Develop optimal design of "clinically-testable" version of 3D-Crystal display based on the Phase 1 prototype experience, and prepare for Phase 2 work plan. The Phase 2 follow-on program should afford us with sufficient resources to design, build and test a clinically-testable version of functional high resolution volumetric 3D display. The proposed true 3D display technology adds one more dimension (literally and figuratively) to many medical image visualization applications. It is not meant to replace traditional 2D display and 3D rendering visualization systems, but rather to augment them, giving the viewers the unique power and flexibility to unambiguously visualize 3D complex information. If succeed, this ground breaking effort will have a significant impact on medical research and will revolutionize many current practices in medical image visualization, clinical diagnosis, radiation therapy planning, reconstructive and corrective surgery, medical education, training, and medical research. . Key Words Medical imaging, image visualization, image processing, three dimensional display, volumetric, static screen.

描述（由申请人提供）：用于医学图像可视化的新颖静态屏幕体积 3D 显示第一阶段提案，响应 NIH SBIR PAR-07-160“生物医学计算科学和技术倡议的创新”，由 Xigen LLC 于 08/05 提交2008 年，与约翰霍普金斯大学医学院放射肿瘤科合作项目摘要医学成像技术的最新进展导致了高分辨率的可用性患者的 3D 和 4D 图像。这些图像本质上具有 3D 性质，但所有传统显示器都使用缺乏重要深度提示的平面 2D 屏幕。虽然使用 2D 显示监视器的渲染软件在呈现成像模式的 3D 方面非常有效，但它们通常还不够。这种根本性的限制极大地限制了临床医生感知3D解剖结构和治疗计划的复杂性的能力，从而影响了治疗过程的安全性、速度、准确性和有效性。与传统的2D显示器相比，我们在此提出的“体积3D显示器”拥有真实的3D显示体积，并且将所显示的3D图像中的每个3D“体素”物理地放置在真实的3D（x，y，z）空间位置处。每个体素类似于 2D 图像中的像素，从该位置发出光线，在观看者眼中形成真实的 3D 图像。体积3D显示技术为人类视觉系统提供生理和心理深度线索来感知3D物体，被认为是医学图像真正3D可视化以及许多其他图像显示问题的圣杯解决方案。在过去的十年中，该 SBIR 的首席研究员一直致力于开发最先进的体积 3D 显示技术。尽管我们之前的开发取得了巨大成功，但此类体显示系统的主要限制之一是其3D显示体是由以600~1800 RPM的速度不断旋转的大尺寸移动屏幕产生的。移动屏幕的结构使显示系统的设计、生产、使用和维护变得非常复杂，使其对于日常使用来说非常脆弱和脆弱，并且对于医学图像可视化的广泛采用来说价格昂贵。 Xigen LLC最近取得了技术突破，开发出革命性的体积3D显示新概念，完全消除了任何移动屏幕。所提出的静态屏幕体积3D显示技术的独特优势包括： z 无移动屏幕； z 用于 3D 体素寻址的固有并行机制； z 空间分辨率高； z 全彩显示易于实现 z 精细体素尺寸（亚毫米级）； z 显示体积无盲区，显示体积可以是任意形状。 z 简洁优雅的系统结构设计； z 无需特殊的观看眼镜或任何特殊的眼镜即可观看3D图像； z 无屏幕移动带来的图像抖动影响； z 低成本、低维护。我们已经进行了大量的初步可行性研究，以验证所提出的概念和实施策略的有效性。我们提出这个 SBIR 计划来构建高分辨率版本的原型硬件并开发相关的软件平台。公共健康相关性：第一阶段 SBIR 工作的主要目标是展示新颖的体积 3D 显示概念的可行性，以及前所未有的静态屏幕高分辨率体积 3D 显示功能。我们已经进行了大量的初步可行性研究，以验证所提出的概念和实施策略的有效性。我们提出这个 SBIR 计划来构建高分辨率版本的原型硬件并开发相关的软件平台来演示其在医学图像可视化方面的应用。 SBIR 工作的主要创新包括： 将激光次表面雕刻技术引入动态体积 3D 显示； z “体素柱”概念，将晶体块和 2D 图像投影转换为具有静态屏幕的可寻址动态体积 3D 显示设备； z “时分”和“衍射轮”概念，有助于从单个 DMD 投影系统进行超高分辨率图像投影，以实现高分辨率体积 3D 显示。我们第一阶段计划的具体目标包括： 目标 1：与临床专家合作定义 3D 晶体要求；目标 2：设计并构建 3D 水晶屏幕的高分辨率原型；目标3：设计并构建高分辨率图像投影引擎；目标4：开发3D-Crystal立体3D显示系统的图像处理和控制软件；目标 5：对体积 3D 显示原型进行广泛的测试；目标6：与约翰·霍普金斯大学的影像专家合作，展示立体3D显示在医学图像可视化方面的优势；目标7：基于第一阶段原型经验开发“可临床测试”版本3D晶体显示器的优化设计，并为第二阶段工作计划做好准备。第二阶段的后续计划应该为我们提供足够的资源来设计、构建和测试功能性高分辨率体积 3D 显示器的临床可测试版本。所提出的真正 3D 显示技术为许多医学图像可视化应用增加了一个维度（字面上和比喻上）。它并不是要取代传统的 2D 显示和 3D 渲染可视化系统，而是要增强它们，为观看者提供独特的功能和灵活性，以明确地可视化 3D 复杂信息。如果成功，这一突破性的努力将对医学研究产生重大影响，并将彻底改变医学图像可视化、临床诊断、放射治疗计划、重建和矫正手术、医学教育、培训和医学研究领域的许多当前实践。 。关键词 医学成像、图像可视化、图像处理、三维显示、体积、静态屏幕。