Augmented Reality Head Mounted Display for Magnetic Resonance Imaging Guided Inte

用于磁共振成像引导互联网的增强现实头戴式显示器

• 批准号: 8524685
• 负责人: RAO P GULLAPALLI
• 金额: $ 45.71万
• 依托单位: ROBIN MEDICAL, INC.
• 依托单位国家: 美国
• 财政年份: 2013
• 资助国家: 美国
• 起止时间: 2013-06-07 至 2016-05-31
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/8524685
• 关键词: 3-Dimensional; Activities of Daily Living; Address; Anatomy; Animal Experimentation; Animal Testing; Area; Baltimore; Brain; Brain Neoplasms; Businesses; Calibration; Characteristics; Clinical; Coagulation Process; Data; Data Display; Data Set; Development; Devices; Diagnostic; Evaluation; Excision; Goals; Head; Health Care Costs; Healthcare; Hospitalization; Human; Hybrids; Image; Imagery; Imaging Device; Impairment; Intervention; Lesion; Location; Magnetic Resonance; Magnetic Resonance Imaging; Maps; Maryland; Medical; Medical center; Monitor; Navigation System; Neurosurgeon; Neurosurgical Procedures; Operative Surgical Procedures; Patients; Phase; Physicians; Positioning Attribute; Price; Procedures; Protocols documentation; Rehabilitation therapy; Research; Resolution; Robin bird; Scanning; Societies; Structure; System; Testing; Time; Translating; Tumor Tissue; Universities; Update; Visualization software; Work; base; brain surgery; brain tissue; cancer imaging; cost; disability payment; ergonomics; experience; graphical user interface; imaging modality; instrument; operation; public health relevance; satisfaction; sensor; stereoscopic; success; technology development; tumor; virtual

DESCRIPTION (provided by applicant): The broad, long-term objective is to develop a low cost, easy to use system that can convert diagnostic MRI scanner into a functional neurosurgical MRI suite. The specific aims of the project are: 1. Develop the display-only mode of the HMD that integrates MRI realtime scans and device tracking annotation into a stereoscopic 3D display. Feasibility of such HMD has been demonstrated in Phase I of the project. 2. Develop a hybrid image-based and gradient-tracking based head positioning system for the augmented reality system to provide head position in the MRI coordinate system at the edge area of the scanner. 3. Develop the augmented reality mode of the HMD that presents 3D anatomic data from previously acquired MRI onto neurosurgical operation field at the edge of the scanner. 4. Develop application specific MRI protocols that provide non-distorted high-resolution 3D rendered images with multiple contrast characteristics (e.g. T1, T2, FLAIR, MP-RAGE, etc.); and the planning and visualization software interface to incorporate these images to procedure planning and guidance using augmented reality. 5. Conduct phantom tests to demonstrate adequate operation of the HMD in its two modes of operation. 6. Conduct animal tests to evaluate the HMD in conducting percutaneous interventions and open neurosurgical procedures. The proposed project complies with two of the four specific goals of PA-10-079, namely: - The development and optimization of fully integrated cancer imaging, monitoring, and therapy systems. - Partnerships among small business and academic clinical centers in order to reach the research goals. The development of the technology and the eventual product for clinical use will be done jointly by Robin Medical, Inc., a small business specializes in the development of navigation systems for MRI; and the Magnetic Resonance Research Center (MRRC) at the University of Maryland, Baltimore, having extensive experience in human and large animal research in MRI and development of customized scan sequences. Robin Medical will develop a head mounted display (HMD) and head mounted augmented reality system (HMARS), based on feasibility demonstration in Phase I. The HMD will provide a 3D display of realtime or previously acquired MR images along with realtime tracking annotation. The HMARS will provide an augmented reality display composed of view of the surgical field obtained by head mounted cameras, MR images, and tracking annotation. The MRRC group will develop customized MRI sequences for real-time guidance and display of 3D rendered structures and will conduct the technical and animal experimentation with the system.

描述（由申请人提供）：广泛的长期目标是开发一种低成本、易于使用的系统，可以将诊断 MRI 扫描仪转换为功能性神经外科 MRI 套件。该项目的具体目标是： 1. 开发 HMD 的仅显示模式，将 MRI 实时扫描和设备跟踪注释集成到立体 3D 显示中。这种头戴式显示器的可行性已在项目第一阶段得到证实。 2. 为增强现实系统开发基于图像和基于梯度跟踪的混合头部定位系统，以在扫描仪边缘区域的 MRI 坐标系中提供头部位置。 3. 开发 HMD 的增强现实模式，将先前采集的 MRI 的 3D 解剖数据呈现到扫描仪边缘的神经外科手术区域。 4. 开发特定应用的 MRI 协议，提供具有多种对比特性（例如 T1、T2、FLAIR、MP-RAGE 等）的不失真高分辨率 3D 渲染图像；以及规划和可视化软件界面，使用增强现实将这些图像合并到程序规划和指导中。 5. 进行模型测试以证明 HMD 在两种操作模式下都能正常运行。 6. 进行动物测试，以评估 HMD 进行经皮干预和开放神经外科手术的效果。拟议项目符合 PA-10-079 四个具体目标中的两个，即： - 完全集成的癌症成像、监测和治疗系统的开发和优化。 - 小型企业和学术临床中心之间的合作伙伴关系，以实现研究目标。该技术的开发和最终的临床使用产品将由 Robin Medical, Inc. 联合完成，这是一家专门开发 MRI 导航系统的小企业；巴尔的摩马里兰大学磁共振研究中心 (MRRC) 在人类和大型动物 MRI 研究以及定制扫描序列开发方面拥有丰富的经验。 Robin Medical 将根据第一阶段的可行性论证开发头戴式显示器 (HMD) 和头戴式增强现实系统 (HMARS)。HMD 将提供实时或先前采集的 MR 图像的 3D 显示以及实时跟踪注释。 HMARS 将提供增强现实显示，其中包括通过头戴式摄像机获得的手术区域视图、MR 图像和跟踪注释。 MRRC 小组将开发定制的 MRI 序列，用于实时引导和显示 3D 渲染结构，并将利用该系统进行技术和动物实验。