ITR: Collaborative Research: Development of Head-mounted Projective Display for Distance Collaborative Environments

ITR：协作研究：用于远程协作环境的头戴式投影显示的开发

• 批准号: 0083037
• 负责人: Hong Hua
• 金额: $ 29.49万
• 依托单位: University of Illinois at Urbana-Champaign
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2000
• 资助国家: 美国
• 起止时间: 2000-09-01 至 2003-05-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0083037&HistoricalAwards=false
• 关键词: ITR; Collaborative; Research; Development; Head

This is the first year funding of a three-year continuing award. A demanding application area of virtual or augmented environment is multi-user collaborative environment where multiple users at either a local site or remote sites communicate with each other and interact with a synthetic or virtual scene. Among the necessary sensors and devices, an effective visualization device and a real-time image acquisition system are two main challenges. The objective of this project is to develop a novel visualization device referred to as head-mounted projective display (HMPD), build a multi-user interactive workbench by integrating the developed HMPD technology with a unique real-time image acquisition system known as an omni-focus camera, and evaluate and quantify the system as an effective tool for remote collaboration. The head-mounted projective display (HMPD) proposed is coupled with a supple, non-distorting and durable projection surface as an alternative to current visualization devices. Its novel concept suggests solutions to part of the problems of state-of-art visualization devices, such as large distortion with wide field of view, occlusion contradiction between virtual and real objects, and brightness conflict with background illumination. Several properties of the proposed HMPD make it extremely suitable for multiple-user collaborative applications. Research efforts will be made to design and implement a lightweight and compact head-mounted prototype by introducing diffractive optical element (DOE) and plastic materials, and investigate approaches to optimize the illumination of the display and retro-reflective material properties for imaging purpose. At one site, a multi-user interactive bench prototype with tele-presence capability will be built by using the HMPD concept and adding an image acquisition system developed from a unique omni-focus camera system. At the other site, a mural display system will be built with conventional stereoscopic video system located near the mural display, where one or several collaborators will also gather. Tele-collaborative work will be tested between the Beckman Institute at the University of Illinois--Urbana Champaign and the School of Optics-CREOL at the University of Central Florida through the Internet II connection linking our laboratories. Finally, the PIs will quantify the depth and size representation and perception accuracy, evaluate occlusion perception aspects, and set up a comprehensive calibration procedure for the HMPD and the workbench and mural prototypes. The results are expected to impact a wide range of applications such as collaboration/tele-collaboration, tele-presence, tele-manipulation, and visualized education/tele-education.

这是为期三年的连续奖励的第一年资助。虚拟或增强环境的一个要求较高的应用领域是多用户协作环境，其中本地站点或远程站点的多个用户相互通信并与合成或虚拟场景交互。在必要的传感器和设备中，有效的可视化设备和实时图像采集系统是两个主要挑战。该项目的目标是开发一种称为头戴式投影显示器（HMPD）的新型可视化设备，通过将开发的 HMPD 技术与称为全向投影的独特实时图像采集系统集成来构建多用户交互式工作台。 -聚焦相机，并评估和量化系统作为远程协作的有效工具。所提出的头戴式投影显示器（HMPD）与柔软、不变形且耐用的投影表面相结合，作为当前可视化设备的替代品。其新颖的概念为最先进的可视化设备的部分问题提供了解决方案，例如宽视场的大失真、虚拟和真实物体之间的遮挡矛盾以及亮度与背景照明的冲突。所提出的 HMPD 的几个特性使其非常适合多用户协作应用程序。研究工作将通过引入衍射光学元件（DOE）和塑料材料来设计和实现轻质紧凑的头戴式原型，并研究优化显示器照明和用于成像目的的回归反射材料特性的方法。在一个地点，将使用 HMPD 概念并添加由独特的全焦点相机系统开发的图像采集系统来构建具有远程呈现功能的多用户交互式工作台原型。在另一个地点，将建立一个壁画显示系统，传统的立体视频系统位于壁画显示器附近，一个或多个合作者也将聚集在那里。伊利诺伊大学香槟分校贝克曼研究所和中佛罗里达大学光学学院 CREOL 之间的远程协作工作将通过连接我们实验室的 Internet II 连接进行测试。最后，PI 将量化深度和尺寸表示以及感知准确性，评估遮挡感知方面，并为 HMPD 以及工作台和壁画原型建立全面的校准程序。研究结果预计将影响广泛的应用，例如协作/远程协作、远程呈现、远程操作和可视化教育/远程教育。