ITR: Collaborative Research: Development of Head-mounted Projective Displays for Distance Collaborative Environments

ITR：协作研究：用于远程协作环境的头戴式投影显示器的开发

• 批准号: 0082016
• 负责人: Jannick Rolland
• 金额: $ 20.5万
• 依托单位: The University of Central Florida Board of Trustees
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2000
• 资助国家: 美国
• 起止时间: 2000-09-01 至 2004-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0082016&HistoricalAwards=false
• 关键词: ITR; Collaborative; Research; Development; Head

This is the first year funding of a three-year continuing award. A demanding application area of virtual or augmented environment is multi-user collaborative environment where multiple users at either a local site or remote sites communicate with each other and interact with a synthetic or virtual scene. Among the necessary sensors and devices, an effective visualization device and a real-time image acquisition system are two main challenges. The objective of this project is to develop a novel visualization device referred to as head-mounted projective display (HMPD), build a multi-user interactive workbench by integrating the developed HMPD technology with a unique real-time image acquisition system known as an omni-focus camera, and evaluate and quantify the system as an effective tool for remote collaboration. The head-mounted projective display (HMPD) proposed is coupled with a supple, non-distorting and durable projection surface as an alternative to current visualization devices. Its novel concept suggests solutions to part of the problems of state-of-art visualization devices, such as large distortion with wide field of view, occlusion contradiction between virtual and real objects, and brightness conflict with background illumination. Several properties of the proposed HMPD make it extremely suitable for multiple-user collaborative applications. Research efforts will be made to design and implement a lightweight and compact head-mounted prototype by introducing diffractive optical element (DOE) and plastic materials, and investigate approaches to optimize the illumination of the display and retro-reflective material properties for imaging purpose. At one site, a multi-user interactive bench prototype with tele-presence capability will be built by using the HMPD concept and adding an image acquisition system developed from a unique omni-focus camera system. At the other site, a mural display system will be built with conventional stereoscopic video system located near the mural display, where one or several collaborators will also gather. Tele-collaborative work will be tested between the Beckman Institute at the University of Illinois--Urbana Champaign and the School of Optics-CREOL at the University of Central Florida through the Internet II connection linking our laboratories. Finally, the PIs will quantify the depth and size representation and perception accuracy, evaluate occlusion perception aspects, and set up a comprehensive calibration procedure for the HMPD and the workbench and mural prototypes. The results are expected to impact a wide range of applications such as collaboration/tele-collaboration, tele-presence, tele-manipulation, and visualized education/tele-education.

这是为期三年的裁决的第一年资金。多用户协作环境的虚拟环境或增强环境的苛刻应用领域，在本地站点或远程站点的多个用户相互通信并与合成或虚拟场景进行交互。在必要的传感器和设备中，有效的可视化设备和实时图像采集系统是两个主要挑战。该项目的目的是开发一种新型的可视化设备，称为头部安装的投影显示（HMPD），通过将开发的HMPD技术与独特的实时图像采集系统集成为OMNI对焦摄像机，并评估和量化该系统作为远程协作的有效工具，从而构建了多用户交互式工作台。提出的头部安装的投影显示（HMPD）与柔软，非延伸和耐用的投影表面相结合，作为当前可视化设备的替代方案。它的新颖概念提出了解决一部分最先进的可视化设备问题的解决方案，例如具有广泛的视野，虚拟和真实对象之间的遮挡矛盾以及与背景照明的亮度冲突。提出的HMPD的几个属性使其非常适合多用户协作应用程序。将通过引入衍射光学元素（DOE）和塑料材料来设计和实施轻巧且紧凑的头部原型，并调查方法以优化显示屏和重新反射材料的照明，以实现成像目的。在一个站点上，将使用HMPD概念并添加从独特的Omni-Pocus相机系统开发的图像采集系统来构建具有Tele-Presence功能的多用户交互式台式原型。在另一个站点，将使用位于壁画展示附近的常规立体视频系统建造壁画显示系统，其中一个或几个合作者也将聚集。伊利诺伊大学贝克曼学院 - 欧巴纳·尚恩格恩大学的贝克曼学院和中央佛罗里达大学的光学 - 库尔大学贝克曼学院将通过与我们的实验室联系的Internet II Connection进行测试。最后，PI将量化深度和大小表示的精度，评估遮挡感知方面，并为HMPD以及Workbench和Workbench和壁画原型设置全面的校准程序。结果预计将影响广泛的应用，例如协作/远程制作，电视节目，远程操作和可视化的教育/远程教育。