MRI: Development of a Gesture Based Virtual Reality System for Research in Virtual Worlds

MRI：开发基于手势的虚拟现实系统，用于虚拟世界的研究

• 批准号: 0923158
• 负责人: Horea Ilies
• 金额: $ 78.2万
• 依托单位: University of Connecticut
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2009
• 资助国家: 美国
• 起止时间: 2009-07-15 至 2015-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0923158&HistoricalAwards=false
• 关键词: MRI; Development; Gesture; Based; Virtual

Proposal #: CNS 09-23158PI(s): Ilies, Horea T.; Anderson, Amy; Kazerounian, Kazem; Marsh, Kerry L.; Nowak, KristineInstitution: University of ConnecticutTitle: MRI/Dev.: Dev. of a Gesture Based Virtual Reality System for Research in Virtual WorldsProject Proposed:This project, developing an integrated virtual environment system capable of allowing not only 3D visualization of data, but also interaction with data through natural hand and finger gestured based on a dual interface, exploits a multi-touch interaction interface and a vision based hand-gesture interface. Virtual reality environments rely on a collection of technologies that allow the user to go through a coherent and unified perceptual experience involving multiple senses, such as vision, touch, and sound, while interacting with 3-dimensional data. These immersive, highly visual, 3D environments currently offer a fairly high level of performance for spatially visualizing data. However, the corresponding machinery providing user interaction with these systems has not kept up the same pace of development with the visualization tools. At present some advanced commercial environments offer some user interaction capabilities achieved through wired wearable hardware (such as wired gloves and head mounted displays). This promotes, in turn, an unnatural and cumbersome interaction between the user and the virtual reality environments, curbing the acceptance of the technologies. The syntax and semantics of the hand and finger gestures developed interacts with geometric data, while the implementation relies on the Multi-Touch Surface computing platform as well as on a newly developed gesture tracking and recognition system. The environment should lead to a potent open platform for interacting with virtual geometric data in an intuitive way, without the need for wearable hardware galvanizing the state of the art at the institution in Nano and Design Engineering, Psychology, Computer Science, Structural biology, as well as support research in the Center for Health, Intervention, and Prevention (CHIP). This project addresses the problem.Broader Impacts: This instrumentation will be open source and widely available with well documented set up procedures. The VR system will be networked with other VR-sites, including VRAC at Iowa State, to maximize the impact and stimulate technology transfer. Moreover, the instrument contributes to- Stimulate critical avenues of interdisciplinary research involving engineering, biology, computer science, psychology, and Human Computer Interaction (HCI),- Strengthen the potential for educational, student recruiting, and outreach activities, and- Perform targeted outreach to K-12 students, teachers, and school districts serving groups that have traditionally been underrepresented in the engineering disciplines. The project also advances the state of the art in the teaching and practice of engineering design, as well as other fields in which geometry plays and important role. Contributing to the development of a new generation of professionals that use capabilities of virtual reality tools to augment traditional disciplines for improved engineering design, this work should have a long-lasting impact on the ability of scientists and engineers.

提案＃：CNS 09-23158PI（S）：Ilies，Horea T。; 安德森，艾米； Kazem的Kazerounian；沼泽，克里·L。 Nowak，Kristineinstitution：Connecticuttitle大学：MRI/DEV。：DEV。提出的基于手势的虚拟现实系统用于研究：该项目：开发一个集成的虚拟环境系统，不仅可以允许3D可视化数据，而且还可以通过基于双重接口的自然手和手指示意数据与数据进行交互，从而利用了多点触摸互动互动互动互动互动互动互动和基于视觉的手感接口。虚拟现实环境依赖于一系列技术，这些技术使用户可以在与三维数据互动时经历涉及多种感官（例如视觉，触摸和声音）的连贯和统一的感知体验。这些沉浸式，高度视觉的3D环境目前为空间可视化数据提供了相当高的性能。但是，提供用户与这些系统互动的相应机械并没有通过可视化工具来保持相同的开发速度。目前，一些高级商业环境提供了通过有线可穿戴硬件（例如有线手套和头部安装显示器）实现的一些用户互动功能。反过来，这又促进了用户与虚拟现实环境之间的不自然和繁琐的相互作用，从而遏制了对技术的接受。手指和手指手势的语法和语义与几何数据相互作用，而实现依赖于多点触摸表面计算平台以及新开发的手势跟踪和识别系统。环境应导致一个有力的开放平台，以直观的方式与虚拟几何数据进行互动，而无需可穿戴硬件在纳米和设计工程，心理学，计算机科学，结构生物学，以及在健康，干预和预防（CHIP）中支持研究的机构和设计工程，心理学，计算机科学，结构生物学以及支持研究。该项目解决了问题。BRODER的影响：该仪器将是开源的，并在有据可查的设置过程中广泛使用。 VR系统将与其他VR网站联网，包括爱荷华州的VRAC，以最大程度地发挥影响并刺激技术传输。此外，该工具促进了涉及工程，生物学，计算机科学，心理学和人类计算机互动（HCI）（HCI）的跨学科研究的关键途径 - 增强了教育，学生招聘和外展活动的潜力，并向K-12的学生，老师，教师和学区提供针对性的群体，这些群体在统治下进行工程专业的态度，以实现K-12的学生进行宣传。该项目在工程设计的教学和实践中以及几何扮演和重要作用的其他领域都可以提高最新技术的状态。为了发展新一代专业人士的发展，这些专业人员使用虚拟现实工具的功能来增强传统学科以改善工程设计，这项工作应对科学家和工程师的能力产生持久的影响。