Collaborative Research: CCRI: Planning: InfraStructure for Photorealistic Image and Environment Synthesis (I-SPIES)

合作研究：CCRI：规划：真实感图像和环境合成的基础设施 (I-SPIES)

• 批准号: 2120240
• 负责人: Ryan McMahan
• 金额: $ 7.79万
• 依托单位: The University of Central Florida Board of Trustees
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2021
• 资助国家: 美国
• 起止时间: 2021-10-01 至 2023-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2120240&HistoricalAwards=false
• 关键词: Collaborative; Research; CCRI; Planning; InfraStructure

Numerous Computer and Information Science and Engineering (CISE) research communities leverage datasets comprised of visual images or 3D virtual environments to conduct research in computer vision, robotics, multimedia systems, virtual reality, and mixed reality. Many of these datasets consist of either images previously captured with cameras and other optical sensors, or synthetic images previously rendered from 3D virtual environments. The static nature of these datasets limits their usefulness and potential applications. Recently, some researchers have provided datasets and tools for synthesizing new images from 3D virtual environments using customizable virtual camera positions, which broadens their research applications. However, many of these datasets consist of lower-fidelity indoor virtual environments that yield non-photorealistic images. Furthermore, such datasets are missing outdoor virtual environments, and tools for sharing custom camera positions within the research community are not currently available.This planning project prepares to address the limitations of prior datasets by investigating the feasibility of using high-quality terrestrial laser scanners to capture and create high-fidelity, photorealistic virtual environments of real-world locations, both indoor and outdoor. This will be coupled with surveys of the relevant CISE research communities through workshops held at top academic conferences. This project will result in the development of two preliminary datasets, one indoor and one outdoor, using the proposed laser-scanner methodology, and the identification of community needs, priorities, and support for the proposed InfraStructure for Photorealistic Images and Environment Synthesis (I-SPIES). Undergraduate students will be engaged in the development of the preliminary datasets through the University of Central Florida’s EXCEL STEM program, a former NSF STEP programThis award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

许多计算机和信息科学与工程 (CISE) 研究团体利用由视觉图像或 3D 虚拟环境组成的数据集来进行计算机视觉、机器人、多媒体系统、虚拟现实和混合现实方面的研究，其中许多数据集由以前的图像组成。使用相机和其他光学传感器捕获的图像，或以前从 3D 虚拟环境渲染的合成图像，这些数据集的静态性质限制了它们的实用性和潜在应用。最近，一些研究人员提供了用于从 3D 虚拟环境合成新图像的数据集和工具。可定制的虚拟相机位置，这拓宽了它们的研究应用。然而，许多数据集由保真度较低的室内虚拟环境组成，产生非真实感图像。此外，此类数据集缺少室外虚拟环境以及用于在其中共享自定义相机位置的工具。该规划项目准备通过研究使用高质量地面激光扫描仪捕获和创建真实世界位置（包括室内）的高保真、逼真的虚拟环境的可行性，来解决先前数据集的局限性和这将与通过在顶级学术会议上举办的研讨会对相关 CISE 研究团体进行的调查相结合，该项目将使用拟议的激光扫描仪方法开发两个初步数据集，一个是室内数据集，一个是室外数据集。确定社区需求、优先事项以及对拟议的真实感图像和环境合成基础设施 (I-SPIES) 的支持 本科生将通过中佛罗里达大学的 EXCEL STEM 项目参与初步数据集的开发，前 NSF STEP 计划该奖项反映了 NSF 的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。