EAGER: Collaborative Research: Augmented 360 Video for Situation Awareness in Firefighting

EAGER：协作研究：用于消防态势感知的增强型 360 度视频

• 批准号: 2140645
• 负责人: Klara Nahrstedt
• 金额: $ 15万
• 依托单位: University of Illinois at Urbana-Champaign
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2021
• 资助国家: 美国
• 起止时间: 2021-10-01 至 2024-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2140645&HistoricalAwards=false
• 关键词: EAGER; Collaborative; Research; Augmented; 360

Fire incidents have caused substantial injuries, illness, and death on both firefighters and civilians. Poor communications between commanders in the control center and firefighters working at emergency sites are frequently cited as the determining factor in fatality and loss reports of firefighter operations. Traditionally, remote commanders visualize emergency sites and lead the operation using videos captured by helmet cameras of firefighters. Unfortunately, these video systems suffer from a fundamental problem, i.e., commanders are only able to see a single view of the emergency site at a time. This limitation restricts the situation awareness of commanders and leads to productivity and safety issues such as miscommunication of locations and failure to identify dangerous events. This project combines 360-degree videos and augmented reality to enable remote commanders to achieve 360-degree situation awareness of the entire emergency site in all viewing directions and enhance firefighting productivity and safety. The 360-degree video viewing benefits various emergency response communities in planning and training. Other research outcomes, including open datasets and software, are widely disseminated through publications, presentations, and websites to contribute to the computer science and engineering communities. Educational activities including undergraduate research as well as fire safety training for K-12 students are also planned to enhance the impacts of this project. This project will design and develop augmented 360 video technology to enable remote commanders to switch viewports within a 360-degree scene and visualize machine-detected events of interest. It will investigate an augmented 360 video viewing system to enable panoramic situation awareness for incident command in firefighter operations through these steps: (1) to address commanders’ needs and requirements for situation awareness in firefighter videos, interviews will be performed to identify and categorize important objects and events in firefighter response and their technology preferences; (2) to fill in the knowledge gap of how to enable automatic machine detection of important events in firefighter videos, a view of interest detection model will be designed detects target objects and events; and (3) to provide panoramic situation awareness to commanders, an augmented 360 video viewing system for remote incident command will be developed and evaluated through a field study.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

火灾事故导致消防员和平民大量受伤、患病和死亡。控制中心指挥官和紧急救援现场的消防员之间的沟通不畅经常被认为是消防员行动死亡和损失报告的决定性因素。指挥官使用消防员头盔摄像机拍摄的视频来可视化紧急现场并领导行动。不幸的是，这些视频系统存在一个根本问题，即指挥官一次只能看到紧急现场的单个视图。的态势感知该项目结合了 360 度视频和增强现实技术，使远程指挥员能够在所有观看方向上实现整个应急现场的 360 度态势感知。 360 度视频观看有利于各种应急响应社区的规划和培训，包括开放数据集和软件，通过出版物、演示文稿和网站广泛传播，为计算机做出贡献。还计划开展本科生研究以及针对 K-12 学生的消防安全培训等教育活动，以增强该项目的影响力。该项目将设计和开发增强型 360 度视频技术，使远程指挥官能够在其中切换视口。它将研究增强型 360 度视频观看系统，通过以下步骤实现消防员行动中事件指挥的全景态势感知：(1) 满足指挥官的需求。以及消防员视频中态势感知的要求，将进行访谈以识别和分类消防员响应中的重要对象和事件及其技术偏好（2）填补如何实现消防员重要事件的自动机器检测的知识空白； (3) 为了向指挥官提供全景态势感知，将开发用于远程事件指挥的增强型 360 度视频观看系统，并通过现场研究进行评估。奖项反映通过使用基金会的智力价值和更广泛的影响审查标准进行评估，NSF 的法定使命被认为值得支持。