SCC-PG: JST: Multimodal Data Analytics and Integration for Emergency Response and Disaster Management

SCC-PG：JST：应急响应和灾害管理的多模式数据分析和集成

• 批准号: 1952089
• 负责人: Shu-Ching Chen
• 金额: $ 7.5万
• 依托单位: Florida International University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-07-01 至 2022-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1952089&HistoricalAwards=false
• 关键词: SCC; PG; JST; Multimodal; Data

The prevalence of high-speed data management and communication systems have produced countless large volumes of high-veracity, real-time data collections across many domains. For example, natural disasters initiate a myriad of human communications, data exchange, and situational assessments. It is crucial to quickly collect and analyze all of the relevant data, as life or death decisions may rest on the outcome. Hurricane Irma in 2017 caused the largest civil evacuation in Florida’s history and emphasizes two critical problems in emergency management: 1) pre-storm evacuation coordination; and 2) post-storm support for shelter-in-place locations. Disaster information integration and fusion technologies have the potential to deliver enhanced situational awareness tools across all sectors, enabling a more efficient, effective, and automated emergency management and recovery process. However, there is no discernible approach to identify and exploit the underlying patterns of each dataset while also minimizing possible drawbacks. This project aims to utilize multimodal data, such as text messages, images, videos, traffic information, and geo-referencing information, from various sources including social media, news, government announcements, and radio broadcasts. This work will investigate the analysis and fusion of this information to provide useful insights for aiding the decision-making process for both residents and government agencies. The goal is to develop new tools and technologies that can support emergency managers to better evaluate the effectiveness of disaster management policies such as evacuation. The proposed research provides potential solutions to solve crucial information analysis challenges related to disaster information management while leveraging the team's previous work. In addition, the team's research approach offers rapid key information identification, efficient multimodal data integration that facilitates emergency management, and enhances dynamic community disaster information sharing. Moreover, solutions developed could later be extended to other domains in the information management field. This project fosters collaboration among two institutions, Florida International University (FIU) and University of Tokyo, as well as institutions across the public and private sectors, to develop advanced techniques for effective emergency response and disaster management. The broader impact of this work will lead to scientific advances in the preparation, response, recovery, and mitigation of major disasters. As the largest graduate Hispanic Serving Institution in the continental United States, FIU will also benefit from the impact of this project that expands the participation of underrepresented groups in STEM fields. The research findings of this project will be broadly disseminated via publications, presentations, and an organized workshop.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

高速数据管理和通信系统的普及在许多领域产生了无数大量的高精度、实时数据收集，例如，自然灾害引发了无数的人类通信、数据交换和态势评估。快速收集和分析所有相关数据至关重要，因为 2017 年飓风“艾尔玛”的生死攸关可能取决于其结果，这导致了佛罗里达州历史上最大规模的公民疏散，并强调了应急管理中的两个关键问题：1）风暴前的情况。疏散协调；2) 灾害后避难场所的支持信息集成和融合技术有可能为所有部门提供增强的态势感知工具，从而实现更高效、更有效和自动化的应急管理和恢复。然而，没有明显的方法来识别和利用每个数据集的底层模式，同时最大限度地减少可能的缺点。该项目旨在利用多模式数据，例如文本消息、图像、视频、交通信息和地理参考信息。 ，来自各种来源，包括社会这项工作将调查这些信息的分析和融合，为居民和政府机构的决策过程提供有用的见解。可以支持应急管理人员更好地评估疏散等灾害管理政策的有效性。拟议的研究提供了潜在的解决方案，以解决与灾害信息管理相关的关键信息分析挑战，同时利用团队之前的工作。此外，该团队的研究方法提供了快速的解决方案。关键信息识别，高效促进应急管理并增强动态社区灾害信息共享的多模式数据集成此外，开发的解决方案随后可以扩展到信息管理领域的其他领域，该项目促进了佛罗里达国际大学（FIU）和佛罗里达大学之间的合作。东京以及公共和私营部门的机构致力于开发有效应急响应和灾害管理的先进技术，这项工作的更广泛影响将导致重大灾害的准备、响应、恢复和减轻方面的科学进步。作为美国最大的西班牙裔毕业生服务机构在美国大陆，FIU 也将从该项目的影响中受益，该项目扩大了 STEM 领域代表性不足的群体的参与。该项目的研究成果将通过出版物、演讲和有组织的研讨会广泛传播。该奖项由 NSF 法定授予。使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Multi-Label Multi-Task Learning with Dynamic Task Weight Balancing

• DOI: 10.1109/iri49571.2020.00042
• 发表时间: 2020-08
• 期刊: 2020 IEEE 21st International Conference on Information Reuse and Integration for Data Science (IRI)
• 作者: Tianyi Wang;Shu‐Ching Chen

Data Analytics for Air Travel Data: A Survey and New Perspectives

• DOI: 10.1145/3469028
• 发表时间: 2021-11-01
• 期刊: ACM COMPUTING SURVEYS
• 影响因子: 16.6
• 作者: Tian, Haiman;Presa-Reyes, Maria;Iyengar, Sundaraja Sitharama
• 通讯作者: Iyengar, Sundaraja Sitharama

Weakly-Supervised Damaged Building Localization and Assessment with Noise Regularization

弱监督受损建筑定位和噪声正则化评估

• DOI: 10.1109/mipr51284.2021.00009
• 发表时间: 2021
• 期刊: The 4th IEEE International Conference on Multimedia Information Processing and Retrieval
• 作者: Presa-Reyes, Maria;Chen, Shu-Ching
• 通讯作者: Chen, Shu-Ching

Hierarchical Multimodal Fusion Network with Dynamic Multi-task Learning

• DOI: 10.1109/iri51335.2021.00034
• 发表时间: 2021-08
• 期刊: 2021 IEEE 22nd International Conference on Information Reuse and Integration for Data Science (IRI)
• 作者: Tianyi Wang;Shu‐Ching Chen

Data-Driven In-Crisis Community Identification for Disaster Response and Management

• DOI: 10.1109/cic52973.2021.00021
• 发表时间: 2021-12
• 期刊: 2021 IEEE 7th International Conference on Collaboration and Internet Computing (CIC)
• 作者: Yudong Tao;Renhe Jiang;Erik Coltey;Chuang Yang;Xuan Song;R. Shibasaki;Mei-Ling Shyu;Shu‐Ching Chen