SCC-PG: JST: Multimodal Data Analytics and Integration for Emergency Response and Disaster Management

SCC-PG：JST：应急响应和灾害管理的多模式数据分析和集成

• 批准号: 1952089
• 负责人: Shu-Ching Chen
• 金额: $ 7.5万
• 依托单位: Florida International University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-07-01 至 2022-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1952089&HistoricalAwards=false
• 关键词: SCC; PG; JST; Multimodal; Data

The prevalence of high-speed data management and communication systems have produced countless large volumes of high-veracity, real-time data collections across many domains. For example, natural disasters initiate a myriad of human communications, data exchange, and situational assessments. It is crucial to quickly collect and analyze all of the relevant data, as life or death decisions may rest on the outcome. Hurricane Irma in 2017 caused the largest civil evacuation in Florida’s history and emphasizes two critical problems in emergency management: 1) pre-storm evacuation coordination; and 2) post-storm support for shelter-in-place locations. Disaster information integration and fusion technologies have the potential to deliver enhanced situational awareness tools across all sectors, enabling a more efficient, effective, and automated emergency management and recovery process. However, there is no discernible approach to identify and exploit the underlying patterns of each dataset while also minimizing possible drawbacks. This project aims to utilize multimodal data, such as text messages, images, videos, traffic information, and geo-referencing information, from various sources including social media, news, government announcements, and radio broadcasts. This work will investigate the analysis and fusion of this information to provide useful insights for aiding the decision-making process for both residents and government agencies. The goal is to develop new tools and technologies that can support emergency managers to better evaluate the effectiveness of disaster management policies such as evacuation. The proposed research provides potential solutions to solve crucial information analysis challenges related to disaster information management while leveraging the team's previous work. In addition, the team's research approach offers rapid key information identification, efficient multimodal data integration that facilitates emergency management, and enhances dynamic community disaster information sharing. Moreover, solutions developed could later be extended to other domains in the information management field. This project fosters collaboration among two institutions, Florida International University (FIU) and University of Tokyo, as well as institutions across the public and private sectors, to develop advanced techniques for effective emergency response and disaster management. The broader impact of this work will lead to scientific advances in the preparation, response, recovery, and mitigation of major disasters. As the largest graduate Hispanic Serving Institution in the continental United States, FIU will also benefit from the impact of this project that expands the participation of underrepresented groups in STEM fields. The research findings of this project will be broadly disseminated via publications, presentations, and an organized workshop.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

高速数据管理和通信系统的流行率产生了许多范围内的大量高磁力，实时数据收集。例如，自然灾害会引发无数的人类通信，数据交换和情境评估。快速收集和分析所有相关数据至关重要，因为生死决策可能取决于结果。 2017年，艾尔玛飓风造成了佛罗里达州历史上最大的民事疏散，并强调了紧急管理中的两个关键问题：1）预先疏散协调；和2）在现场庇护所的后支持。灾难信息集成和融合技术有可能在所有部门提供增强的情境意识工具，从而实现更高效，有效和自动化的紧急管理和恢复过程。但是，没有可辨别的方法来识别和利用每个数据集的基本模式，同时还可以最大程度地减少可能的缺点。该项目旨在利用多模式数据，例如来自社交媒体，新闻，政府公告和无线电广播的各种来源的文本消息，图像，视频，流量信息和地理参考信息。这项工作将调查此信息的分析和融合，以提供有用的见解，以帮助居民和政府机构的决策过程。目的是开发新的工具和技术，这些工具和技术可以支持应急管理人员更好地评估诸如疏散等灾难管理政策的有效性。拟议的研究提供了潜在的解决方案，以解决与灾难信息管理有关的重要信息分析挑战，同时利用团队以前的工作。此外，该团队的研究方法还提供了快速的关键信息识别，有效的多模式数据集成，可促进紧急管理，并增强动态的社区灾难信息共享。此外，后来可以将开发的解决方案扩展到信息管理字段中的其他域。该项目促进了两个机构之间的合作，佛罗里达国际大学（FIU）和东京大学以及公共和私营部门的机构，开发了高级技术，以进行有效的紧急响应和灾难管理。这项工作的更广泛影响将导致对重大灾难的准备，反应，康复和缓解的科学进步。作为连续美国最大的西班牙裔毕业生，FIU还将受益于该项目的影响，从而扩大了代表性不足的群体在STEM领域的参与。该项目的研究结果将通过出版物，演讲和有组织的研讨会广泛传播。该奖项反映了NSF的法定任务，并被认为是值得通过基金会的知识分子优点和更广泛的审查标准通过评估来获得支持的。

项目成果

Multi-Label Multi-Task Learning with Dynamic Task Weight Balancing

• DOI: 10.1109/iri49571.2020.00042
• 发表时间: 2020-08
• 期刊: 2020 IEEE 21st International Conference on Information Reuse and Integration for Data Science (IRI)
• 作者: Tianyi Wang;Shu‐Ching Chen

Data Analytics for Air Travel Data: A Survey and New Perspectives

• DOI: 10.1145/3469028
• 发表时间: 2021-11-01
• 期刊: ACM COMPUTING SURVEYS
• 影响因子: 16.6
• 作者: Tian, Haiman;Presa-Reyes, Maria;Iyengar, Sundaraja Sitharama
• 通讯作者: Iyengar, Sundaraja Sitharama

Weakly-Supervised Damaged Building Localization and Assessment with Noise Regularization

弱监督受损建筑定位和噪声正则化评估

• DOI: 10.1109/mipr51284.2021.00009
• 发表时间: 2021
• 期刊: The 4th IEEE International Conference on Multimedia Information Processing and Retrieval
• 作者: Presa-Reyes, Maria;Chen, Shu-Ching
• 通讯作者: Chen, Shu-Ching

Hierarchical Multimodal Fusion Network with Dynamic Multi-task Learning

• DOI: 10.1109/iri51335.2021.00034
• 发表时间: 2021-08
• 期刊: 2021 IEEE 22nd International Conference on Information Reuse and Integration for Data Science (IRI)
• 作者: Tianyi Wang;Shu‐Ching Chen

Data-Driven In-Crisis Community Identification for Disaster Response and Management

• DOI: 10.1109/cic52973.2021.00021
• 发表时间: 2021-12
• 期刊: 2021 IEEE 7th International Conference on Collaboration and Internet Computing (CIC)
• 作者: Yudong Tao;Renhe Jiang;Erik Coltey;Chuang Yang;Xuan Song;R. Shibasaki;Mei-Ling Shyu;Shu‐Ching Chen