Collaborative Research: Framework: Data: NSCI: HDR: GeoSCIFramework: Scalable Real-Time Streaming Analytics and Machine Learning for Geoscience and Hazards Research
协作研究:框架:数据:NSCI:HDR:GeoSCIFramework:用于地球科学和灾害研究的可扩展实时流分析和机器学习
基本信息
- 批准号:2219975
- 负责人:
- 金额:$ 89.91万
- 依托单位:
- 依托单位国家:美国
- 项目类别:Standard Grant
- 财政年份:2021
- 资助国家:美国
- 起止时间:2021-10-01 至 2024-08-31
- 项目状态:已结题
- 来源:
- 关键词:
项目摘要
This project develops a real-time processing system capable of handling a large mix of sensor observations. The focus of this system is automation of the detection of natural hazard events using machine learning, as the events are occurring. A four-organization collaboration (UNAVCO, University of Colorado, University of Oregon, and Rutgers University) develops a data framework for generalized real-time streaming analytics and machine learning for geoscience and hazards research. This work will support rapid analysis and understanding of data associated with hazardous events (earthquakes, volcanic eruptions, tsunamis). This project uses a collaboration between computer scientists and geoscientists to develop a data framework for generalized real-time streaming analytics and machine learning for geoscience and hazards research. It focuses on the aggregation and integration of a large number of data streams into a coherent system that supports analysis of the data streams in real-time. The framework will offer machine-learning-based tools designed to detect signals of events, such as earthquakes and tsunamis, that might only be detectable when looking at a broad selection of observational inputs. The architecture sets up a fast data pipeline by combining a group of open source components that make big data applications viable and easier to develop. Data sources for the project draw primarily upon the 1500+ sensors from the EarthScope networks currently managed by UNAVCO and the Incorporated Research Institutions for Seismology (IRIS), as well as the Ocean Observatories Initiative (OOI) cabled array data managed by Rutgers University. Machine learning (ML) algorithms will be researched and applied to the tsunami and earthquake use cases. Initially, the project plans to employ an advanced convolutional neural network method in a multi-data environment. The method has only been applied to seismic waveforms, so the project will explore extending the method to a multi-data environment. The approach is expected to be extensible beyond detection and characterization of earthquakes to include the onset of other geophysical signals such as slow-slip events or magmatic intrusion, expanding the potential for new scientific discoveries. The framework is applied to use cases in the Cascadia subduction zone and Yellowstone: these locations combine the expertise of the science team with locations where EarthScope and OOI have the greatest concentration of instruments. The architecture will be transportable and scalable, running in a Docker environment on laptops, local clusters and the cloud. Integral to the project will be development, documentation and training using collaborative online resources such as GitLab and Jupyter Notebooks, and utilizing NSF XSEDE resources to make larger datasets and computational resources more widely available.This award by the NSF Office of Advanced Cyberinfrastructure is jointly supported by the Cross-Cutting Program and Division of Earth Sciences within the NSF Directorate for Geosciences, the Big Data Science and Engineering Program within the Directorate for Computer and Information Science and Engineering, and the EarthCube Program jointly sponsored by the NSF Directorate for Geosciences and the Office of Advanced Cyberinfrastructure.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
该项目开发了一个实时处理系统,能够处理大量传感器观测结果。该系统的重点是在自然灾害事件发生时使用机器学习自动检测自然灾害事件。 四家组织(UNAVCO、科罗拉多大学、俄勒冈大学和罗格斯大学)合作开发了一个数据框架,用于地球科学和灾害研究的通用实时流分析和机器学习。 这项工作将支持快速分析和理解与危险事件(地震、火山爆发、海啸)相关的数据。 该项目利用计算机科学家和地球科学家之间的合作,开发一个数据框架,用于地球科学和灾害研究的通用实时流分析和机器学习。 它专注于将大量数据流聚合和集成到一个支持实时数据流分析的连贯系统中。该框架将提供基于机器学习的工具,旨在检测地震和海啸等事件信号,这些信号可能只有在广泛选择观测输入时才能检测到。 该架构通过组合一组开源组件来建立快速数据管道,使大数据应用程序可行且更易于开发。该项目的数据源主要利用来自目前由 UNAVCO 和地震学联合研究机构 (IRIS) 管理的 EarthScope 网络的 1500 多个传感器,以及由罗格斯大学管理的海洋观测计划 (OOI) 有线阵列数据。 将研究机器学习(ML)算法并将其应用于海啸和地震用例。 最初,该项目计划在多数据环境中采用先进的卷积神经网络方法。 该方法仅应用于地震波形,因此该项目将探索将该方法扩展到多数据环境。 该方法预计可以扩展到地震的检测和表征之外,包括其他地球物理信号的出现,例如慢滑事件或岩浆侵入,从而扩大新科学发现的潜力。 该框架适用于卡斯卡迪亚俯冲带和黄石公园的用例:这些地点将科学团队的专业知识与 EarthScope 和 OOI 仪器最集中的地点结合起来。 该架构将具有可移植性和可扩展性,可在笔记本电脑、本地集群和云上的 Docker 环境中运行。 该项目的组成部分将是使用 GitLab 和 Jupyter Notebooks 等协作在线资源进行开发、文档和培训,并利用 NSF XSEDE 资源来更广泛地提供更大的数据集和计算资源。该奖项由 NSF 高级网络基础设施办公室共同支持由美国国家科学基金会地球科学理事会的跨领域项目和地球科学部、计算机和信息科学与工程理事会的大数据科学与工程项目以及由美国国家科学基金会联合发起的地球立方项目NSF 地球科学理事会和先进网络基础设施办公室。该奖项反映了 NSF 的法定使命,并通过使用基金会的智力价值和更广泛的影响审查标准进行评估,被认为值得支持。
项目成果
期刊论文数量(2)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
Toward Democratizing Access to Facilities Data: A Framework for Intelligent Data Discovery and Delivery
- DOI:10.1109/mcse.2022.3179408
- 发表时间:2021-12
- 期刊:
- 影响因子:2.1
- 作者:Yubo Qin;I. Rodero;M. Parashar
- 通讯作者:Yubo Qin;I. Rodero;M. Parashar
Accelerating Data-Intensive Seismic Research Through Parallel Workflow Optimization and Federated Cyberinfrastructure
通过并行工作流程优化和联合网络基础设施加速数据密集型地震研究
- DOI:10.1145/3624062.3624276
- 发表时间:2023
- 期刊:
- 影响因子:0
- 作者:Adair, Marcus;Rodero, Ivan;Parashar, Manish;Melgar, Diego
- 通讯作者:Melgar, Diego
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
数据更新时间:{{ journalArticles.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ monograph.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ sciAawards.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ conferencePapers.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ patent.updateTime }}
Ivan Rodero其他文献
Ivan Rodero的其他文献
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
{{ truncateString('Ivan Rodero', 18)}}的其他基金
CIF21 DIBBs: EI: Virtual Data Collaboratory: A Regional Cyberinfrastructure for Collaborative Data Intensive Science
CIF21 DIBB:EI:虚拟数据协作:协作数据密集型科学的区域网络基础设施
- 批准号:
2220826 - 财政年份:2021
- 资助金额:
$ 89.91万 - 项目类别:
Standard Grant
Collaborative Research: Framework: Data: NSCI: HDR: GeoSCIFramework: Scalable Real-Time Streaming Analytics and Machine Learning for Geoscience and Hazards Research
协作研究:框架:数据:NSCI:HDR:GeoSCIFramework:用于地球科学和灾害研究的可扩展实时流分析和机器学习
- 批准号:
1835692 - 财政年份:2019
- 资助金额:
$ 89.91万 - 项目类别:
Standard Grant
NSF Large Facilities Cyberinfrastructure Workshop
NSF 大型设施网络基础设施研讨会
- 批准号:
1742969 - 财政年份:2017
- 资助金额:
$ 89.91万 - 项目类别:
Standard Grant
EAGER: Online Processing of Data in Large Facilities using National Advanced CyberInfrastructure
EAGER:使用国家先进网络基础设施在线处理大型设施中的数据
- 批准号:
1745246 - 财政年份:2017
- 资助金额:
$ 89.91万 - 项目类别:
Standard Grant
SPX: Collaborative Research: Cross-layer Application-Aware Resilience at Extreme Scale (CAARES)
SPX:协作研究:超大规模跨层应用程序感知弹性 (CAARES)
- 批准号:
1725649 - 财政年份:2017
- 资助金额:
$ 89.91万 - 项目类别:
Standard Grant
CIF21 DIBBs: EI: Virtual Data Collaboratory: A Regional Cyberinfrastructure for Collaborative Data Intensive Science
CIF21 DIBB:EI:虚拟数据协作:协作数据密集型科学的区域网络基础设施
- 批准号:
1640834 - 财政年份:2016
- 资助金额:
$ 89.91万 - 项目类别:
Standard Grant
BIGDATA: Collaborative Research: IA: F: Fractured Subsurface Characterization using High Performance Computing and Guided by Big Data
BIGDATA:协作研究:IA:F:使用高性能计算和大数据指导的断裂地下表征
- 批准号:
1546145 - 财政年份:2016
- 资助金额:
$ 89.91万 - 项目类别:
Standard Grant
CRII: CI: Exploring Advanced Cyber-Infrastructure Co-Design for Big Data Analytics
CRII:CI:探索大数据分析的高级网络基础设施协同设计
- 批准号:
1464317 - 财政年份:2015
- 资助金额:
$ 89.91万 - 项目类别:
Standard Grant
相似国自然基金
中国外来入侵植物优先管理框架研究:分布格局、驱动因素与潜在分布区的综合分析
- 批准号:32372565
- 批准年份:2023
- 资助金额:50 万元
- 项目类别:面上项目
金属有机框架对M-Nx基PEMFCs阴极催化层的多重调控机制研究
- 批准号:22375017
- 批准年份:2023
- 资助金额:50 万元
- 项目类别:面上项目
基于新框架土壤生物促进或抑制外来植物入侵发生条件和机制研究
- 批准号:32371749
- 批准年份:2023
- 资助金额:50 万元
- 项目类别:面上项目
基于共价有机框架薄膜的气体传感器及其敏感机理研究
- 批准号:62371299
- 批准年份:2023
- 资助金额:52 万元
- 项目类别:面上项目
选择性分离水产品中全氟辛酸的金属有机框架的设计制备及吸附机制研究
- 批准号:32302234
- 批准年份:2023
- 资助金额:30 万元
- 项目类别:青年科学基金项目
相似海外基金
EAGER/Collaborative Research: An LLM-Powered Framework for G-Code Comprehension and Retrieval
EAGER/协作研究:LLM 支持的 G 代码理解和检索框架
- 批准号:
2347624 - 财政年份:2024
- 资助金额:
$ 89.91万 - 项目类别:
Standard Grant
Collaborative Research: An Integrated Framework for Learning-Enabled and Communication-Aware Hierarchical Distributed Optimization
协作研究:支持学习和通信感知的分层分布式优化的集成框架
- 批准号:
2331710 - 财政年份:2024
- 资助金额:
$ 89.91万 - 项目类别:
Standard Grant
Collaborative Research: An Integrated Framework for Learning-Enabled and Communication-Aware Hierarchical Distributed Optimization
协作研究:支持学习和通信感知的分层分布式优化的集成框架
- 批准号:
2331711 - 财政年份:2024
- 资助金额:
$ 89.91万 - 项目类别:
Standard Grant
Collaborative Research: A Semiconductor Curriculum and Learning Framework for High-Schoolers Using Artificial Intelligence, Game Modules, and Hands-on Experiences
协作研究:利用人工智能、游戏模块和实践经验为高中生提供半导体课程和学习框架
- 批准号:
2342747 - 财政年份:2024
- 资助金额:
$ 89.91万 - 项目类别:
Standard Grant
Collaborative Research: Dynamic connectivity of river networks as a framework for identifying controls on flux propagation and assessing landscape vulnerability to change
合作研究:河流网络的动态连通性作为识别通量传播控制和评估景观变化脆弱性的框架
- 批准号:
2342936 - 财政年份:2024
- 资助金额:
$ 89.91万 - 项目类别:
Continuing Grant