CIF21 DIBBS: EI: VIFI:Virtual Information-Fabric Infrastructure (VIFI) for Data-Driven Decisions from Distributed Data

CIF21 DIBBS：EI：VIFI：用于分布式数据的数据驱动决策的虚拟信息结构基础设施 (VIFI)

• 批准号: 1640818
• 负责人: William Tolone
• 金额: $ 399.95万
• 依托单位: University of North Carolina at Charlotte
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2016
• 资助国家: 美国
• 起止时间: 2016-10-01 至 2022-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1640818&HistoricalAwards=false
• 关键词: CIF21; DIBBS; EI; VIFI; Virtual; CIF21; DIBBS; EI; VIFI; Virtual

Data discovery and data analytics often rely on the use of multiple data sources and data residing in distributed locations. This project builds infrastructure that encourages data-driven discovery from distributed, fragmented datasets without requiring movement of massive amounts of data and without exposing sensitive raw datasets to end users. The capability will be applied to a wide range of science topics: to the large sky surveys of astronomy, for which the collecting instruments are distributed nationally and internationally; to classify Earth science satellite data; for the management of sickle-cell disease and antimicrobial resistance surveillance studies; and to integrate the highly distributed and fragmented data sources needed for multi-hazard mitigation and for sustainable and resilient human-building ecosystem research. The project outlines an ambitious and will enable interdisciplinary training in multiple universities and institutions, and contribute to the training of early career researchersA Virtual Information-Fabric Infrastructure (VIFI) is created, allowing scientists to search, access, manipulate, and evaluate fragmented, distributed data in the information 'fabric' (the infrastructure to facilitate data sharing) without directly accessing or moving large amounts of data. The system addresses the challenges of coordinating loosely federated infrastructure, distributed data management, security and privacy. The architecture combines a set of loosely coupled components representing some proven capabilities with several emerging components. The VIFI infrastructure includes a novel orchestration layer for on-site analytics and hybrid-infrastructure (GPU, CPU) management, a dynamic secure container-based infrastructure which enables online adaptive analytics from unshareable data at distributed locations, and enhanced data and code management tools. The layer also provides search, access and query based on improvements using persistent identifiers and automated semantic descriptions (or metadata) of raw data using semantic data mining techniques. By integrating several NSF-funded components into a coherent whole, VIFI allows researchers to search, access, manipulate and evaluate data elements without requiring detailed familiarity with the data infrastructure itself. The system contributes to and expands the sets of resources serving diverse communities, and is extensible to additional communities. The project contains a substantial outreach effort, including training of early career scientists.

数据发现和数据分析通常依赖于在分布式位置中使用多个数据源和数据的使用。 该项目构建了基础架构，该基础架构鼓励从分布式的，零散的数据集中发现数据驱动的发现，而无需移动大量数据，而无需向最终用户传播敏感的原始数据集。 该能力将应用于广泛的科学主题：大型天文学调查，在国内和国际上分发了收集工具； 分类地球科学卫星数据；用于管理镰状细胞疾病和抗菌耐药性监测研究；并整合了缓解多危害的高度分布和零散的数据源以及可持续和弹性的人类生态系统研究。该项目概述了雄心勃勃的培训，并将在多个大学和机构中进行跨学科的培训，并为早期职业研究人员的培训做出了贡献。 该系统解决了协调松散联合基础架构，分布式数据管理，安全性和隐私的挑战。 该体系结构结合了一组松散的耦合组件，代表了一些经过验证的功能，并具有多个新兴组件。 VIFI基础架构包括用于现场分析和混合基础架构（GPU，CPU）管理的新型编排层，这是一种动态安全的基于容器的基础架构，可从分布式位置的不可出现的数据以及增强的数据和代码管理工具中从不可展示的数据中进行在线自适应分析。 该层还基于使用持续的标识符和使用语义数据挖掘技术对原始数据的持续标识符和自动语义描述（或元数据）提供了搜索，访问和查询。 通过将几个NSF资助的组件集成到一个连贯的整体中，VIFI允许研究人员搜索，访问，操纵和评估数据元素，而无需详细熟悉数据基础架构本身。 该系统有助于和扩展为各种社区提供服务的资源集，并为其他社区提供了扩展。 该项目包含了大量的外展工作，包括对早期职业科学家的培训。