CC*DNI DIBBs: Multi-Institutional Open Storage Research InfraStructure (MI-OSiRIS)

CC*DNI DIBB：多机构开放存储研究基础设施 (MI-OSiRIS)

• 批准号: 1541335
• 负责人: Shawn McKee
• 金额: $ 491.84万
• 依托单位: Regents of the University of Michigan - Ann Arbor
• 依托单位国家: 美国
• 项目类别: Cooperative Agreement
• 财政年份: 2015
• 资助国家: 美国
• 起止时间: 2015-09-01 至 2021-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1541335&HistoricalAwards=false
• 关键词: CC; DNI; DIBBs; Multi; Institutional

Every field of science generates and utilizes data in various forms: programs, instrument outputs, papers, notes, applications, simulations, video and audio recordings, etc. The continuing and evolving challenge for scientists is how to store, access, transform, manage and curate the variety of data required to effectively conduct their research, and transparently share it with other researchers across campus or at other institutions. The MI-OSiRIS project is addressing that challenge by combining an object-based software-defined storage technology with a monitored, managed network infrastructure to give scientists a distributed storage system which allows them to directly access their data from resources at any of the participating institutions. Furthermore, MI-OSiRIS utilizes each institution's existing authentication infrastructure to allow scientists to provide controlled access to their data across all participating institutions. By documenting and publishing designs, code, and operational experiences, the MI-OSiRIS project serves as a replicable model for supporting data-intensive, multi-institutional science collaborations.MI-OSiRIS implements a Ceph-based petabyte-scale distributed data system by deploying object storage servers at each participating institution, connecting them via a managed high speed network, and distributing data based on the specific requirements of each science research domain. Ceph, an open source storage platform, supports multiple data access methods (traditional file, native object, and block), and allows configuration of access, replication, distribution, and integrity on a per-research-domain basis. MI-OSiRIS is built on low-cost, commodity hardware and can deliver gigabytes per second of I/O bandwidth per node. The system monitors and manages the network paths between its partner institutions, science users and Ceph storage components by strategically deploying perfSONAR instances which have been augmented with a network discovery, monitoring, and management platform (Network Management Abstraction Layer). Globus Online servers provide access to data from outside MI-OSiRIS. In addition, MI-OSiRIS leverages Ceph's software defined storage aspects to automate some data-lifecycle management tasks.

每个科学领域都以各种形式生成和利用数据：程序，仪器，注释，注释，应用，模拟，视频和音频录音等。科学家的持续和不断发展的挑战是如何存储，访问，转换，管理，管理，管理和策划有效地进行研究所需的多种数据，并与跨校园中的其他研究人员跨校园或其他Instutitions进行跨性别的研究。 Mi-Osiris项目正在通过将基于对象的软件定义存储技术与受监控的，托管的网络基础架构相结合，从而为科学家提供分布式存储系统，从而使他们能够在任何参与机构的资源中直接访问其数据，从而解决了这一挑战。 此外，Mi-Osiris利用每个机构的现有身份验证基础架构，使科学家可以在所有参与机构中提供对其数据的受控访问。 通过记录和发布设计，代码和运营经验，Mi-Osiris项目是一个可复制的模型，可用于支持数据密集型，多机构科学合作。Mi-Osiris。基于CEPH的PABYTE规范规模分布式分布式数据系统通过在每个参与机构中通过基于每个参与机构进行分配速度的数据，并通过管理高速公路来分配高级数据，并通过托管高速进行分配，并通过托管高速进行分配。 Ceph是一个开源存储平台，支持多个数据访问方法（传统文件，本机对象和块），并允许以每个研究域的基础配置访问，复制，分发和完整性。 Mi-Osiris建立在低成本，商品硬件上，每个节点的I/O带宽的每秒都可以提供千兆字节。该系统通过战略部署已通过网络发现，监视和管理平台（网络管理抽象层）来扩展其合作伙伴机构，科学用户和CEPH存储组件之间的网络路径。 Globus Online服务器提供了来自Mi-Osiris外部数据的访问。 此外，Mi-Osiris还利用Ceph的软件定义了存储方面来自动化一些数据差异管理任务。