CIF: Small: Computer assisted rate regions for multi-source distributed storage and network coding

CIF：小：用于多源分布式存储和网络编码的计算机辅助费率区域

基本信息

批准号：
1421828
负责人：
John Walsh
金额：
$ 47.5万
依托单位：
Drexel University
依托单位国家：
美国
项目类别：
Standard Grant
财政年份：
2014
资助国家：
美国
起止时间：
2014-09-01 至 2018-08-31
项目状态：
已结题

来源：
https://www.nsf.gov/awardsearch/showAward?AWD_ID=1421828&HistoricalAwards=false
关键词：
CIF Small Computer assisted rate

项目摘要

Distributed information storage architectures that are resilient against drive failures and organized in a manner that allow themselves to heal efficiently are a key component of the emerging area of big data systems. Moreover, the transition by companies and individuals to storing data in the cloud are enabling gigantic economies of scale, and distributed storage architectures are one of the most important components of such a large scale computing services system. The architectures modern distributed storage systems are using are still, from the standpoint of the coding utilized, archaic. More efficient distributed storage architectures would deliver better, more responsive, services to customers including faster access, better reliability, and more responsive processing, and at a lower aggregate long term cost. To reap these long term benefits, new science has to be developed to understand and determine the fundamental limits for these systems. These fundamental limits can be expressed in terms of the capacity regions of networks under network coding, which are themselves as of yet only implicitly characterized in all but the most symmetrized and simplified forms.This project will study the capacity regions of networks and distributed storage systems, and the classes of codes that achieve them. Automated methods of computing these rate regions for small networks will be developed that harness the detection of problem symmetries, specialized polyhedral computation, and the enumeration of classes of matroids associated with optimal codes. Larger networks and storage systems will also be studied via the introduction of network embedding operations that preserve the sufficiency of classes of codes to achieve the entire capacity region.

分布式信息存储架构能够抵御驱动器故障，并以允许自身有效修复的方式进行组织，是大数据系统新兴领域的关键组成部分。此外，公司和个人向云存储数据的转变正在实现巨大的规模经济，而分布式存储架构是这种大规模计算服务系统最重要的组成部分之一。从所使用的编码的角度来看，现代分布式存储系统使用的架构仍然是过时的。更高效的分布式存储架构将为客户提供更好、响应更快的服务，包括更快的访问、更好的可靠性和响应更快的处理，并且总体长期成本更低。为了获得这些长期利益，必须发展新的科学来理解和确定这些系统的基本限制。这些基本限制可以用网络编码下的网络容量区域来表达，而网络编码本身目前仅隐式地以除了最对称和简化的形式之外的所有形式进行表征。该项目将研究网络和分布式存储系统的容量区域，以及实现它们的代码类。将开发为小型网络计算这些速率区域的自动化方法，该方法利用问题对称性的检测、专门的多面体计算以及与最优代码相关的拟阵类别的枚举。还将通过引入网络嵌入操作来研究更大的网络和存储系统，该操作保留代码类别的充分性以实现整个容量区域。