Algorithms to Improve the Efficiency of Data Compression and Caching on Wide-Area Networks

提高广域网上数据压缩和缓存效率的算法

• 批准号: 9977336
• 负责人: Amar Mukherjee
• 金额: $ 23万
• 依托单位: The University of Central Florida Board of Trustees
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 1999
• 资助国家: 美国
• 起止时间: 1999-10-01 至 2003-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=9977336&HistoricalAwards=false
• 关键词: Algorithms; Improve; Efficiency; Data; Compression; Algorithms; Improve; Efficiency; Data; Compression

The goal of this research project is to develop new lossless text compression algorithms and software tools to incorporate compression in MIME/HTML standards. The approach consists of encoding the text to exploit the natural redundancy of a language via the use of a dictionary and then compressing it using a pre-existing compression algorithm. The encoding scheme depends on the specific characteristics of the compression algorithm and the Bzip2 algorithm based on Burrows-Wheeler transform is used as the main backend compression algorithm. A basic understanding of the interaction of the encoding schemes and the compression algorithms is developed in this research project. The performance of the algorithms is measured taking into account both compression and communication metrics. Infrastructure tools are developed using dynamic caching of dictionaries to embed compression into MIME/HTML standards. This research will have impact on the future of information technology by providing methods for data delivery systems where communication bandwidth is at a premium and archival storage is an exponentially costly endeavor. It is expected that the new lossless text compression algorithms will have 5 to 10% improved compression ratio over the best known pre-existing compression algorithms which might translate into a reduction of more than 50% of the text traffic on the Internet. The experimental research is linked to educational goals via rapid dissemination of results via reports, conference and journal papers, doctoral dissertations and masters theses, and transferring the research knowledge into the graduate curriculum. Software tools developed under this grant will be shared via a web site.

该研究项目的目的是开发新的无损文本压缩算法和软件工具，以将压缩纳入MIME/HTML标准。该方法包括编码文本以通过使用字典来利用语言的自然冗余，然后使用预先存在的压缩算法对其进行压缩。编码方案取决于压缩算法的特定特征和基于burrows-wheeler变换的BZIP2算法用作主要后端压缩算法。该研究项目对编码方案和压缩算法的相互作用的相互作用有基本的了解。考虑到压缩和通信指标，测量了算法的性能。基础架构工具是使用词典的动态缓存开发的，将压缩嵌入到MIME/HTML标准中。这项研究将通过为通信带宽处于溢价而提供的数据传递系统的方法来影响信息技术的未来，而档案存储是一种成本成本的努力。预计新的无损文本压缩算法将使压缩率提高5％至10％，而不是最著名的预先存在的压缩算法，这些算法可能会转化为Internet上50％以上的文本流量的减少。实验研究通过报告，会议和期刊论文，博士学位论文和硕士学位，以及将研究知识转移到研究生课程中，与教育目标有关。根据该赠款开发的软件工具将通过网站共享。