III-COR-Medium: Design and Implementation of the DBO Database System

III-COR-Medium：DBO数据库系统的设计与实现

• 批准号: 1007062
• 负责人: Christopher Jermaine
• 金额: $ 72.26万
• 依托单位: William Marsh Rice University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2009
• 资助国家: 美国
• 起止时间: 2009-10-01 至 2013-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1007062&HistoricalAwards=false
• 关键词: III; COR; Medium; Design; Implementation

Commercial and government entities now spend around $10 billion per year on software and hardware systems for managing "data warehouses", which are very large electronic data archives. Despite the size and importance of this marketplace, existing data management solutions can be painfully slow (see, for example, www.tpc.org/tpch/ for recent benchmarking results). It is now possible to spend millions of dollars of hardware and software for a system that still takes hours to answer simple analytic questions. This is unfortunate, because there is much knowledge to be gained by interactive exploration of electronic archives. Very long processing times make it likely that the data will stored away, and never looked at again.The DBO Database System project is concerned with the design and development of a unique system called DBO. Like traditional relational database systems, DBO can run database queries from start to finish and produce exact answers over very large archives. However, unlike any existing research or production system, DBO uses sampling algorithms to produce a statistical estimate for the final query answer at all times throughout query execution. An example of the sort of estimate produced by DBO is, "There is a 95% chance that the true answer is between $1.75 million an $1.80 million". The longer a user waits, the more accurate the estimate becomes. The potential benefit of such an estimate is that a user can stop execution whenever satisfied with the accuracy of the estimate, which may translate to dramatic time savings during exploratory processing. In this way, the goal of the DBO project is to render interactive data analysis a reality, even over the largest databases.All scientific and technical materials produced by the project, as well as any software available for download, can be obtained from http://www.cise.ufl.edu/~cjermain/DBO .

现在，商业和政府实体每年在软件和硬件系统上花费约100亿美元来管理“数据仓库”，这些数据仓库是非常大的电子数据档案。尽管该市场的规模和重要性和重要性，但现有的数据管理解决方案可能会非常缓慢（例如，有关最近的基准测试结果，请参见www.tpc.org/tpch/）。现在，可以为系统花费数百万美元的硬件和软件花费数小时，该系统仍需几个小时才能回答简单的分析问题。这是不幸的，因为通过对电子档案的互动探索可以获得很多知识。 很长的处理时间使数据可能会存储，并且再也不会查看。DBO数据库系统项目与一个名为DBO的唯一系统的设计和开发有关。像传统的关系数据库系统一样，DBO可以从头到尾运行数据库查询，并在非常大的档案中提供精确的答案。但是，与任何现有的研究或生产系统不同，DBO使用采样算法在整个查询执行过程中始终为最终查询答案提供统计估算。 DBO产生的估计值的一个例子是：“真正的答案有95％的机会在175万美元之间，$ 180万美元”。 用户等待的时间越长，估计值就越准确。 这种估计的潜在好处是，每当对估计的准确性满意时，用户可以停止执行，这可能会转化为探索性处理过程中的巨大时间节省。这样，DBO项目的目的是使交互式数据分析甚至在最大的数据库中，该项目生产的所有科学和技术材料以及可下载的任何软件都可以从http://www.cise.cise.ufl.ufl.edu/~cjermain/dbo中获得。