III: Small: RUI: Collaborative Research: Exploiting Information Graphics in a Digital Library

III：小：RUI：协作研究：在数字图书馆中利用信息图形

• 批准号: 1016900
• 负责人: Stephanie Schwartz
• 金额: $ 10.49万
• 依托单位: Millersville University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2010
• 资助国家: 美国
• 起止时间: 2010-09-01 至 2015-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1016900&HistoricalAwards=false
• 关键词: III; Small; RUI; Collaborative; Research

This project is a collaborative effort between the University of Delaware and Millersville University. Information graphics (non-pictorial graphics such as bar charts and line graphs) occur frequently in popular media such as newspapers and magazines. Not only is the knowledge conveyed by these graphics very often not included in the article's text, but (in contrast with scientific documents) the article's text most often does not even explicitly refer to the graphics. Information retrieval research has focused on the text of documents, and their information graphics have largely been ignored. Yet, the graphic designer considered the graphic's message important enough to warrant designing a graphic to convey it. This project's goal is a novel methodology for retrieving relevant information graphics from a digital library in response to user queries.Information graphics in popular media generally have a communicative goal or message that they are intended to convey. This message encapsulates the high-level knowledge contained in the graphic. The approach of the project is a language model that treats the relevance of a graphic to a query as a mixture of three components: a graphic's intended message, other textual components of the graphic such as its caption and additional textual description augmenting the caption, and the text of the document containing the graphic. Challenges that are being addressed include identifying the portion of the article that is relevant to the graphic, associating query terms with the intended messages of graphics in the document library, expanding the abbreviated captions and additional textual descriptions of graphics to more fully capture their content, and appropriately weighting the contribution of individual components of the mixture model. In addition, some kinds of graphics, such as grouped bar charts, have both a primary intended message and a secondary message. The impact of the secondary message on retrieval when an ideal graphic is unavailable is also being addressed. Evaluation of the graph retrieval methodology consists of experiments in which human subjects rate the relevance of retrieved graphics to user queries.The goal of this project is to produce a system for retrieving relevant information graphics, thereby expanding the utility of digital libraries. Together with the SIGHT system, which conveys the content of information graphics via speech, the project will extend the information resources available to individuals with sight-impairments. The project will also produce a corpus of information graphics and their XML representations that can be used by other researchers. Corpora and research results will be disseminated on the project web site (http://www.cis.udel.edu/~carberry/Graph-Retrieval). In addition to significantly increasing the resources accessible from a digital library, the research will lay the foundation for expanding research on question-answering to take into account information graphics. The project will contribute to the development of future scientists by educating graduate students, providing research opportunities for undergraduates at a predominantly undergraduate institution, and enhancing the mentoring skills of graduate students as they work on a team that includes undergraduates.

该项目是特拉华大学和米勒斯维尔大学之间的合作努力。 信息图形（非图形图形，例如条形图和线图）经常出现在流行媒体（例如报纸和杂志）中。 这些图形所传达的知识不仅经常在文章的文本中不包含，而且（与科学文档相比），本文的文本最常甚至没有明确指出图形。 信息检索研究集中在文档的文本上，其信息图形在很大程度上被忽略了。 然而，图形设计师认为图形的信息足够重要，可以保证设计图形传达它。该项目的目标是一种新的方法，用于从数字库中检索相关信息图形以响应用户查询。受欢迎的媒体中的信息图形通常具有沟通性目标或信息，可以传达它们。 此消息封装图形中包含的高级知识。 该项目的方法是一种语言模型，将图形与查询的相关性视为三个组件的混合物：图形的预期消息，图形的其他文本组件（例如其标题）和其他文本描述增强字幕，以及包含图形的文档的文本。 正在解决的挑战包括确定与图形相关的文章部分，将查询术语与文档库中的图形术语相关联，扩大缩写字幕和图形的其他文本描述以更充分地捕获其内容，并适当地加权混合模型的单个组件的贡献。 此外，某些类型的图形，例如分组的条形图，既有主要的消息和次要消息。 当不可用的理想图形不可用时，次级消息对检索的影响。对图检索方法的评估包括实验，其中人类受试者对检索图形与用户查询的相关性进行评分。该项目的目的是生成一个用于检索相关信息图形的系统，从而扩大了数字库的实用性。与视力系统通过语音传达信息图形的内容一起，该项目将扩展可用的视力障碍的个人的信息资源。该项目还将生成其他研究人员可以使用的信息图形及其XML表示。语料库和研究结果将在项目网站（http://www.cis.udel.edu/~carberry/graph-retrieval）上传播。 除了显着增加可从数字图书馆访问的资源外，该研究还将为扩大问题的研究以考虑信息图形为基础。 该项目将通过教育研究生教育，为未来的科学家的发展，为本科学院的本科生提供研究机会，并在包括本科生在内的团队中工作时，为研究生提供了研究机会，并提高了研究生的指导能力。