HCC: Medium: Collaborative Research:Computer Vision and Online Communities: A Symbiosis

HCC：媒介：协作研究：计算机视觉和在线社区：共生

• 批准号: 0905243
• 负责人: Todd Zickler
• 金额: $ 33.47万
• 依托单位: Harvard University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2009
• 资助国家: 美国
• 起止时间: 2009-07-15 至 2013-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0905243&HistoricalAwards=false
• 关键词: HCC; Medium; Collaborative; Research; Computer

This award is funded under the American Recovery and Reinvestment Act of 2009 (Public Law 111-5). The project represents a new paradigm for research in computer vision related to content-based image management--?one that exploits a symbiosis between this technology and the online communities it serves. It is quite clear that communities stand to benefit from improved searching and browsing tools enabled by visual technology, but we argue that the converse is equally true. Visual information that is shared online is almost always embedded in a social network, and these networks provide rich contextual information that can be a boon to vision systems.Our goal is to build foundations for a new generation of computer vision systems that are 'socially aware'. These vision systems will exploit knowledge of the relationships between individuals and the social events that occur in the embedding online community, and in doing so they will exhibit significant performance gains over current technology. They will be trained discriminatively using the data embedded in existing online communities, and they will adapt in response to observations of how they are used by community members.Almost every image that is shared online is embedded in some form of online community, and any system that seeks to analyze and catalog such imagery will gain from the proposed research. We foresee benefits for communities that wish to share historical image archives, scientific image collections, forensic imagery, surveillance videos, and more. Also, while we focus on tools for searching and browsing imagery, our work will have the important effect of improving the quality and density of textual metadata. In this way, the research stands to benefit all members of an online community, including those with visual impairments.

该奖项是根据2009年《美国复苏与再投资法》（公法111-5）资助的。该项目代表了与基于内容的图像管理相关的计算机视觉研究的新范式 - 一个利用该技术与其所服务在线社区之间的共生。很明显，社区将受益于通过视觉技术启用的改进搜索和浏览工具，但我们认为相反同样正确。在线共享的视觉信息几乎总是嵌入在社交网络中，这些网络提供了丰富的上下文信息，这些信息可以成为视觉系统的福音。我们的目标是为“社会意识到”的新一代计算机视觉系统建立基础。这些愿景系统将利用对嵌入在线社区中的个人与社交事件之间关系的知识，在此过程中，它们将对当前技术表现出显着的性能提高。将使用嵌入在现有在线社区中的数据进行区分培训，并将适应社区成员如何使用它们的观察。几乎所有共享在线图像都以某种形式的在线社区中嵌入，并且任何旨在分析和分类此类图像的系统都将从提议的研究中获得。我们预见了希望共享历史图像档案，科学图像收集，法医图像，监视视频等的社区的利益。同样，尽管我们专注于搜索和浏览图像的工具，但我们的工作将具有提高文本元数据质量和密度的重要效果。这样，研究将使在线社区的所有成员（包括视觉障碍的人）中受益。