Video summarization based on key-places clustering and logical story units

基于关键地点聚类和逻辑故事单元的视频摘要

• 批准号: 227071-2011
• 负责人: Gagnon, Langis
• 金额: $ 1.6万
• 依托单位: Centre de recherche informatique de Montréal
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2015
• 资助国家: 加拿大
• 起止时间: 2015-01-01 至 2016-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=570234
• 关键词: Video; summarization; based; key; places

Video content can be accessed by retrieval or browsing. Retrieval is useful when the user know exactly what he/she is looking for. Browsing is useful when the user only needs an overview of the content. In a sense, retrieval is like looking for something from the index of a book while browsing is from the table of content (ToC). Video summarization is the process of generating an audio-visual ToC to help quickly capture the content of a video. The proposed research program targets video summarization. The objective is to develop and integrate multimodal analysis tools to segment a video into logical story units (LSU) based on a new automatic key-places clustering. This will be integrated into a LSU-based GUI, rather than a standard shot- or key-frame-based one, that provides a graphical ToC to the user with the possibility to access parts of the video from it. The GUI should be adaptable to allow user to access video based on his preferences and compatible with the TRECVID evlauation. Video indexing is a very active research topic. Many researches are still needed to reduce the so-called "semantic gap" between low-level features and human understanding. This project wants to be a contribution to this important field but through the video summarization "lense". In particular, a LSU-based videosummarization GUI will be an original contribution of the research program for the advancement of knowledge in the field of visual content usability and for the information technology sector.

可以通过检索或浏览访问视频内容。当用户确切地知道他/她正在寻找什么时，检索很有用。当用户只需要概述内容时，浏览是有用的。从某种意义上说，检索就像在浏览中从书籍的索引中寻找东西（TOC）。视频摘要是生成视听TOC的过程，以帮助快速捕获视频的内容。 拟议的研究计划针对视频摘要。目的是开发和整合 多模式分析工具将视频分割为基于新自动的逻辑故事单元（LSU） 键空间聚类。这将集成到基于LSU的GUI中，而不是标准镜头或 基于密钥框架的一个，为用户提供图形TOC，并有可能从中访问视频的一部分。 GUI应该适应能够允许用户根据视频的喜好访问视频，并与Trecvid Evlauation兼容。 视频索引是一个非常活跃的研究主题。仍然需要许多研究来减少所谓的 低级特征和人类理解之间的“语义差距”。该项目希望通过视频摘要“ Lense”为这一重要领域做出贡献。特别是，基于LSU的视频仪式GUI将是研究计划的原始贡献，以提高视觉内容可用性和信息技术领域的知识。