Cross-media retrieval through collaborative use of image/audio signals and text data

通过协作使用图像/音频信号和文本数据进行跨媒体检索

• 批准号: 21300030
• 负责人: HASEYAMA Miki
• 金额: $ 10.32万
• 依托单位: Hokkaido University
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (B)
• 财政年份: 2009
• 资助国家: 日本
• 起止时间: 2009 至 2012
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-21300030/
• 关键词: 情報検索; 映像データ処理; 映像検索; メタデータ付与; メディア横断; 個人嗜好; 音楽信号処理; 映像意味理解; テキスト処理

We implemented an effective method for recommending the desired contents to a user. The method accepts an image, video or music clip as a query, and is based on search theory that can deal with ambiguous user requests that are unique to each image, video or music clip. Specifically, in order to implement this method, we narrow down the search results to the three media types of image, video and audio, and implement cross-media search, allowing the user to acquire the desired contents even in cases where they cannot express the same query using keywords or media of the identical type.

我们实施了一种向用户推荐所需内容的有效方法。该方法接受图像，视频或音乐剪辑作为查询，并且基于搜索理论，该理论可以处理每个图像，视频或音乐剪辑中唯一的模棱两可的用户请求。具体而言，为了实现此方法，我们将搜索结果缩小到图像，视频和音频的三种媒体类型，并实现交叉媒体搜索，从而使用户即使在无法使用相同类型的关键字或媒体表达相同的查询的情况下，也可以获取所需内容。

项目成果

A cross-modal approach for extracting semantic relationships of concepts from an image database

• DOI: 10.1109/icassp.2012.6288392
• 发表时间: 2012-03
• 期刊: 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
• 作者: Marie Katsurai;Takahiro Ogawa;M. Haseyama

Adaptive Single Image Superresolution Approach Using Support Vector Data Description

• DOI: 10.1155/2011/852934
• 发表时间: 2011-03
• 期刊: EURASIP Journal on Advances in Signal Processing
• 影响因子: 1.9
• 作者: Takahiro Ogawa;M. Haseyama

Super-Resolution Reconstruction for Spatio-Temporal Resolution Enhancement of Video Sequences

• DOI: 10.1587/transinf.e95.d.2355
• 发表时间: 2012-09
• 期刊: IEICE Trans. Inf. Syst.
• 作者: Miki Haseyama;D. Izumi;Makoto Takizawa

Cross Low-Dimension Pursuit for Sparse Signal Recovery from Incomplete Measurements Based on Permuted Block Diagonal Matrix

• DOI: 10.1587/transfun.e94.a.1793
• 发表时间: 2011-09
• 期刊: IEICE Trans. Fundam. Electron. Commun. Comput. Sci.
• 作者: Zaixing He;Takahiro Ogawa;M. Haseyama

Linear time decoding of real-field codes over high error rate channels

• DOI: 10.1109/icassp.2011.5946695
• 发表时间: 2011-05
• 期刊: 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
• 作者: Zaixing He;Takahiro Ogawa;M. Haseyama