Research on 'Database Vision' based on media cooperative recognition and purposive utilization

基于媒体协同识别与有目的利用的“数据库视觉”研究

• 批准号: 03452163
• 负责人: SAKAUCHI Masao
• 金额: $ 4.35万
• 依托单位: University of Tokyo
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for General Scientific Research (B)
• 财政年份: 1991
• 资助国家: 日本
• 起止时间: 1991 至 1992
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/en/grant/KAKENHI-PROJECT-03452163/
• 关键词: Image Processing; Multi-media Database; Database Vision; Media Fusion; Drama Analysis; Keyword Extraction; マルチメディア; メディア協調; デ-タベ-スビジョン; 状態遷移モデル

In this research project, a new approach to realize effective multi-media database systems, named 'Database Vision' framework, has been successfully proposed, where two new ideas of automatic image recognition based on media fusion and purposive and adaptive utilization of achieved data model, playa important role. The following concrete results have been obtained.(1) Proposal of the framework for database vision approach and purposive utilization: In this sub-project, a general purpose automatic image understanding method using 'state-transition' mechanism has been developed and implemented, which provides flexible image date models adaptively applicable to various purposes.(2) Development of an automatic drama movie understanding system based on media fusion: A concrete moving image understanding system using cooperative recognition of images, documents and voice, has been implemented to successfully realize difficult 'scene decomposition' and human identification for real TV drama movies.(3) Realization of purposive image databases: Two full-automatic image databases, one for sports scene still images and the other for TV scene moving images, have been realized and successfully evaluated by experiments.(4) A new-type of Image Sequence Analysis Method using color multiplextion has been invented and effectiveness has been revealed by experiments.

在该研究项目中，成功提出了一种实现有效多媒体数据库系统的新方法，称为“数据库视觉”框架，其中基于媒体融合的自动图像识别和有目的地自适应利用已获得的数据模型的两种新思想，发挥着重要作用。取得了以下具体成果。(1)提出了数据库视觉方法和有目的利用的框架：在该子项目中，开发并实现了一种使用“状态转换”机制的通用自动图像理解方法，该方法提供灵活的图像数据模型，自适应地适用于各种目的。（2）开发基于媒体融合的自动戏剧电影理解系统：使用图像、文档和语音协同识别的具体运动图像理解系统，已成功实现困难的解决方案。 “场景分解”和人体识别（3）有目的图像数据库的实现：已经实现了两个全自动图像数据库，一个是体育场景静止图像，另一个是电视场景运动图像，并通过实验评估成功。（4）发明了使用颜色复用的新型图像序列分析方法，并通过实验证明了其有效性。

项目成果

Yoshitomo Yaginuma, Masao Sakauchi: "Human Extraction from the Drama Scene" Monthly Journal of Institute of Industrial Science, University of Tokyo. Vol.44. 26-28 (1992)

八木沼义智、坂内正雄：《从戏剧场景中提取人》东京大学产业科学研究所月刊。

山根 淳,坂内 正夫: "キ-ワ-ド自動抽出を考慮した画像デ-タベ-ス" 情報処理学会コンピュ-タビジョン研究会資料. CD73ー1. (1991)

Jun Yamane，Masao Sakauchi：“考虑自动关键词提取的图像数据库”日本信息处理学会计算机视觉研究组材料 CD73-1。

Masao Sakauchi: "Perspective of Multi-media Database based on Image Understanding" Proceeding of International Workshop on Next Generation of Industrial Fuzzy Technology. 155-167 (1992)

Masao Sakauchi：“基于图像理解的多媒体数据库视角”下一代工业模糊技术国际研讨会论文集。

柳沼 良知、坂内 正夫: "ドラマシーンからの人物の抽出" 生産研究. 44. 26-28 (1992)

Yoshichi Yaginuma、Masao Sakauchi：“戏剧场景中的人物提取”制作研究 44. 26-28 (1992)。

Masao Sakauchi: "Image ans Multimedia Database" The Journal of the Institute of Television Engineers of Japan. Vol.46. 1474-1479 (1992)

Masao Sakauchi：“图像与多媒体数据库”日本电视工程师学会杂志。