Multi-modal Content Retrieval and Presentation and Broadcast Content Generation for Mobile Environment

移动环境的多模式内容检索和演示以及广播内容生成

• 批准号: 14208036
• 负责人: TANAKA Katsumi
• 金额: $ 25.04万
• 依托单位: Kyoto University
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (A)
• 财政年份: 2002
• 资助国家: 日本
• 起止时间: 2002 至 2004
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-14208036/
• 关键词: cross-media retrieval; search engine; query relaxation; content composition; hypermedia; image retrieval; mobile information retrieval; query language; モバイル機器; WWW; 情報検索; ユーザ対話; SMIL; 情報統合; メタサーチ; クロスメディア; ユーザインタフェース; プレゼンテーション; 話題構造分析

The aim of the research is to realize advanced mobile content services by developing new software technologies for retrieving and presenting contents on mobile terminals. We have mainly researched and developed the following five technologies :(1)Research on autonomous content presentation :We have developed a passive-viewing method by automatically acquiring by mobile terminals and transforming operation manual information of appliance devices or Web retrieval results in general into CG animation content with synthesized speech. Also, in order to realize multi-modal retrieval of video data, we developed a querying method by sketching moving objects trace.(2)Research on cross-media meta-search engine :In order to retrieve heterogeneous media-type contents by simply giving a few keywords, we developed a meta-search engine based on the method called "query relaxation". The method relaxes a given query into two subqueries, and these subqueires are given to a text-based Web search engine a … More nd an image search engine, respectively. The intersection of these two search engines' retrieval results is returned as an answer The evaluation work shows that our method improves the recall ratio three times than conventional image search engine with loss of 20 % precision ratio.(3)Topic structure extraction from users' dialogue :We developed a Web retrieval system which retrieves related pages by the dialogue's topic structure extracted from users' dialogue such as chat and e-mails by mobile phones. As for Blog information, we developed a method to compute the "trust" degree of retrieved Web pages by analyzing their related Blog informatioa Also, we implemented a Blog listening system by which user can browse Web pages and listen to their related Blog information.(4)Dynamic composition of multimedia contents for mobile broadcasting :We designed and implemented a scripting language called MetaSMIL which aims to describe the way of composing several stream contents. The major characteristics of MetaSMIL are the expressive power of query embedding and integrity-constraint specification for composition. Also, in order to realize composition of Web pages and photo images captured by digital cameras or mobile phones, we developed a way to interconnect photo images and Web pages that are regarded as images.(5)Adding autonomous retrieval and presentation capabilities to Web :We developed a method to add autonomous retrieval and presentation capabilities to Web pages that are displayed on multiple screens, by which Web pages are autonomously presented and their related pages are retrieved by pasting a Web page to some screen devices. Less

该研究的目的是通过开发用于检索移动终端中内容和呈现内容的新软件技术来实现先进的移动内容服务。我们主要研究并开发了以下五种技术：（1）关于自主内容介绍的研究：我们通过通过移动终端自动获取设备设备或Web检索的操作手册信息，开发了一种被动查看方法，或者将Web检索的操作手册信息总体上带入CG动画内容，并使用合成的语音进行CG动画内容。另外，为了实现视频数据的多模式检索，我们通过绘制移动对象的素描来开发一种查询方法。（2）对跨媒体媒体元搜索引擎进行研究：为了通过简单地提供一些关键字来检索异质媒体型内容，我们开发了一种基于“元方法”的方法来检索异质的媒体型内容。该方法将给定的查询放松为两个子查询，这些子标题分别为基于文本的Web搜索引擎A…更多。这两个搜索引擎的检索结果的相交作为答案，评估工作表明，我们的方法比传统的图像搜索引擎提高了三倍，损失了20％的精度比。（3）主题结构从用户的对话中提取：我们开发了网络检索系统，通过从用户的对话中提取对话的对话，例如通过cath和e-e-e-e-e-e-e-e-e-e-e-Maild froce for the Interagion tobles for conteripal conteriage cortiage cotialev and calloge and catize coptial and for coties toce。 As for Blog information, we developed a method to compute the "trust" degree of retrieved Web pages by analyzing their related Blog informationioa Also, we implemented a Blog listening system by which user can browse Web pages and listen to their related Blog information.(4)Dynamic composition of multimedia contents for mobile broadcasting :We designed and implemented a scripting language called MetaSMIL which aims to describe the way of composing several stream contents. metasmil的主要特征是查询嵌入和完整性构成规范的表达能力。 Also, in order to realize composition of Web pages and photo images captured by digital cameras or mobile phones, we developed a way to interconnect photo images and Web pages that are considered as images.(5)Adding autonomous retrieval and presentation capabilities to Web :We developed a method to add autonomous retrieval and presentation capabilities to Web pages that are displayed on multiple screens, by which Web pages are autonomously presented and their related pages are retrieved通过将网页粘贴到某些屏幕设备上。较少的

项目成果

MWM : Retrieval and Automatic Presentation of Manual Data for Mobile Terminals

MWM：移动终端手动数据的检索和自动呈现

• 发表时间: 2002
• 期刊: Proceeding of The 13th International Conference on Database and Expert Systems Applications (DEXA2UQ2) (LNCS, Springer) 2453
• 作者: Masaki Shikata;Akiyo Nadamoto;Kazutoshi Sumiya;Katsumi Tanaka
• 通讯作者: Katsumi Tanaka

赤星祐平, 小山聡, 角谷和俊, 田中克己: "携帯端末による電子メール交換に基づくWeb検索"日本データベース学会Letters. 2・1. 111-114 (2003)

Yuhei Akahoshi、Satoshi Koyama、Kazutoshi Kakutani、Katsumi Tanaka：“基于使用移动终端的电子邮件交换的网络搜索”日本数据库协会 111-114 (2003)。

Querying Video Data by Spatio-Temporal Relationships of Moving Object Traces

通过运动物体轨迹的时空关系查询视频数据

• 发表时间: 2002
• 期刊: Visual and Multimedia Information Management (X.Zhou and P.Pu Eds.) (Kiuwer Academic Publishers)
• 作者: Chikashi Yajima;Yoshihiro Nakanishi;Katsumi Tanaka
• 通讯作者: Katsumi Tanaka

桑原昭裕, 小山聡, 角谷和俊, 田中克己: "マルチメディア・メタサーチのための質問変換と検索結果の統合"日本データベース学会Letters. 2・1. 55-58 (2003)

Akihiro Kuwabara、Satoshi Koyama、Kazutoshi Kakutani、Katsumi Tanaka：“多媒体元搜索的问题转换和搜索结果集成”日本数据库通讯会 2・1（2003 年）。

赤星 祐平, 小山 聡, 角谷 和俊, 田中 克己: "携帯端末による電子メール交換に基づくWeb検索"日本データベース学会 Letters (採録済み. 掲載予定). 2・1. (2003)

Yuhei Akahoshi、Satoshi Koyama、Kazutoshi Kakutani、Katsumi Tanaka：“基于使用移动终端的电子邮件交换的网络搜索”日本数据库通讯学会（已接受，待出版）（2003）。