Visualization and summarization of Omnidirectional surveillance Video by Spatio-temporal Indexing

时空索引全向监控视频可视化总结

基本信息

批准号：
14380163
负责人：
BABAGUCHI Noboru
金额：
$ 9.73万
依托单位：
Osaka University
依托单位国家：
日本
项目类别：
Grant-in-Aid for Scientific Research (B)
财政年份：
2002
资助国家：
日本
起止时间：
2002 至 2003
项目状态：
已结题

项目摘要

For surveillance video given from an omnidirectional vision sensor, the goal of this research project is to build a new media system that is capable of visualizing the whole contents by coordinating temporal and spatial representation and summarizing the video by collecting significant scenes. For this purpose, we performed the following research topics and have obtained valuable knowledge and insights.1)Development of processing tools for high-vision omnidirectional vision sensorsA high-resolution ominidirectional sensor with a high-vision camera was introduced and real-time video transformation tools, e.g. generation of perspective images, panoramic images and zoom images were implemented. Also a model of an indoor environment where the sensor was located at its center was constructed.2)Event detection and spatio-temporal indexingAlgorithms for detecting the region of a person with background subtraction and for estimating the two-dimensional position of him/her based on coordinates of his/her legs and head were designed. Viewing IN, OUT, MOVE and STAY as events of the person, we realized event based spatio-temporal indexing. It is confirmed that the spatio-temporal indexing is suitable for surveillance applications.3)Construction of a prototype system for visualization and summarization of surveillance videoWe constructed a prototype system by taking advantage of event based spatio-temporal indexing. To make a viewer easy to understand what event has taken place, the system offers the time-line, spatial map, speed graph and video browsing. In addition, the effectiveness of this system was demonstrated by applying it to actual convenience store environments.

对于来自全向视觉传感器的监视视频，该研究项目的目的是构建一个新的媒体系统，能够通过协调时间和空间代表来可视化整体内容，并通过收集重要场景来总结视频。为此，我们执行了以下研究主题，并获得了宝贵的知识和见解。1）引入了高视觉传感器的高视觉全向视觉传感器的加工工具，并引入了高视觉摄像头的高分辨率imiriendirectional Sensor，并引入了实时视频转换工具，例如实现了透视图像，全景图像和变焦图像的生成。也是构建传感器位于其中心的室内环境的模型。2）事件检测和时空索引索引索引algorithms，用于检测背景减法的人的区域，用于估算他/基于他/她的二维位置在他/她的双腿和头部的坐标上设计了。我们探讨，移动并留下来作为人的事件，我们意识到基于事件的时空索引。可以证实，时空索引适用于监视应用。3）构建一种原型系统，用于可视化和汇总监视视频的构造，通过利用基于事件的时空索引来构建了原型系统。为了使观众易于理解发生了什么事件，系统提供了时间表，空间地图，速度图和视频浏览。此外，通过将其应用于实际的便利店环境来证明该系统的有效性。