Avatar-Guided Estimation of Human Shape and Motion

虚拟形象引导的人体形状和运动估计

• 批准号: 0208965
• 负责人: Robert Collins
• 金额: $ 37.01万
• 依托单位: Carnegie-Mellon University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2002
• 资助国家: 美国
• 起止时间: 2002-08-01 至 2006-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0208965&HistoricalAwards=false
• 关键词: Avatar; Guided; Estimation; Human; Shape

We propose a research program to develop vision algorithms that infer human form and action from video sequences. The main feature of the approach is the use of an animated humanoid avatar to provide strong expectations on body shape and motion. A temporal sequence of body silhouette images is collapsed using line projections into four two-dimensional patterns that can be analyzed using robust signal processing techniques. To identify activities, patterns generated from video of a person are matched against spatio-temporal prototypes generated from the humanoid avatar. A moment-based method for coarse temporal and spatial pattern alignment brings model and data patterns into registration, so that they can be compared to classify viewpoint and activity. The resulting coarse alignment predicts 2D body topology and occlusion in each video frame, which enables a 2D nonrigid shape matching method based on thin-plate splines to identify and delineate body parts in each image. The avatar data also predicts which body dimension measurements can be made most reliably in which image frames, leading to efficient and accurate recovery of 3D body shape, pose and motion. We initially plan to focus on observations of human gait. Gait analysis shares many of the same challenges as the general activity analysis problem, namely high degree of freedom articulated motion, occlusion of body parts from 2D viewpoints, and idiosyncratic performance by different individuals. At the same time, the periodic nature of the activity simplifies temporal alignment of model and data sequences, and improves overall resiliance to noisy data. Success in vision-based gait analysis would enable applications ranging from motion capture for orthopedics to computation of human biometrics for smart rooms and surveillance.

我们提出了一个研究计划来开发视觉算法，从视频序列中推断人类的形态和动作。 该方法的主要特点是使用动画人形化身来提供对身体形状和运动的强烈期望。 使用线投影将身体轮廓图像的时间序列折叠成四个二维图案，可以使用稳健的信号处理技术对其进行分析。 为了识别活动，将从人的视频生成的模式与从人形化身生成的时空原型进行匹配。 用于粗时空模式对齐的基于矩的方法将模型和数据模式进行配准，以便可以对它们进行比较以对观点和活动进行分类。 由此产生的粗对齐可以预测每个视频帧中的 2D 身体拓扑和遮挡，从而实现基于薄板样条的 2D 非刚性形状匹配方法来识别和描绘每个图像中的身体部位。 化身数据还可以预测在哪些图像帧中可以最可靠地进行哪些身体尺寸测量，从而高效、准确地恢复 3D 身体形状、姿势和运动。 我们最初计划重点关注人类步态的观察。 步态分析与一般活动分析问题面临许多相同的挑战，即高自由度的关节运动、从 2D 角度观察身体部位的遮挡以及不同个体的特殊表现。 同时，活动的周期性性质简化了模型和数据序列的时间对齐，并提高了对噪声数据的整体弹性。 基于视觉的步态分析的成功将使从骨科运动捕捉到智能房间和监控的人体生物识别计算等应用成为可能。