RI: Small: Object Detection, Pose Estimation, and Semantic Segmentation Using 3D Wireframe Models

RI：小：使用 3D 线框模型进行物体检测、姿势估计和语义分割

基本信息

批准号：
1527340
负责人：
Rene Vidal
金额：
$ 45.02万
依托单位：
Johns Hopkins University
依托单位国家：
美国
项目类别：
Continuing Grant
财政年份：
2015
资助国家：
美国
起止时间：
2015-09-01 至 2019-08-31
项目状态：
已结题

来源：
https://www.nsf.gov/awardsearch/showAward?AWD_ID=1527340&HistoricalAwards=false
关键词：
RI Small Object Detection Pose

项目摘要

Humans can recognize a wide variety of object categories in an image, even in the midst of occlusion and clutter, and in spite of significant variability in the objects' shape, size, appearance, and pose. While automatic object recognition systems in computer vision have seen great progress over the past decade, state-of-the-art methods rely primarily on 2D representations of object categories, which cannot capture large variations in the objects' shape and pose. This project develops new 3D representations of objects that are general enough to describe the shape of a wide variety of object categories, yet simple enough so that they can be learned efficiently from a collection of 2D images, and used for detecting and segmenting objects in new images. This project can impact many research areas, including image search, autonomous navigation, medical diagnostic tools, surveillance and robotics.This project develops a new class of 3D wireframe models for view-invariant object detection, fine-grained pose estimation, and semantic segmentation. A wireframe model is a sparse collection of 3D points, edges and surface normals defined only at a few points on the boundaries of the 3D object. The project develops methods for learning wireframe models from 2D images of multiple object categories, methods for learning deformable wireframe models that capture intra-class shape variations across object categories, methods for integrating appearance information into wireframe models, and methods for semantic segmentation based on wireframe models.

即使在遮挡和杂乱的情况下，并且尽管对象的形状、大小、外观和姿势存在显着变化，人类仍可以识别图像中的各种对象类别。虽然计算机视觉中的自动对象识别系统在过去十年中取得了巨大进步，但最先进的方法主要依赖于对象类别的 2D 表示，而这无法捕获对象形状和姿势的巨大变化。该项目开发了新的对象 3D 表示，这些表示足够通用，可以描述各种对象类别的形状，但又足够简单，可以从 2D 图像集合中有效地学习它们，并用于以新的方式检测和分割对象。图像。该项目可以影响许多研究领域，包括图像搜索、自主导航、医疗诊断工具、监视和机器人技术。该项目开发了一类新型 3D 线框模型，用于视图不变对象检测、细粒度姿态估计和语义分割。线框模型是仅在 3D 对象边界上的几个点处定义的 3D 点、边缘和表面法线的稀疏集合。该项目开发了从多个对象类别的 2D 图像中学习线框模型的方法、学习捕获跨对象类别的类内形状变化的可变形线框模型的方法、将外观信息集成到线框模型中的方法以及基于线框的语义分割方法模型。