RI: Small: Collaborative Research: Structured Inference for Low-Level Vision

RI：小型：协作研究：低级视觉的结构化推理

• 批准号: 1618021
• 负责人: Ayan Chakrabarti
• 金额: $ 19.46万
• 依托单位: Toyota Technological Institute at Chicago
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2016
• 资助国家: 美国
• 起止时间: 2016-07-01 至 2018-01-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1618021&HistoricalAwards=false
• 关键词: RI; Small; Collaborative; Research; Structured

Vision is a valuable sensing modality because it is versatile. It lets humans navigate through unfamiliar environments, discover assets, grasp and manipulate tools, react to projectiles, track targets through clutter, interpret body language, and recognize familiar objects and people. This versatility stems from low-level visual processes that somehow produce, from ambiguous retinal measurements, useful intermediate representations of depth, surface orientation, motion, and other intrinsic scene properties. This project establishes a mathematical and computational foundation for similar low-level processing in machines. The key challenge it addresses is how to usefully encode and exploit the fact that, visually, the world exhibits substantial intrinsic structure. By advancing understanding of low-level vision in machines, this project makes progress toward computer vision systems that can compare to vision in humans, in terms of accuracy, reliability, speed, and power-efficiency.This research revisits low-level vision, and develops a comprehensive framework that possesses a common abstraction for information from different optical cues; the ability to encode scene structure across large regions and at multiple scales; implementation as parallel and distributed processing; and large-scale end-to-end learnability. The project approaches low-level vision as a structured prediction task, with ambiguous local predictions from many overlapping receptive fields being combined to produce a consistent global scene map that spans the visual field. The structured prediction models are different from those used for categorical tasks such as semantic segmentation, because they are specifically designed to accommodate the distinctive requirements and properties of low-level vision: continuous-valued output spaces; ambiguities that may form equiprobable manifolds; extreme scale variations; and global scene maps with higher-order piecewise smoothness. By strengthening the computational foundations of low-level vision, this project strives to enable many kinds of vision systems that are more efficient and more versatile, and it strives to have impacts across the breadth of computer vision.

视觉是一种有价值的传感方式，因为它具有多种用途。它可以让人类在陌生的环境中导航、发现资产、掌握和操作工具、对投射物做出反应、在混乱中跟踪目标、解释肢体语言以及识别熟悉的物体和人。这种多功能性源于低级视觉过程，这些过程以某种方式从模糊的视网膜测量中产生有用的深度、表面方向、运动和其他内在场景属性的中间表示。该项目为机器中类似的低级处理建立了数学和计算基础。它解决的关键挑战是如何有效地编码和利用这样一个事实：从视觉上看，世界展现出实质性的内在结构。通过加深对机器低级视觉的理解，该项目在计算机视觉系统方面取得了进展，在准确性、可靠性、速度和能效方面可与人类视觉相媲美。这项研究重新审视了低级视觉，并开发一个综合框架，对来自不同光学线索的信息拥有共同的抽象；跨大区域和多尺度编码场景结构的能力；作为并行和分布式处理实现；和大规模端到端的可学习性。该项目将低级视觉视为结构化预测任务，将来自许多重叠感受野的模糊局部预测组合起来，生成跨越视野的一致的全局场景图。结构化预测模型不同于用于语义分割等分类任务的模型，因为它们是专门为适应低级视觉的独特要求和属性而设计的：连续值输出空间；可能形成等概率流形的歧义；极端尺度变化；以及具有高阶分段平滑度的全局场景图。通过加强低级视觉的计算基础，该项目致力于实现更高效、更通用的多种视觉系统，并努力在计算机视觉领域产生影响。