RI: Toward Shape from Specular Reflections under Real-world Illumination

RI：现实世界照明下镜面反射的形状

• 批准号: 0712956
• 负责人: Todd Zickler
• 金额: $ 38万
• 依托单位: Harvard University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2007
• 资助国家: 美国
• 起止时间: 2007-09-01 至 2011-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0712956&HistoricalAwards=false
• 关键词: RI; Toward; Shape; Specular; Reflections; RI; Toward; Shape; Specular; Reflections

Proposal 0712956 PI: Todd ZicklerInstitution: Harvard UniversityTitle: RI: Toward Shape from Specular Reflections under Real-world IlluminationAbstract:The recovery of shape information from image data is a central problem in computer vision, and decades of research have led to the development of computational tools for inferring shape from a variety of visual cues, including shading, texture, color, and shadows. An important visual cue for shape is specular reflection. Specular(mirror-like) surfaces are abundant in both natural and man-made environments. Metal, glass, the wavy surface of a pond, and glazed ceramics are a few examples. Specular surfaces reflect incident light toward an observer without attenuation, and when they are curved, they present a distorted version of their illumination environment that contains very rich information about their shape. While perceptual studies suggest that humans make use of this visual cue, the underlying mechanisms are not yet known, and computational tools for inferring shape from specular reflections under real-world illumination do not yet exist. Instead, due to the complexity of the relationship between a specular shape and its images, previous analysis has been limited to controlled, unnatural environments and/or very limited types of surfaces. This proposal moves in a fundamentally different direction by specifically considering arbitrary smooth surfaces in uncontrolled, real-world illumination conditions. This seemingly difficult task is made manageable by a novel approach with two key components: 1) the consideration of far-field illumination environments in which the environment-surface distance is large relative to the relief of the surface; and 2) the analysis of ``specular flow''---the dense motion field on the image plane that is induced by the relative movement between a specular surface and its environment. This approach provides a unique balance between tractability and practical validity, and it may be a pivotal step in furthering our understanding of a powerful visual cue.Progress reports for this project will be regularly updated at http:\\www.eecs.harvard.edu\~zickler

提案0712956 PI：Todd Zicklerinstitution：Harvard Universitytitle：RI：从现实世界中的镜面反射朝向形状：从图像数据中恢复形状信息从图像数据中恢复是计算机视觉中的一个核心问题，并且数十年的研究导致了从各种视觉提示，包括视觉提示，色彩，色彩，色彩，彩色的颜色的计算工具，从而开发了计算工具。形状的重要视觉提示是镜面反射。在天然和人造环境中，镜面（类似镜面）表面都很丰富。金属，玻璃，池塘的波浪表面和釉面陶瓷就是一些例子。镜面表面反映了朝向观察者的事件光，而无需衰减，当它们弯曲时，它们会呈现出扭曲的照明环境，其中包含有关其形状的非常丰富的信息。虽然感知研究表明人类利用这种视觉提示，但尚不清楚潜在的机制，并且尚不存在从现实世界照明下从镜面反射中推断形状的计算工具。 相反，由于镜面形状及其图像之间关系的复杂性，先前的分析仅限于受控的，不自然的环境和/或表面非常有限的表面类型。该提案通过专门考虑在不受控制的现实照明条件下的任意平滑表面来沿根本不同的方向移动。这项看似艰巨的任务是通过具有两个关键组成部分的新型方法来管理的：1）考虑远场照明环境，其中环境表面距离相对于表面的缓解而言是较大的； 2）``镜面流动''---图像平面上密集的运动场的分析是由镜面表面及其环境之间的相对运动引起的。 这种方法在易处理性和实际有效性之间提供了独特的平衡，这可能是进一步了解我们对强大的视觉提示的关键一步。该项目的Progress报告将在http上定期更新：\\ www.eecs.harvard.harvard.edu \〜Zickler