Computational Transient Imaging: Instrumentation, Image Formation Models, Inverse Methods, and Applications

计算瞬态成像：仪器、图像形成模型、反演方法和应用

基本信息

批准号：
263273705
负责人：
Professor Dr.-Ing. Matthias Hullin
金额：
--
依托单位：
Department Elektrotechnik und Informatik
依托单位国家：
德国
项目类别：
Research Grants
财政年份：
2015
资助国家：
德国
起止时间：
2014-12-31 至 2019-12-31
项目状态：
已结题

来源：
https://gepris.dfg.de/gepris/projekt/263273705?language=en
关键词：
Computational Transient Imaging Instrumentation Image

项目摘要

The relatively young research direction of transient imaging deals with the time-resolved capture of non-stationary light distribution on macroscopic scales, or "videos of light in flight". Transient images are expected to enable a deeper understanding of, and elegant solutions to, many problems in computer vision, just as impulse responses have proven a versatile and valuable tool in the sciences and engineering. To date, the acquisition of transient images required very expensive and highly sensitive optical devices (ultrashort pulse lasers and streak cameras) and thus was reserved to a few highly specialized laboratories. The proposed project is based on our own development of a reconstruction technique of transient images from opto-electronical correlation measurements that are readily available from lock-in image sensors found in time-of-flight range cameras. The goal of our work is to better understand this alternative hardware platform for transient imaging, and to find answers to the following central questions:How can transient images be measured at a higher resolution, in shorter time and at reduced hardware cost? How can existing models and numerical methods make better use of the data sparsity inherent to transient signals, in order to obtain more reliable reconstructions? How can multi-path image formation models be inverted to solve long-standing computer vision problems? Which new application opportunities emerge astransient imaging becomes widely available?With this project, we will address all of these questions in an interdisciplinary way, with computation as the key enabler.

瞬态成像的相对年轻的研究方向涉及宏观尺度上非平稳光分布的时间分辨捕获，或“飞行中的光视频”。瞬态图像有望使计算机视觉中许多问题有更深入的理解和优雅的解决方案，就像脉冲响应已被证明是科学和工程学中的多功能和宝贵工具一样。迄今为止，瞬态图像的采集需要非常昂贵且高度敏感的光学设备（超短脉冲激光器和条纹摄像头），因此保留给一些高度专业的实验室。拟议的项目是基于我们自己开发从光电相关测量测量的瞬态图像的重建技术的开发，这些测量很容易从飞行器范围摄像机中的锁定图像传感器中获得。我们工作的目的是更好地了解瞬态成像的替代硬件平台，并找到以下中心问题的答案：如何以更高的分辨率，较短的时间和减少的硬件成本来测量瞬态图像？现有模型和数值方法如何更好地利用瞬态信号固有的数据稀疏性，以获得更可靠的重建？多路径图像形成模型如何倒置以解决长期的计算机视觉问题？出现了哪些新的应用程序机会，可以广泛使用Astransient Imaging？通过该项目，我们将以跨学科的方式解决所有这些问题，并以计算为关键推动器。

项目成果

期刊论文数量（6）

专著数量（0）

科研奖励数量（0）

会议论文数量（0）

专利数量（0）

4D imaging through spray-on optics

通过喷涂光学器件进行 4D 成像

DOI：
10.1145/3072959.3073589
发表时间：
2017
期刊：
ACM Transactions on Graphics (TOG)
影响因子：
0
作者：
J. Iseringhausen;B. Goldlücke;N. Pesheva;S. Iliev;A. Wender;M. Fuchs;M. B. Hullin
通讯作者：
M. B. Hullin

Snapshot difference imaging using correlation time-of-flight sensors

使用相关飞行时间传感器进行快照差异成像