Development of a high performance, compact Snapshot Hyperspectral Camera with light integrator array

开发具有光积分器阵列的高性能、紧凑型快照高光谱相机

• 批准号: 10384195
• 负责人: ARTUR G OLSZAK
• 金额: $ 25.2万
• 依托单位: ATTORIS, LLC
• 依托单位国家: 美国
• 财政年份: 2022
• 资助国家: 美国
• 起止时间: 2022-05-01 至 2024-04-30
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/10384195
• 关键词: 3-Dimensional; Americas; Area; Award; Biological; Businesses; Calibration; Cancer Diagnostics; Characteristics; Collection; Color; Communities; Complex; Computer software; Coupled; Custom; Data; Data Collection; Detection; Development; Devices; Diagnostic; Dimensions; Elements; Endoscopes; Engineering; Evaluation; Event; Feedback; Fluo 4; Fluorescence; Fundus photography; Geometry; Goals; Image; Imaging Device; Imaging technology; Investigation; Label; Legal patent; Light; Light Microscope; Lighting; Maps; Methods; Microscope; Microscopic; Modality; Names; Noise; Optics; Organism; Output; Paper; Patients; Performance; Photobleaching; Phototoxicity; Price; Procedures; Process; Research; Research Personnel; Resolution; Resources; Sampling; Scanning; Scientist; Side; Signal Transduction; Societies; Software Tools; Spectrometry; Spectrum Analysis; Speed; System; Techniques; Technology; Testing; Time; Translations; Validation; Work; base; biological systems; cellular imaging; clinical diagnostics; commercialization; cost; design; detector; experimental study; fluorophore; imager; imaging system; improved; innovation; insight; instrument; instrumentation; invention; light intensity; live cell imaging; malignant retina neoplasm; meetings; microscopic imaging; prototype; real-time images; retinal imaging; seminaphthorhodaminefluoride; sensor; spectrograph; temporal measurement

Development of a high performance, compact Snapshot Hyperspectral Camera with light integrator array. The overall goal of this research is to develop a compact, high dynamic range, snapshot hyperspectral camera for biomedical and biological applications. The technology is based on utilization of a TApered Light Integrator Array for Imaging Spectrometry. For the purposes of this application and name simplification we call the system TALIARIS. As the proposed development is a platform technology (complete system can be treated as a spectral camera easily coupled to microscopes as well as to endoscopes, fundus cameras and other imaging instruments) it can be used in fundamental cell signaling studies as well as medical diagnostics for example retinal imaging / cancer diagnostics. In this proposal though, the experimental focus will be limited to cell signaling in microscopic imaging. The proposed system offers faster frame rates and higher dynamic range (by 1+ orders of magnitude) than other current methods for hyperspectral and multi-spectral imaging of living systems, while still permitting diffraction- limited resolution. Snapshot feature in combination with high light collection efficiency (based on unique, recently patented array of light integrators for spectral imaging) greatly enhances a range of possible biological experiments (its characteristics include also low photobleaching, increased patient comfort at lower light intensities, etc.). The TALIARIS instrument is fully parallel so data at all wavelengths will be collected simultaneously from the entire field of view. Thus this approach has a great potential to overcome limitations of existing hyperspectral modalities, and enables real time imaging of multiple signaling processes in living systems. Towards this goal, our first aim will focus on the development of a proof of concept TALIARIS system and a prototype of array of miniature light integrators. The TALIARIS will transform a 3D spatial-spectral object cube to a 2D mapped image, which allows acquisition of entire 3D data cube in the snapshot mode. The core of the system is the custom-made array of miniature light integrators allowing collection of all light at the input and concentrating it at smaller output areas to create void spaces needed for spectral information. For low noise imaging, the proposed device will employ IRIS 15 camera from Photometrics (15Mpix sCMOS camera). The TALIARIS system will be optimized for throughput and will permit imaging in real time at 30+ frames/second, and 16-bit dynamic range. The proposed system, we will provide datacube dimensions spanning from 100x100x25 to 250x250x50 with spectral sampling of 5 nm over 470 – 670 spectral range. Spatial resolution and FOV are inherently connected with fore-optics and will depend on specific microscope objective being used in experiments. TALIARIS will be validated in microscopic imaging to obtain effective spatial resolution of 0.5 micron and 125 microns FOV. The second aim will focus on development of calibration and real-time linear unmixing procedures. This aim will lead to optimized performance in regard of resolution, spectral unmixing, and data collection for 3-dimensional imaging (x, y, ). This aim will also provide software tools capable of displaying both data cubes and pseudo- color unmixed images in real time. This last feature is critical for both live cell imaging as well as diagnostic applications, as it provides an immediate feedback during real time observations. In Aim 2, we will also test the TALIARIS spectrometer against currently available spectral imaging systems in several cell imaging applications. These experiments will focus on tests of dynamic biological systems, which are routinely being used in the lab of Dr. David Piston’s (collaborator on the project). We will be able to validate the results from the TALIARIS against Zeiss hyperspectral microscopic META imagers as well as other snapshot techniques like Image Mapping Spectrometers (IMS). System evaluations will utilize a variety of fluorophore combinations, starting with two-color pairs, moving to more complex combinations such as CFP/GFP/YFP/Fluo-4, and mCherry/SNARF- 1/Fura-Red.

开发具有光积分阵列的高性能快照高光谱摄像头。 这项研究的总体目标是开发紧凑，高动态范围，快照高光谱摄像头 用于生物医学和生物学应用。该技术基于锥形光积分器的利用 用于成像光谱的阵列。出于此应用程序和名称简化的目的，我们称之为系统 塔里亚里斯。由于拟议的开发是一种平台技术（完整的系统可以视为光谱 摄像机很容易与显微镜以及内窥镜，眼底摄像机和其他成像结合起来 仪器）可以用于基本的细胞信号研究以及医学诊断 视网膜成像 /癌症诊断。但是，在此提案中，实验重点将仅限于细胞信号 在微观成像中。 所提出的系统提供的帧速率比其他系统更快，动态范围更高（数量级以上） 当前的生活系统高光谱和多光谱成像的方法，同时仍允许衍射 - 有限的分辨率。快照功能与高光收集效率结合使用（基于独特的，最近 获得专利的光积分阵列用于光谱成像）极大地增强了一系列可能的生物学 实验（其特征还包括较低的光漂白，在较低光线下的患者舒适感增加 强度等）。 Taliaris仪器是完全平行的，因此将收集所有波长的数据 同样，从整个视野。这种方法具有克服局限性的巨大潜力 现有的高光谱方式，并在生活中实现多个信号过程的实时成像 系统。 为了实现这一目标，我们的第一个目标将集中于概念验证塔里亚里人系统的发展和 微型光积分阵列的原型。 Taliaris将转换3D空间光谱对象立方体 到2D映射的图像，该图像允许在快照模式下获取整个3D数据立方体。核心 系统是定制的微型照明集成器，允许在输入和 将其集中在较小的输出区域，以创建光谱信息所需的空间空间。对于低噪音 成像，提出的设备将使用光电图（15MPIX SCMOS摄像机）使用IRIS 15摄像头。这 Taliaris系统将用于吞吐量，并允许以30帧/秒的时间实时成像， 和16位动态范围。提出的系统，我们将提供来自 100x100x25至250x250x50在470 - 670光谱范围内具有5 nm的光谱采样。空间分辨率和 FOV固有地与前启动相关，并将取决于使用的特定显微镜目标 实验。 Taliaris将在微观成像中进行验证，以获得0.5的有效空间分辨率 微米和125微米FOV。 第二个目标将集中于校准和实时线性拆卸程序的开发。这个目标 在分辨率，光谱拆卸和数据收集方面可提高优化的性能 成像（x，y，）。该目标还将提供能够显示数据立方和伪的软件工具 - 实时颜色未混合图像。最后一个功能对于活细胞成像和诊断至关重要 应用程序，因为它在实时观察过程中提供了立即反馈。在AIM 2中，我们还将测试 在几个细胞成像应用中，针对当前可用的光谱成像系统的塔利亚利光谱仪。 这些实验将集中于动态生物系统的测试，这些测试通常在实验室中使用 David Piston博士（该项目的合作者）。我们将能够验证Taliaris的结果 反对蔡司高光谱微观元图像以及其他快照技术（例如图像） 映射光谱仪（IMS）。系统评估将利用各种荧光团组合，从 两色对，转变为更复杂的组合，例如CFP/GFP/YFP/Fluo-4和MCHERRY/SNARF- 1/fura-red。