AitF: FULL: Collaborative Research: PEARL: Perceptual Adaptive Representation Learning in the Wild

AitF：FULL：协作研究：PEARL：野外感知自适应表示学习

• 批准号: 1535987
• 负责人: Mehryar Mohri
• 金额: $ 40万
• 依托单位: New York University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2015
• 资助国家: 美国
• 起止时间: 2015-09-01 至 2021-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1535987&HistoricalAwards=false
• 关键词: AitF; FULL; Collaborative; Research; PEARL

Vast amounts of digitized images and videos are now commonly available, and the advent of search engines has further facilitated their access. This has created an exceptional opportunity for the application of machine learning techniques to model human visual perception. However, the data often does not conform to the core assumption of machine learning that training and test images are drawn from exactly the same distribution, or "domain." In practice, the training and test distributions are often somewhat dissimilar, and distributions may even drift with time. For example, a "dog" detector trained on Flickr may be tested on images from a wearable camera, where dogs are seen in different viewpoints and lighting conditions. The problem of compensating for these changes--the domain adaptation problem--must therefore be addressed both in theory and in practice for algorithms to be effective. This problem is not just a second-order effect and its solution does not constitute a small increase in performance. Ignoring it can lead to dramatically poor results for algorithms "in the field."This project will develop a core suite of theory and algorithms for PErceptual Adaptive Representation Learning (PEARL), which, when given a new task domain, and previous experience with related tasks and domains, will provide a learning architecture likely to achieve optimal generalization on the new task. We expect PEARL to have a significant impact on the research community by providing a much-needed theoretical and computational framework that takes steps toward unifying the subfields of domain adaptation theory and domain adaptation practice. Our theoretical and practical advancements will impact many application areas by allowing the use of pre-trained perceptual models (visual and otherwise) in new situations and across space and time. For example, in mobile technology and robotics, PEARL will help personal assistants and robots better adapt their perceptual interfaces to individual users and particular situated environments. At the core of this project are three main research thrusts: 1) making theoretical advances for domain adaptation by developing generalized discrepancy distance minimization; 2) using the theoretical guarantees of generalized discrepancy distance to develop algorithms for key adaptation scenarios of deep perceptual representation learning, domain adaptation with active learning, and time-dependent adaptation; 3) advancing the theory and developing algorithms for the multiple-source adaptation scenario. In addition to our core aims, we plan to implement our algorithms within a scalable open-source framework, and evaluate our algorithms on large-scale visual data sets.

现在，大量的数字化图像和视频已随处可见，搜索引擎的出现进一步方便了它们的访问。这为应用机器学习技术来模拟人类视觉感知创造了绝佳的机会。然而，数据通常不符合机器学习的核心假设，即训练和测试图像是从完全相同的分布或“域”中提取的。在实践中，训练和测试分布通常有些不同，分布甚至可能随时间漂移。例如，可以在可穿戴相机的图像上测试在 Flickr 上训练的“狗”检测器，其中可以在不同的视角和照明条件下看到狗。因此，补偿这些变化的问题（领域适应问题）必须在理论和实践中得到解决，以使算法有效。这个问题不仅仅是二阶效应，其解决方案并不构成性能的小幅提升。 忽略它可能会导致算法“在该领域”的结果非常糟糕。该项目将为感知自适应表示学习（PEARL）开发一套核心理论和算法，当给定一个新的任务领域以及相关的先前经验时，任务和领域，将提供一个可能在新任务上实现最佳泛化的学习架构。我们期望 PEARL 通过提供急需的理论和计算框架来对研究界产生重大影响，该框架将采取措施统一领域适应理论和领域适应实践的子领域。我们的理论和实践进步将通过允许在新情况下跨空间和时间使用预先训练的感知模型（视觉和其他）来影响许多应用领域。例如，在移动技术和机器人技术中，PEARL 将帮助个人助理和机器人更好地适应个人用户和特定环境的感知界面。 该项目的核心是三个主要研究方向：1）通过发展广义差异距离最小化，在领域适应方面取得理论进展； 2）利用广义差异距离的理论保证，开发深度感知表示学习、主动学习领域适应、时间相关适应等关键适应场景的算法； 3）推进多源适应场景的理论并开发算法。除了我们的核心目标之外，我们还计划在可扩展的开源框架中实现我们的算法，并在大规模视觉数据集上评估我们的算法。