AF: RI: Medium: Collaborative Research: Understanding and Improving Optimization in Deep and Recurrent Networks

AF：RI：中：协作研究：理解和改进深度和循环网络的优化

基本信息

批准号：
1764033
负责人：
Moritz Hardt
金额：
$ 32.82万
依托单位：
University of California-Berkeley
依托单位国家：
美国
项目类别：
Standard Grant
财政年份：
2018
资助国家：
美国
起止时间：
2018-08-01 至 2021-12-31
项目状态：
已结题

来源：
https://www.nsf.gov/awardsearch/showAward?AWD_ID=1764033&HistoricalAwards=false
关键词：
AF RI Medium Collaborative Research

项目摘要

Machine learning using deep neural networks has recently demonstrated broad empirical success. Despite this success, the optimization procedures that fit deep neural networks to data are still poorly understood. Besides playing a crucial role in fitting deep neural networks to data, optimization also strongly affects the model's ability to generalize from training examples to unseen data. This project will establish a working theory for why and when large artificial neural networks train and generalize well, and use this theory to develop new optimization methods. The utility of the new methods will be demonstrated in applications involving language, speech, biological sequences and other sequence data. The project will involve training of graduate and undergraduate students, and the project leaders will offer tutorials aimed at both the machine learning community, and other researchers and engineers using machine learning tools. In order to establish a theory of why and when non-convex optimization works well when training deep networks, both empirical top-down and analytic bottom-up approaches will be pursued. The top-down approach will involve phenomenological analysis of large scale deep models used in practice, both when presented with real data, and when presented with data specifically crafted to test the behavior of the network. The bottom-up approach will involve precise analytic investigation from increasingly more complex models, starting with linear models, and non-convex matrix factorization, progressing through linear neural networks, models with a small number of hidden layers, and eventually reaching deeper and more complex networks. The theory developed aims to be both explanatory and actionable, and will be used to derive new optimization methods and modifications to architectures that aid in optimization and generalization. A particularly important testbed is the case of recurrent neural networks. Recurrent neural networks are powerful sequence models that maintain state as they process an input sequence and are used for sequence data. Particularly challenging to optimize, recurrent neural networks still leave much room for a stronger principled understanding, which the project aims to provide.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

使用深度神经网络的机器学习最近取得了广泛的经验成功。尽管取得了如此成功，但将深度神经网络与数据相匹配的优化过程仍然知之甚少。除了在深度神经网络与数据的拟合方面发挥着至关重要的作用之外，优化还强烈影响模型从训练样本泛化到未见过的数据的能力。该项目将建立一个工作理论，解释大型人工神经网络为何以及何时能够良好地训练和泛化，并利用该理论开发新的优化方法。新方法的实用性将在涉及语言、语音、生物序列和其他序列数据的应用中得到证明。该项目将涉及对研究生和本科生的培训，项目负责人将为机器学习社区以及使用机器学习工具的其他研究人员和工程师提供教程。为了建立关于非凸优化在训练深度网络时为何以及何时发挥良好作用的理论，将采用经验自上而下和分析自下而上的方法。自上而下的方法将涉及对实践中使用的大规模深度模型的现象学分析，无论是在提供真实数据时，还是在提供专门为测试网络行为而设计的数据时。自下而上的方法将涉及对日益复杂的模型进行精确的分析研究，从线性模型和非凸矩阵分解开始，通过线性神经网络、具有少量隐藏层的模型，最终达到更深、更复杂的目标网络。所开发的理论旨在具有解释性和可操作性，并将用于推导新的优化方法和对有助于优化和泛化的架构的修改。一个特别重要的测试平台是循环神经网络。循环神经网络是强大的序列模型，在处理输入序列并用于序列数据时保持状态。循环神经网络的优化尤其具有挑战性，但仍然为该项目旨在提供的更强有力的原则性理解留下了很大的空间。该奖项反映了 NSF 的法定使命，并通过使用基金会的智力优点和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

期刊论文数量（6）

专著数量（0）

科研奖励数量（0）

会议论文数量（0）

专利数量（0）

Revisiting Design Choices in Proximal Policy Optimization

DOI：
发表时间：
2020-09
期刊：
ArXiv
影响因子：
0
作者：
Chloe Ching-Yun Hsu;Celestine Mendler-Dünner;Moritz Hardt
通讯作者：
Chloe Ching-Yun Hsu;Celestine Mendler-Dünner;Moritz Hardt

Towards a Dimension-Free Understanding of Adaptive Linear Control

对自适应线性控制的无量纲理解

DOI：
发表时间：
2021
期刊：
Proceedings of Thirty Fourth Conference on Learning Theory
影响因子：
0
作者：
Perdomo, Juan C;Simchowitz, Max;Agarwal, Alekh;Bartlett, Peter
通讯作者：
Bartlett, Peter

Online Learning of Unknown Dynamics for Model-Based Controllers in Legged Locomotion

DOI：
10.1109/lra.2021.3108510
发表时间：
2021-10
期刊：
IEEE Robotics and Automation Letters
影响因子：
5.2
作者：
Yu Sun;Wyatt Ubellacker;Wen-Loong Ma;Xiang Zhang;Changhao Wang;Noel Csomay-Shanklin;M. Tomizuka;K. Sreenath;A. Ames
通讯作者：
Yu Sun;Wyatt Ubellacker;Wen-Loong Ma;Xiang Zhang;Changhao Wang;Noel Csomay-Shanklin;M. Tomizuka;K. Sreenath;A. Ames

Test-Time Training with Self-Supervision for Generalization under Distribution Shifts