Collaborative Research: Sparse Optimization for Machine Learning and Image/Signal Processing

协作研究：机器学习和图像/信号处理的稀疏优化

• 批准号: 2208386
• 负责人: Yuesheng Xu
• 金额: $ 17.11万
• 依托单位: Old Dominion University Research Foundation
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2022
• 资助国家: 美国
• 起止时间: 2022-08-15 至 2025-07-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2208386&HistoricalAwards=false
• 关键词: Collaborative; Research; Sparse; Optimization; Machine

Data sets involved in information technology, nanotechnology, biotechnology, civil infrastructure, environmental science, and other important areas are often extremely large. Due to growing quantities of data and related model sizes, demands for more competent data processing models continue to increase. Data sets in applications often have certain embedded sparsity structures, in the sense that their essential intrinsic characteristics can be represented by smaller amounts of information. Motivated by this observation, the aim of this project is to develop computationally efficient methods for non-smooth and non-convex optimization by exploring sparsity structures embedded in data sets. The investigators anticipate that the outcomes of this project will be of use in many application areas. The research and associated educational components in this project are expected to provide undergraduate and graduate students rigorous training so that they will have the skill sets needed to face the scientific and technological challenges of the big data era. This project will address several critical issues in non-smooth, non-convex optimization that result from sparse modeling of data in a range of applications, including machine learning and sparse image/signal restoration. For both learning and image/signal restoration, proper sparse regularization models will be developed. Suitable sparsity promoting functions will be designed for use in forming regularization terms, and appropriate bases/transforms will be constructed so that the resulting regularization algorithms compel their solutions to be sparse. For machine learning, appropriate reproducing kernel Banach spaces will be built up to allow for the representation of complex and rich geometric and topological structures of data and hence lead to improved learning outcomes. Representer theorems of the resulting learning methods in these spaces will be established so that the learning solutions can be expressed as a combination of a finite number of kernel sessions with the number equal to that of the data points used in training even though the hypothesis space is of infinite dimension. Geometric features of these spaces will be employed to induce sparsity of the learning solutions. The construction of bases or transforms via machine learning from data is expected to lead to improved methods for image/signal restoration.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

涉及信息技术、纳米技术、生物技术、民用基础设施、环境科学和其他重要领域的数据集往往非常庞大。由于数据量和相关模型大小的不断增长，对更强大的数据处理模型的需求不断增加。应用程序中的数据集通常具有某些嵌入的稀疏结构，从某种意义上说，它们的基本内在特征可以用更少量的信息来表示。受这一观察的启发，该项目的目标是通过探索数据集中嵌入的稀疏结构来开发计算有效的非平滑和非凸优化方法。研究人员预计该项目的成果将用于许多应用领域。该项目的研究和相关教育部分预计将为本科生和研究生提供严格的培训，使他们具备面对大数据时代的科学和技术挑战所需的技能。 该项目将解决非平滑、非凸优化中的几个关键问题，这些问题是由一系列应用中的数据稀疏建模引起的，包括机器学习和稀疏图像/信号恢复。对于学习和图像/信号恢复，将开发适当的稀疏正则化模型。将设计合适的稀疏性促进函数以用于形成正则化项，并且将构造合适的基/变换，以便所得到的正则化算法迫使其解决方案是稀疏的。对于机器学习，将建立适当的再现内核巴拿赫空间，以允许表示复杂且丰富的数据几何和拓扑结构，从而改善学习结果。将在这些空间中建立所得学习方法的表示定理，以便学习解决方案可以表示为有限数量的内核会话的组合，其数量等于训练中使用的数据点的数量，即使假设空间是无限维度的。这些空间的几何特征将用于诱导学习解决方案的稀疏性。通过机器学习从数据中构建基础或转换预计将改进图像/信号恢复方法。该奖项反映了 NSF 的法定使命，并通过使用基金会的智力优点和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Convergence rate analysis for fixed-point iterations of generalized averaged nonexpansive operators

• DOI: 10.1007/s11784-022-00972-7
• 发表时间: 2022-09
• 期刊: Journal of Fixed Point Theory and Applications
• 影响因子: 1.8
• 作者: Yizun Lin;Yuesheng Xu