Collaborative Research: Sparse Optimization for Machine Learning and Image/Signal Processing

协作研究：机器学习和图像/信号处理的稀疏优化

• 批准号: 2208386
• 负责人: Yuesheng Xu
• 金额: $ 17.11万
• 依托单位: Old Dominion University Research Foundation
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2022
• 资助国家: 美国
• 起止时间: 2022-08-15 至 2025-07-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2208386&HistoricalAwards=false
• 关键词: Collaborative; Research; Sparse; Optimization; Machine

Data sets involved in information technology, nanotechnology, biotechnology, civil infrastructure, environmental science, and other important areas are often extremely large. Due to growing quantities of data and related model sizes, demands for more competent data processing models continue to increase. Data sets in applications often have certain embedded sparsity structures, in the sense that their essential intrinsic characteristics can be represented by smaller amounts of information. Motivated by this observation, the aim of this project is to develop computationally efficient methods for non-smooth and non-convex optimization by exploring sparsity structures embedded in data sets. The investigators anticipate that the outcomes of this project will be of use in many application areas. The research and associated educational components in this project are expected to provide undergraduate and graduate students rigorous training so that they will have the skill sets needed to face the scientific and technological challenges of the big data era. This project will address several critical issues in non-smooth, non-convex optimization that result from sparse modeling of data in a range of applications, including machine learning and sparse image/signal restoration. For both learning and image/signal restoration, proper sparse regularization models will be developed. Suitable sparsity promoting functions will be designed for use in forming regularization terms, and appropriate bases/transforms will be constructed so that the resulting regularization algorithms compel their solutions to be sparse. For machine learning, appropriate reproducing kernel Banach spaces will be built up to allow for the representation of complex and rich geometric and topological structures of data and hence lead to improved learning outcomes. Representer theorems of the resulting learning methods in these spaces will be established so that the learning solutions can be expressed as a combination of a finite number of kernel sessions with the number equal to that of the data points used in training even though the hypothesis space is of infinite dimension. Geometric features of these spaces will be employed to induce sparsity of the learning solutions. The construction of bases or transforms via machine learning from data is expected to lead to improved methods for image/signal restoration.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

信息技术，纳米技术，生物技术，民用基础设施，环境科学和其他重要领域涉及的数据集通常非常大。由于数量越来越多的数据和相关模型大小，对更有能力的数据处理模型的需求继续增加。应用程序中的数据集通常具有某些嵌入式的稀疏结构，从某种意义上说，它们的基本内在特征可以用较小的信息来表示。在这一观察结果的推动下，该项目的目的是通过探索嵌入数据集中的稀疏结构来开发非平滑和非凸优化的计算有效方法。调查人员预计，该项目的结果将在许多应用领域使用。预计该项目中的研究和相关的教育组成部分将为本科和研究生提供严格的培训，以便他们将拥有面对大数据时代的科学和技术挑战所需的技能。 该项目将解决非平滑，非凸优化的几个关键问题，这些问题是由于在一系列应用程序中的数据稀疏建模而导致的，包括机器学习和稀疏图像/信号恢复。对于学习和图像/信号恢复，将开发适当的稀疏正则化模型。合适的稀疏性促进功能将设计用于形成正则化项，并将构建适当的碱基/变换，以使所得的正则化算法迫使其溶液稀疏。对于机器学习，将建立适当的繁殖Banach空间，以允许代表数据的复杂而丰富的几何和拓扑结构，从而导致改善的学习成果。将建立这些空间中所得学习方法的代表定理，以便可以将学习解决方案表示为有限数量的内核会话的组合，即使假设空间是无限维度，也可以等于训练中使用的数据点的数量。这些空间的几何特征将用于诱导学习解决方案的稀疏性。通过机器学习的基础或转换的构建预计有望改善图像/信号恢复的方法。该奖项反映了NSF的法定任务，并且使用基金会的智力优点和更广泛的影响审查标准，被视为值得通过评估的支持。

项目成果

Convergence rate analysis for fixed-point iterations of generalized averaged nonexpansive operators

• DOI: 10.1007/s11784-022-00972-7
• 发表时间: 2022-09
• 期刊: Journal of Fixed Point Theory and Applications
• 影响因子: 1.8
• 作者: Yizun Lin;Yuesheng Xu