CAREER: New Representations of Probability Distributions to Improve Machine Learning --- A Unified Kernel Embedding Framework for Distributions

职业：改进机器学习的概率分布的新表示——统一的分布内核嵌入框架

• 批准号: 1350983
• 负责人: Haesun Park
• 金额: $ 49.97万
• 依托单位: Georgia Tech Research Corporation
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2014
• 资助国家: 美国
• 起止时间: 2014-05-15 至 2021-04-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1350983&HistoricalAwards=false
• 关键词: CAREER; New; Representations; Probability; Distributions

Computational intelligence touches our lives daily. Web searches, weather prediction, detecting financial fraud, medicine and education benefit from this ubiquitous technology. Problems in computational intelligence such as image classification and predicting properties of new materials produce copious amounts of high-dimensional, complex data. Many algorithms in computational intelligence rely on probability distributions, and such data can carry unusual distributions that challenge traditional methods of modeling. (For example, they are typically not textbook distributions such as the Gaussian.) In some applications, the data input to the algorithms are themselves probability distributions. Existing techniques are cannot both capture unusual distributions and scale to millions of data points without stalling the computation. There is a pressing need for a flexible, efficient framework for representing, learning, and reasoning about datasets arising from these problems.This project will address these challenges by developing a novel and unified framework to represent and model, learn, and use probability distributions in computational intelligence. To evaluate the utility of the new techniques, the project will test them on difficult real-world problems in computer image analysis, materials science, and flow cytometry (a biotechnology technique used for cell counting, cell sorting, and protein engineering).The project, an NSF CAREER award, will integrate the research results with several education intiatives. New curricula will be designed for both undergraduate and graduate students, with empahsis on students from under-represented groups. A new online course will be created to make the results accessible to massive online masters students. Finally, advanced high school math teachers will be engaged to design problems related to the reserach for use in a math competition for advanced high school students.This project will (1) create a novel and unified nonparametric kernel framework for distributional data and distributions with fine-grained statistical properties, and (2) develop principled and scalable algorithms for nonparametric analysis of big data. The unified kernel embedding framework will advance large scale nonparametric data analysis significantly, and play an important synergistic role in bridging together traditionally separate research areas in data analysis, including kernel methods, graphical models, optimization, nonparametric Bayesian methods, functional analysis and tensor data analysis. In addition to advances in algorithmic methods, the applications to large-scale image classification, flow cytometry, and materials property prediction have the potential for transformative impact on society.

计算智能触及我们的日常生活。 网络搜索、天气预报、金融欺诈检测、医学和教育都受益于这种无处不在的技术。 图像分类和预测新材料特性等计算智能问题会产生大量高维、复杂的数据。 计算智能中的许多算法都依赖于概率分布，而此类数据可能带有不寻常的分布，这对传统的建模方法提出了挑战。 （例如，它们通常不是高斯分布等教科书分布。）在某些应用中，算法的数据输入本身就是概率分布。 现有技术无法既捕获不寻常的分布，又无法在不停止计算的情况下扩展到数百万个数据点。 迫切需要一个灵活、高效的框架来表示、学习和推理这些问题产生的数据集。该项目将通过开发一个新颖且统一的框架来表示和建模、学习和使用概率分布来解决这些挑战。计算智能。 为了评估新技术的实用性，该项目将在计算机图像分析、材料科学和流式细胞术（一种用于细胞计数、细胞分选和蛋白质工程的生物技术）中对现实世界中的困难问题进行测试。是 NSF 职业奖，将把研究成果与多项教育计划相结合。 新课程将为本科生和研究生设计，重点关注来自代表性不足群体的学生。 将创建一个新的在线课程，以使大量在线硕士生可以获得结果。 最后，高级高中数学教师将参与设计与高级高中学生数学竞赛中使用的研究相关的问题。该项目将（1）为分布数据和具有精细分布的分布创建一个新颖且统一的非参数核框架。 - 粒度统计特性，(2) 开发用于大数据非参数分析的有原则且可扩展的算法。统一的核嵌入框架将显着推进大规模非参数数据分析，并将在数据分析中传统上独立的研究领域（包括核方法、图模型、优化、非参数贝叶斯方法、泛函分析和张量数据分析）之间发挥重要的协同作用。 。除了算法方法的进步之外，大规模图像分类、流式细胞术和材料性能预测的应用也有可能对社会产生变革性影响。