REU Site: Recent Advances in Natural Language Processing

REU 网站：自然语言处理的最新进展

• 批准号: 2349452
• 负责人: Jugal Kalita
• 金额: $ 46.5万
• 依托单位: University of Colorado at Colorado Springs
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2024
• 资助国家: 美国
• 起止时间: 2024-02-01 至 2027-01-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2349452&HistoricalAwards=false
• 关键词: REU; Site; Recent; Advances; Natural

The objective of this project is to expose motivated undergraduates who aspire to pursue advanced careers in Computer Science, in particular in Artificial Intelligence and Machine Learning (AI-ML), to active research experience early in their careers. This project will develop a summer Research Experience for Undergraduates (REU) site at the University of Colorado, Colorado Springs, to engage ten participants per year from around the country in cutting-edge research on topics such as the use and security of Large Language Models, and the use of the new paradigm of Quantum Computing to better solve problems in Natural Language Processing. The students will write software to solve interesting and timely problems, write papers for publication, and will be exposed to procedures for applying for graduate school. The proposal will also focus on training future computer scientists from institutions with limited research opportunities, women, and under-represented minorities. The research experience will encourage these students to be productive researchers in academic and non-academic environments during their future careers.The participating students will be introduced to the latest advances such as Deep Learning, Large Language Models, and Quantum Computing via focused lectures, discussion of latest publications, and personalized readings. In particular, the students will learn about latest innovations in Deep Learning, including Transformer-inspired architectures, such as the Bidirectional Encoder Representations from Transformers (BERT) and the Generative Pre-Trained Transformers (GPT) series, that have ushered in a recent period of sustained improved results to many problems that have been the focus of research for years. The students will perform hands-on research on novel problems, conduct experiments using Transformer-based Deep Learning architectures and Quantum Computing methods, and communicate their results through written papers and presentations. Example projects will involve controlling generation of large language models; defending language models against attacks; and the use of Quantum Computing in solving tasks such as part-of-speech tagging and named entity recognition.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

该项目的目标是让那些渴望在计算机科学领域（特别是人工智能和机器学习 (AI-ML)）领域追求高级职业的积极主动的本科生在职业生涯早期获得积极的研究经验。该项目将在科罗拉多大学科罗拉多斯普林斯分校开发一个夏季本科生研究体验 (REU) 网站，每年吸引来自全国各地的 10 名参与者参与大型语言模型的使用和安全等主题的前沿研究，并利用量子计算的新范式更好地解决自然语言处理中的问题。 学生将编写软件来解决有趣且及时的问题，撰写论文以发表，并将接触到申请研究生院的程序。该提案还将重点培训来自研究机会有限的机构、女性和代表性不足的少数族裔的未来计算机科学家。研究经验将鼓励这些学生在未来的职业生涯中成为学术和非学术环境中富有成效的研究人员。将通过重点讲座、讨论向参与的学生介绍深度学习、大型语言模型和量子计算等最新进展最新出版物和个性化读物。特别是，学生们将了解深度学习的最新创新，包括受 Transformer 启发的架构，例如 Transformers 的双向编码器表示 (BERT) 和生成预训练 Transformers (GPT) 系列，这些在最近一段时间迎来了新的发展。多年来一直是研究焦点的许多问题的持续改进结果。学生将对新问题进行实践研究，使用基于 Transformer 的深度学习架构和量子计算方法进行实验，并通过书面论文和演示文稿传达他们的结果。示例项目将涉及控制大型语言模型的生成；保护语言模型免受攻击；该奖项反映了 NSF 的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，认为值得支持。