REU Site: Recent Advances in Natural Language Processing

REU 网站：自然语言处理的最新进展

• 批准号: 2349452
• 负责人: Jugal Kalita
• 金额: $ 46.5万
• 依托单位: University of Colorado at Colorado Springs
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2024
• 资助国家: 美国
• 起止时间: 2024-02-01 至 2027-01-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2349452&HistoricalAwards=false
• 关键词: REU; Site; Recent; Advances; Natural; REU; Site; Recent; Advances; Natural

The objective of this project is to expose motivated undergraduates who aspire to pursue advanced careers in Computer Science, in particular in Artificial Intelligence and Machine Learning (AI-ML), to active research experience early in their careers. This project will develop a summer Research Experience for Undergraduates (REU) site at the University of Colorado, Colorado Springs, to engage ten participants per year from around the country in cutting-edge research on topics such as the use and security of Large Language Models, and the use of the new paradigm of Quantum Computing to better solve problems in Natural Language Processing. The students will write software to solve interesting and timely problems, write papers for publication, and will be exposed to procedures for applying for graduate school. The proposal will also focus on training future computer scientists from institutions with limited research opportunities, women, and under-represented minorities. The research experience will encourage these students to be productive researchers in academic and non-academic environments during their future careers.The participating students will be introduced to the latest advances such as Deep Learning, Large Language Models, and Quantum Computing via focused lectures, discussion of latest publications, and personalized readings. In particular, the students will learn about latest innovations in Deep Learning, including Transformer-inspired architectures, such as the Bidirectional Encoder Representations from Transformers (BERT) and the Generative Pre-Trained Transformers (GPT) series, that have ushered in a recent period of sustained improved results to many problems that have been the focus of research for years. The students will perform hands-on research on novel problems, conduct experiments using Transformer-based Deep Learning architectures and Quantum Computing methods, and communicate their results through written papers and presentations. Example projects will involve controlling generation of large language models; defending language models against attacks; and the use of Quantum Computing in solving tasks such as part-of-speech tagging and named entity recognition.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

该项目的目的是揭露渴望从事计算机科学领域的高级职业的积极进取的本科生，尤其是在人工智能和机器学习中（AI-ML），以便在其职业生涯的早期开始积极的研究经验。该项目将在科罗拉多斯普林斯分校的本科生（REU）网站上开发夏季研究经验，以每年与全国各地的十名参与者与诸如大型语言模型的使用和安全性以及新的量子计算范式的使用，以更好地解决自然语言处理中的问题。 学生将编写软件来解决有趣且及时的问题，写论文以发表，并将接触到申请研究生院的程序。该提案还将着重于培训来自研究机会有限的机构，妇女和代表性不足的少数群体的计算机科学家。研究经验将鼓励这些学生在未来的职业生涯中成为学术和非学术环境中的生产研究人员。参与的学生将通过集中的讲座，最新出版物的讨论和个性化的阅读来介绍最新的进步，例如深度学习，大语言模型和量子计算。特别是，学生将了解深度学习中的最新创新，包括以变形金刚启发的体系结构，例如来自变形金刚（BERT）的双向编码器表示和生成的预培训的变形金刚（GPT）系列，这些架构在最近的持续持续成果中遇到了多年的研究焦点。学生将对新的问题进行动手研究，使用基于变压器的深度学习体系结构和量子计算方法进行实验，并通过书面论文和演讲来传达其结果。示例项目将涉及控制大型语言模型的生成；捍卫语言模型免受攻击；并在解决诸如言论的标签和命名实体识别之类的任务中使用量子计算。该奖项反映了NSF的法定任务，并且使用基金会的知识分子优点和更广泛的影响审查标准，被认为值得通过评估来获得支持。