CAREER: Knowledge-Rich Neural Text Comprehension and Reasoning

职业：知识丰富的神经文本理解和推理

• 批准号: 2044660
• 负责人: Hanna Hajishirzi
• 金额: $ 54.98万
• 依托单位: University of Washington
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2021
• 资助国家: 美国
• 起止时间: 2021-09-01 至 2026-08-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2044660&HistoricalAwards=false
• 关键词: CAREER; Knowledge; Rich; Neural; Text

Enormous amounts of ever-changing knowledge are available online in diverse textual styles (e.g., news vs. science text) and diverse formats (knowledge bases vs. web pages vs. textual documents). This proposal addresses the question of textual comprehension and reasoning given this diversity: how can artificial intelligence (AI) help applications comprehend and combine evidence from variable, evolving sources of textual knowledge to make complex inferences and draw logical conclusions? Recent advances in deep learning algorithms, large-scale datasets, and industry-scale computational resources are spurring progress in many Natural Language Processing (NLP) tasks, including question answering. Nevertheless, current models lack the ability to answer complex questions that require them to reason intelligently across diverse sources and explain their decisions. Further, these models cannot scale up when task-annotated training data are scarce and computational resources are limited. Our results will give rise to the next generation of question answering and fact checking algorithms that offer rich natural language comprehension using multi-hop and interpretable reasoning even when annotated training data is scarce. With a focus on textual comprehension and reasoning, this research will integrate capabilities of symbolic AI approaches into current deep learning algorithms. It will devise hybrid, interpretable algorithms that understand and reason about textual knowledge across varied formats and styles, generalize to emerging domains with scarce training data (are robust), and operate efficiently under resource limitations (are scalable). Toward this end, this research will focus on four transformative research initiatives: (1) defining a general-purpose formalism to promote data comprehension through knowledge-rich neural representations, (2) devising an interpretable, multi-hop inference and reasoning engine, (3) developing robust and scalable algorithms to demonstrate generalizable domain and device adaptation, and (4) building applications and datasets in question answering and fact checking tasks that will have lasting general-purpose utility.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

大量不断变化的知识可以以不同的文本风格（例如，新闻与科学文本）和不同的格式（知识库、网页与文本文档）在线获取。鉴于这种多样性，该提案解决了文本理解和推理的问题：人工智能（AI）如何帮助应用程序理解和组合来自可变的、不断演变的文本知识来源的证据，以做出复杂的推理并得出逻辑结论？ 深度学习算法、大规模数据集和行业规模计算资源的最新进展正在推动许多自然语言处理 (NLP) 任务（包括问答）的进步。然而，当前的模型缺乏回答复杂问题的能力，这些问题需要它们对不同来源进行智能推理并解释其决策。 此外，当任务注释的训练数据稀缺且计算资源有限时，这些模型无法扩展。我们的研究结果将催生下一代问答和事实检查算法，即使在带注释的训练数据稀缺的情况下，也可以使用多跳和可解释推理来提供丰富的自然语言理解。 这项研究以文本理解和推理为重点，将符号人工智能方法的功能集成到当前的深度学习算法中。它将设计混合的、可解释的算法，能够理解和推理不同格式和风格的文本知识，推广到训练数据稀缺的新兴领域（稳健），并在资源限制下高效运行（可扩展）。为此，本研究将重点关注四项变革性研究举措：（1）定义通用形式主义，通过知识丰富的神经表示来促进数据理解，（2）设计可解释的多跳推理和推理引擎，（ 3) 开发强大且可扩展的算法来展示可推广的领域和设备适应，以及 (4) 在问答和事实检查任务中构建具有持久通用实用性的应用程序和数据集。该奖项反映了 NSF 的法定使命，并已通过使用基金会的智力优点和更广泛的影响审查标准进行评估，认为值得支持。

项目成果

Self-Instruct: Aligning Language Models with Self-Generated Instructions

自指导：使语言模型与自生成的指令保持一致

• DOI: 10.48550/arxiv.2212.10560
• 发表时间: 2022-12-20
• 期刊: Journal of Jinan University
• 作者: Yizhong Wang;Yeganeh Kordi;Swaroop Mishra;Alisa Liu;Noah A. Smith;Daniel Khashabi;Hannaneh Hajishirzi
• 通讯作者: Hannaneh Hajishirzi

Rainier: Reinforced Knowledge Introspector for Commonsense Question Answering

Rainier：用于常识问答的强化知识内省器

• DOI: 10.48550/arxiv.2210.03078
• 发表时间: 2022-10-06
• 期刊: ArXiv
• 作者: Jiacheng Liu;Skyler Hallinan;Ximing Lu;Pengfei He;S. Welleck;Hannaneh Hajishirzi;Yejin Choi
• 通讯作者: Yejin Choi

Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks

Super-NaturalInstructions：通过 1600 个 NLP 任务的声明性指令进行泛化

• DOI: 10.18653/v1/2022.emnlp-main.340
• 发表时间: 2022-04-16
• 作者: Yizhong Wang;Swaroop Mishra;Pegah Alipoormolabashi;Yeganeh Kordi;Amirreza Mirzaei;Anjana Arunkumar;Arjun Ashok;Arut Selvan Dhanasekaran;Atharva Naik;David Stap;Eshaan Pathak;Giannis Karamanolakis;H. Lai;I. Purohit;Ishani Mondal;Jacob Anderson;Kirby Kuznia;Krima Doshi;Maitreya Patel;Kuntal Kumar Pal;M. Moradshahi;Mihir Parmar;Mirali Purohit;Neeraj Varshney;Phani Rohitha Kaza;Pulkit Verma;Ravsehaj Singh Puri;Rushang Karia;Shailaja Keyur Sampat;Savan Doshi;Siddhartha Mishra;Sujan Reddy;Sumanta Patro;Tanay Dixit;Xudong Shen;Chitta Baral;Yejin Choi;Noah A. Smith;Hannaneh Hajishirzi;Daniel Khashabi
• 通讯作者: Daniel Khashabi

Task-aware Retrieval with Instructions

带指令的任务感知检索

• DOI: 10.48550/arxiv.2211.09260
• 发表时间: 2022-11-16
• 期刊: ArXiv
• 作者: Akari Asai;Timo Schick;Patrick Lewis;Xilun Chen;Gautier Izacard;Sebastian Riedel;Hannaneh Hajishirzi;Wen
• 通讯作者: Wen

InSCIt : Information-Seeking Conversations with Mixed-Initiative Interactions

InSCIt：具有混合主动交互的信息寻求对话

• DOI: 10.1162/tacl_a_00559
• 发表时间: 2023-05
• 期刊: Transactions of the Association for Computational Linguistics
• 影响因子: 10.9
• 作者: Wu, Zeqiu;Parish, Ryu;Cheng, Hao;Min, Sewon;Ammanabrolu, Prithviraj;Ostendorf, Mari;Hajishirzi, Hannaneh
• 通讯作者: Hajishirzi, Hannaneh