Collaborative Research: Frameworks: hpcGPT: Enhancing Computing Center User Support with HPC-enriched Generative AI

协作研究：框架：hpcGPT：通过 HPC 丰富的生成式 AI 增强计算中心用户支持

• 批准号: 2411297
• 负责人: Amitava Majumdar
• 金额: $ 35.96万
• 依托单位: University of California-San Diego
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2024
• 资助国家: 美国
• 起止时间: 2024-08-01 至 2027-07-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2411297&HistoricalAwards=false
• 关键词: Collaborative; Research; Frameworks; hpcGPT; Enhancing

hpcGPT is a question answering service for academic computing centers such as the National Center for Supercomputing Applications, Ohio Supercomputer Center, San Diego Supercomputer Center, and Texas Advanced Computing Center. These Centers provide high-performance computing (HPC) platforms to tens of thousands of users for science and engineering research. In collaboration with Princeton University and Rutgers University, hpcGPT uses generative artificial intelligence (AI) and integrates heterogeneous data sources with different update frequencies to enhance the user support service quality and efficiency, decrease the response time, and improve precision of the support. With hpcGPT, user support teams can leverage the historical knowledge, real-time system status, and external technical expertise to better support the HPC users. With the high-quality and timely answers from hpcGPT, HPC users can resolve many technical issues, thus reducing the workload of the user support teams. This will allow the support teams to focus more on new and novel support issues. hpcGPT will significantly enhance the user support service quality, capacity, and efficiency without increasing the human effort.hpcGPT combines the fine-tuning and Retrieval Augmented Generation (RAG) techniques to incorporate recent knowledge, past experience, domain expertise, documentations, and real-time system status of versatile computing. By building upon existing and recognized capabilities in large language model fine-tuning and hosting, retrieval augmentation generation, and external data source integration, hpcGPT reduces the complexity and effort required to align information and identify dependencies between questions, answers, and the supporting information. This is particularly beneficial for research groups and computing centers with diverse application requirements and limited staff. hpcGPT extends and translates a suite of Cyberinfrastructure building blocks and technologies such as large language model training and inference service hosting.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

hpcGPT 是为国家超级计算应用中心、俄亥俄州超级计算机中心、圣地亚哥超级计算机中心和德克萨斯州高级计算中心等学术计算中心提供的问答服务。这些中心为数以万计的科学和工程研究用户提供高性能计算 (HPC) 平台。 hpcGPT与普林斯顿大学和罗格斯大学合作，利用生成人工智能（AI），整合不同更新频率的异构数据源，提升用户支持服务质量和效率，减少响应时间，提高支持精度。借助 hpcGPT，用户支持团队可以利用历史知识、实时系统状态和外部技术专业知识来更好地支持 HPC 用户。借助hpcGPT高质量、及时的答复，HPC用户可以解决许多技术问题，从而减轻用户支持团队的工作量。这将使支持团队能够更多地关注新的和新颖的支持问题。 hpcGPT 将在不增加人力的情况下显着提高用户支持服务质量、容量和效率。hpcGPT 结合了微调和检索增强生成 (RAG) 技术，将最新知识、过去经验、领域专业知识、文档和实际情况结合起来。通用计算的时间系统状态。通过构建大型语言模型微调和托管、检索增强生成和外部数据源集成方面现有的和公认的功能，hpcGPT 降低了协调信息和识别问题、答案和支持信息之间依赖关系所需的复杂性和工作量。这对于具有不同应用需求和有限人员的研究小组和计算中心尤其有利。 hpcGPT 扩展并翻译了一套网络基础设施构建块和技术，例如大型语言模型训练和推理服务托管。该奖项反映了 NSF 的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。