CAREER: Secure Voice-Controlled Platforms

职业：安全语音控制平台

• 批准号: 1943100
• 负责人: Yuan Tian
• 金额: $ 49.04万
• 依托单位: University of Virginia Main Campus
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-06-01 至 2023-05-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1943100&HistoricalAwards=false
• 关键词: CAREER; Secure; Voice; Controlled; Platforms

Voice control technologies, which utilize natural language processing (NLP) techniques to enable handsfree interactions through Voice User Interface (VUI), are widely deployed in a plethora of IoT platforms, such as Amazon Alexa, Google Home, and automotive voice assistants. In addition to the built-in functionalities, voice-controlled devices are enhanced by an ecosystem fostered by their providers, such as Amazon and Google. In such an ecosystem, third-party developers can build new functions to offer additional services to the end-users for example, order food, manage bank accounts, and lock doors. These systems have already been deployed to households around the world and utilized by tens of millions of users. However, they could bring in new security and privacy risks, whose implications are not adequately understood so far. This work focuses on addressing the security and privacy issues in voice-controlled platforms. The project defines how we secure users while using voice interfaces and make key progress towards securing the IoT infrastructure and enhancing national security. Combined with integrated education and outreach efforts, this work provides a technical foundation for designing IoT platforms with strong security and privacy properties. Protecting Voice User Interfaces is fundamentally challenging, owing to the lack of effective means to authenticate and authorize the parties involved in the open and noisy channel. The project focuses on protecting users by helping them avoid unexpected sensitive behaviors through the noisy, open, and low-bandwidth voice channel. The work is organized around three main thrusts: (1) the design of a chatbot-based effective and efficient testing framework that combines semantic understanding and security domain knowledge to generate inputs, and understands outputs for determining unexpected sensitive behaviors in the voice apps during installation time, (2) the design of context-based integrity check and detection for unexpected voice command at runtime, and (3) the design of usable interfaces to communicate with users about the risks identified in the first two thrusts. These explorations culminate in the design options for a security module as part of a voice-controlled platform, and broader security and privacy recommendations for IoT platforms.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

语音控制技术利用自然语言处理（NLP）技术通过语音用户界面（VUI）启用无权交互，该技术被广泛地部署在众多的物联网平台中，例如亚马逊Alexa，Google Home和Automotive Voice Assistant。除了内置功能外，语音控制设备还通过其提供商（例如Amazon和Google）培养的生态系统增强。在这样的生态系统中，第三方开发人员可以构建新功能，例如为最终用户提供其他服务，例如订购食物，管理银行帐户和锁门。这些系统已经部署给了世界各地的家庭，并被数千万用户使用。但是，他们可以带来新的安全和隐私风险，到目前为止，其含义尚未充分理解。这项工作着重于解决语音控制平台中的安全性和隐私问题。该项目定义了我们在使用语音接口时如何保护用户，并在确保IoT基础架构并增强国家安全方面取得了关键的进步。结合综合教育和外展工作，这项工作为设计具有强大安全性和隐私权的物联网平台提供了技术基础。保护语音用户界面在根本上是具有挑战性的，因为缺乏有效的手段来验证和授权与开放和嘈杂渠道有关的各方。该项目通过帮助避免通过嘈杂，开放和低频带的语音渠道避免意外敏感行为来保护用户来保护用户。这项工作围绕三个主要推力组织：（1）设计基于聊天机器人的有效和高效的测试框架，结合语义理解和安全域知识以生成输入，并了解输出以确定在安装时间内确定语音应用程序中语音应用程序中的敏感行为的输出，（2）基于上下文的综合检查和在运行时的插入式的插入式的插入式的插入式式的插入和（3）在前两个推力中。作为语音控制平台的一部分，这些探索最终导致了安全模块的设计选项，以及针对物联网平台的更广泛的安全性和隐私建议。该奖项反映了NSF的法定任务，并被认为是通过基金会的知识分子优点和更广泛影响的审查标准通过评估来获得支持的。

项目成果

Trade-offs and Guarantees on Adversarial Representation Learning for Information Obfuscation

信息混淆的对抗性表示学习的权衡和保证

• 发表时间: 2020
• 期刊: Advances in neural information processing systems
• 作者: Zhao, H.;Chi, J.;Tian, Y.;Gordon., J.
• 通讯作者: Gordon., J.

Towards Return Parity in Markov Decision Processes

• 发表时间: 2021-11
• 作者: Jianfeng Chi;Jian Shen;Xinyi Dai;Weinan Zhang;Yuan Tian;Han Zhao

Intent Classification and Slot Filling for Privacy Policies

• DOI: 10.18653/v1/2021.acl-long.340
• 发表时间: 2021-01
• 作者: Wasi Uddin Ahmad;Jianfeng Chi;Tu Le;Thomas B. Norton;Yuan Tian;Kai-Wei Chang

Your Microphone Array Retains Your Identity: A Robust Voice Liveness Detection System for Smart Speakers

• 发表时间: 2022
• 作者: Yan Meng;Jiachun Li;Matthew Pillari;A. Deopujari;Liam Brennan;Hafsah Shamsie;Haojin Zhu;Yuan Tian